Oct 16 11:08:55 user nova-compute[74683]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74683) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74683) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74683) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 16 11:08:55 user nova-compute[74683]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:08:55 user nova-compute[74683]: INFO nova.virt.driver [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] Loading compute driver 'libvirt.LibvirtDriver'
Oct 16 11:08:55 user nova-compute[74683]: INFO nova.compute.provider_config [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] Acquiring lock "singleton_lock" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] Acquired lock "singleton_lock" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] Releasing lock "singleton_lock" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] Full set of CONF: {{(pid=74683) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] ******************************************************************************** {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] Configuration options gathered from: {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] ================================================================================ {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] allow_resize_to_same_host      = True {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] arq_binding_timeout            = 300 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] backdoor_port                  = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] backdoor_socket                = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] block_device_allocate_retries  = 300 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] block_device_allocate_retries_interval = 5 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cert                           = self.pem {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] compute_monitors               = [] {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] config_dir                     = [] {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] config_drive_format            = iso9660 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] config_source                  = [] {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] console_host                   = user {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] control_exchange               = nova {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cpu_allocation_ratio           = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] daemon                         = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] debug                          = True {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] default_access_ip_network_name = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] default_availability_zone      = nova {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] default_ephemeral_format       = ext4 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] default_green_pool_size        = 1000 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] default_schedule_zone          = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] disk_allocation_ratio          = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] enable_new_services            = True {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] enabled_apis                   = ['osapi_compute'] {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] enabled_ssl_apis               = [] {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] flat_injected                  = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] force_config_drive             = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] force_raw_images               = True {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] graceful_shutdown_timeout      = 5 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] heal_instance_info_cache_interval = 60 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] host                           = user {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] instance_build_timeout         = 0 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] instance_delete_interval       = 300 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] instance_format                = [instance: %(uuid)s]  {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] instance_name_template         = instance-%08x {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] instance_usage_audit           = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] instance_usage_audit_period    = month {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] internal_service_availability_zone = internal {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] key                            = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] live_migration_retry_count     = 30 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] log_config_append              = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] log_dir                        = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] log_file                       = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] log_options                    = True {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] log_rotate_interval            = 1 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] log_rotate_interval_type       = days {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] log_rotation_type              = none {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:55 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] long_rpc_timeout               = 1800 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] max_concurrent_builds          = 10 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] max_concurrent_live_migrations = 1 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] max_concurrent_snapshots       = 5 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] max_local_block_devices        = 3 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] max_logfile_count              = 30 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] max_logfile_size_mb            = 200 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] maximum_instance_delete_attempts = 5 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] metadata_listen                = 0.0.0.0 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] metadata_listen_port           = 8775 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] metadata_workers               = 3 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] migrate_max_retries            = -1 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] mkisofs_cmd                    = genisoimage {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] my_ip                          = 10.0.0.210 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] network_allocate_retries       = 0 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] osapi_compute_listen_port      = 8774 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] osapi_compute_unique_server_name_scope =  {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] osapi_compute_workers          = 3 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] password_length                = 12 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] periodic_enable                = True {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] periodic_fuzzy_delay           = 60 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] pointer_model                  = ps2mouse {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] preallocate_images             = none {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] publish_errors                 = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] pybasedir                      = /opt/stack/nova {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] ram_allocation_ratio           = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] rate_limit_burst               = 0 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] rate_limit_except_level        = CRITICAL {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] rate_limit_interval            = 0 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] reboot_timeout                 = 0 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] reclaim_instance_interval      = 0 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] record                         = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] reimage_timeout_per_gb         = 60 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] report_interval                = 120 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] rescue_timeout                 = 0 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] reserved_host_cpus             = 0 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] reserved_host_disk_mb          = 0 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] reserved_host_memory_mb        = 512 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] reserved_huge_pages            = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] resize_confirm_window          = 0 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] resize_fs_using_block_device   = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] resume_guests_state_on_host_boot = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] rpc_response_timeout           = 60 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] run_external_periodic_tasks    = True {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] running_deleted_instance_action = reap {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] running_deleted_instance_poll_interval = 1800 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] running_deleted_instance_timeout = 0 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] scheduler_instance_sync_interval = 120 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] service_down_time              = 720 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] servicegroup_driver            = db {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] shelved_offload_time           = 0 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] shelved_poll_interval          = 3600 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] shutdown_timeout               = 0 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] source_is_ipv6                 = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] ssl_only                       = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] state_path                     = /opt/stack/data/nova {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] sync_power_state_interval      = 600 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] sync_power_state_pool_size     = 1000 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] syslog_log_facility            = LOG_USER {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] tempdir                        = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] timeout_nbd                    = 10 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] transport_url                  = **** {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] update_resources_interval      = 0 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] use_cow_images                 = True {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] use_eventlog                   = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] use_journal                    = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] use_json                       = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] use_rootwrap_daemon            = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] use_stderr                     = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] use_syslog                     = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vcpu_pin_set                   = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vif_plugging_is_fatal          = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vif_plugging_timeout           = 0 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] virt_mkfs                      = [] {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] volume_usage_poll_interval     = 0 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] watch_log_file                 = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] web                            = /usr/share/spice-html5 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_concurrency.disable_process_locking = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] api.auth_strategy              = keystone {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] api.compute_link_prefix        = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] api.dhcp_domain                = novalocal {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] api.enable_instance_password   = True {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] api.glance_link_prefix         = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] api.instance_list_per_project_cells = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] api.list_records_by_skipping_down_cells = True {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] api.local_metadata_per_cell    = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] api.max_limit                  = 1000 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] api.metadata_cache_expiration  = 15 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] api.neutron_default_tenant_id  = default {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] api.use_forwarded_for          = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] api.use_neutron_default_nets   = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] api.vendordata_dynamic_targets = [] {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] api.vendordata_jsonfile_path   = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cache.backend                  = dogpile.cache.memcached {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cache.backend_argument         = **** {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cache.config_prefix            = cache.oslo {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cache.dead_timeout             = 60.0 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cache.debug_cache_backend      = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cache.enable_retry_client      = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cache.enable_socket_keepalive  = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cache.enabled                  = True {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cache.expiration_time          = 600 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cache.hashclient_retry_attempts = 2 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cache.memcache_dead_retry      = 300 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cache.memcache_password        =  {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cache.memcache_pool_maxsize    = 10 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cache.memcache_sasl_enabled    = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cache.memcache_username        =  {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cache.proxies                  = [] {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cache.retry_attempts           = 2 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cache.retry_delay              = 0.0 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cache.socket_keepalive_count   = 1 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cache.socket_keepalive_idle    = 1 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cache.socket_keepalive_interval = 1 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cache.tls_allowed_ciphers      = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cache.tls_cafile               = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cache.tls_certfile             = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cache.tls_enabled              = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cache.tls_keyfile              = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cinder.auth_section            = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cinder.auth_type               = password {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cinder.cafile                  = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cinder.certfile                = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cinder.collect_timing          = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cinder.cross_az_attach         = True {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cinder.debug                   = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cinder.endpoint_template       = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cinder.http_retries            = 3 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cinder.insecure                = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cinder.keyfile                 = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cinder.os_region_name          = RegionOne {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cinder.split_loggers           = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cinder.timeout                 = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] compute.cpu_dedicated_set      = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] compute.cpu_shared_set         = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] compute.image_type_exclude_list = [] {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] compute.max_concurrent_disk_ops = 0 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] compute.max_disk_devices_to_attach = -1 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] compute.resource_provider_association_refresh = 300 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] compute.shutdown_retry_interval = 10 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] conductor.workers              = 3 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] console.allowed_origins        = [] {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] console.ssl_ciphers            = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] console.ssl_minimum_version    = default {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] consoleauth.token_ttl          = 600 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cyborg.cafile                  = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cyborg.certfile                = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cyborg.collect_timing          = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cyborg.connect_retries         = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cyborg.connect_retry_delay     = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cyborg.endpoint_override       = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cyborg.insecure                = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cyborg.keyfile                 = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cyborg.max_version             = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cyborg.min_version             = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cyborg.region_name             = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cyborg.service_name            = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cyborg.service_type            = accelerator {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cyborg.split_loggers           = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cyborg.status_code_retries     = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cyborg.status_code_retry_delay = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cyborg.timeout                 = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] cyborg.version                 = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] database.backend               = sqlalchemy {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] database.connection            = **** {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] database.connection_debug      = 0 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] database.connection_parameters =  {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] database.connection_recycle_time = 3600 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] database.connection_trace      = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] database.db_inc_retry_interval = True {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] database.db_max_retries        = 20 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] database.db_max_retry_interval = 10 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] database.db_retry_interval     = 1 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] database.max_overflow          = 50 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] database.max_pool_size         = 5 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] database.max_retries           = 10 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] database.mysql_wsrep_sync_wait = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] database.pool_timeout          = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] database.retry_interval        = 10 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] database.slave_connection      = **** {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] database.sqlite_synchronous    = True {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] api_database.backend           = sqlalchemy {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] api_database.connection        = **** {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] api_database.connection_debug  = 0 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] api_database.connection_parameters =  {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] api_database.connection_recycle_time = 3600 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] api_database.connection_trace  = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] api_database.db_inc_retry_interval = True {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] api_database.db_max_retries    = 20 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] api_database.db_max_retry_interval = 10 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] api_database.db_retry_interval = 1 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] api_database.max_overflow      = 50 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] api_database.max_pool_size     = 5 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] api_database.max_retries       = 10 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] api_database.pool_timeout      = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] api_database.retry_interval    = 10 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] api_database.slave_connection  = **** {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] api_database.sqlite_synchronous = True {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] devices.enabled_mdev_types     = [] {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] ephemeral_storage_encryption.enabled = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] glance.api_servers             = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] glance.cafile                  = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] glance.certfile                = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] glance.collect_timing          = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] glance.connect_retries         = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] glance.connect_retry_delay     = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] glance.debug                   = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] glance.default_trusted_certificate_ids = [] {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] glance.enable_certificate_validation = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] glance.enable_rbd_download     = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] glance.endpoint_override       = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] glance.insecure                = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] glance.keyfile                 = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] glance.max_version             = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] glance.min_version             = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] glance.num_retries             = 3 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] glance.rbd_ceph_conf           =  {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] glance.rbd_connect_timeout     = 5 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] glance.rbd_pool                =  {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] glance.rbd_user                =  {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] glance.region_name             = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] glance.service_name            = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] glance.service_type            = image {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] glance.split_loggers           = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] glance.status_code_retries     = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] glance.status_code_retry_delay = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] glance.timeout                 = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] glance.verify_glance_signatures = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] glance.version                 = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] guestfs.debug                  = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] hyperv.config_drive_cdrom      = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] hyperv.config_drive_inject_password = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] hyperv.enable_instance_metrics_collection = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] hyperv.enable_remotefx         = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] hyperv.instances_path_share    =  {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] hyperv.iscsi_initiator_list    = [] {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] hyperv.limit_cpu_features      = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] hyperv.power_state_check_timeframe = 60 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] hyperv.use_multipath_io        = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] hyperv.volume_attach_retry_count = 10 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] hyperv.vswitch_name            = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] mks.enabled                    = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] image_cache.manager_interval   = 2400 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] image_cache.precache_concurrency = 1 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] image_cache.remove_unused_base_images = True {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] image_cache.subdirectory_name  = _base {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] ironic.api_max_retries         = 60 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] ironic.api_retry_interval      = 2 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] ironic.auth_section            = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] ironic.auth_type               = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] ironic.cafile                  = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] ironic.certfile                = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] ironic.collect_timing          = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] ironic.conductor_group         = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] ironic.connect_retries         = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] ironic.connect_retry_delay     = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] ironic.endpoint_override       = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] ironic.insecure                = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] ironic.keyfile                 = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] ironic.max_version             = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] ironic.min_version             = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] ironic.peer_list               = [] {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] ironic.region_name             = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] ironic.serial_console_state_timeout = 10 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] ironic.service_name            = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] ironic.service_type            = baremetal {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] ironic.split_loggers           = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] ironic.status_code_retries     = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] ironic.status_code_retry_delay = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] ironic.timeout                 = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] ironic.version                 = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] key_manager.fixed_key          = **** {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] barbican.barbican_api_version  = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] barbican.barbican_endpoint     = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] barbican.barbican_endpoint_type = public {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] barbican.barbican_region_name  = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] barbican.cafile                = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] barbican.certfile              = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] barbican.collect_timing        = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] barbican.insecure              = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] barbican.keyfile               = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] barbican.number_of_retries     = 60 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] barbican.retry_delay           = 1 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] barbican.send_service_user_token = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] barbican.split_loggers         = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] barbican.timeout               = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] barbican.verify_ssl            = True {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] barbican.verify_ssl_path       = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] barbican_service_user.auth_section = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] barbican_service_user.auth_type = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] barbican_service_user.cafile   = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] barbican_service_user.certfile = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] barbican_service_user.collect_timing = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] barbican_service_user.insecure = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] barbican_service_user.keyfile  = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] barbican_service_user.split_loggers = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] barbican_service_user.timeout  = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vault.approle_role_id          = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vault.approle_secret_id        = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vault.cafile                   = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vault.certfile                 = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vault.collect_timing           = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vault.insecure                 = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vault.keyfile                  = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vault.kv_mountpoint            = secret {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vault.kv_path                  = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vault.kv_version               = 2 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vault.namespace                = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vault.root_token_id            = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vault.split_loggers            = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vault.ssl_ca_crt_file          = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vault.timeout                  = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vault.use_ssl                  = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] keystone.auth_section          = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] keystone.auth_type             = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] keystone.cafile                = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] keystone.certfile              = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] keystone.collect_timing        = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] keystone.connect_retries       = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] keystone.connect_retry_delay   = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] keystone.endpoint_override     = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] keystone.insecure              = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] keystone.keyfile               = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] keystone.max_version           = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] keystone.min_version           = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] keystone.region_name           = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] keystone.service_name          = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] keystone.service_type          = identity {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] keystone.split_loggers         = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] keystone.status_code_retries   = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] keystone.status_code_retry_delay = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] keystone.timeout               = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] keystone.version               = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.connection_uri         =  {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.cpu_mode               = custom {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: WARNING oslo_config.cfg [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.cpu_power_governor_high = performance {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.cpu_power_governor_low = powersave {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.cpu_power_management   = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.device_detach_attempts = 8 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.device_detach_timeout  = 20 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.disk_cachemodes        = [] {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.disk_prefix            = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.enabled_perf_events    = [] {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.file_backed_memory     = 0 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.gid_maps               = [] {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.hw_disk_discard        = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.hw_machine_type        = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.images_rbd_glance_store_name =  {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.images_rbd_pool        = rbd {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.images_type            = default {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.images_volume_group    = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.inject_key             = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.inject_partition       = -2 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.inject_password        = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.iscsi_iface            = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.iser_use_multipath     = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.live_migration_bandwidth = 0 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.live_migration_downtime = 500 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.live_migration_inbound_addr = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.live_migration_permit_post_copy = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.live_migration_scheme  = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.live_migration_timeout_action = abort {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.live_migration_tunnelled = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: WARNING oslo_config.cfg [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Oct 16 11:08:56 user nova-compute[74683]: live_migration_uri is deprecated for removal in favor of two other options that
Oct 16 11:08:56 user nova-compute[74683]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Oct 16 11:08:56 user nova-compute[74683]: and ``live_migration_inbound_addr`` respectively.
Oct 16 11:08:56 user nova-compute[74683]: ).  Its value may be silently ignored in the future.
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.live_migration_with_native_tls = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.max_queues             = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.nfs_mount_options      = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.num_memory_encrypted_guests = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.num_pcie_ports         = 0 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.pmem_namespaces        = [] {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.quobyte_client_cfg     = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.rbd_secret_uuid        = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.rbd_user               = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.remote_filesystem_transport = ssh {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.rescue_image_id        = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.rescue_kernel_id       = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.rescue_ramdisk_id      = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.rx_queue_size          = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.smbfs_mount_options    =  {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.snapshot_compression   = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.snapshot_image_format  = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.sparse_logical_volumes = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.swtpm_enabled          = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.swtpm_group            = tss {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.swtpm_user             = tss {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.sysinfo_serial         = unique {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.tb_cache_size          = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.tx_queue_size          = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.uid_maps               = [] {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.use_virtio_for_bridges = True {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.virt_type              = kvm {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.volume_clear           = zero {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.volume_clear_size      = 0 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.volume_use_multipath   = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.vzstorage_cache_path   = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.vzstorage_mount_user   = stack {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] neutron.auth_section           = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] neutron.auth_type              = password {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] neutron.cafile                 = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] neutron.certfile               = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] neutron.collect_timing         = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] neutron.connect_retries        = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] neutron.connect_retry_delay    = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] neutron.default_floating_pool  = public {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] neutron.endpoint_override      = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] neutron.extension_sync_interval = 600 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] neutron.http_retries           = 3 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] neutron.insecure               = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] neutron.keyfile                = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] neutron.max_version            = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] neutron.min_version            = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] neutron.ovs_bridge             = br-int {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] neutron.physnets               = [] {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] neutron.region_name            = RegionOne {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] neutron.service_metadata_proxy = True {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] neutron.service_name           = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] neutron.service_type           = network {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] neutron.split_loggers          = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] neutron.status_code_retries    = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] neutron.status_code_retry_delay = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] neutron.timeout                = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] neutron.version                = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] notifications.bdms_in_notifications = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] notifications.default_level    = INFO {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] notifications.notification_format = unversioned {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] notifications.notify_on_state_change = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] pci.alias                      = [] {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] pci.device_spec                = [] {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] pci.report_in_placement        = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] placement.auth_section         = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] placement.auth_type            = password {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] placement.cafile               = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] placement.certfile             = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] placement.collect_timing       = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] placement.connect_retries      = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] placement.connect_retry_delay  = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] placement.default_domain_id    = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] placement.default_domain_name  = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] placement.domain_id            = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] placement.domain_name          = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] placement.endpoint_override    = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] placement.insecure             = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] placement.keyfile              = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] placement.max_version          = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] placement.min_version          = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] placement.password             = **** {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] placement.project_domain_id    = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] placement.project_domain_name  = Default {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] placement.project_id           = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] placement.project_name         = service {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] placement.region_name          = RegionOne {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] placement.service_name         = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] placement.service_type         = placement {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] placement.split_loggers        = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] placement.status_code_retries  = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] placement.status_code_retry_delay = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] placement.system_scope         = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] placement.timeout              = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] placement.trust_id             = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] placement.user_domain_id       = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] placement.user_domain_name     = Default {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] placement.user_id              = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] placement.username             = placement {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] placement.version              = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] quota.cores                    = 20 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] quota.count_usage_from_placement = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] quota.injected_file_content_bytes = 10240 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] quota.injected_file_path_length = 255 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] quota.injected_files           = 5 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] quota.instances                = 10 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] quota.key_pairs                = 100 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] quota.metadata_items           = 128 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] quota.ram                      = 51200 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] quota.recheck_quota            = True {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] quota.server_group_members     = 10 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] quota.server_groups            = 10 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] rdp.enabled                    = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] scheduler.image_metadata_prefilter = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] scheduler.max_attempts         = 3 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] scheduler.max_placement_results = 1000 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] scheduler.query_placement_for_image_type_support = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] scheduler.workers              = 3 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] filter_scheduler.host_subset_size = 1 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] filter_scheduler.isolated_hosts = [] {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] filter_scheduler.isolated_images = [] {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] filter_scheduler.pci_in_placement = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] filter_scheduler.track_instance_changes = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] metrics.required               = True {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] metrics.weight_multiplier      = 1.0 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] metrics.weight_setting         = [] {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] serial_console.enabled         = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] serial_console.port_range      = 10000:20000 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] serial_console.serialproxy_port = 6083 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] service_user.auth_section      = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] service_user.auth_type         = password {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] service_user.cafile            = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] service_user.certfile          = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] service_user.collect_timing    = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] service_user.insecure          = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] service_user.keyfile           = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] service_user.send_service_user_token = True {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] service_user.split_loggers     = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] service_user.timeout           = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] spice.agent_enabled            = True {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] spice.enabled                  = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] spice.html5proxy_port          = 6082 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] spice.image_compression        = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] spice.jpeg_compression         = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] spice.playback_compression     = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] spice.server_listen            = 127.0.0.1 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] spice.streaming_mode           = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] spice.zlib_compression         = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] upgrade_levels.baseapi         = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] upgrade_levels.cert            = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] upgrade_levels.compute         = auto {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] upgrade_levels.conductor       = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] upgrade_levels.scheduler       = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vendordata_dynamic_auth.auth_section = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vendordata_dynamic_auth.auth_type = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vendordata_dynamic_auth.cafile = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vendordata_dynamic_auth.certfile = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vendordata_dynamic_auth.insecure = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vendordata_dynamic_auth.keyfile = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vendordata_dynamic_auth.timeout = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vmware.api_retry_count         = 10 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vmware.ca_file                 = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vmware.cache_prefix            = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vmware.cluster_name            = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vmware.connection_pool_size    = 10 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vmware.console_delay_seconds   = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vmware.datastore_regex         = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vmware.host_ip                 = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vmware.host_password           = **** {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vmware.host_port               = 443 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vmware.host_username           = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vmware.insecure                = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vmware.integration_bridge      = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vmware.maximum_objects         = 100 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vmware.pbm_default_policy      = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vmware.pbm_enabled             = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vmware.pbm_wsdl_location       = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vmware.serial_port_proxy_uri   = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vmware.serial_port_service_uri = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vmware.task_poll_interval      = 0.5 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vmware.use_linked_clone        = True {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vmware.vnc_keymap              = en-us {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vmware.vnc_port                = 5900 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vmware.vnc_port_total          = 10000 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vnc.auth_schemes               = ['none'] {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vnc.enabled                    = True {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vnc.novncproxy_port            = 6080 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vnc.server_listen              = 0.0.0.0 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vnc.vencrypt_ca_certs          = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vnc.vencrypt_client_cert       = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vnc.vencrypt_client_key        = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] workarounds.disable_rootwrap   = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] workarounds.enable_numa_live_migration = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] workarounds.libvirt_disable_apic = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] wsgi.client_socket_timeout     = 900 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] wsgi.default_pool_size         = 1000 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] wsgi.keep_alive                = True {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] wsgi.max_header_line           = 16384 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] wsgi.ssl_ca_file               = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] wsgi.ssl_cert_file             = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] wsgi.ssl_key_file              = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] wsgi.tcp_keepidle              = 600 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] zvm.ca_file                    = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] zvm.cloud_connector_url        = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] zvm.reachable_timeout          = 300 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_policy.enforce_new_defaults = True {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_policy.enforce_scope      = True {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_policy.policy_default_rule = default {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_policy.policy_file        = policy.yaml {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] profiler.connection_string     = messaging:// {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] profiler.enabled               = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] profiler.es_doc_type           = notification {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] profiler.es_scroll_size        = 10000 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] profiler.es_scroll_time        = 2m {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] profiler.filter_error_trace    = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] profiler.hmac_keys             = **** {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] profiler.sentinel_service_name = mymaster {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] profiler.socket_timeout        = 0.1 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] profiler.trace_requests        = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] profiler.trace_sqlalchemy      = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] profiler_jaeger.process_tags   = {} {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] profiler_jaeger.service_name_prefix = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] profiler_otlp.service_name_prefix = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] remote_debug.host              = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] remote_debug.port              = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_messaging_rabbit.ssl      = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_messaging_notifications.retry = -1 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_messaging_notifications.transport_url = **** {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_limit.auth_section        = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_limit.auth_type           = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_limit.cafile              = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_limit.certfile            = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_limit.collect_timing      = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_limit.connect_retries     = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_limit.connect_retry_delay = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_limit.endpoint_id         = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_limit.endpoint_override   = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_limit.insecure            = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_limit.keyfile             = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_limit.max_version         = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_limit.min_version         = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_limit.region_name         = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_limit.service_name        = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_limit.service_type        = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_limit.split_loggers       = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_limit.status_code_retries = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_limit.status_code_retry_delay = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_limit.timeout             = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_limit.valid_interfaces    = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_limit.version             = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_reports.file_event_handler = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] oslo_reports.log_dir           = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vif_plug_ovs_privileged.group  = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] vif_plug_ovs_privileged.user   = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] os_vif_linux_bridge.flat_interface = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] os_vif_ovs.isolate_vif         = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] os_vif_ovs.per_port_bridge     = False {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] os_brick.lock_path             = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] privsep_osbrick.capabilities   = [21] {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] privsep_osbrick.group          = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] privsep_osbrick.helper_command = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] privsep_osbrick.user           = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] nova_sys_admin.group           = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] nova_sys_admin.helper_command  = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] nova_sys_admin.user            = None {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG oslo_service.service [None req-5b29141f-0338-4f13-8c46-334d96194568 None None] ******************************************************************************** {{(pid=74683) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Oct 16 11:08:56 user nova-compute[74683]: INFO nova.service [-] Starting compute node (version 0.0.0)
Oct 16 11:08:56 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Connecting to libvirt: qemu:///system {{(pid=74683) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fda6d165120> {{(pid=74683) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Oct 16 11:08:56 user nova-compute[74683]: libvirt:  error : internal error: could not initialize domain event timer
Oct 16 11:08:56 user nova-compute[74683]: WARNING nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Oct 16 11:08:56 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fda6d165120> {{(pid=74683) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Starting native event thread {{(pid=74683) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Starting green dispatch thread {{(pid=74683) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Oct 16 11:08:56 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Starting connection event dispatch thread {{(pid=74683) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Oct 16 11:08:56 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Connection event '1' reason 'None'
Oct 16 11:08:56 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 16 11:08:56 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.mount [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Initialising _HostMountState generation 0 {{(pid=74683) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Oct 16 11:09:04 user nova-compute[74683]: INFO nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Libvirt host capabilities <capabilities>
Oct 16 11:09:04 user nova-compute[74683]:   <host>
Oct 16 11:09:04 user nova-compute[74683]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Oct 16 11:09:04 user nova-compute[74683]:     <cpu>
Oct 16 11:09:04 user nova-compute[74683]:       <arch>x86_64</arch>
Oct 16 11:09:04 user nova-compute[74683]:       <model>IvyBridge-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <vendor>Intel</vendor>
Oct 16 11:09:04 user nova-compute[74683]:       <microcode version='1070'/>
Oct 16 11:09:04 user nova-compute[74683]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Oct 16 11:09:04 user nova-compute[74683]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature name='ss'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature name='vmx'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature name='pcid'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature name='osxsave'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature name='hypervisor'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature name='arat'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature name='tsc_adjust'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature name='md-clear'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature name='stibp'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature name='arch-capabilities'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature name='ssbd'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature name='invtsc'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature name='rsba'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature name='skip-l1dfl-vmentry'/>
Oct 16 11:09:04 user nova-compute[74683]:       <pages unit='KiB' size='4'/>
Oct 16 11:09:04 user nova-compute[74683]:       <pages unit='KiB' size='2048'/>
Oct 16 11:09:04 user nova-compute[74683]:     </cpu>
Oct 16 11:09:04 user nova-compute[74683]:     <power_management>
Oct 16 11:09:04 user nova-compute[74683]:       <suspend_mem/>
Oct 16 11:09:04 user nova-compute[74683]:       <suspend_disk/>
Oct 16 11:09:04 user nova-compute[74683]:       <suspend_hybrid/>
Oct 16 11:09:04 user nova-compute[74683]:     </power_management>
Oct 16 11:09:04 user nova-compute[74683]:     <iommu support='no'/>
Oct 16 11:09:04 user nova-compute[74683]:     <migration_features>
Oct 16 11:09:04 user nova-compute[74683]:       <live/>
Oct 16 11:09:04 user nova-compute[74683]:       <uri_transports>
Oct 16 11:09:04 user nova-compute[74683]:         <uri_transport>tcp</uri_transport>
Oct 16 11:09:04 user nova-compute[74683]:         <uri_transport>rdma</uri_transport>
Oct 16 11:09:04 user nova-compute[74683]:       </uri_transports>
Oct 16 11:09:04 user nova-compute[74683]:     </migration_features>
Oct 16 11:09:04 user nova-compute[74683]:     <topology>
Oct 16 11:09:04 user nova-compute[74683]:       <cells num='2'>
Oct 16 11:09:04 user nova-compute[74683]:         <cell id='0'>
Oct 16 11:09:04 user nova-compute[74683]:           <memory unit='KiB'>8140616</memory>
Oct 16 11:09:04 user nova-compute[74683]:           <pages unit='KiB' size='4'>2035154</pages>
Oct 16 11:09:04 user nova-compute[74683]:           <pages unit='KiB' size='2048'>0</pages>
Oct 16 11:09:04 user nova-compute[74683]:           <distances>
Oct 16 11:09:04 user nova-compute[74683]:             <sibling id='0' value='10'/>
Oct 16 11:09:04 user nova-compute[74683]:             <sibling id='1' value='20'/>
Oct 16 11:09:04 user nova-compute[74683]:           </distances>
Oct 16 11:09:04 user nova-compute[74683]:           <cpus num='6'>
Oct 16 11:09:04 user nova-compute[74683]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Oct 16 11:09:04 user nova-compute[74683]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Oct 16 11:09:04 user nova-compute[74683]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Oct 16 11:09:04 user nova-compute[74683]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Oct 16 11:09:04 user nova-compute[74683]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Oct 16 11:09:04 user nova-compute[74683]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Oct 16 11:09:04 user nova-compute[74683]:           </cpus>
Oct 16 11:09:04 user nova-compute[74683]:         </cell>
Oct 16 11:09:04 user nova-compute[74683]:         <cell id='1'>
Oct 16 11:09:04 user nova-compute[74683]:           <memory unit='KiB'>8255068</memory>
Oct 16 11:09:04 user nova-compute[74683]:           <pages unit='KiB' size='4'>2063767</pages>
Oct 16 11:09:04 user nova-compute[74683]:           <pages unit='KiB' size='2048'>0</pages>
Oct 16 11:09:04 user nova-compute[74683]:           <distances>
Oct 16 11:09:04 user nova-compute[74683]:             <sibling id='0' value='20'/>
Oct 16 11:09:04 user nova-compute[74683]:             <sibling id='1' value='10'/>
Oct 16 11:09:04 user nova-compute[74683]:           </distances>
Oct 16 11:09:04 user nova-compute[74683]:           <cpus num='6'>
Oct 16 11:09:04 user nova-compute[74683]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Oct 16 11:09:04 user nova-compute[74683]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Oct 16 11:09:04 user nova-compute[74683]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Oct 16 11:09:04 user nova-compute[74683]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Oct 16 11:09:04 user nova-compute[74683]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Oct 16 11:09:04 user nova-compute[74683]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Oct 16 11:09:04 user nova-compute[74683]:           </cpus>
Oct 16 11:09:04 user nova-compute[74683]:         </cell>
Oct 16 11:09:04 user nova-compute[74683]:       </cells>
Oct 16 11:09:04 user nova-compute[74683]:     </topology>
Oct 16 11:09:04 user nova-compute[74683]:     <cache>
Oct 16 11:09:04 user nova-compute[74683]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Oct 16 11:09:04 user nova-compute[74683]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Oct 16 11:09:04 user nova-compute[74683]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Oct 16 11:09:04 user nova-compute[74683]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Oct 16 11:09:04 user nova-compute[74683]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Oct 16 11:09:04 user nova-compute[74683]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Oct 16 11:09:04 user nova-compute[74683]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Oct 16 11:09:04 user nova-compute[74683]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Oct 16 11:09:04 user nova-compute[74683]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Oct 16 11:09:04 user nova-compute[74683]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Oct 16 11:09:04 user nova-compute[74683]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Oct 16 11:09:04 user nova-compute[74683]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Oct 16 11:09:04 user nova-compute[74683]:     </cache>
Oct 16 11:09:04 user nova-compute[74683]:     <secmodel>
Oct 16 11:09:04 user nova-compute[74683]:       <model>apparmor</model>
Oct 16 11:09:04 user nova-compute[74683]:       <doi>0</doi>
Oct 16 11:09:04 user nova-compute[74683]:     </secmodel>
Oct 16 11:09:04 user nova-compute[74683]:     <secmodel>
Oct 16 11:09:04 user nova-compute[74683]:       <model>dac</model>
Oct 16 11:09:04 user nova-compute[74683]:       <doi>0</doi>
Oct 16 11:09:04 user nova-compute[74683]:       <baselabel type='kvm'>+64055:+108</baselabel>
Oct 16 11:09:04 user nova-compute[74683]:       <baselabel type='qemu'>+64055:+108</baselabel>
Oct 16 11:09:04 user nova-compute[74683]:     </secmodel>
Oct 16 11:09:04 user nova-compute[74683]:   </host>
Oct 16 11:09:04 user nova-compute[74683]:   <guest>
Oct 16 11:09:04 user nova-compute[74683]:     <os_type>hvm</os_type>
Oct 16 11:09:04 user nova-compute[74683]:     <arch name='alpha'>
Oct 16 11:09:04 user nova-compute[74683]:       <wordsize>64</wordsize>
Oct 16 11:09:04 user nova-compute[74683]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='4'>clipper</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <domain type='qemu'/>
Oct 16 11:09:04 user nova-compute[74683]:     </arch>
Oct 16 11:09:04 user nova-compute[74683]:     <features>
Oct 16 11:09:04 user nova-compute[74683]:       <cpuselection/>
Oct 16 11:09:04 user nova-compute[74683]:       <deviceboot/>
Oct 16 11:09:04 user nova-compute[74683]:       <disksnapshot default='on' toggle='no'/>
Oct 16 11:09:04 user nova-compute[74683]:     </features>
Oct 16 11:09:04 user nova-compute[74683]:   </guest>
Oct 16 11:09:04 user nova-compute[74683]:   <guest>
Oct 16 11:09:04 user nova-compute[74683]:     <os_type>hvm</os_type>
Oct 16 11:09:04 user nova-compute[74683]:     <arch name='armv6l'>
Oct 16 11:09:04 user nova-compute[74683]:       <wordsize>32</wordsize>
Oct 16 11:09:04 user nova-compute[74683]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>integratorcp</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>borzoi</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>spitz</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2'>nuri</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2'>musca-b1</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>versatileab</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>kzm</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2'>musca-a</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2'>smdkc210</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>sx1</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>z2</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>tosa</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='4'>sabrelite</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>realview-eb</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>n810</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>n800</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>versatilepb</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>terrier</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>mainstone</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='4'>midway</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>musicpal</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>microbit</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>cubieboard</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>verdex</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>netduino2</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='4'>raspi2b</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>cheetah</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='4'>highbank</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>akita</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>connex</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>collie</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>raspi0</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <domain type='qemu'/>
Oct 16 11:09:04 user nova-compute[74683]:     </arch>
Oct 16 11:09:04 user nova-compute[74683]:     <features>
Oct 16 11:09:04 user nova-compute[74683]:       <cpuselection/>
Oct 16 11:09:04 user nova-compute[74683]:       <deviceboot/>
Oct 16 11:09:04 user nova-compute[74683]:       <disksnapshot default='on' toggle='no'/>
Oct 16 11:09:04 user nova-compute[74683]:     </features>
Oct 16 11:09:04 user nova-compute[74683]:   </guest>
Oct 16 11:09:04 user nova-compute[74683]:   <guest>
Oct 16 11:09:04 user nova-compute[74683]:     <os_type>hvm</os_type>
Oct 16 11:09:04 user nova-compute[74683]:     <arch name='armv7l'>
Oct 16 11:09:04 user nova-compute[74683]:       <wordsize>32</wordsize>
Oct 16 11:09:04 user nova-compute[74683]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>integratorcp</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>borzoi</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>spitz</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2'>nuri</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2'>musca-b1</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>versatileab</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>kzm</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2'>musca-a</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2'>smdkc210</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>sx1</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>z2</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>tosa</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='4'>sabrelite</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>realview-eb</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>n810</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>n800</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>versatilepb</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>terrier</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>mainstone</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='4'>midway</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>musicpal</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>microbit</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>cubieboard</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>verdex</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>netduino2</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='4'>raspi2b</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>cheetah</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='4'>highbank</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>akita</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>connex</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>collie</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>raspi0</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <domain type='qemu'/>
Oct 16 11:09:04 user nova-compute[74683]:     </arch>
Oct 16 11:09:04 user nova-compute[74683]:     <features>
Oct 16 11:09:04 user nova-compute[74683]:       <cpuselection/>
Oct 16 11:09:04 user nova-compute[74683]:       <deviceboot/>
Oct 16 11:09:04 user nova-compute[74683]:       <disksnapshot default='on' toggle='no'/>
Oct 16 11:09:04 user nova-compute[74683]:     </features>
Oct 16 11:09:04 user nova-compute[74683]:   </guest>
Oct 16 11:09:04 user nova-compute[74683]:   <guest>
Oct 16 11:09:04 user nova-compute[74683]:     <os_type>hvm</os_type>
Oct 16 11:09:04 user nova-compute[74683]:     <arch name='aarch64'>
Oct 16 11:09:04 user nova-compute[74683]:       <wordsize>64</wordsize>
Oct 16 11:09:04 user nova-compute[74683]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>integratorcp</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>borzoi</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>spitz</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2'>nuri</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2'>musca-b1</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>versatileab</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>kzm</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2'>musca-a</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2'>smdkc210</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>sx1</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>z2</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>tosa</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='4'>sabrelite</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>realview-eb</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='512'>sbsa-ref</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>n810</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>n800</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>versatilepb</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>terrier</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>mainstone</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='4'>midway</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>musicpal</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>microbit</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='4'>raspi3ap</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>cubieboard</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>verdex</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>netduino2</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='4'>raspi3b</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='4'>raspi2b</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>cheetah</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='4'>highbank</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>akita</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>connex</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>collie</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>raspi0</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <domain type='qemu'/>
Oct 16 11:09:04 user nova-compute[74683]:     </arch>
Oct 16 11:09:04 user nova-compute[74683]:     <features>
Oct 16 11:09:04 user nova-compute[74683]:       <acpi default='on' toggle='yes'/>
Oct 16 11:09:04 user nova-compute[74683]:       <cpuselection/>
Oct 16 11:09:04 user nova-compute[74683]:       <deviceboot/>
Oct 16 11:09:04 user nova-compute[74683]:       <disksnapshot default='on' toggle='no'/>
Oct 16 11:09:04 user nova-compute[74683]:     </features>
Oct 16 11:09:04 user nova-compute[74683]:   </guest>
Oct 16 11:09:04 user nova-compute[74683]:   <guest>
Oct 16 11:09:04 user nova-compute[74683]:     <os_type>hvm</os_type>
Oct 16 11:09:04 user nova-compute[74683]:     <arch name='cris'>
Oct 16 11:09:04 user nova-compute[74683]:       <wordsize>32</wordsize>
Oct 16 11:09:04 user nova-compute[74683]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>axis-dev88</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <domain type='qemu'/>
Oct 16 11:09:04 user nova-compute[74683]:     </arch>
Oct 16 11:09:04 user nova-compute[74683]:     <features>
Oct 16 11:09:04 user nova-compute[74683]:       <cpuselection/>
Oct 16 11:09:04 user nova-compute[74683]:       <deviceboot/>
Oct 16 11:09:04 user nova-compute[74683]:       <disksnapshot default='on' toggle='no'/>
Oct 16 11:09:04 user nova-compute[74683]:     </features>
Oct 16 11:09:04 user nova-compute[74683]:   </guest>
Oct 16 11:09:04 user nova-compute[74683]:   <guest>
Oct 16 11:09:04 user nova-compute[74683]:     <os_type>hvm</os_type>
Oct 16 11:09:04 user nova-compute[74683]:     <arch name='i686'>
Oct 16 11:09:04 user nova-compute[74683]:       <wordsize>32</wordsize>
Oct 16 11:09:04 user nova-compute[74683]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>x-remote</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>isapc</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>microvm</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <domain type='qemu'/>
Oct 16 11:09:04 user nova-compute[74683]:       <domain type='kvm'/>
Oct 16 11:09:04 user nova-compute[74683]:     </arch>
Oct 16 11:09:04 user nova-compute[74683]:     <features>
Oct 16 11:09:04 user nova-compute[74683]:       <pae/>
Oct 16 11:09:04 user nova-compute[74683]:       <nonpae/>
Oct 16 11:09:04 user nova-compute[74683]:       <acpi default='on' toggle='yes'/>
Oct 16 11:09:04 user nova-compute[74683]:       <apic default='on' toggle='no'/>
Oct 16 11:09:04 user nova-compute[74683]:       <cpuselection/>
Oct 16 11:09:04 user nova-compute[74683]:       <deviceboot/>
Oct 16 11:09:04 user nova-compute[74683]:       <disksnapshot default='on' toggle='no'/>
Oct 16 11:09:04 user nova-compute[74683]:     </features>
Oct 16 11:09:04 user nova-compute[74683]:   </guest>
Oct 16 11:09:04 user nova-compute[74683]:   <guest>
Oct 16 11:09:04 user nova-compute[74683]:     <os_type>hvm</os_type>
Oct 16 11:09:04 user nova-compute[74683]:     <arch name='m68k'>
Oct 16 11:09:04 user nova-compute[74683]:       <wordsize>32</wordsize>
Oct 16 11:09:04 user nova-compute[74683]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>mcf5208evb</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>an5206</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>virt-6.0</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>q800</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>virt-6.2</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>next-cube</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>virt-6.1</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <domain type='qemu'/>
Oct 16 11:09:04 user nova-compute[74683]:     </arch>
Oct 16 11:09:04 user nova-compute[74683]:     <features>
Oct 16 11:09:04 user nova-compute[74683]:       <cpuselection/>
Oct 16 11:09:04 user nova-compute[74683]:       <deviceboot/>
Oct 16 11:09:04 user nova-compute[74683]:       <disksnapshot default='on' toggle='no'/>
Oct 16 11:09:04 user nova-compute[74683]:     </features>
Oct 16 11:09:04 user nova-compute[74683]:   </guest>
Oct 16 11:09:04 user nova-compute[74683]:   <guest>
Oct 16 11:09:04 user nova-compute[74683]:     <os_type>hvm</os_type>
Oct 16 11:09:04 user nova-compute[74683]:     <arch name='microblaze'>
Oct 16 11:09:04 user nova-compute[74683]:       <wordsize>32</wordsize>
Oct 16 11:09:04 user nova-compute[74683]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <domain type='qemu'/>
Oct 16 11:09:04 user nova-compute[74683]:     </arch>
Oct 16 11:09:04 user nova-compute[74683]:     <features>
Oct 16 11:09:04 user nova-compute[74683]:       <cpuselection/>
Oct 16 11:09:04 user nova-compute[74683]:       <deviceboot/>
Oct 16 11:09:04 user nova-compute[74683]:       <disksnapshot default='on' toggle='no'/>
Oct 16 11:09:04 user nova-compute[74683]:     </features>
Oct 16 11:09:04 user nova-compute[74683]:   </guest>
Oct 16 11:09:04 user nova-compute[74683]:   <guest>
Oct 16 11:09:04 user nova-compute[74683]:     <os_type>hvm</os_type>
Oct 16 11:09:04 user nova-compute[74683]:     <arch name='microblazeel'>
Oct 16 11:09:04 user nova-compute[74683]:       <wordsize>32</wordsize>
Oct 16 11:09:04 user nova-compute[74683]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <domain type='qemu'/>
Oct 16 11:09:04 user nova-compute[74683]:     </arch>
Oct 16 11:09:04 user nova-compute[74683]:     <features>
Oct 16 11:09:04 user nova-compute[74683]:       <cpuselection/>
Oct 16 11:09:04 user nova-compute[74683]:       <deviceboot/>
Oct 16 11:09:04 user nova-compute[74683]:       <disksnapshot default='on' toggle='no'/>
Oct 16 11:09:04 user nova-compute[74683]:     </features>
Oct 16 11:09:04 user nova-compute[74683]:   </guest>
Oct 16 11:09:04 user nova-compute[74683]:   <guest>
Oct 16 11:09:04 user nova-compute[74683]:     <os_type>hvm</os_type>
Oct 16 11:09:04 user nova-compute[74683]:     <arch name='mips'>
Oct 16 11:09:04 user nova-compute[74683]:       <wordsize>32</wordsize>
Oct 16 11:09:04 user nova-compute[74683]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='16'>malta</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>mipssim</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <domain type='qemu'/>
Oct 16 11:09:04 user nova-compute[74683]:     </arch>
Oct 16 11:09:04 user nova-compute[74683]:     <features>
Oct 16 11:09:04 user nova-compute[74683]:       <cpuselection/>
Oct 16 11:09:04 user nova-compute[74683]:       <deviceboot/>
Oct 16 11:09:04 user nova-compute[74683]:       <disksnapshot default='on' toggle='no'/>
Oct 16 11:09:04 user nova-compute[74683]:     </features>
Oct 16 11:09:04 user nova-compute[74683]:   </guest>
Oct 16 11:09:04 user nova-compute[74683]:   <guest>
Oct 16 11:09:04 user nova-compute[74683]:     <os_type>hvm</os_type>
Oct 16 11:09:04 user nova-compute[74683]:     <arch name='mipsel'>
Oct 16 11:09:04 user nova-compute[74683]:       <wordsize>32</wordsize>
Oct 16 11:09:04 user nova-compute[74683]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='16'>malta</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>mipssim</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <domain type='qemu'/>
Oct 16 11:09:04 user nova-compute[74683]:     </arch>
Oct 16 11:09:04 user nova-compute[74683]:     <features>
Oct 16 11:09:04 user nova-compute[74683]:       <cpuselection/>
Oct 16 11:09:04 user nova-compute[74683]:       <deviceboot/>
Oct 16 11:09:04 user nova-compute[74683]:       <disksnapshot default='on' toggle='no'/>
Oct 16 11:09:04 user nova-compute[74683]:     </features>
Oct 16 11:09:04 user nova-compute[74683]:   </guest>
Oct 16 11:09:04 user nova-compute[74683]:   <guest>
Oct 16 11:09:04 user nova-compute[74683]:     <os_type>hvm</os_type>
Oct 16 11:09:04 user nova-compute[74683]:     <arch name='mips64'>
Oct 16 11:09:04 user nova-compute[74683]:       <wordsize>64</wordsize>
Oct 16 11:09:04 user nova-compute[74683]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='16'>malta</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>mipssim</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>pica61</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>magnum</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <domain type='qemu'/>
Oct 16 11:09:04 user nova-compute[74683]:     </arch>
Oct 16 11:09:04 user nova-compute[74683]:     <features>
Oct 16 11:09:04 user nova-compute[74683]:       <cpuselection/>
Oct 16 11:09:04 user nova-compute[74683]:       <deviceboot/>
Oct 16 11:09:04 user nova-compute[74683]:       <disksnapshot default='on' toggle='no'/>
Oct 16 11:09:04 user nova-compute[74683]:     </features>
Oct 16 11:09:04 user nova-compute[74683]:   </guest>
Oct 16 11:09:04 user nova-compute[74683]:   <guest>
Oct 16 11:09:04 user nova-compute[74683]:     <os_type>hvm</os_type>
Oct 16 11:09:04 user nova-compute[74683]:     <arch name='mips64el'>
Oct 16 11:09:04 user nova-compute[74683]:       <wordsize>64</wordsize>
Oct 16 11:09:04 user nova-compute[74683]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='16'>malta</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='16'>loongson3-virt</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>mipssim</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>pica61</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>magnum</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='16'>boston</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>fuloong2e</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <domain type='qemu'/>
Oct 16 11:09:04 user nova-compute[74683]:     </arch>
Oct 16 11:09:04 user nova-compute[74683]:     <features>
Oct 16 11:09:04 user nova-compute[74683]:       <cpuselection/>
Oct 16 11:09:04 user nova-compute[74683]:       <deviceboot/>
Oct 16 11:09:04 user nova-compute[74683]:       <disksnapshot default='on' toggle='no'/>
Oct 16 11:09:04 user nova-compute[74683]:     </features>
Oct 16 11:09:04 user nova-compute[74683]:   </guest>
Oct 16 11:09:04 user nova-compute[74683]:   <guest>
Oct 16 11:09:04 user nova-compute[74683]:     <os_type>hvm</os_type>
Oct 16 11:09:04 user nova-compute[74683]:     <arch name='ppc'>
Oct 16 11:09:04 user nova-compute[74683]:       <wordsize>32</wordsize>
Oct 16 11:09:04 user nova-compute[74683]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>g3beige</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>mac99</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='32'>ppce500</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>pegasos2</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>sam460ex</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>bamboo</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>40p</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>ref405ep</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>taihu</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <domain type='qemu'/>
Oct 16 11:09:04 user nova-compute[74683]:     </arch>
Oct 16 11:09:04 user nova-compute[74683]:     <features>
Oct 16 11:09:04 user nova-compute[74683]:       <cpuselection/>
Oct 16 11:09:04 user nova-compute[74683]:       <deviceboot/>
Oct 16 11:09:04 user nova-compute[74683]:       <disksnapshot default='on' toggle='no'/>
Oct 16 11:09:04 user nova-compute[74683]:     </features>
Oct 16 11:09:04 user nova-compute[74683]:   </guest>
Oct 16 11:09:04 user nova-compute[74683]:   <guest>
Oct 16 11:09:04 user nova-compute[74683]:     <os_type>hvm</os_type>
Oct 16 11:09:04 user nova-compute[74683]:     <arch name='ppc64'>
Oct 16 11:09:04 user nova-compute[74683]:       <wordsize>64</wordsize>
Oct 16 11:09:04 user nova-compute[74683]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2048'>powernv9</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>taihu</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2048'>powernv10</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='32'>ppce500</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>40p</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>pegasos2</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>bamboo</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>g3beige</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>mac99</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>sam460ex</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>ref405ep</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2048'>powernv8</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <domain type='qemu'/>
Oct 16 11:09:04 user nova-compute[74683]:     </arch>
Oct 16 11:09:04 user nova-compute[74683]:     <features>
Oct 16 11:09:04 user nova-compute[74683]:       <cpuselection/>
Oct 16 11:09:04 user nova-compute[74683]:       <deviceboot/>
Oct 16 11:09:04 user nova-compute[74683]:       <disksnapshot default='on' toggle='no'/>
Oct 16 11:09:04 user nova-compute[74683]:     </features>
Oct 16 11:09:04 user nova-compute[74683]:   </guest>
Oct 16 11:09:04 user nova-compute[74683]:   <guest>
Oct 16 11:09:04 user nova-compute[74683]:     <os_type>hvm</os_type>
Oct 16 11:09:04 user nova-compute[74683]:     <arch name='ppc64le'>
Oct 16 11:09:04 user nova-compute[74683]:       <wordsize>64</wordsize>
Oct 16 11:09:04 user nova-compute[74683]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2048'>powernv9</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>taihu</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2048'>powernv10</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='32'>ppce500</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>40p</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>pegasos2</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>bamboo</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>g3beige</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>mac99</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>sam460ex</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>ref405ep</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2048'>powernv8</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <domain type='qemu'/>
Oct 16 11:09:04 user nova-compute[74683]:     </arch>
Oct 16 11:09:04 user nova-compute[74683]:     <features>
Oct 16 11:09:04 user nova-compute[74683]:       <cpuselection/>
Oct 16 11:09:04 user nova-compute[74683]:       <deviceboot/>
Oct 16 11:09:04 user nova-compute[74683]:       <disksnapshot default='on' toggle='no'/>
Oct 16 11:09:04 user nova-compute[74683]:     </features>
Oct 16 11:09:04 user nova-compute[74683]:   </guest>
Oct 16 11:09:04 user nova-compute[74683]:   <guest>
Oct 16 11:09:04 user nova-compute[74683]:     <os_type>hvm</os_type>
Oct 16 11:09:04 user nova-compute[74683]:     <arch name='riscv32'>
Oct 16 11:09:04 user nova-compute[74683]:       <wordsize>32</wordsize>
Oct 16 11:09:04 user nova-compute[74683]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='8'>spike</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>opentitan</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='5'>sifive_u</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>sifive_e</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='8'>virt</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <domain type='qemu'/>
Oct 16 11:09:04 user nova-compute[74683]:     </arch>
Oct 16 11:09:04 user nova-compute[74683]:     <features>
Oct 16 11:09:04 user nova-compute[74683]:       <cpuselection/>
Oct 16 11:09:04 user nova-compute[74683]:       <deviceboot/>
Oct 16 11:09:04 user nova-compute[74683]:       <disksnapshot default='on' toggle='no'/>
Oct 16 11:09:04 user nova-compute[74683]:     </features>
Oct 16 11:09:04 user nova-compute[74683]:   </guest>
Oct 16 11:09:04 user nova-compute[74683]:   <guest>
Oct 16 11:09:04 user nova-compute[74683]:     <os_type>hvm</os_type>
Oct 16 11:09:04 user nova-compute[74683]:     <arch name='riscv64'>
Oct 16 11:09:04 user nova-compute[74683]:       <wordsize>64</wordsize>
Oct 16 11:09:04 user nova-compute[74683]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='8'>spike</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='5'>sifive_u</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>shakti_c</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>sifive_e</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='8'>virt</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <domain type='qemu'/>
Oct 16 11:09:04 user nova-compute[74683]:     </arch>
Oct 16 11:09:04 user nova-compute[74683]:     <features>
Oct 16 11:09:04 user nova-compute[74683]:       <cpuselection/>
Oct 16 11:09:04 user nova-compute[74683]:       <deviceboot/>
Oct 16 11:09:04 user nova-compute[74683]:       <disksnapshot default='on' toggle='no'/>
Oct 16 11:09:04 user nova-compute[74683]:     </features>
Oct 16 11:09:04 user nova-compute[74683]:   </guest>
Oct 16 11:09:04 user nova-compute[74683]:   <guest>
Oct 16 11:09:04 user nova-compute[74683]:     <os_type>hvm</os_type>
Oct 16 11:09:04 user nova-compute[74683]:     <arch name='s390x'>
Oct 16 11:09:04 user nova-compute[74683]:       <wordsize>64</wordsize>
Oct 16 11:09:04 user nova-compute[74683]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <domain type='qemu'/>
Oct 16 11:09:04 user nova-compute[74683]:     </arch>
Oct 16 11:09:04 user nova-compute[74683]:     <features>
Oct 16 11:09:04 user nova-compute[74683]:       <cpuselection/>
Oct 16 11:09:04 user nova-compute[74683]:       <deviceboot/>
Oct 16 11:09:04 user nova-compute[74683]:       <disksnapshot default='on' toggle='no'/>
Oct 16 11:09:04 user nova-compute[74683]:     </features>
Oct 16 11:09:04 user nova-compute[74683]:   </guest>
Oct 16 11:09:04 user nova-compute[74683]:   <guest>
Oct 16 11:09:04 user nova-compute[74683]:     <os_type>hvm</os_type>
Oct 16 11:09:04 user nova-compute[74683]:     <arch name='sh4'>
Oct 16 11:09:04 user nova-compute[74683]:       <wordsize>32</wordsize>
Oct 16 11:09:04 user nova-compute[74683]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>shix</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>r2d</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <domain type='qemu'/>
Oct 16 11:09:04 user nova-compute[74683]:     </arch>
Oct 16 11:09:04 user nova-compute[74683]:     <features>
Oct 16 11:09:04 user nova-compute[74683]:       <cpuselection/>
Oct 16 11:09:04 user nova-compute[74683]:       <deviceboot/>
Oct 16 11:09:04 user nova-compute[74683]:       <disksnapshot default='on' toggle='no'/>
Oct 16 11:09:04 user nova-compute[74683]:     </features>
Oct 16 11:09:04 user nova-compute[74683]:   </guest>
Oct 16 11:09:04 user nova-compute[74683]:   <guest>
Oct 16 11:09:04 user nova-compute[74683]:     <os_type>hvm</os_type>
Oct 16 11:09:04 user nova-compute[74683]:     <arch name='sh4eb'>
Oct 16 11:09:04 user nova-compute[74683]:       <wordsize>64</wordsize>
Oct 16 11:09:04 user nova-compute[74683]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>shix</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>r2d</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <domain type='qemu'/>
Oct 16 11:09:04 user nova-compute[74683]:     </arch>
Oct 16 11:09:04 user nova-compute[74683]:     <features>
Oct 16 11:09:04 user nova-compute[74683]:       <cpuselection/>
Oct 16 11:09:04 user nova-compute[74683]:       <deviceboot/>
Oct 16 11:09:04 user nova-compute[74683]:       <disksnapshot default='on' toggle='no'/>
Oct 16 11:09:04 user nova-compute[74683]:     </features>
Oct 16 11:09:04 user nova-compute[74683]:   </guest>
Oct 16 11:09:04 user nova-compute[74683]:   <guest>
Oct 16 11:09:04 user nova-compute[74683]:     <os_type>hvm</os_type>
Oct 16 11:09:04 user nova-compute[74683]:     <arch name='sparc'>
Oct 16 11:09:04 user nova-compute[74683]:       <wordsize>32</wordsize>
Oct 16 11:09:04 user nova-compute[74683]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>SS-5</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='4'>SS-20</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>LX</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>SPARCClassic</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>leon3_generic</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>SPARCbook</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>SS-4</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='4'>SS-600MP</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='4'>SS-10</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>Voyager</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <domain type='qemu'/>
Oct 16 11:09:04 user nova-compute[74683]:     </arch>
Oct 16 11:09:04 user nova-compute[74683]:     <features>
Oct 16 11:09:04 user nova-compute[74683]:       <cpuselection/>
Oct 16 11:09:04 user nova-compute[74683]:       <deviceboot/>
Oct 16 11:09:04 user nova-compute[74683]:       <disksnapshot default='on' toggle='no'/>
Oct 16 11:09:04 user nova-compute[74683]:     </features>
Oct 16 11:09:04 user nova-compute[74683]:   </guest>
Oct 16 11:09:04 user nova-compute[74683]:   <guest>
Oct 16 11:09:04 user nova-compute[74683]:     <os_type>hvm</os_type>
Oct 16 11:09:04 user nova-compute[74683]:     <arch name='sparc64'>
Oct 16 11:09:04 user nova-compute[74683]:       <wordsize>64</wordsize>
Oct 16 11:09:04 user nova-compute[74683]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>sun4u</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>niagara</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>sun4v</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <domain type='qemu'/>
Oct 16 11:09:04 user nova-compute[74683]:     </arch>
Oct 16 11:09:04 user nova-compute[74683]:     <features>
Oct 16 11:09:04 user nova-compute[74683]:       <cpuselection/>
Oct 16 11:09:04 user nova-compute[74683]:       <deviceboot/>
Oct 16 11:09:04 user nova-compute[74683]:       <disksnapshot default='on' toggle='no'/>
Oct 16 11:09:04 user nova-compute[74683]:     </features>
Oct 16 11:09:04 user nova-compute[74683]:   </guest>
Oct 16 11:09:04 user nova-compute[74683]:   <guest>
Oct 16 11:09:04 user nova-compute[74683]:     <os_type>hvm</os_type>
Oct 16 11:09:04 user nova-compute[74683]:     <arch name='x86_64'>
Oct 16 11:09:04 user nova-compute[74683]:       <wordsize>64</wordsize>
Oct 16 11:09:04 user nova-compute[74683]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>x-remote</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='1'>isapc</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>microvm</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <domain type='qemu'/>
Oct 16 11:09:04 user nova-compute[74683]:       <domain type='kvm'/>
Oct 16 11:09:04 user nova-compute[74683]:     </arch>
Oct 16 11:09:04 user nova-compute[74683]:     <features>
Oct 16 11:09:04 user nova-compute[74683]:       <acpi default='on' toggle='yes'/>
Oct 16 11:09:04 user nova-compute[74683]:       <apic default='on' toggle='no'/>
Oct 16 11:09:04 user nova-compute[74683]:       <cpuselection/>
Oct 16 11:09:04 user nova-compute[74683]:       <deviceboot/>
Oct 16 11:09:04 user nova-compute[74683]:       <disksnapshot default='on' toggle='no'/>
Oct 16 11:09:04 user nova-compute[74683]:     </features>
Oct 16 11:09:04 user nova-compute[74683]:   </guest>
Oct 16 11:09:04 user nova-compute[74683]:   <guest>
Oct 16 11:09:04 user nova-compute[74683]:     <os_type>hvm</os_type>
Oct 16 11:09:04 user nova-compute[74683]:     <arch name='xtensa'>
Oct 16 11:09:04 user nova-compute[74683]:       <wordsize>32</wordsize>
Oct 16 11:09:04 user nova-compute[74683]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='4'>sim</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='32'>kc705</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='32'>ml605</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='32'>virt</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='32'>lx200</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='32'>lx60</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <domain type='qemu'/>
Oct 16 11:09:04 user nova-compute[74683]:     </arch>
Oct 16 11:09:04 user nova-compute[74683]:     <features>
Oct 16 11:09:04 user nova-compute[74683]:       <cpuselection/>
Oct 16 11:09:04 user nova-compute[74683]:       <deviceboot/>
Oct 16 11:09:04 user nova-compute[74683]:       <disksnapshot default='on' toggle='no'/>
Oct 16 11:09:04 user nova-compute[74683]:     </features>
Oct 16 11:09:04 user nova-compute[74683]:   </guest>
Oct 16 11:09:04 user nova-compute[74683]:   <guest>
Oct 16 11:09:04 user nova-compute[74683]:     <os_type>hvm</os_type>
Oct 16 11:09:04 user nova-compute[74683]:     <arch name='xtensaeb'>
Oct 16 11:09:04 user nova-compute[74683]:       <wordsize>32</wordsize>
Oct 16 11:09:04 user nova-compute[74683]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='4'>sim</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='32'>kc705</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='32'>ml605</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='32'>virt</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='32'>lx200</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='32'>lx60</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 16 11:09:04 user nova-compute[74683]:       <domain type='qemu'/>
Oct 16 11:09:04 user nova-compute[74683]:     </arch>
Oct 16 11:09:04 user nova-compute[74683]:     <features>
Oct 16 11:09:04 user nova-compute[74683]:       <cpuselection/>
Oct 16 11:09:04 user nova-compute[74683]:       <deviceboot/>
Oct 16 11:09:04 user nova-compute[74683]:       <disksnapshot default='on' toggle='no'/>
Oct 16 11:09:04 user nova-compute[74683]:     </features>
Oct 16 11:09:04 user nova-compute[74683]:   </guest>
Oct 16 11:09:04 user nova-compute[74683]: </capabilities>
Oct 16 11:09:04 user nova-compute[74683]: 
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74683) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74683) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=74683) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74683) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74683) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74683) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74683) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74683) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74683) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74683) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74683) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Getting domain capabilities for i686 via machine types: {'pc', 'ubuntu', 'q35', 'ubuntu-q35'} {{(pid=74683) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Oct 16 11:09:04 user nova-compute[74683]: <domainCapabilities>
Oct 16 11:09:04 user nova-compute[74683]:   <path>/usr/bin/qemu-system-i386</path>
Oct 16 11:09:04 user nova-compute[74683]:   <domain>kvm</domain>
Oct 16 11:09:04 user nova-compute[74683]:   <machine>pc-i440fx-6.2</machine>
Oct 16 11:09:04 user nova-compute[74683]:   <arch>i686</arch>
Oct 16 11:09:04 user nova-compute[74683]:   <vcpu max='255'/>
Oct 16 11:09:04 user nova-compute[74683]:   <iothreads supported='yes'/>
Oct 16 11:09:04 user nova-compute[74683]:   <os supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:     <enum name='firmware'/>
Oct 16 11:09:04 user nova-compute[74683]:     <loader supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 16 11:09:04 user nova-compute[74683]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 16 11:09:04 user nova-compute[74683]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 16 11:09:04 user nova-compute[74683]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 16 11:09:04 user nova-compute[74683]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='type'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>rom</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>pflash</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='readonly'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>yes</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>no</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='secure'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>no</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </loader>
Oct 16 11:09:04 user nova-compute[74683]:   </os>
Oct 16 11:09:04 user nova-compute[74683]:   <cpu>
Oct 16 11:09:04 user nova-compute[74683]:     <mode name='host-passthrough' supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='hostPassthroughMigratable'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>off</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </mode>
Oct 16 11:09:04 user nova-compute[74683]:     <mode name='maximum' supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='maximumMigratable'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>on</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>off</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </mode>
Oct 16 11:09:04 user nova-compute[74683]:     <mode name='host-model' supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <vendor>Intel</vendor>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='ss'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='vmx'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='pcid'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='hypervisor'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='arat'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='tsc_adjust'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='umip'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='md-clear'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='stibp'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='arch-capabilities'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='ssbd'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='ibpb'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='ibrs'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='amd-stibp'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='amd-ssbd'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='disable' name='erms'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='disable' name='xsaveopt'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='disable' name='lm'/>
Oct 16 11:09:04 user nova-compute[74683]:     </mode>
Oct 16 11:09:04 user nova-compute[74683]:     <mode name='custom' supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>qemu64</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>qemu32</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>phenom</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>pentium3</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>pentium2</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>pentium</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>n270</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>kvm64</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>kvm32</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>coreduo</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>core2duo</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>athlon</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Westmere-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Westmere</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Snowridge</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Skylake-Server</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Skylake-Client</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>SandyBridge</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Penryn</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Opteron_G5</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Opteron_G4</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Opteron_G3</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Opteron_G2</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Opteron_G1</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Nehalem-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Nehalem</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>IvyBridge</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Icelake-Server</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Haswell-noTSX</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Haswell-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Haswell</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>EPYC-Rome</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>EPYC-Milan</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>EPYC-IBPB</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>EPYC</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Dhyana</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Cooperlake</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Conroe</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Cascadelake-Server</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Broadwell-noTSX</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Broadwell-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Broadwell</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>486</model>
Oct 16 11:09:04 user nova-compute[74683]:     </mode>
Oct 16 11:09:04 user nova-compute[74683]:   </cpu>
Oct 16 11:09:04 user nova-compute[74683]:   <memoryBacking supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:     <enum name='sourceType'>
Oct 16 11:09:04 user nova-compute[74683]:       <value>file</value>
Oct 16 11:09:04 user nova-compute[74683]:       <value>anonymous</value>
Oct 16 11:09:04 user nova-compute[74683]:       <value>memfd</value>
Oct 16 11:09:04 user nova-compute[74683]:     </enum>
Oct 16 11:09:04 user nova-compute[74683]:   </memoryBacking>
Oct 16 11:09:04 user nova-compute[74683]:   <devices>
Oct 16 11:09:04 user nova-compute[74683]:     <disk supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='diskDevice'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>disk</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>cdrom</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>floppy</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>lun</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='bus'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>ide</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>fdc</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>scsi</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtio</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>usb</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>sata</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='model'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtio</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtio-transitional</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtio-non-transitional</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </disk>
Oct 16 11:09:04 user nova-compute[74683]:     <graphics supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='type'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>sdl</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>vnc</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>spice</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>egl-headless</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </graphics>
Oct 16 11:09:04 user nova-compute[74683]:     <video supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='modelType'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>vga</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>cirrus</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>vmvga</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>qxl</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtio</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>none</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>bochs</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>ramfb</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </video>
Oct 16 11:09:04 user nova-compute[74683]:     <hostdev supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='mode'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>subsystem</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='startupPolicy'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>default</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>mandatory</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>requisite</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>optional</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='subsysType'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>usb</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>pci</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>scsi</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='capsType'/>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='pciBackend'/>
Oct 16 11:09:04 user nova-compute[74683]:     </hostdev>
Oct 16 11:09:04 user nova-compute[74683]:     <rng supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='model'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtio</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtio-transitional</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtio-non-transitional</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='backendModel'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>random</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>egd</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>builtin</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </rng>
Oct 16 11:09:04 user nova-compute[74683]:     <filesystem supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='driverType'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>path</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>handle</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtiofs</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </filesystem>
Oct 16 11:09:04 user nova-compute[74683]:     <tpm supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='model'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>tpm-tis</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>tpm-crb</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='backendModel'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>passthrough</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>emulator</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </tpm>
Oct 16 11:09:04 user nova-compute[74683]:   </devices>
Oct 16 11:09:04 user nova-compute[74683]:   <features>
Oct 16 11:09:04 user nova-compute[74683]:     <gic supported='no'/>
Oct 16 11:09:04 user nova-compute[74683]:     <vmcoreinfo supported='yes'/>
Oct 16 11:09:04 user nova-compute[74683]:     <genid supported='yes'/>
Oct 16 11:09:04 user nova-compute[74683]:     <backingStoreInput supported='yes'/>
Oct 16 11:09:04 user nova-compute[74683]:     <backup supported='yes'/>
Oct 16 11:09:04 user nova-compute[74683]:     <sev supported='no'/>
Oct 16 11:09:04 user nova-compute[74683]:   </features>
Oct 16 11:09:04 user nova-compute[74683]: </domainCapabilities>
Oct 16 11:09:04 user nova-compute[74683]:  {{(pid=74683) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Oct 16 11:09:04 user nova-compute[74683]: <domainCapabilities>
Oct 16 11:09:04 user nova-compute[74683]:   <path>/usr/bin/qemu-system-i386</path>
Oct 16 11:09:04 user nova-compute[74683]:   <domain>kvm</domain>
Oct 16 11:09:04 user nova-compute[74683]:   <machine>pc-i440fx-jammy</machine>
Oct 16 11:09:04 user nova-compute[74683]:   <arch>i686</arch>
Oct 16 11:09:04 user nova-compute[74683]:   <vcpu max='255'/>
Oct 16 11:09:04 user nova-compute[74683]:   <iothreads supported='yes'/>
Oct 16 11:09:04 user nova-compute[74683]:   <os supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:     <enum name='firmware'/>
Oct 16 11:09:04 user nova-compute[74683]:     <loader supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 16 11:09:04 user nova-compute[74683]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 16 11:09:04 user nova-compute[74683]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 16 11:09:04 user nova-compute[74683]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 16 11:09:04 user nova-compute[74683]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='type'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>rom</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>pflash</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='readonly'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>yes</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>no</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='secure'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>no</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </loader>
Oct 16 11:09:04 user nova-compute[74683]:   </os>
Oct 16 11:09:04 user nova-compute[74683]:   <cpu>
Oct 16 11:09:04 user nova-compute[74683]:     <mode name='host-passthrough' supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='hostPassthroughMigratable'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>off</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </mode>
Oct 16 11:09:04 user nova-compute[74683]:     <mode name='maximum' supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='maximumMigratable'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>on</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>off</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </mode>
Oct 16 11:09:04 user nova-compute[74683]:     <mode name='host-model' supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <vendor>Intel</vendor>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='ss'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='vmx'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='pcid'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='hypervisor'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='arat'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='tsc_adjust'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='umip'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='md-clear'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='stibp'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='arch-capabilities'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='ssbd'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='ibpb'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='ibrs'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='amd-stibp'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='amd-ssbd'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='disable' name='erms'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='disable' name='xsaveopt'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='disable' name='lm'/>
Oct 16 11:09:04 user nova-compute[74683]:     </mode>
Oct 16 11:09:04 user nova-compute[74683]:     <mode name='custom' supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>qemu64</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>qemu32</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>phenom</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>pentium3</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>pentium2</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>pentium</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>n270</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>kvm64</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>kvm32</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>coreduo</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>core2duo</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>athlon</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Westmere-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Westmere</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Snowridge</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Skylake-Server</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Skylake-Client</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>SandyBridge</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Penryn</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Opteron_G5</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Opteron_G4</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Opteron_G3</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Opteron_G2</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Opteron_G1</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Nehalem-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Nehalem</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>IvyBridge</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Icelake-Server</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Haswell-noTSX</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Haswell-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Haswell</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>EPYC-Rome</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>EPYC-Milan</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>EPYC-IBPB</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>EPYC</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Dhyana</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Cooperlake</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Conroe</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Cascadelake-Server</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Broadwell-noTSX</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Broadwell-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Broadwell</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>486</model>
Oct 16 11:09:04 user nova-compute[74683]:     </mode>
Oct 16 11:09:04 user nova-compute[74683]:   </cpu>
Oct 16 11:09:04 user nova-compute[74683]:   <memoryBacking supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:     <enum name='sourceType'>
Oct 16 11:09:04 user nova-compute[74683]:       <value>file</value>
Oct 16 11:09:04 user nova-compute[74683]:       <value>anonymous</value>
Oct 16 11:09:04 user nova-compute[74683]:       <value>memfd</value>
Oct 16 11:09:04 user nova-compute[74683]:     </enum>
Oct 16 11:09:04 user nova-compute[74683]:   </memoryBacking>
Oct 16 11:09:04 user nova-compute[74683]:   <devices>
Oct 16 11:09:04 user nova-compute[74683]:     <disk supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='diskDevice'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>disk</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>cdrom</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>floppy</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>lun</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='bus'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>ide</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>fdc</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>scsi</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtio</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>usb</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>sata</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='model'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtio</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtio-transitional</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtio-non-transitional</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </disk>
Oct 16 11:09:04 user nova-compute[74683]:     <graphics supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='type'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>sdl</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>vnc</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>spice</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>egl-headless</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </graphics>
Oct 16 11:09:04 user nova-compute[74683]:     <video supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='modelType'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>vga</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>cirrus</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>vmvga</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>qxl</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtio</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>none</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>bochs</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>ramfb</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </video>
Oct 16 11:09:04 user nova-compute[74683]:     <hostdev supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='mode'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>subsystem</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='startupPolicy'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>default</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>mandatory</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>requisite</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>optional</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='subsysType'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>usb</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>pci</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>scsi</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='capsType'/>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='pciBackend'/>
Oct 16 11:09:04 user nova-compute[74683]:     </hostdev>
Oct 16 11:09:04 user nova-compute[74683]:     <rng supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='model'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtio</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtio-transitional</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtio-non-transitional</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='backendModel'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>random</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>egd</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>builtin</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </rng>
Oct 16 11:09:04 user nova-compute[74683]:     <filesystem supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='driverType'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>path</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>handle</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtiofs</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </filesystem>
Oct 16 11:09:04 user nova-compute[74683]:     <tpm supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='model'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>tpm-tis</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>tpm-crb</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='backendModel'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>passthrough</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>emulator</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </tpm>
Oct 16 11:09:04 user nova-compute[74683]:   </devices>
Oct 16 11:09:04 user nova-compute[74683]:   <features>
Oct 16 11:09:04 user nova-compute[74683]:     <gic supported='no'/>
Oct 16 11:09:04 user nova-compute[74683]:     <vmcoreinfo supported='yes'/>
Oct 16 11:09:04 user nova-compute[74683]:     <genid supported='yes'/>
Oct 16 11:09:04 user nova-compute[74683]:     <backingStoreInput supported='yes'/>
Oct 16 11:09:04 user nova-compute[74683]:     <backup supported='yes'/>
Oct 16 11:09:04 user nova-compute[74683]:     <sev supported='no'/>
Oct 16 11:09:04 user nova-compute[74683]:   </features>
Oct 16 11:09:04 user nova-compute[74683]: </domainCapabilities>
Oct 16 11:09:04 user nova-compute[74683]:  {{(pid=74683) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Oct 16 11:09:04 user nova-compute[74683]: <domainCapabilities>
Oct 16 11:09:04 user nova-compute[74683]:   <path>/usr/bin/qemu-system-i386</path>
Oct 16 11:09:04 user nova-compute[74683]:   <domain>kvm</domain>
Oct 16 11:09:04 user nova-compute[74683]:   <machine>pc-q35-6.2</machine>
Oct 16 11:09:04 user nova-compute[74683]:   <arch>i686</arch>
Oct 16 11:09:04 user nova-compute[74683]:   <vcpu max='288'/>
Oct 16 11:09:04 user nova-compute[74683]:   <iothreads supported='yes'/>
Oct 16 11:09:04 user nova-compute[74683]:   <os supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:     <enum name='firmware'/>
Oct 16 11:09:04 user nova-compute[74683]:     <loader supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 16 11:09:04 user nova-compute[74683]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 16 11:09:04 user nova-compute[74683]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 16 11:09:04 user nova-compute[74683]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 16 11:09:04 user nova-compute[74683]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='type'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>rom</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>pflash</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='readonly'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>yes</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>no</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='secure'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>no</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </loader>
Oct 16 11:09:04 user nova-compute[74683]:   </os>
Oct 16 11:09:04 user nova-compute[74683]:   <cpu>
Oct 16 11:09:04 user nova-compute[74683]:     <mode name='host-passthrough' supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='hostPassthroughMigratable'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>off</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </mode>
Oct 16 11:09:04 user nova-compute[74683]:     <mode name='maximum' supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='maximumMigratable'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>on</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>off</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </mode>
Oct 16 11:09:04 user nova-compute[74683]:     <mode name='host-model' supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <vendor>Intel</vendor>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='ss'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='vmx'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='pcid'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='hypervisor'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='arat'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='tsc_adjust'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='umip'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='md-clear'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='stibp'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='arch-capabilities'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='ssbd'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='ibpb'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='ibrs'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='amd-stibp'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='amd-ssbd'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='disable' name='erms'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='disable' name='xsaveopt'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='disable' name='lm'/>
Oct 16 11:09:04 user nova-compute[74683]:     </mode>
Oct 16 11:09:04 user nova-compute[74683]:     <mode name='custom' supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>qemu64</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>qemu32</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>phenom</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>pentium3</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>pentium2</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>pentium</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>n270</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>kvm64</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>kvm32</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>coreduo</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>core2duo</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>athlon</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Westmere-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Westmere</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Snowridge</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Skylake-Server</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Skylake-Client</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>SandyBridge</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Penryn</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Opteron_G5</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Opteron_G4</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Opteron_G3</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Opteron_G2</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Opteron_G1</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Nehalem-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Nehalem</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>IvyBridge</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Icelake-Server</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Haswell-noTSX</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Haswell-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Haswell</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>EPYC-Rome</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>EPYC-Milan</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>EPYC-IBPB</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>EPYC</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Dhyana</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Cooperlake</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Conroe</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Cascadelake-Server</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Broadwell-noTSX</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Broadwell-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Broadwell</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>486</model>
Oct 16 11:09:04 user nova-compute[74683]:     </mode>
Oct 16 11:09:04 user nova-compute[74683]:   </cpu>
Oct 16 11:09:04 user nova-compute[74683]:   <memoryBacking supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:     <enum name='sourceType'>
Oct 16 11:09:04 user nova-compute[74683]:       <value>file</value>
Oct 16 11:09:04 user nova-compute[74683]:       <value>anonymous</value>
Oct 16 11:09:04 user nova-compute[74683]:       <value>memfd</value>
Oct 16 11:09:04 user nova-compute[74683]:     </enum>
Oct 16 11:09:04 user nova-compute[74683]:   </memoryBacking>
Oct 16 11:09:04 user nova-compute[74683]:   <devices>
Oct 16 11:09:04 user nova-compute[74683]:     <disk supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='diskDevice'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>disk</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>cdrom</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>floppy</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>lun</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='bus'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>fdc</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>scsi</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtio</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>usb</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>sata</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='model'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtio</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtio-transitional</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtio-non-transitional</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </disk>
Oct 16 11:09:04 user nova-compute[74683]:     <graphics supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='type'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>sdl</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>vnc</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>spice</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>egl-headless</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </graphics>
Oct 16 11:09:04 user nova-compute[74683]:     <video supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='modelType'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>vga</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>cirrus</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>vmvga</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>qxl</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtio</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>none</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>bochs</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>ramfb</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </video>
Oct 16 11:09:04 user nova-compute[74683]:     <hostdev supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='mode'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>subsystem</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='startupPolicy'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>default</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>mandatory</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>requisite</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>optional</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='subsysType'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>usb</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>pci</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>scsi</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='capsType'/>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='pciBackend'/>
Oct 16 11:09:04 user nova-compute[74683]:     </hostdev>
Oct 16 11:09:04 user nova-compute[74683]:     <rng supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='model'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtio</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtio-transitional</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtio-non-transitional</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='backendModel'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>random</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>egd</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>builtin</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </rng>
Oct 16 11:09:04 user nova-compute[74683]:     <filesystem supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='driverType'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>path</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>handle</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtiofs</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </filesystem>
Oct 16 11:09:04 user nova-compute[74683]:     <tpm supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='model'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>tpm-tis</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>tpm-crb</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='backendModel'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>passthrough</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>emulator</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </tpm>
Oct 16 11:09:04 user nova-compute[74683]:   </devices>
Oct 16 11:09:04 user nova-compute[74683]:   <features>
Oct 16 11:09:04 user nova-compute[74683]:     <gic supported='no'/>
Oct 16 11:09:04 user nova-compute[74683]:     <vmcoreinfo supported='yes'/>
Oct 16 11:09:04 user nova-compute[74683]:     <genid supported='yes'/>
Oct 16 11:09:04 user nova-compute[74683]:     <backingStoreInput supported='yes'/>
Oct 16 11:09:04 user nova-compute[74683]:     <backup supported='yes'/>
Oct 16 11:09:04 user nova-compute[74683]:     <sev supported='no'/>
Oct 16 11:09:04 user nova-compute[74683]:   </features>
Oct 16 11:09:04 user nova-compute[74683]: </domainCapabilities>
Oct 16 11:09:04 user nova-compute[74683]:  {{(pid=74683) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Oct 16 11:09:04 user nova-compute[74683]: <domainCapabilities>
Oct 16 11:09:04 user nova-compute[74683]:   <path>/usr/bin/qemu-system-i386</path>
Oct 16 11:09:04 user nova-compute[74683]:   <domain>kvm</domain>
Oct 16 11:09:04 user nova-compute[74683]:   <machine>pc-q35-jammy</machine>
Oct 16 11:09:04 user nova-compute[74683]:   <arch>i686</arch>
Oct 16 11:09:04 user nova-compute[74683]:   <vcpu max='288'/>
Oct 16 11:09:04 user nova-compute[74683]:   <iothreads supported='yes'/>
Oct 16 11:09:04 user nova-compute[74683]:   <os supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:     <enum name='firmware'/>
Oct 16 11:09:04 user nova-compute[74683]:     <loader supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 16 11:09:04 user nova-compute[74683]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 16 11:09:04 user nova-compute[74683]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 16 11:09:04 user nova-compute[74683]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 16 11:09:04 user nova-compute[74683]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='type'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>rom</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>pflash</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='readonly'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>yes</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>no</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='secure'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>no</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </loader>
Oct 16 11:09:04 user nova-compute[74683]:   </os>
Oct 16 11:09:04 user nova-compute[74683]:   <cpu>
Oct 16 11:09:04 user nova-compute[74683]:     <mode name='host-passthrough' supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='hostPassthroughMigratable'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>off</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </mode>
Oct 16 11:09:04 user nova-compute[74683]:     <mode name='maximum' supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='maximumMigratable'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>on</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>off</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </mode>
Oct 16 11:09:04 user nova-compute[74683]:     <mode name='host-model' supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <vendor>Intel</vendor>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='ss'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='vmx'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='pcid'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='hypervisor'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='arat'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='tsc_adjust'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='umip'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='md-clear'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='stibp'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='arch-capabilities'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='ssbd'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='ibpb'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='ibrs'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='amd-stibp'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='amd-ssbd'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='disable' name='erms'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='disable' name='xsaveopt'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='disable' name='lm'/>
Oct 16 11:09:04 user nova-compute[74683]:     </mode>
Oct 16 11:09:04 user nova-compute[74683]:     <mode name='custom' supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>qemu64</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>qemu32</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>phenom</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>pentium3</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>pentium2</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>pentium</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>n270</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>kvm64</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>kvm32</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>coreduo</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>core2duo</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>athlon</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Westmere-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Westmere</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Snowridge</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Skylake-Server</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Skylake-Client</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>SandyBridge</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Penryn</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Opteron_G5</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Opteron_G4</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Opteron_G3</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Opteron_G2</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Opteron_G1</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Nehalem-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Nehalem</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>IvyBridge</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Icelake-Server</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Haswell-noTSX</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Haswell-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Haswell</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>EPYC-Rome</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>EPYC-Milan</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>EPYC-IBPB</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>EPYC</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Dhyana</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Cooperlake</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Conroe</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Cascadelake-Server</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Broadwell-noTSX</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Broadwell-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Broadwell</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>486</model>
Oct 16 11:09:04 user nova-compute[74683]:     </mode>
Oct 16 11:09:04 user nova-compute[74683]:   </cpu>
Oct 16 11:09:04 user nova-compute[74683]:   <memoryBacking supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:     <enum name='sourceType'>
Oct 16 11:09:04 user nova-compute[74683]:       <value>file</value>
Oct 16 11:09:04 user nova-compute[74683]:       <value>anonymous</value>
Oct 16 11:09:04 user nova-compute[74683]:       <value>memfd</value>
Oct 16 11:09:04 user nova-compute[74683]:     </enum>
Oct 16 11:09:04 user nova-compute[74683]:   </memoryBacking>
Oct 16 11:09:04 user nova-compute[74683]:   <devices>
Oct 16 11:09:04 user nova-compute[74683]:     <disk supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='diskDevice'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>disk</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>cdrom</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>floppy</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>lun</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='bus'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>fdc</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>scsi</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtio</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>usb</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>sata</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='model'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtio</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtio-transitional</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtio-non-transitional</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </disk>
Oct 16 11:09:04 user nova-compute[74683]:     <graphics supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='type'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>sdl</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>vnc</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>spice</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>egl-headless</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </graphics>
Oct 16 11:09:04 user nova-compute[74683]:     <video supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='modelType'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>vga</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>cirrus</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>vmvga</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>qxl</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtio</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>none</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>bochs</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>ramfb</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </video>
Oct 16 11:09:04 user nova-compute[74683]:     <hostdev supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='mode'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>subsystem</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='startupPolicy'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>default</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>mandatory</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>requisite</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>optional</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='subsysType'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>usb</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>pci</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>scsi</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='capsType'/>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='pciBackend'/>
Oct 16 11:09:04 user nova-compute[74683]:     </hostdev>
Oct 16 11:09:04 user nova-compute[74683]:     <rng supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='model'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtio</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtio-transitional</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtio-non-transitional</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='backendModel'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>random</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>egd</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>builtin</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </rng>
Oct 16 11:09:04 user nova-compute[74683]:     <filesystem supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='driverType'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>path</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>handle</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtiofs</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </filesystem>
Oct 16 11:09:04 user nova-compute[74683]:     <tpm supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='model'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>tpm-tis</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>tpm-crb</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='backendModel'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>passthrough</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>emulator</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </tpm>
Oct 16 11:09:04 user nova-compute[74683]:   </devices>
Oct 16 11:09:04 user nova-compute[74683]:   <features>
Oct 16 11:09:04 user nova-compute[74683]:     <gic supported='no'/>
Oct 16 11:09:04 user nova-compute[74683]:     <vmcoreinfo supported='yes'/>
Oct 16 11:09:04 user nova-compute[74683]:     <genid supported='yes'/>
Oct 16 11:09:04 user nova-compute[74683]:     <backingStoreInput supported='yes'/>
Oct 16 11:09:04 user nova-compute[74683]:     <backup supported='yes'/>
Oct 16 11:09:04 user nova-compute[74683]:     <sev supported='no'/>
Oct 16 11:09:04 user nova-compute[74683]:   </features>
Oct 16 11:09:04 user nova-compute[74683]: </domainCapabilities>
Oct 16 11:09:04 user nova-compute[74683]:  {{(pid=74683) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=74683) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74683) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74683) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74683) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74683) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74683) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74683) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74683) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74683) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74683) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74683) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74683) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74683) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74683) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74683) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74683) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74683) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=74683) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74683) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74683) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74683) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=74683) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74683) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74683) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74683) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74683) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74683) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74683) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74683) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74683) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74683) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74683) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74683) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74683) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74683) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74683) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74683) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74683) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'ubuntu', 'q35', 'ubuntu-q35'} {{(pid=74683) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Oct 16 11:09:04 user nova-compute[74683]: <domainCapabilities>
Oct 16 11:09:04 user nova-compute[74683]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 16 11:09:04 user nova-compute[74683]:   <domain>kvm</domain>
Oct 16 11:09:04 user nova-compute[74683]:   <machine>pc-i440fx-6.2</machine>
Oct 16 11:09:04 user nova-compute[74683]:   <arch>x86_64</arch>
Oct 16 11:09:04 user nova-compute[74683]:   <vcpu max='255'/>
Oct 16 11:09:04 user nova-compute[74683]:   <iothreads supported='yes'/>
Oct 16 11:09:04 user nova-compute[74683]:   <os supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:     <enum name='firmware'>
Oct 16 11:09:04 user nova-compute[74683]:       <value>efi</value>
Oct 16 11:09:04 user nova-compute[74683]:     </enum>
Oct 16 11:09:04 user nova-compute[74683]:     <loader supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='type'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>rom</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>pflash</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='readonly'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>yes</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>no</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='secure'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>no</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </loader>
Oct 16 11:09:04 user nova-compute[74683]:   </os>
Oct 16 11:09:04 user nova-compute[74683]:   <cpu>
Oct 16 11:09:04 user nova-compute[74683]:     <mode name='host-passthrough' supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='hostPassthroughMigratable'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>on</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>off</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </mode>
Oct 16 11:09:04 user nova-compute[74683]:     <mode name='maximum' supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='maximumMigratable'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>on</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>off</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </mode>
Oct 16 11:09:04 user nova-compute[74683]:     <mode name='host-model' supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <vendor>Intel</vendor>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='ss'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='vmx'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='pcid'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='hypervisor'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='arat'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='tsc_adjust'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='umip'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='md-clear'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='stibp'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='arch-capabilities'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='ssbd'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='invtsc'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='ibpb'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='ibrs'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='amd-stibp'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='amd-ssbd'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='rsba'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='pschange-mc-no'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='disable' name='erms'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='disable' name='xsaveopt'/>
Oct 16 11:09:04 user nova-compute[74683]:     </mode>
Oct 16 11:09:04 user nova-compute[74683]:     <mode name='custom' supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>qemu64</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>qemu32</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>phenom</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>pentium3</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>pentium2</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>pentium</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>n270</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>kvm64</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>kvm32</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>coreduo</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>core2duo</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>athlon</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>Westmere-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>Westmere</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Snowridge</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Skylake-Server</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Skylake-Client</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>SandyBridge</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>Penryn</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Opteron_G5</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Opteron_G4</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Opteron_G3</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Opteron_G2</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>Opteron_G1</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>Nehalem</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>IvyBridge</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Icelake-Server</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Haswell-noTSX</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Haswell-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Haswell</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>EPYC-Rome</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>EPYC-Milan</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>EPYC-IBPB</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>EPYC</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Dhyana</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Cooperlake</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>Conroe</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Cascadelake-Server</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Broadwell-noTSX</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Broadwell-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Broadwell</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>486</model>
Oct 16 11:09:04 user nova-compute[74683]:     </mode>
Oct 16 11:09:04 user nova-compute[74683]:   </cpu>
Oct 16 11:09:04 user nova-compute[74683]:   <memoryBacking supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:     <enum name='sourceType'>
Oct 16 11:09:04 user nova-compute[74683]:       <value>file</value>
Oct 16 11:09:04 user nova-compute[74683]:       <value>anonymous</value>
Oct 16 11:09:04 user nova-compute[74683]:       <value>memfd</value>
Oct 16 11:09:04 user nova-compute[74683]:     </enum>
Oct 16 11:09:04 user nova-compute[74683]:   </memoryBacking>
Oct 16 11:09:04 user nova-compute[74683]:   <devices>
Oct 16 11:09:04 user nova-compute[74683]:     <disk supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='diskDevice'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>disk</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>cdrom</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>floppy</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>lun</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='bus'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>ide</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>fdc</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>scsi</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtio</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>usb</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>sata</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='model'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtio</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtio-transitional</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtio-non-transitional</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </disk>
Oct 16 11:09:04 user nova-compute[74683]:     <graphics supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='type'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>sdl</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>vnc</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>spice</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>egl-headless</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </graphics>
Oct 16 11:09:04 user nova-compute[74683]:     <video supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='modelType'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>vga</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>cirrus</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>vmvga</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>qxl</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtio</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>none</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>bochs</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>ramfb</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </video>
Oct 16 11:09:04 user nova-compute[74683]:     <hostdev supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='mode'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>subsystem</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='startupPolicy'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>default</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>mandatory</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>requisite</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>optional</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='subsysType'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>usb</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>pci</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>scsi</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='capsType'/>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='pciBackend'/>
Oct 16 11:09:04 user nova-compute[74683]:     </hostdev>
Oct 16 11:09:04 user nova-compute[74683]:     <rng supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='model'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtio</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtio-transitional</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtio-non-transitional</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='backendModel'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>random</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>egd</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>builtin</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </rng>
Oct 16 11:09:04 user nova-compute[74683]:     <filesystem supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='driverType'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>path</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>handle</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtiofs</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </filesystem>
Oct 16 11:09:04 user nova-compute[74683]:     <tpm supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='model'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>tpm-tis</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>tpm-crb</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='backendModel'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>passthrough</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>emulator</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </tpm>
Oct 16 11:09:04 user nova-compute[74683]:   </devices>
Oct 16 11:09:04 user nova-compute[74683]:   <features>
Oct 16 11:09:04 user nova-compute[74683]:     <gic supported='no'/>
Oct 16 11:09:04 user nova-compute[74683]:     <vmcoreinfo supported='yes'/>
Oct 16 11:09:04 user nova-compute[74683]:     <genid supported='yes'/>
Oct 16 11:09:04 user nova-compute[74683]:     <backingStoreInput supported='yes'/>
Oct 16 11:09:04 user nova-compute[74683]:     <backup supported='yes'/>
Oct 16 11:09:04 user nova-compute[74683]:     <sev supported='no'/>
Oct 16 11:09:04 user nova-compute[74683]:   </features>
Oct 16 11:09:04 user nova-compute[74683]: </domainCapabilities>
Oct 16 11:09:04 user nova-compute[74683]:  {{(pid=74683) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Oct 16 11:09:04 user nova-compute[74683]: <domainCapabilities>
Oct 16 11:09:04 user nova-compute[74683]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 16 11:09:04 user nova-compute[74683]:   <domain>kvm</domain>
Oct 16 11:09:04 user nova-compute[74683]:   <machine>pc-i440fx-jammy</machine>
Oct 16 11:09:04 user nova-compute[74683]:   <arch>x86_64</arch>
Oct 16 11:09:04 user nova-compute[74683]:   <vcpu max='255'/>
Oct 16 11:09:04 user nova-compute[74683]:   <iothreads supported='yes'/>
Oct 16 11:09:04 user nova-compute[74683]:   <os supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:     <enum name='firmware'>
Oct 16 11:09:04 user nova-compute[74683]:       <value>efi</value>
Oct 16 11:09:04 user nova-compute[74683]:     </enum>
Oct 16 11:09:04 user nova-compute[74683]:     <loader supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='type'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>rom</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>pflash</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='readonly'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>yes</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>no</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='secure'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>no</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </loader>
Oct 16 11:09:04 user nova-compute[74683]:   </os>
Oct 16 11:09:04 user nova-compute[74683]:   <cpu>
Oct 16 11:09:04 user nova-compute[74683]:     <mode name='host-passthrough' supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='hostPassthroughMigratable'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>on</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>off</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </mode>
Oct 16 11:09:04 user nova-compute[74683]:     <mode name='maximum' supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='maximumMigratable'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>on</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>off</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </mode>
Oct 16 11:09:04 user nova-compute[74683]:     <mode name='host-model' supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <vendor>Intel</vendor>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='ss'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='vmx'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='pcid'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='hypervisor'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='arat'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='tsc_adjust'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='umip'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='md-clear'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='stibp'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='arch-capabilities'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='ssbd'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='invtsc'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='ibpb'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='ibrs'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='amd-stibp'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='amd-ssbd'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='rsba'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='pschange-mc-no'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='disable' name='erms'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='disable' name='xsaveopt'/>
Oct 16 11:09:04 user nova-compute[74683]:     </mode>
Oct 16 11:09:04 user nova-compute[74683]:     <mode name='custom' supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>qemu64</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>qemu32</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>phenom</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>pentium3</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>pentium2</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>pentium</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>n270</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>kvm64</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>kvm32</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>coreduo</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>core2duo</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>athlon</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>Westmere-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>Westmere</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Snowridge</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Skylake-Server</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Skylake-Client</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>SandyBridge</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>Penryn</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Opteron_G5</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Opteron_G4</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Opteron_G3</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Opteron_G2</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>Opteron_G1</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>Nehalem</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>IvyBridge</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Icelake-Server</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Haswell-noTSX</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Haswell-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Haswell</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>EPYC-Rome</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>EPYC-Milan</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>EPYC-IBPB</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>EPYC</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Dhyana</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Cooperlake</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>Conroe</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Cascadelake-Server</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Broadwell-noTSX</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Broadwell-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Broadwell</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>486</model>
Oct 16 11:09:04 user nova-compute[74683]:     </mode>
Oct 16 11:09:04 user nova-compute[74683]:   </cpu>
Oct 16 11:09:04 user nova-compute[74683]:   <memoryBacking supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:     <enum name='sourceType'>
Oct 16 11:09:04 user nova-compute[74683]:       <value>file</value>
Oct 16 11:09:04 user nova-compute[74683]:       <value>anonymous</value>
Oct 16 11:09:04 user nova-compute[74683]:       <value>memfd</value>
Oct 16 11:09:04 user nova-compute[74683]:     </enum>
Oct 16 11:09:04 user nova-compute[74683]:   </memoryBacking>
Oct 16 11:09:04 user nova-compute[74683]:   <devices>
Oct 16 11:09:04 user nova-compute[74683]:     <disk supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='diskDevice'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>disk</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>cdrom</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>floppy</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>lun</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='bus'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>ide</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>fdc</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>scsi</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtio</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>usb</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>sata</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='model'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtio</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtio-transitional</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtio-non-transitional</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </disk>
Oct 16 11:09:04 user nova-compute[74683]:     <graphics supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='type'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>sdl</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>vnc</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>spice</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>egl-headless</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </graphics>
Oct 16 11:09:04 user nova-compute[74683]:     <video supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='modelType'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>vga</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>cirrus</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>vmvga</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>qxl</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtio</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>none</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>bochs</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>ramfb</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </video>
Oct 16 11:09:04 user nova-compute[74683]:     <hostdev supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='mode'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>subsystem</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='startupPolicy'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>default</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>mandatory</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>requisite</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>optional</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='subsysType'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>usb</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>pci</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>scsi</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='capsType'/>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='pciBackend'/>
Oct 16 11:09:04 user nova-compute[74683]:     </hostdev>
Oct 16 11:09:04 user nova-compute[74683]:     <rng supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='model'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtio</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtio-transitional</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtio-non-transitional</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='backendModel'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>random</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>egd</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>builtin</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </rng>
Oct 16 11:09:04 user nova-compute[74683]:     <filesystem supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='driverType'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>path</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>handle</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtiofs</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </filesystem>
Oct 16 11:09:04 user nova-compute[74683]:     <tpm supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='model'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>tpm-tis</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>tpm-crb</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='backendModel'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>passthrough</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>emulator</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </tpm>
Oct 16 11:09:04 user nova-compute[74683]:   </devices>
Oct 16 11:09:04 user nova-compute[74683]:   <features>
Oct 16 11:09:04 user nova-compute[74683]:     <gic supported='no'/>
Oct 16 11:09:04 user nova-compute[74683]:     <vmcoreinfo supported='yes'/>
Oct 16 11:09:04 user nova-compute[74683]:     <genid supported='yes'/>
Oct 16 11:09:04 user nova-compute[74683]:     <backingStoreInput supported='yes'/>
Oct 16 11:09:04 user nova-compute[74683]:     <backup supported='yes'/>
Oct 16 11:09:04 user nova-compute[74683]:     <sev supported='no'/>
Oct 16 11:09:04 user nova-compute[74683]:   </features>
Oct 16 11:09:04 user nova-compute[74683]: </domainCapabilities>
Oct 16 11:09:04 user nova-compute[74683]:  {{(pid=74683) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Oct 16 11:09:04 user nova-compute[74683]: <domainCapabilities>
Oct 16 11:09:04 user nova-compute[74683]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 16 11:09:04 user nova-compute[74683]:   <domain>kvm</domain>
Oct 16 11:09:04 user nova-compute[74683]:   <machine>pc-q35-6.2</machine>
Oct 16 11:09:04 user nova-compute[74683]:   <arch>x86_64</arch>
Oct 16 11:09:04 user nova-compute[74683]:   <vcpu max='288'/>
Oct 16 11:09:04 user nova-compute[74683]:   <iothreads supported='yes'/>
Oct 16 11:09:04 user nova-compute[74683]:   <os supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:     <enum name='firmware'>
Oct 16 11:09:04 user nova-compute[74683]:       <value>efi</value>
Oct 16 11:09:04 user nova-compute[74683]:     </enum>
Oct 16 11:09:04 user nova-compute[74683]:     <loader supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 16 11:09:04 user nova-compute[74683]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 16 11:09:04 user nova-compute[74683]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='type'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>rom</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>pflash</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='readonly'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>yes</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>no</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='secure'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>yes</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>no</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </loader>
Oct 16 11:09:04 user nova-compute[74683]:   </os>
Oct 16 11:09:04 user nova-compute[74683]:   <cpu>
Oct 16 11:09:04 user nova-compute[74683]:     <mode name='host-passthrough' supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='hostPassthroughMigratable'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>on</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>off</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </mode>
Oct 16 11:09:04 user nova-compute[74683]:     <mode name='maximum' supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='maximumMigratable'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>on</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>off</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </mode>
Oct 16 11:09:04 user nova-compute[74683]:     <mode name='host-model' supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <vendor>Intel</vendor>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='ss'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='vmx'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='pcid'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='hypervisor'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='arat'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='tsc_adjust'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='umip'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='md-clear'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='stibp'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='arch-capabilities'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='ssbd'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='invtsc'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='ibpb'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='ibrs'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='amd-stibp'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='amd-ssbd'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='rsba'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='pschange-mc-no'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='disable' name='erms'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='disable' name='xsaveopt'/>
Oct 16 11:09:04 user nova-compute[74683]:     </mode>
Oct 16 11:09:04 user nova-compute[74683]:     <mode name='custom' supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>qemu64</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>qemu32</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>phenom</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>pentium3</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>pentium2</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>pentium</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>n270</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>kvm64</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>kvm32</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>coreduo</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>core2duo</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>athlon</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>Westmere-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>Westmere</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Snowridge</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Skylake-Server</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Skylake-Client</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>SandyBridge</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>Penryn</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Opteron_G5</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Opteron_G4</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Opteron_G3</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Opteron_G2</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>Opteron_G1</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>Nehalem</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>IvyBridge</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Icelake-Server</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Haswell-noTSX</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Haswell-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Haswell</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>EPYC-Rome</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>EPYC-Milan</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>EPYC-IBPB</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>EPYC</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Dhyana</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Cooperlake</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>Conroe</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Cascadelake-Server</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Broadwell-noTSX</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Broadwell-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Broadwell</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>486</model>
Oct 16 11:09:04 user nova-compute[74683]:     </mode>
Oct 16 11:09:04 user nova-compute[74683]:   </cpu>
Oct 16 11:09:04 user nova-compute[74683]:   <memoryBacking supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:     <enum name='sourceType'>
Oct 16 11:09:04 user nova-compute[74683]:       <value>file</value>
Oct 16 11:09:04 user nova-compute[74683]:       <value>anonymous</value>
Oct 16 11:09:04 user nova-compute[74683]:       <value>memfd</value>
Oct 16 11:09:04 user nova-compute[74683]:     </enum>
Oct 16 11:09:04 user nova-compute[74683]:   </memoryBacking>
Oct 16 11:09:04 user nova-compute[74683]:   <devices>
Oct 16 11:09:04 user nova-compute[74683]:     <disk supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='diskDevice'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>disk</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>cdrom</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>floppy</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>lun</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='bus'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>fdc</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>scsi</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtio</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>usb</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>sata</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='model'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtio</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtio-transitional</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtio-non-transitional</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </disk>
Oct 16 11:09:04 user nova-compute[74683]:     <graphics supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='type'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>sdl</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>vnc</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>spice</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>egl-headless</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </graphics>
Oct 16 11:09:04 user nova-compute[74683]:     <video supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='modelType'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>vga</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>cirrus</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>vmvga</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>qxl</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtio</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>none</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>bochs</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>ramfb</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </video>
Oct 16 11:09:04 user nova-compute[74683]:     <hostdev supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='mode'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>subsystem</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='startupPolicy'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>default</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>mandatory</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>requisite</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>optional</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='subsysType'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>usb</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>pci</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>scsi</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='capsType'/>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='pciBackend'/>
Oct 16 11:09:04 user nova-compute[74683]:     </hostdev>
Oct 16 11:09:04 user nova-compute[74683]:     <rng supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='model'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtio</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtio-transitional</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtio-non-transitional</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='backendModel'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>random</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>egd</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>builtin</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </rng>
Oct 16 11:09:04 user nova-compute[74683]:     <filesystem supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='driverType'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>path</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>handle</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtiofs</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </filesystem>
Oct 16 11:09:04 user nova-compute[74683]:     <tpm supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='model'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>tpm-tis</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>tpm-crb</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='backendModel'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>passthrough</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>emulator</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </tpm>
Oct 16 11:09:04 user nova-compute[74683]:   </devices>
Oct 16 11:09:04 user nova-compute[74683]:   <features>
Oct 16 11:09:04 user nova-compute[74683]:     <gic supported='no'/>
Oct 16 11:09:04 user nova-compute[74683]:     <vmcoreinfo supported='yes'/>
Oct 16 11:09:04 user nova-compute[74683]:     <genid supported='yes'/>
Oct 16 11:09:04 user nova-compute[74683]:     <backingStoreInput supported='yes'/>
Oct 16 11:09:04 user nova-compute[74683]:     <backup supported='yes'/>
Oct 16 11:09:04 user nova-compute[74683]:     <sev supported='no'/>
Oct 16 11:09:04 user nova-compute[74683]:   </features>
Oct 16 11:09:04 user nova-compute[74683]: </domainCapabilities>
Oct 16 11:09:04 user nova-compute[74683]:  {{(pid=74683) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Oct 16 11:09:04 user nova-compute[74683]: <domainCapabilities>
Oct 16 11:09:04 user nova-compute[74683]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 16 11:09:04 user nova-compute[74683]:   <domain>kvm</domain>
Oct 16 11:09:04 user nova-compute[74683]:   <machine>pc-q35-jammy</machine>
Oct 16 11:09:04 user nova-compute[74683]:   <arch>x86_64</arch>
Oct 16 11:09:04 user nova-compute[74683]:   <vcpu max='288'/>
Oct 16 11:09:04 user nova-compute[74683]:   <iothreads supported='yes'/>
Oct 16 11:09:04 user nova-compute[74683]:   <os supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:     <enum name='firmware'>
Oct 16 11:09:04 user nova-compute[74683]:       <value>efi</value>
Oct 16 11:09:04 user nova-compute[74683]:     </enum>
Oct 16 11:09:04 user nova-compute[74683]:     <loader supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 16 11:09:04 user nova-compute[74683]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 16 11:09:04 user nova-compute[74683]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='type'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>rom</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>pflash</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='readonly'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>yes</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>no</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='secure'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>yes</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>no</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </loader>
Oct 16 11:09:04 user nova-compute[74683]:   </os>
Oct 16 11:09:04 user nova-compute[74683]:   <cpu>
Oct 16 11:09:04 user nova-compute[74683]:     <mode name='host-passthrough' supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='hostPassthroughMigratable'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>on</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>off</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </mode>
Oct 16 11:09:04 user nova-compute[74683]:     <mode name='maximum' supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='maximumMigratable'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>on</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>off</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </mode>
Oct 16 11:09:04 user nova-compute[74683]:     <mode name='host-model' supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <vendor>Intel</vendor>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='ss'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='vmx'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='pcid'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='hypervisor'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='arat'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='tsc_adjust'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='umip'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='md-clear'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='stibp'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='arch-capabilities'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='ssbd'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='invtsc'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='ibpb'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='ibrs'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='amd-stibp'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='amd-ssbd'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='rsba'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='require' name='pschange-mc-no'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='disable' name='erms'/>
Oct 16 11:09:04 user nova-compute[74683]:       <feature policy='disable' name='xsaveopt'/>
Oct 16 11:09:04 user nova-compute[74683]:     </mode>
Oct 16 11:09:04 user nova-compute[74683]:     <mode name='custom' supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>qemu64</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>qemu32</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>phenom</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>pentium3</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>pentium2</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>pentium</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>n270</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>kvm64</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>kvm32</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>coreduo</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>core2duo</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>athlon</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>Westmere-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>Westmere</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Snowridge</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Skylake-Server</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Skylake-Client</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>SandyBridge</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>Penryn</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Opteron_G5</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Opteron_G4</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Opteron_G3</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Opteron_G2</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>Opteron_G1</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>Nehalem</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>IvyBridge</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Icelake-Server</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Haswell-noTSX</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Haswell-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Haswell</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>EPYC-Rome</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>EPYC-Milan</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>EPYC-IBPB</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>EPYC</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Dhyana</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Cooperlake</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>Conroe</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Cascadelake-Server</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Broadwell-noTSX</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Broadwell-IBRS</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='no'>Broadwell</model>
Oct 16 11:09:04 user nova-compute[74683]:       <model usable='yes'>486</model>
Oct 16 11:09:04 user nova-compute[74683]:     </mode>
Oct 16 11:09:04 user nova-compute[74683]:   </cpu>
Oct 16 11:09:04 user nova-compute[74683]:   <memoryBacking supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:     <enum name='sourceType'>
Oct 16 11:09:04 user nova-compute[74683]:       <value>file</value>
Oct 16 11:09:04 user nova-compute[74683]:       <value>anonymous</value>
Oct 16 11:09:04 user nova-compute[74683]:       <value>memfd</value>
Oct 16 11:09:04 user nova-compute[74683]:     </enum>
Oct 16 11:09:04 user nova-compute[74683]:   </memoryBacking>
Oct 16 11:09:04 user nova-compute[74683]:   <devices>
Oct 16 11:09:04 user nova-compute[74683]:     <disk supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='diskDevice'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>disk</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>cdrom</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>floppy</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>lun</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='bus'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>fdc</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>scsi</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtio</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>usb</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>sata</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='model'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtio</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtio-transitional</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtio-non-transitional</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </disk>
Oct 16 11:09:04 user nova-compute[74683]:     <graphics supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='type'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>sdl</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>vnc</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>spice</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>egl-headless</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </graphics>
Oct 16 11:09:04 user nova-compute[74683]:     <video supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='modelType'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>vga</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>cirrus</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>vmvga</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>qxl</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtio</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>none</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>bochs</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>ramfb</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </video>
Oct 16 11:09:04 user nova-compute[74683]:     <hostdev supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='mode'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>subsystem</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='startupPolicy'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>default</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>mandatory</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>requisite</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>optional</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='subsysType'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>usb</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>pci</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>scsi</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='capsType'/>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='pciBackend'/>
Oct 16 11:09:04 user nova-compute[74683]:     </hostdev>
Oct 16 11:09:04 user nova-compute[74683]:     <rng supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='model'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtio</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtio-transitional</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtio-non-transitional</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='backendModel'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>random</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>egd</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>builtin</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </rng>
Oct 16 11:09:04 user nova-compute[74683]:     <filesystem supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='driverType'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>path</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>handle</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>virtiofs</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </filesystem>
Oct 16 11:09:04 user nova-compute[74683]:     <tpm supported='yes'>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='model'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>tpm-tis</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>tpm-crb</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:       <enum name='backendModel'>
Oct 16 11:09:04 user nova-compute[74683]:         <value>passthrough</value>
Oct 16 11:09:04 user nova-compute[74683]:         <value>emulator</value>
Oct 16 11:09:04 user nova-compute[74683]:       </enum>
Oct 16 11:09:04 user nova-compute[74683]:     </tpm>
Oct 16 11:09:04 user nova-compute[74683]:   </devices>
Oct 16 11:09:04 user nova-compute[74683]:   <features>
Oct 16 11:09:04 user nova-compute[74683]:     <gic supported='no'/>
Oct 16 11:09:04 user nova-compute[74683]:     <vmcoreinfo supported='yes'/>
Oct 16 11:09:04 user nova-compute[74683]:     <genid supported='yes'/>
Oct 16 11:09:04 user nova-compute[74683]:     <backingStoreInput supported='yes'/>
Oct 16 11:09:04 user nova-compute[74683]:     <backup supported='yes'/>
Oct 16 11:09:04 user nova-compute[74683]:     <sev supported='no'/>
Oct 16 11:09:04 user nova-compute[74683]:   </features>
Oct 16 11:09:04 user nova-compute[74683]: </domainCapabilities>
Oct 16 11:09:04 user nova-compute[74683]:  {{(pid=74683) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74683) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74683) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74683) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74683) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Checking secure boot support for host arch (x86_64) {{(pid=74683) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Checking secure boot support for host arch (x86_64) {{(pid=74683) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Checking secure boot support for host arch (x86_64) {{(pid=74683) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Checking secure boot support for host arch (x86_64) {{(pid=74683) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Checking secure boot support for host arch (x86_64) {{(pid=74683) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 16 11:09:04 user nova-compute[74683]: INFO nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Secure Boot support detected
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] cpu compare xml: <cpu match="exact">
Oct 16 11:09:04 user nova-compute[74683]:   <model>Nehalem</model>
Oct 16 11:09:04 user nova-compute[74683]: </cpu>
Oct 16 11:09:04 user nova-compute[74683]:  {{(pid=74683) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Oct 16 11:09:04 user nova-compute[74683]: INFO nova.virt.node [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Generated node identity 7142d606-df50-4cbe-b5ed-1802caa31862
Oct 16 11:09:04 user nova-compute[74683]: INFO nova.virt.node [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Wrote node identity 7142d606-df50-4cbe-b5ed-1802caa31862 to /opt/stack/data/nova/compute_id
Oct 16 11:09:04 user nova-compute[74683]: WARNING nova.compute.manager [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Compute nodes ['7142d606-df50-4cbe-b5ed-1802caa31862'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Oct 16 11:09:04 user nova-compute[74683]: INFO nova.compute.manager [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Oct 16 11:09:04 user nova-compute[74683]: WARNING nova.compute.manager [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 16 11:09:04 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Auditing locally available compute resources for user (node: user) {{(pid=74683) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 11:09:04 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:09:04 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Hypervisor/Node resource view: name=user free_ram=11001MB free_disk=26.203807830810547GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74683) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:09:04 user nova-compute[74683]: WARNING nova.compute.resource_tracker [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] No compute node record for user:7142d606-df50-4cbe-b5ed-1802caa31862: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 7142d606-df50-4cbe-b5ed-1802caa31862 could not be found.
Oct 16 11:09:04 user nova-compute[74683]: INFO nova.compute.resource_tracker [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Compute node record created for user:user with uuid: 7142d606-df50-4cbe-b5ed-1802caa31862
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 11:09:04 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 11:09:05 user nova-compute[74683]: INFO nova.scheduler.client.report [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] [req-ec107160-9666-483c-95e2-87d5ed9580c4] Created resource provider record via placement API for resource provider with UUID 7142d606-df50-4cbe-b5ed-1802caa31862 and name user.
Oct 16 11:09:05 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74683) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Oct 16 11:09:05 user nova-compute[74683]: INFO nova.virt.libvirt.host [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] kernel doesn't support AMD SEV
Oct 16 11:09:05 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Updating inventory in ProviderTree for provider 7142d606-df50-4cbe-b5ed-1802caa31862 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 16 11:09:05 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:09:05 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Libvirt baseline CPU <cpu>
Oct 16 11:09:05 user nova-compute[74683]:   <arch>x86_64</arch>
Oct 16 11:09:05 user nova-compute[74683]:   <model>Nehalem</model>
Oct 16 11:09:05 user nova-compute[74683]:   <vendor>Intel</vendor>
Oct 16 11:09:05 user nova-compute[74683]:   <topology sockets="6" cores="1" threads="1"/>
Oct 16 11:09:05 user nova-compute[74683]: </cpu>
Oct 16 11:09:05 user nova-compute[74683]:  {{(pid=74683) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Oct 16 11:09:05 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Updated inventory for provider 7142d606-df50-4cbe-b5ed-1802caa31862 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Oct 16 11:09:05 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Updating resource provider 7142d606-df50-4cbe-b5ed-1802caa31862 generation from 0 to 1 during operation: update_inventory {{(pid=74683) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 16 11:09:05 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Updating inventory in ProviderTree for provider 7142d606-df50-4cbe-b5ed-1802caa31862 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 16 11:09:05 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Updating resource provider 7142d606-df50-4cbe-b5ed-1802caa31862 generation from 1 to 2 during operation: update_traits {{(pid=74683) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 16 11:09:05 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Compute_service record updated for user:user {{(pid=74683) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 11:09:05 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.633s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:09:05 user nova-compute[74683]: DEBUG nova.service [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Creating RPC server for service compute {{(pid=74683) start /opt/stack/nova/nova/service.py:182}}
Oct 16 11:09:05 user nova-compute[74683]: DEBUG nova.service [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] Join ServiceGroup membership for this service compute {{(pid=74683) start /opt/stack/nova/nova/service.py:199}}
Oct 16 11:09:05 user nova-compute[74683]: DEBUG nova.servicegroup.drivers.db [None req-ba06b62d-f455-4d4b-a4fe-cd9e5d9751cf None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74683) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Oct 16 11:09:46 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._sync_power_states {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:09:46 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:09:55 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:09:55 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:09:55 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Starting heal instance info cache {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 11:09:55 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Rebuilding the list of instances to heal {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 11:09:55 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Didn't find any instances for network info cache update. {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 16 11:09:55 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:09:55 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:09:55 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:09:55 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:09:55 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:09:55 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:09:55 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74683) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 11:09:55 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:09:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:09:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:09:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:09:55 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Auditing locally available compute resources for user (node: user) {{(pid=74683) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 11:09:56 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:09:56 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:09:56 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Hypervisor/Node resource view: name=user free_ram=10463MB free_disk=26.107582092285156GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74683) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 11:09:56 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:09:56 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:09:56 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 11:09:56 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 11:09:56 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:09:56 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:09:56 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Compute_service record updated for user:user {{(pid=74683) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 11:09:56 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.185s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:10:56 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:10:56 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:10:56 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:10:56 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:10:56 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:10:56 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Starting heal instance info cache {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 11:10:56 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Rebuilding the list of instances to heal {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 11:10:56 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Didn't find any instances for network info cache update. {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 16 11:10:56 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:10:56 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:10:56 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:10:56 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74683) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 11:10:57 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:10:57 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:10:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:10:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:10:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:10:57 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Auditing locally available compute resources for user (node: user) {{(pid=74683) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 11:10:57 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:10:57 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:10:57 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Hypervisor/Node resource view: name=user free_ram=10378MB free_disk=26.171405792236328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74683) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 11:10:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:10:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:10:58 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 11:10:58 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 11:10:58 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:10:58 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:10:58 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Compute_service record updated for user:user {{(pid=74683) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 11:10:58 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.108s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:11:57 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:11:57 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:11:57 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Starting heal instance info cache {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 11:11:57 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Rebuilding the list of instances to heal {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 11:11:57 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Didn't find any instances for network info cache update. {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 16 11:11:57 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:11:57 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:11:57 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:11:57 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74683) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 11:11:57 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:11:57 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:11:57 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:11:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:11:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:11:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:11:57 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Auditing locally available compute resources for user (node: user) {{(pid=74683) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 11:11:57 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:11:57 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:11:57 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Hypervisor/Node resource view: name=user free_ram=10407MB free_disk=25.925216674804688GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74683) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 11:11:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:11:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:11:58 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 11:11:58 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 11:11:58 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:11:58 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:11:58 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Compute_service record updated for user:user {{(pid=74683) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 11:11:58 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.129s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:11:59 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:12:56 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:12:56 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:12:57 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:12:57 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:12:57 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Starting heal instance info cache {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 11:12:57 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Rebuilding the list of instances to heal {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 11:12:57 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Didn't find any instances for network info cache update. {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 16 11:12:57 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:12:57 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:12:57 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74683) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 11:12:58 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:12:58 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:12:59 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:12:59 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:12:59 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:12:59 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:12:59 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Auditing locally available compute resources for user (node: user) {{(pid=74683) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 11:13:00 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:13:00 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:13:00 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Hypervisor/Node resource view: name=user free_ram=9655MB free_disk=25.944881439208984GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74683) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 11:13:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:13:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:13:00 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 11:13:00 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 11:13:00 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:13:00 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:13:00 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Compute_service record updated for user:user {{(pid=74683) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 11:13:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.164s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:13:01 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:13:01 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Acquiring lock "427b793c-ae47-451c-bbc5-589d6ce1d2bf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:13:01 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Lock "427b793c-ae47-451c-bbc5-589d6ce1d2bf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:13:01 user nova-compute[74683]: DEBUG nova.compute.manager [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Starting instance... {{(pid=74683) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 11:13:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:13:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:13:02 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74683) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 11:13:02 user nova-compute[74683]: INFO nova.compute.claims [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Claim successful on node user
Oct 16 11:13:02 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:13:02 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:13:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.463s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:13:02 user nova-compute[74683]: DEBUG nova.compute.manager [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Start building networks asynchronously for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 11:13:02 user nova-compute[74683]: DEBUG nova.compute.manager [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Allocating IP information in the background. {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 11:13:02 user nova-compute[74683]: DEBUG nova.network.neutron [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] allocate_for_instance() {{(pid=74683) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 11:13:02 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 11:13:02 user nova-compute[74683]: DEBUG nova.compute.manager [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Start building block device mappings for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 11:13:02 user nova-compute[74683]: DEBUG nova.compute.manager [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Start spawning the instance on the hypervisor. {{(pid=74683) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 11:13:02 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Creating instance directory {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 11:13:02 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Creating image(s)
Oct 16 11:13:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Acquiring lock "/opt/stack/data/nova/instances/427b793c-ae47-451c-bbc5-589d6ce1d2bf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:13:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Lock "/opt/stack/data/nova/instances/427b793c-ae47-451c-bbc5-589d6ce1d2bf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:13:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Lock "/opt/stack/data/nova/instances/427b793c-ae47-451c-bbc5-589d6ce1d2bf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.013s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:13:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Acquiring lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:13:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:13:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66.part --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:13:04 user nova-compute[74683]: DEBUG nova.policy [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4fbd806ac68b4b76982426e5f68452a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99f352b52b94e32808b154ede6c1eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74683) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 11:13:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66.part --force-share --output=json" returned: 0 in 0.172s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:13:04 user nova-compute[74683]: DEBUG nova.virt.images [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] 0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f was qcow2, converting to raw {{(pid=74683) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 16 11:13:04 user nova-compute[74683]: DEBUG nova.privsep.utils [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74683) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 11:13:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66.part /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66.converted {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:13:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66.part /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66.converted" returned: 0 in 0.190s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:13:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66.converted --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:13:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66.converted --force-share --output=json" returned: 0 in 0.218s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:13:04 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.591s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:13:04 user nova-compute[74683]: INFO oslo.privsep.daemon [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp228ba_fc/privsep.sock']
Oct 16 11:13:04 user sudo[83896]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp228ba_fc/privsep.sock
Oct 16 11:13:04 user sudo[83896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 16 11:13:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Acquiring lock "18a77385-fab9-4ea0-8aa6-666cf7e798a6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:13:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "18a77385-fab9-4ea0-8aa6-666cf7e798a6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:13:06 user sudo[83896]: pam_unix(sudo:session): session closed for user root
Oct 16 11:13:06 user nova-compute[74683]: INFO oslo.privsep.daemon [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Spawned new privsep daemon via rootwrap
Oct 16 11:13:06 user nova-compute[74683]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 16 11:13:06 user nova-compute[74683]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 16 11:13:06 user nova-compute[74683]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Oct 16 11:13:06 user nova-compute[74683]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83906
Oct 16 11:13:06 user nova-compute[74683]: DEBUG nova.compute.manager [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Starting instance... {{(pid=74683) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 11:13:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:13:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:13:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:13:06 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74683) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 11:13:06 user nova-compute[74683]: INFO nova.compute.claims [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Claim successful on node user
Oct 16 11:13:06 user nova-compute[74683]: DEBUG nova.network.neutron [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Successfully created port: d46f88ce-60a8-4ce5-989a-6d7b9eb90d28 {{(pid=74683) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 11:13:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.216s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:13:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Acquiring lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:13:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:13:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:13:06 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:13:06 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:13:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.191s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:13:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/427b793c-ae47-451c-bbc5-589d6ce1d2bf/disk 1073741824 {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:13:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.398s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:13:06 user nova-compute[74683]: DEBUG nova.compute.manager [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Start building networks asynchronously for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 11:13:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/427b793c-ae47-451c-bbc5-589d6ce1d2bf/disk 1073741824" returned: 0 in 0.042s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:13:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:13:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:13:07 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.153s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:13:07 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Checking if we can resize image /opt/stack/data/nova/instances/427b793c-ae47-451c-bbc5-589d6ce1d2bf/disk. size=1073741824 {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 11:13:07 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/427b793c-ae47-451c-bbc5-589d6ce1d2bf/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:13:07 user nova-compute[74683]: DEBUG nova.compute.manager [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Allocating IP information in the background. {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 11:13:07 user nova-compute[74683]: DEBUG nova.network.neutron [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] allocate_for_instance() {{(pid=74683) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 11:13:07 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 11:13:07 user nova-compute[74683]: DEBUG nova.compute.manager [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Start building block device mappings for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 11:13:07 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/427b793c-ae47-451c-bbc5-589d6ce1d2bf/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:13:07 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Cannot resize image /opt/stack/data/nova/instances/427b793c-ae47-451c-bbc5-589d6ce1d2bf/disk to a smaller size. {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 11:13:07 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Created local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 11:13:07 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Ensure instance console log exists: /opt/stack/data/nova/instances/427b793c-ae47-451c-bbc5-589d6ce1d2bf/console.log {{(pid=74683) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 11:13:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:13:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:13:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:13:07 user nova-compute[74683]: DEBUG nova.policy [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '76a41804541e4a259771702727d9993e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6e0046017b4bba85caf2a39d1c67b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74683) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 11:13:07 user nova-compute[74683]: DEBUG nova.compute.manager [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Start spawning the instance on the hypervisor. {{(pid=74683) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 11:13:07 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Creating instance directory {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 11:13:07 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Creating image(s)
Oct 16 11:13:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Acquiring lock "/opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:13:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "/opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:13:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "/opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:13:07 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:13:07 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.202s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:13:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Acquiring lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:13:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:13:07 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:13:07 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.162s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:13:07 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk 1073741824 {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:13:07 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk 1073741824" returned: 0 in 0.042s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:13:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.211s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:13:07 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:13:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.239s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:13:08 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Checking if we can resize image /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk. size=1073741824 {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 11:13:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:13:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:13:08 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Cannot resize image /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk to a smaller size. {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 11:13:08 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Created local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 11:13:08 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Ensure instance console log exists: /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/console.log {{(pid=74683) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 11:13:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:13:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:13:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:13:09 user nova-compute[74683]: DEBUG nova.network.neutron [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Successfully created port: fab663e7-134f-4cde-8cf1-2ccb1c83a812 {{(pid=74683) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 11:13:09 user nova-compute[74683]: DEBUG nova.network.neutron [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Successfully updated port: d46f88ce-60a8-4ce5-989a-6d7b9eb90d28 {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:13:10 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Acquiring lock "refresh_cache-427b793c-ae47-451c-bbc5-589d6ce1d2bf" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:13:10 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Acquired lock "refresh_cache-427b793c-ae47-451c-bbc5-589d6ce1d2bf" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:13:10 user nova-compute[74683]: DEBUG nova.network.neutron [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:13:10 user nova-compute[74683]: DEBUG nova.network.neutron [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:13:10 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Acquiring lock "bd60be9c-0ff3-40a5-aaab-f31fa88a67f1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:13:10 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "bd60be9c-0ff3-40a5-aaab-f31fa88a67f1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:13:10 user nova-compute[74683]: DEBUG nova.compute.manager [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Starting instance... {{(pid=74683) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 11:13:10 user nova-compute[74683]: DEBUG nova.compute.manager [req-0cd7d58c-57df-47ef-a15f-bcf00f520768 req-8850d724-fdb9-41fc-9ada-2f24abc86206 service nova] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Received event network-changed-d46f88ce-60a8-4ce5-989a-6d7b9eb90d28 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:13:10 user nova-compute[74683]: DEBUG nova.compute.manager [req-0cd7d58c-57df-47ef-a15f-bcf00f520768 req-8850d724-fdb9-41fc-9ada-2f24abc86206 service nova] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Refreshing instance network info cache due to event network-changed-d46f88ce-60a8-4ce5-989a-6d7b9eb90d28. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:13:10 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-0cd7d58c-57df-47ef-a15f-bcf00f520768 req-8850d724-fdb9-41fc-9ada-2f24abc86206 service nova] Acquiring lock "refresh_cache-427b793c-ae47-451c-bbc5-589d6ce1d2bf" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:13:10 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:13:10 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:13:10 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74683) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 11:13:10 user nova-compute[74683]: INFO nova.compute.claims [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Claim successful on node user
Oct 16 11:13:10 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:13:10 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:13:10 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.260s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:13:10 user nova-compute[74683]: DEBUG nova.compute.manager [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Start building networks asynchronously for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 11:13:10 user nova-compute[74683]: DEBUG nova.compute.manager [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Allocating IP information in the background. {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 11:13:10 user nova-compute[74683]: DEBUG nova.network.neutron [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] allocate_for_instance() {{(pid=74683) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 11:13:10 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 11:13:10 user nova-compute[74683]: DEBUG nova.compute.manager [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Start building block device mappings for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 11:13:11 user nova-compute[74683]: DEBUG nova.compute.manager [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Start spawning the instance on the hypervisor. {{(pid=74683) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 11:13:11 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Creating instance directory {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 11:13:11 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Creating image(s)
Oct 16 11:13:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Acquiring lock "/opt/stack/data/nova/instances/bd60be9c-0ff3-40a5-aaab-f31fa88a67f1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:13:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "/opt/stack/data/nova/instances/bd60be9c-0ff3-40a5-aaab-f31fa88a67f1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:13:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "/opt/stack/data/nova/instances/bd60be9c-0ff3-40a5-aaab-f31fa88a67f1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:13:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:13:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.158s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:13:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Acquiring lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:13:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:13:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:13:11 user nova-compute[74683]: DEBUG nova.policy [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cdc203c025d84efe86e25cfdf75107b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c66aa774134aa6a873eabffc28ec07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74683) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 11:13:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.174s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:13:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/bd60be9c-0ff3-40a5-aaab-f31fa88a67f1/disk 1073741824 {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:13:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/bd60be9c-0ff3-40a5-aaab-f31fa88a67f1/disk 1073741824" returned: 0 in 0.097s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:13:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:13:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:13:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.178s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:13:11 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bd60be9c-0ff3-40a5-aaab-f31fa88a67f1/disk. size=1073741824 {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 11:13:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd60be9c-0ff3-40a5-aaab-f31fa88a67f1/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:13:11 user nova-compute[74683]: DEBUG nova.network.neutron [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Successfully updated port: fab663e7-134f-4cde-8cf1-2ccb1c83a812 {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:13:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Acquiring lock "refresh_cache-18a77385-fab9-4ea0-8aa6-666cf7e798a6" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:13:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Acquired lock "refresh_cache-18a77385-fab9-4ea0-8aa6-666cf7e798a6" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:13:11 user nova-compute[74683]: DEBUG nova.network.neutron [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:13:11 user nova-compute[74683]: DEBUG nova.network.neutron [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Updating instance_info_cache with network_info: [{"id": "d46f88ce-60a8-4ce5-989a-6d7b9eb90d28", "address": "fa:16:3e:a1:28:21", "network": {"id": "f5b8ede2-9ce3-4748-b782-dd18a611cc53", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2023834343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f99f352b52b94e32808b154ede6c1eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd46f88ce-60", "ovs_interfaceid": "d46f88ce-60a8-4ce5-989a-6d7b9eb90d28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:13:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Releasing lock "refresh_cache-427b793c-ae47-451c-bbc5-589d6ce1d2bf" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:13:11 user nova-compute[74683]: DEBUG nova.compute.manager [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Instance network_info: |[{"id": "d46f88ce-60a8-4ce5-989a-6d7b9eb90d28", "address": "fa:16:3e:a1:28:21", "network": {"id": "f5b8ede2-9ce3-4748-b782-dd18a611cc53", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2023834343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f99f352b52b94e32808b154ede6c1eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd46f88ce-60", "ovs_interfaceid": "d46f88ce-60a8-4ce5-989a-6d7b9eb90d28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 11:13:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-0cd7d58c-57df-47ef-a15f-bcf00f520768 req-8850d724-fdb9-41fc-9ada-2f24abc86206 service nova] Acquired lock "refresh_cache-427b793c-ae47-451c-bbc5-589d6ce1d2bf" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:13:11 user nova-compute[74683]: DEBUG nova.network.neutron [req-0cd7d58c-57df-47ef-a15f-bcf00f520768 req-8850d724-fdb9-41fc-9ada-2f24abc86206 service nova] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Refreshing network info cache for port d46f88ce-60a8-4ce5-989a-6d7b9eb90d28 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:13:11 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Start _get_guest_xml network_info=[{"id": "d46f88ce-60a8-4ce5-989a-6d7b9eb90d28", "address": "fa:16:3e:a1:28:21", "network": {"id": "f5b8ede2-9ce3-4748-b782-dd18a611cc53", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2023834343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f99f352b52b94e32808b154ede6c1eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd46f88ce-60", "ovs_interfaceid": "d46f88ce-60a8-4ce5-989a-6d7b9eb90d28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:13:11 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:13:11 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:13:11 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:13:11 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:13:11 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:13:11 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:13:11 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:13:11 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:13:11 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:13:11 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:13:11 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:13:11 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:13:11 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:13:11 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:13:11 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:13:11 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:13:11 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:13:11 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:13:11 user nova-compute[74683]: DEBUG nova.privsep.utils [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74683) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 11:13:11 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:13:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-943938581',display_name='tempest-DeleteServersTestJSON-server-943938581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-943938581',id=1,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f99f352b52b94e32808b154ede6c1eac',ramdisk_id='',reservation_id='r-ewr0m06v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-2005547870',owner_user_name='tempest-DeleteServersTestJSON-2005547870-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:13:03Z,user_data=None,user_id='4fbd806ac68b4b76982426e5f68452a3',uuid=427b793c-ae47-451c-bbc5-589d6ce1d2bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d46f88ce-60a8-4ce5-989a-6d7b9eb90d28", "address": "fa:16:3e:a1:28:21", "network": {"id": "f5b8ede2-9ce3-4748-b782-dd18a611cc53", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2023834343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f99f352b52b94e32808b154ede6c1eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd46f88ce-60", "ovs_interfaceid": "d46f88ce-60a8-4ce5-989a-6d7b9eb90d28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:13:11 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Converting VIF {"id": "d46f88ce-60a8-4ce5-989a-6d7b9eb90d28", "address": "fa:16:3e:a1:28:21", "network": {"id": "f5b8ede2-9ce3-4748-b782-dd18a611cc53", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2023834343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f99f352b52b94e32808b154ede6c1eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd46f88ce-60", "ovs_interfaceid": "d46f88ce-60a8-4ce5-989a-6d7b9eb90d28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:13:11 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:28:21,bridge_name='br-int',has_traffic_filtering=True,id=d46f88ce-60a8-4ce5-989a-6d7b9eb90d28,network=Network(f5b8ede2-9ce3-4748-b782-dd18a611cc53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd46f88ce-60') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:13:11 user nova-compute[74683]: DEBUG nova.objects.instance [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Lazy-loading 'pci_devices' on Instance uuid 427b793c-ae47-451c-bbc5-589d6ce1d2bf {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:13:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd60be9c-0ff3-40a5-aaab-f31fa88a67f1/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:13:11 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Cannot resize image /opt/stack/data/nova/instances/bd60be9c-0ff3-40a5-aaab-f31fa88a67f1/disk to a smaller size. {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 11:13:11 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Created local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 11:13:11 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Ensure instance console log exists: /opt/stack/data/nova/instances/bd60be9c-0ff3-40a5-aaab-f31fa88a67f1/console.log {{(pid=74683) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 11:13:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:13:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:13:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:13:11 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:13:11 user nova-compute[74683]:   <uuid>427b793c-ae47-451c-bbc5-589d6ce1d2bf</uuid>
Oct 16 11:13:11 user nova-compute[74683]:   <name>instance-00000001</name>
Oct 16 11:13:11 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:13:11 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:13:11 user nova-compute[74683]:   <metadata>
Oct 16 11:13:11 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:13:11 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:13:11 user nova-compute[74683]:       <nova:name>tempest-DeleteServersTestJSON-server-943938581</nova:name>
Oct 16 11:13:11 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:13:11</nova:creationTime>
Oct 16 11:13:11 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:13:11 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:13:11 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:13:11 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:13:11 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:13:11 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:13:11 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:13:11 user nova-compute[74683]:       <nova:owner>
Oct 16 11:13:11 user nova-compute[74683]:         <nova:user uuid="4fbd806ac68b4b76982426e5f68452a3">tempest-DeleteServersTestJSON-2005547870-project-member</nova:user>
Oct 16 11:13:11 user nova-compute[74683]:         <nova:project uuid="f99f352b52b94e32808b154ede6c1eac">tempest-DeleteServersTestJSON-2005547870</nova:project>
Oct 16 11:13:11 user nova-compute[74683]:       </nova:owner>
Oct 16 11:13:11 user nova-compute[74683]:       <nova:root type="image" uuid="0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f"/>
Oct 16 11:13:11 user nova-compute[74683]:       <nova:ports>
Oct 16 11:13:11 user nova-compute[74683]:         <nova:port uuid="d46f88ce-60a8-4ce5-989a-6d7b9eb90d28">
Oct 16 11:13:11 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 16 11:13:11 user nova-compute[74683]:         </nova:port>
Oct 16 11:13:11 user nova-compute[74683]:       </nova:ports>
Oct 16 11:13:11 user nova-compute[74683]:     </nova:instance>
Oct 16 11:13:11 user nova-compute[74683]:   </metadata>
Oct 16 11:13:11 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:13:11 user nova-compute[74683]:     <system>
Oct 16 11:13:11 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:13:11 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:13:11 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:13:11 user nova-compute[74683]:       <entry name="serial">427b793c-ae47-451c-bbc5-589d6ce1d2bf</entry>
Oct 16 11:13:11 user nova-compute[74683]:       <entry name="uuid">427b793c-ae47-451c-bbc5-589d6ce1d2bf</entry>
Oct 16 11:13:11 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:13:11 user nova-compute[74683]:     </system>
Oct 16 11:13:11 user nova-compute[74683]:   </sysinfo>
Oct 16 11:13:11 user nova-compute[74683]:   <os>
Oct 16 11:13:11 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:13:11 user nova-compute[74683]:     <boot dev="hd"/>
Oct 16 11:13:11 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:13:11 user nova-compute[74683]:   </os>
Oct 16 11:13:11 user nova-compute[74683]:   <features>
Oct 16 11:13:11 user nova-compute[74683]:     <acpi/>
Oct 16 11:13:11 user nova-compute[74683]:     <apic/>
Oct 16 11:13:11 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:13:11 user nova-compute[74683]:   </features>
Oct 16 11:13:11 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:13:11 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:13:11 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:13:11 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:13:11 user nova-compute[74683]:   </clock>
Oct 16 11:13:11 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:13:11 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:13:11 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:13:11 user nova-compute[74683]:   </cpu>
Oct 16 11:13:11 user nova-compute[74683]:   <devices>
Oct 16 11:13:11 user nova-compute[74683]:     <disk type="file" device="disk">
Oct 16 11:13:11 user nova-compute[74683]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 11:13:11 user nova-compute[74683]:       <source file="/opt/stack/data/nova/instances/427b793c-ae47-451c-bbc5-589d6ce1d2bf/disk"/>
Oct 16 11:13:11 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:13:11 user nova-compute[74683]:     </disk>
Oct 16 11:13:11 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:13:11 user nova-compute[74683]:       <mac address="fa:16:3e:a1:28:21"/>
Oct 16 11:13:11 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:13:11 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:13:11 user nova-compute[74683]:       <target dev="tapd46f88ce-60"/>
Oct 16 11:13:11 user nova-compute[74683]:     </interface>
Oct 16 11:13:11 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:13:11 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/427b793c-ae47-451c-bbc5-589d6ce1d2bf/console.log" append="off"/>
Oct 16 11:13:11 user nova-compute[74683]:     </serial>
Oct 16 11:13:11 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:13:11 user nova-compute[74683]:     <video>
Oct 16 11:13:11 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:13:11 user nova-compute[74683]:     </video>
Oct 16 11:13:11 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:13:11 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:13:11 user nova-compute[74683]:     </rng>
Oct 16 11:13:11 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:13:11 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:13:11 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:13:11 user nova-compute[74683]:     </memballoon>
Oct 16 11:13:11 user nova-compute[74683]:   </devices>
Oct 16 11:13:11 user nova-compute[74683]: </domain>
Oct 16 11:13:11 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:13:11 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:13:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-943938581',display_name='tempest-DeleteServersTestJSON-server-943938581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-943938581',id=1,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f99f352b52b94e32808b154ede6c1eac',ramdisk_id='',reservation_id='r-ewr0m06v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-2005547870',owner_user_name='tempest-DeleteServersTestJSON-2005547870-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:13:03Z,user_data=None,user_id='4fbd806ac68b4b76982426e5f68452a3',uuid=427b793c-ae47-451c-bbc5-589d6ce1d2bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d46f88ce-60a8-4ce5-989a-6d7b9eb90d28", "address": "fa:16:3e:a1:28:21", "network": {"id": "f5b8ede2-9ce3-4748-b782-dd18a611cc53", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2023834343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f99f352b52b94e32808b154ede6c1eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd46f88ce-60", "ovs_interfaceid": "d46f88ce-60a8-4ce5-989a-6d7b9eb90d28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:13:11 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Converting VIF {"id": "d46f88ce-60a8-4ce5-989a-6d7b9eb90d28", "address": "fa:16:3e:a1:28:21", "network": {"id": "f5b8ede2-9ce3-4748-b782-dd18a611cc53", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2023834343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f99f352b52b94e32808b154ede6c1eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd46f88ce-60", "ovs_interfaceid": "d46f88ce-60a8-4ce5-989a-6d7b9eb90d28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:13:11 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:28:21,bridge_name='br-int',has_traffic_filtering=True,id=d46f88ce-60a8-4ce5-989a-6d7b9eb90d28,network=Network(f5b8ede2-9ce3-4748-b782-dd18a611cc53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd46f88ce-60') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:13:11 user nova-compute[74683]: DEBUG os_vif [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:28:21,bridge_name='br-int',has_traffic_filtering=True,id=d46f88ce-60a8-4ce5-989a-6d7b9eb90d28,network=Network(f5b8ede2-9ce3-4748-b782-dd18a611cc53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd46f88ce-60') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:13:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Created schema index Interface.name {{(pid=74683) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 16 11:13:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Created schema index Port.name {{(pid=74683) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 16 11:13:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Created schema index Bridge.name {{(pid=74683) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 16 11:13:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:13:12 user nova-compute[74683]: DEBUG nova.network.neutron [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:13:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] [POLLOUT] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:13:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:13:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:13:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a0bb2308-3449-58d5-8e26-881e094f67ad', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:13:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:13:12 user nova-compute[74683]: INFO oslo.privsep.daemon [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpbxnbhpyf/privsep.sock']
Oct 16 11:13:12 user sudo[83964]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpbxnbhpyf/privsep.sock
Oct 16 11:13:12 user sudo[83964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 16 11:13:12 user nova-compute[74683]: DEBUG nova.compute.manager [req-0e01a8ed-1926-4589-bd0c-4052f92a51b7 req-b0d283d0-9e7a-45cf-a443-58ba465f071a service nova] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Received event network-changed-fab663e7-134f-4cde-8cf1-2ccb1c83a812 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:13:12 user nova-compute[74683]: DEBUG nova.compute.manager [req-0e01a8ed-1926-4589-bd0c-4052f92a51b7 req-b0d283d0-9e7a-45cf-a443-58ba465f071a service nova] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Refreshing instance network info cache due to event network-changed-fab663e7-134f-4cde-8cf1-2ccb1c83a812. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:13:12 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-0e01a8ed-1926-4589-bd0c-4052f92a51b7 req-b0d283d0-9e7a-45cf-a443-58ba465f071a service nova] Acquiring lock "refresh_cache-18a77385-fab9-4ea0-8aa6-666cf7e798a6" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:13:12 user nova-compute[74683]: DEBUG nova.network.neutron [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Updating instance_info_cache with network_info: [{"id": "fab663e7-134f-4cde-8cf1-2ccb1c83a812", "address": "fa:16:3e:8c:d5:b1", "network": {"id": "4d43cc12-d2cd-4552-90a4-884a0ff3dc66", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-825513246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6e0046017b4bba85caf2a39d1c67b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfab663e7-13", "ovs_interfaceid": "fab663e7-134f-4cde-8cf1-2ccb1c83a812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:13:12 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Releasing lock "refresh_cache-18a77385-fab9-4ea0-8aa6-666cf7e798a6" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:13:12 user nova-compute[74683]: DEBUG nova.compute.manager [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Instance network_info: |[{"id": "fab663e7-134f-4cde-8cf1-2ccb1c83a812", "address": "fa:16:3e:8c:d5:b1", "network": {"id": "4d43cc12-d2cd-4552-90a4-884a0ff3dc66", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-825513246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6e0046017b4bba85caf2a39d1c67b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfab663e7-13", "ovs_interfaceid": "fab663e7-134f-4cde-8cf1-2ccb1c83a812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 11:13:12 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-0e01a8ed-1926-4589-bd0c-4052f92a51b7 req-b0d283d0-9e7a-45cf-a443-58ba465f071a service nova] Acquired lock "refresh_cache-18a77385-fab9-4ea0-8aa6-666cf7e798a6" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:13:12 user nova-compute[74683]: DEBUG nova.network.neutron [req-0e01a8ed-1926-4589-bd0c-4052f92a51b7 req-b0d283d0-9e7a-45cf-a443-58ba465f071a service nova] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Refreshing network info cache for port fab663e7-134f-4cde-8cf1-2ccb1c83a812 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:13:12 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Start _get_guest_xml network_info=[{"id": "fab663e7-134f-4cde-8cf1-2ccb1c83a812", "address": "fa:16:3e:8c:d5:b1", "network": {"id": "4d43cc12-d2cd-4552-90a4-884a0ff3dc66", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-825513246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6e0046017b4bba85caf2a39d1c67b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfab663e7-13", "ovs_interfaceid": "fab663e7-134f-4cde-8cf1-2ccb1c83a812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:13:12 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:13:12 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:13:12 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:13:12 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:13:12 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:13:12 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:13:12 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:13:12 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:13:12 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:13:12 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:13:12 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:13:12 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:13:12 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:13:12 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:13:12 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:13:12 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:13:12 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:13:12 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:13:12 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:13:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1157992863',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1157992863',id=2,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d6e0046017b4bba85caf2a39d1c67b3',ramdisk_id='',reservation_id='r-3ht96uco',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1787816377',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:13:07Z,user_data=None,user_id='76a41804541e4a259771702727d9993e',uuid=18a77385-fab9-4ea0-8aa6-666cf7e798a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fab663e7-134f-4cde-8cf1-2ccb1c83a812", "address": "fa:16:3e:8c:d5:b1", "network": {"id": "4d43cc12-d2cd-4552-90a4-884a0ff3dc66", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-825513246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6e0046017b4bba85caf2a39d1c67b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfab663e7-13", "ovs_interfaceid": "fab663e7-134f-4cde-8cf1-2ccb1c83a812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:13:12 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Converting VIF {"id": "fab663e7-134f-4cde-8cf1-2ccb1c83a812", "address": "fa:16:3e:8c:d5:b1", "network": {"id": "4d43cc12-d2cd-4552-90a4-884a0ff3dc66", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-825513246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6e0046017b4bba85caf2a39d1c67b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfab663e7-13", "ovs_interfaceid": "fab663e7-134f-4cde-8cf1-2ccb1c83a812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:13:12 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:d5:b1,bridge_name='br-int',has_traffic_filtering=True,id=fab663e7-134f-4cde-8cf1-2ccb1c83a812,network=Network(4d43cc12-d2cd-4552-90a4-884a0ff3dc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfab663e7-13') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:13:12 user nova-compute[74683]: DEBUG nova.objects.instance [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lazy-loading 'pci_devices' on Instance uuid 18a77385-fab9-4ea0-8aa6-666cf7e798a6 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:13:12 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:13:12 user nova-compute[74683]:   <uuid>18a77385-fab9-4ea0-8aa6-666cf7e798a6</uuid>
Oct 16 11:13:12 user nova-compute[74683]:   <name>instance-00000002</name>
Oct 16 11:13:12 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:13:12 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:13:12 user nova-compute[74683]:   <metadata>
Oct 16 11:13:12 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:13:12 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:13:12 user nova-compute[74683]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1157992863</nova:name>
Oct 16 11:13:12 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:13:12</nova:creationTime>
Oct 16 11:13:12 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:13:12 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:13:12 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:13:12 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:13:12 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:13:12 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:13:12 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:13:12 user nova-compute[74683]:       <nova:owner>
Oct 16 11:13:12 user nova-compute[74683]:         <nova:user uuid="76a41804541e4a259771702727d9993e">tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member</nova:user>
Oct 16 11:13:12 user nova-compute[74683]:         <nova:project uuid="4d6e0046017b4bba85caf2a39d1c67b3">tempest-ServerBootFromVolumeStableRescueTest-1787816377</nova:project>
Oct 16 11:13:12 user nova-compute[74683]:       </nova:owner>
Oct 16 11:13:12 user nova-compute[74683]:       <nova:root type="image" uuid="0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f"/>
Oct 16 11:13:12 user nova-compute[74683]:       <nova:ports>
Oct 16 11:13:12 user nova-compute[74683]:         <nova:port uuid="fab663e7-134f-4cde-8cf1-2ccb1c83a812">
Oct 16 11:13:12 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 16 11:13:12 user nova-compute[74683]:         </nova:port>
Oct 16 11:13:12 user nova-compute[74683]:       </nova:ports>
Oct 16 11:13:12 user nova-compute[74683]:     </nova:instance>
Oct 16 11:13:12 user nova-compute[74683]:   </metadata>
Oct 16 11:13:12 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:13:12 user nova-compute[74683]:     <system>
Oct 16 11:13:12 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:13:12 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:13:12 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:13:12 user nova-compute[74683]:       <entry name="serial">18a77385-fab9-4ea0-8aa6-666cf7e798a6</entry>
Oct 16 11:13:12 user nova-compute[74683]:       <entry name="uuid">18a77385-fab9-4ea0-8aa6-666cf7e798a6</entry>
Oct 16 11:13:12 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:13:12 user nova-compute[74683]:     </system>
Oct 16 11:13:12 user nova-compute[74683]:   </sysinfo>
Oct 16 11:13:12 user nova-compute[74683]:   <os>
Oct 16 11:13:12 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:13:12 user nova-compute[74683]:     <boot dev="hd"/>
Oct 16 11:13:12 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:13:12 user nova-compute[74683]:   </os>
Oct 16 11:13:12 user nova-compute[74683]:   <features>
Oct 16 11:13:12 user nova-compute[74683]:     <acpi/>
Oct 16 11:13:12 user nova-compute[74683]:     <apic/>
Oct 16 11:13:12 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:13:12 user nova-compute[74683]:   </features>
Oct 16 11:13:12 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:13:12 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:13:12 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:13:12 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:13:12 user nova-compute[74683]:   </clock>
Oct 16 11:13:12 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:13:12 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:13:12 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:13:12 user nova-compute[74683]:   </cpu>
Oct 16 11:13:12 user nova-compute[74683]:   <devices>
Oct 16 11:13:12 user nova-compute[74683]:     <disk type="file" device="disk">
Oct 16 11:13:12 user nova-compute[74683]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 11:13:12 user nova-compute[74683]:       <source file="/opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk"/>
Oct 16 11:13:12 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:13:12 user nova-compute[74683]:     </disk>
Oct 16 11:13:12 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:13:12 user nova-compute[74683]:       <mac address="fa:16:3e:8c:d5:b1"/>
Oct 16 11:13:12 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:13:12 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:13:12 user nova-compute[74683]:       <target dev="tapfab663e7-13"/>
Oct 16 11:13:12 user nova-compute[74683]:     </interface>
Oct 16 11:13:12 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:13:12 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/console.log" append="off"/>
Oct 16 11:13:12 user nova-compute[74683]:     </serial>
Oct 16 11:13:12 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:13:12 user nova-compute[74683]:     <video>
Oct 16 11:13:12 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:13:12 user nova-compute[74683]:     </video>
Oct 16 11:13:12 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:13:12 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:13:12 user nova-compute[74683]:     </rng>
Oct 16 11:13:12 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:13:12 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:13:12 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:13:12 user nova-compute[74683]:     </memballoon>
Oct 16 11:13:12 user nova-compute[74683]:   </devices>
Oct 16 11:13:12 user nova-compute[74683]: </domain>
Oct 16 11:13:12 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:13:12 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:13:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1157992863',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1157992863',id=2,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d6e0046017b4bba85caf2a39d1c67b3',ramdisk_id='',reservation_id='r-3ht96uco',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1787816377',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:13:07Z,user_data=None,user_id='76a41804541e4a259771702727d9993e',uuid=18a77385-fab9-4ea0-8aa6-666cf7e798a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fab663e7-134f-4cde-8cf1-2ccb1c83a812", "address": "fa:16:3e:8c:d5:b1", "network": {"id": "4d43cc12-d2cd-4552-90a4-884a0ff3dc66", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-825513246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6e0046017b4bba85caf2a39d1c67b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfab663e7-13", "ovs_interfaceid": "fab663e7-134f-4cde-8cf1-2ccb1c83a812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:13:12 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Converting VIF {"id": "fab663e7-134f-4cde-8cf1-2ccb1c83a812", "address": "fa:16:3e:8c:d5:b1", "network": {"id": "4d43cc12-d2cd-4552-90a4-884a0ff3dc66", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-825513246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6e0046017b4bba85caf2a39d1c67b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfab663e7-13", "ovs_interfaceid": "fab663e7-134f-4cde-8cf1-2ccb1c83a812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:13:12 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:d5:b1,bridge_name='br-int',has_traffic_filtering=True,id=fab663e7-134f-4cde-8cf1-2ccb1c83a812,network=Network(4d43cc12-d2cd-4552-90a4-884a0ff3dc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfab663e7-13') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:13:12 user nova-compute[74683]: DEBUG os_vif [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:d5:b1,bridge_name='br-int',has_traffic_filtering=True,id=fab663e7-134f-4cde-8cf1-2ccb1c83a812,network=Network(4d43cc12-d2cd-4552-90a4-884a0ff3dc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfab663e7-13') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:13:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:13:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:13:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cf1db824-5ec6-5bf5-a336-a60f0cbb6379', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:13:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:13:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Acquiring lock "f192d1ec-311d-4a30-9766-361b27a8dae8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:13:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Lock "f192d1ec-311d-4a30-9766-361b27a8dae8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:13:13 user nova-compute[74683]: DEBUG nova.compute.manager [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Starting instance... {{(pid=74683) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 11:13:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:13:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:13:13 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74683) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 11:13:13 user nova-compute[74683]: INFO nova.compute.claims [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Claim successful on node user
Oct 16 11:13:13 user sudo[83964]: pam_unix(sudo:session): session closed for user root
Oct 16 11:13:13 user nova-compute[74683]: INFO oslo.privsep.daemon [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Spawned new privsep daemon via rootwrap
Oct 16 11:13:13 user nova-compute[74683]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 16 11:13:13 user nova-compute[74683]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 16 11:13:13 user nova-compute[74683]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Oct 16 11:13:13 user nova-compute[74683]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83970
Oct 16 11:13:13 user nova-compute[74683]: WARNING oslo_privsep.priv_context [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] privsep daemon already running
Oct 16 11:13:13 user nova-compute[74683]: DEBUG nova.network.neutron [req-0e01a8ed-1926-4589-bd0c-4052f92a51b7 req-b0d283d0-9e7a-45cf-a443-58ba465f071a service nova] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Updated VIF entry in instance network info cache for port fab663e7-134f-4cde-8cf1-2ccb1c83a812. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:13:13 user nova-compute[74683]: DEBUG nova.network.neutron [req-0e01a8ed-1926-4589-bd0c-4052f92a51b7 req-b0d283d0-9e7a-45cf-a443-58ba465f071a service nova] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Updating instance_info_cache with network_info: [{"id": "fab663e7-134f-4cde-8cf1-2ccb1c83a812", "address": "fa:16:3e:8c:d5:b1", "network": {"id": "4d43cc12-d2cd-4552-90a4-884a0ff3dc66", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-825513246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6e0046017b4bba85caf2a39d1c67b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfab663e7-13", "ovs_interfaceid": "fab663e7-134f-4cde-8cf1-2ccb1c83a812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:13:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-0e01a8ed-1926-4589-bd0c-4052f92a51b7 req-b0d283d0-9e7a-45cf-a443-58ba465f071a service nova] Releasing lock "refresh_cache-18a77385-fab9-4ea0-8aa6-666cf7e798a6" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:13:13 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:13:13 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:13:14 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.613s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:13:14 user nova-compute[74683]: DEBUG nova.compute.manager [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Start building networks asynchronously for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 11:13:14 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:14 user nova-compute[74683]: DEBUG nova.compute.manager [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Allocating IP information in the background. {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 11:13:14 user nova-compute[74683]: DEBUG nova.network.neutron [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] allocate_for_instance() {{(pid=74683) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 11:13:14 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 11:13:14 user nova-compute[74683]: DEBUG nova.compute.manager [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Start building block device mappings for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 11:13:14 user nova-compute[74683]: DEBUG nova.compute.manager [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Start spawning the instance on the hypervisor. {{(pid=74683) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 11:13:14 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Creating instance directory {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 11:13:14 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Creating image(s)
Oct 16 11:13:14 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Acquiring lock "/opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:13:14 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Lock "/opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:13:14 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Lock "/opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:13:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:13:14 user nova-compute[74683]: DEBUG nova.network.neutron [req-0cd7d58c-57df-47ef-a15f-bcf00f520768 req-8850d724-fdb9-41fc-9ada-2f24abc86206 service nova] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Updated VIF entry in instance network info cache for port d46f88ce-60a8-4ce5-989a-6d7b9eb90d28. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:13:14 user nova-compute[74683]: DEBUG nova.network.neutron [req-0cd7d58c-57df-47ef-a15f-bcf00f520768 req-8850d724-fdb9-41fc-9ada-2f24abc86206 service nova] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Updating instance_info_cache with network_info: [{"id": "d46f88ce-60a8-4ce5-989a-6d7b9eb90d28", "address": "fa:16:3e:a1:28:21", "network": {"id": "f5b8ede2-9ce3-4748-b782-dd18a611cc53", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2023834343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f99f352b52b94e32808b154ede6c1eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd46f88ce-60", "ovs_interfaceid": "d46f88ce-60a8-4ce5-989a-6d7b9eb90d28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:13:14 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-0cd7d58c-57df-47ef-a15f-bcf00f520768 req-8850d724-fdb9-41fc-9ada-2f24abc86206 service nova] Releasing lock "refresh_cache-427b793c-ae47-451c-bbc5-589d6ce1d2bf" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:13:14 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:14 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:14 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd46f88ce-60, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:13:14 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd46f88ce-60, col_values=(('qos', UUID('80f52798-75b3-4f0e-8d1b-36751e5aa703')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:13:14 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd46f88ce-60, col_values=(('external_ids', {'iface-id': 'd46f88ce-60a8-4ce5-989a-6d7b9eb90d28', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:28:21', 'vm-uuid': '427b793c-ae47-451c-bbc5-589d6ce1d2bf'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:13:14 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:14 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:13:14 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:14 user nova-compute[74683]: INFO os_vif [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:28:21,bridge_name='br-int',has_traffic_filtering=True,id=d46f88ce-60a8-4ce5-989a-6d7b9eb90d28,network=Network(f5b8ede2-9ce3-4748-b782-dd18a611cc53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd46f88ce-60')
Oct 16 11:13:14 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:14 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfab663e7-13, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:13:14 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfab663e7-13, col_values=(('qos', UUID('ea005057-2c13-40e5-9274-01eca46ad78d')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:13:14 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfab663e7-13, col_values=(('external_ids', {'iface-id': 'fab663e7-134f-4cde-8cf1-2ccb1c83a812', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:d5:b1', 'vm-uuid': '18a77385-fab9-4ea0-8aa6-666cf7e798a6'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:13:14 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:14 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:13:14 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:14 user nova-compute[74683]: INFO os_vif [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:d5:b1,bridge_name='br-int',has_traffic_filtering=True,id=fab663e7-134f-4cde-8cf1-2ccb1c83a812,network=Network(4d43cc12-d2cd-4552-90a4-884a0ff3dc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfab663e7-13')
Oct 16 11:13:14 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Acquiring lock "2f1db5e2-0b25-4d61-9dd3-038811b4eda1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:13:14 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Lock "2f1db5e2-0b25-4d61-9dd3-038811b4eda1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:13:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.214s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:13:14 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Acquiring lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:13:14 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:13:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:13:14 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:13:14 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] No VIF found with MAC fa:16:3e:a1:28:21, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:13:14 user nova-compute[74683]: DEBUG nova.compute.manager [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Starting instance... {{(pid=74683) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 11:13:14 user nova-compute[74683]: DEBUG nova.policy [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0fc0a33378424a9080c747d4f78528a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d7573bebfe47e3989f8eedd90dee6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74683) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 11:13:14 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:13:14 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] No VIF found with MAC fa:16:3e:8c:d5:b1, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:13:14 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:13:14 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:13:14 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74683) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 11:13:14 user nova-compute[74683]: INFO nova.compute.claims [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Claim successful on node user
Oct 16 11:13:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.180s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:13:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/disk 1073741824 {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:13:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/disk 1073741824" returned: 0 in 0.055s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:13:14 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:13:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:13:14 user nova-compute[74683]: DEBUG nova.network.neutron [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Successfully created port: 05cf5b29-bd7b-498d-b3d0-b7de22551793 {{(pid=74683) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 11:13:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.176s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:13:14 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/disk. size=1073741824 {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 11:13:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:13:15 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:13:15 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:13:15 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.416s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:13:15 user nova-compute[74683]: DEBUG nova.compute.manager [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Start building networks asynchronously for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 11:13:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:13:15 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Cannot resize image /opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/disk to a smaller size. {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 11:13:15 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Created local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 11:13:15 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Ensure instance console log exists: /opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/console.log {{(pid=74683) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 11:13:15 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:13:15 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:13:15 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:13:15 user nova-compute[74683]: DEBUG nova.compute.manager [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Allocating IP information in the background. {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 11:13:15 user nova-compute[74683]: DEBUG nova.network.neutron [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] allocate_for_instance() {{(pid=74683) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 11:13:15 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 11:13:15 user nova-compute[74683]: DEBUG nova.compute.manager [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Start building block device mappings for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 11:13:15 user nova-compute[74683]: DEBUG nova.compute.manager [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Start spawning the instance on the hypervisor. {{(pid=74683) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 11:13:15 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Creating instance directory {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 11:13:15 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Creating image(s)
Oct 16 11:13:15 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Acquiring lock "/opt/stack/data/nova/instances/2f1db5e2-0b25-4d61-9dd3-038811b4eda1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:13:15 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Lock "/opt/stack/data/nova/instances/2f1db5e2-0b25-4d61-9dd3-038811b4eda1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:13:15 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Lock "/opt/stack/data/nova/instances/2f1db5e2-0b25-4d61-9dd3-038811b4eda1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:13:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:13:15 user nova-compute[74683]: DEBUG nova.policy [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'da5d2dc55a234fa5a6b09bdc3f489055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207a79fe27c042d8b081272246b98245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74683) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 11:13:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.207s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:13:15 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Acquiring lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:13:15 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:13:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:13:15 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.169s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:13:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/2f1db5e2-0b25-4d61-9dd3-038811b4eda1/disk 1073741824 {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:13:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/2f1db5e2-0b25-4d61-9dd3-038811b4eda1/disk 1073741824" returned: 0 in 0.046s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:13:15 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:13:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:13:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.221s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:13:16 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2f1db5e2-0b25-4d61-9dd3-038811b4eda1/disk. size=1073741824 {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 11:13:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1db5e2-0b25-4d61-9dd3-038811b4eda1/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:13:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1db5e2-0b25-4d61-9dd3-038811b4eda1/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:13:16 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Cannot resize image /opt/stack/data/nova/instances/2f1db5e2-0b25-4d61-9dd3-038811b4eda1/disk to a smaller size. {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 11:13:16 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Created local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 11:13:16 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Ensure instance console log exists: /opt/stack/data/nova/instances/2f1db5e2-0b25-4d61-9dd3-038811b4eda1/console.log {{(pid=74683) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 11:13:16 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:13:16 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:13:16 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:13:16 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:16 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:16 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:17 user nova-compute[74683]: DEBUG nova.network.neutron [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Successfully updated port: 05cf5b29-bd7b-498d-b3d0-b7de22551793 {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:13:17 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Acquiring lock "refresh_cache-bd60be9c-0ff3-40a5-aaab-f31fa88a67f1" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:13:17 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Acquired lock "refresh_cache-bd60be9c-0ff3-40a5-aaab-f31fa88a67f1" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:13:17 user nova-compute[74683]: DEBUG nova.network.neutron [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:13:17 user nova-compute[74683]: DEBUG nova.compute.manager [req-6a95faaa-c261-42e7-b5ef-81f269c96626 req-67a88258-1851-4d93-bdab-cecd4e983db4 service nova] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Received event network-changed-05cf5b29-bd7b-498d-b3d0-b7de22551793 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:13:17 user nova-compute[74683]: DEBUG nova.compute.manager [req-6a95faaa-c261-42e7-b5ef-81f269c96626 req-67a88258-1851-4d93-bdab-cecd4e983db4 service nova] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Refreshing instance network info cache due to event network-changed-05cf5b29-bd7b-498d-b3d0-b7de22551793. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:13:17 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-6a95faaa-c261-42e7-b5ef-81f269c96626 req-67a88258-1851-4d93-bdab-cecd4e983db4 service nova] Acquiring lock "refresh_cache-bd60be9c-0ff3-40a5-aaab-f31fa88a67f1" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:13:17 user nova-compute[74683]: DEBUG nova.network.neutron [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Successfully created port: 9476563e-0758-43d9-b920-87f412881869 {{(pid=74683) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 11:13:17 user nova-compute[74683]: DEBUG nova.network.neutron [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:13:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:18 user nova-compute[74683]: DEBUG nova.network.neutron [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Successfully created port: dbbeadad-745e-4d28-a242-577b3197b079 {{(pid=74683) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 11:13:18 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:18 user nova-compute[74683]: DEBUG nova.network.neutron [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Updating instance_info_cache with network_info: [{"id": "05cf5b29-bd7b-498d-b3d0-b7de22551793", "address": "fa:16:3e:dd:07:47", "network": {"id": "f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-137528169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c66aa774134aa6a873eabffc28ec07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05cf5b29-bd", "ovs_interfaceid": "05cf5b29-bd7b-498d-b3d0-b7de22551793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:13:18 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Releasing lock "refresh_cache-bd60be9c-0ff3-40a5-aaab-f31fa88a67f1" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:13:18 user nova-compute[74683]: DEBUG nova.compute.manager [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Instance network_info: |[{"id": "05cf5b29-bd7b-498d-b3d0-b7de22551793", "address": "fa:16:3e:dd:07:47", "network": {"id": "f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-137528169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c66aa774134aa6a873eabffc28ec07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05cf5b29-bd", "ovs_interfaceid": "05cf5b29-bd7b-498d-b3d0-b7de22551793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 11:13:18 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-6a95faaa-c261-42e7-b5ef-81f269c96626 req-67a88258-1851-4d93-bdab-cecd4e983db4 service nova] Acquired lock "refresh_cache-bd60be9c-0ff3-40a5-aaab-f31fa88a67f1" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:13:18 user nova-compute[74683]: DEBUG nova.network.neutron [req-6a95faaa-c261-42e7-b5ef-81f269c96626 req-67a88258-1851-4d93-bdab-cecd4e983db4 service nova] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Refreshing network info cache for port 05cf5b29-bd7b-498d-b3d0-b7de22551793 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:13:18 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Start _get_guest_xml network_info=[{"id": "05cf5b29-bd7b-498d-b3d0-b7de22551793", "address": "fa:16:3e:dd:07:47", "network": {"id": "f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-137528169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c66aa774134aa6a873eabffc28ec07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05cf5b29-bd", "ovs_interfaceid": "05cf5b29-bd7b-498d-b3d0-b7de22551793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:13:18 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:13:18 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:13:18 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:13:18 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:13:18 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:13:18 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:13:18 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:13:18 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:13:18 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:13:18 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:13:18 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:13:18 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:13:18 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:13:18 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:13:18 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:13:18 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:13:18 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:13:18 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:13:18 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:13:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-687235212',display_name='tempest-AttachVolumeNegativeTest-server-687235212',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-687235212',id=3,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOywkcEzrUZv0QsEOR/KzK23mIO19zjdNcrZQotK0DXVfR/PCkmEXQivNn7weVounhNFBFD+tcIW7x+9qvaLgIAsl/ws0bQ5I+kRtdBr1boO2+AuRpkkrMAYOd9PLlvHLA==',key_name='tempest-keypair-895417366',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72c66aa774134aa6a873eabffc28ec07',ramdisk_id='',reservation_id='r-u7l2fvjl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-845934820',owner_user_name='tempest-AttachVolumeNegativeTest-845934820-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:13:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cdc203c025d84efe86e25cfdf75107b8',uuid=bd60be9c-0ff3-40a5-aaab-f31fa88a67f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05cf5b29-bd7b-498d-b3d0-b7de22551793", "address": "fa:16:3e:dd:07:47", "network": {"id": "f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-137528169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c66aa774134aa6a873eabffc28ec07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05cf5b29-bd", "ovs_interfaceid": "05cf5b29-bd7b-498d-b3d0-b7de22551793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:13:18 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Converting VIF {"id": "05cf5b29-bd7b-498d-b3d0-b7de22551793", "address": "fa:16:3e:dd:07:47", "network": {"id": "f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-137528169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c66aa774134aa6a873eabffc28ec07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05cf5b29-bd", "ovs_interfaceid": "05cf5b29-bd7b-498d-b3d0-b7de22551793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:13:18 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:07:47,bridge_name='br-int',has_traffic_filtering=True,id=05cf5b29-bd7b-498d-b3d0-b7de22551793,network=Network(f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05cf5b29-bd') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:13:18 user nova-compute[74683]: DEBUG nova.objects.instance [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lazy-loading 'pci_devices' on Instance uuid bd60be9c-0ff3-40a5-aaab-f31fa88a67f1 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:13:18 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:13:18 user nova-compute[74683]:   <uuid>bd60be9c-0ff3-40a5-aaab-f31fa88a67f1</uuid>
Oct 16 11:13:18 user nova-compute[74683]:   <name>instance-00000003</name>
Oct 16 11:13:18 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:13:18 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:13:18 user nova-compute[74683]:   <metadata>
Oct 16 11:13:18 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:13:18 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:13:18 user nova-compute[74683]:       <nova:name>tempest-AttachVolumeNegativeTest-server-687235212</nova:name>
Oct 16 11:13:18 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:13:18</nova:creationTime>
Oct 16 11:13:18 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:13:18 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:13:18 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:13:18 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:13:18 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:13:18 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:13:18 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:13:18 user nova-compute[74683]:       <nova:owner>
Oct 16 11:13:18 user nova-compute[74683]:         <nova:user uuid="cdc203c025d84efe86e25cfdf75107b8">tempest-AttachVolumeNegativeTest-845934820-project-member</nova:user>
Oct 16 11:13:18 user nova-compute[74683]:         <nova:project uuid="72c66aa774134aa6a873eabffc28ec07">tempest-AttachVolumeNegativeTest-845934820</nova:project>
Oct 16 11:13:18 user nova-compute[74683]:       </nova:owner>
Oct 16 11:13:18 user nova-compute[74683]:       <nova:root type="image" uuid="0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f"/>
Oct 16 11:13:18 user nova-compute[74683]:       <nova:ports>
Oct 16 11:13:18 user nova-compute[74683]:         <nova:port uuid="05cf5b29-bd7b-498d-b3d0-b7de22551793">
Oct 16 11:13:18 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 16 11:13:18 user nova-compute[74683]:         </nova:port>
Oct 16 11:13:18 user nova-compute[74683]:       </nova:ports>
Oct 16 11:13:18 user nova-compute[74683]:     </nova:instance>
Oct 16 11:13:18 user nova-compute[74683]:   </metadata>
Oct 16 11:13:18 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:13:18 user nova-compute[74683]:     <system>
Oct 16 11:13:18 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:13:18 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:13:18 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:13:18 user nova-compute[74683]:       <entry name="serial">bd60be9c-0ff3-40a5-aaab-f31fa88a67f1</entry>
Oct 16 11:13:18 user nova-compute[74683]:       <entry name="uuid">bd60be9c-0ff3-40a5-aaab-f31fa88a67f1</entry>
Oct 16 11:13:18 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:13:18 user nova-compute[74683]:     </system>
Oct 16 11:13:18 user nova-compute[74683]:   </sysinfo>
Oct 16 11:13:18 user nova-compute[74683]:   <os>
Oct 16 11:13:18 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:13:18 user nova-compute[74683]:     <boot dev="hd"/>
Oct 16 11:13:18 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:13:18 user nova-compute[74683]:   </os>
Oct 16 11:13:18 user nova-compute[74683]:   <features>
Oct 16 11:13:18 user nova-compute[74683]:     <acpi/>
Oct 16 11:13:18 user nova-compute[74683]:     <apic/>
Oct 16 11:13:18 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:13:18 user nova-compute[74683]:   </features>
Oct 16 11:13:18 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:13:18 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:13:18 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:13:18 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:13:18 user nova-compute[74683]:   </clock>
Oct 16 11:13:18 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:13:18 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:13:18 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:13:18 user nova-compute[74683]:   </cpu>
Oct 16 11:13:18 user nova-compute[74683]:   <devices>
Oct 16 11:13:18 user nova-compute[74683]:     <disk type="file" device="disk">
Oct 16 11:13:18 user nova-compute[74683]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 11:13:18 user nova-compute[74683]:       <source file="/opt/stack/data/nova/instances/bd60be9c-0ff3-40a5-aaab-f31fa88a67f1/disk"/>
Oct 16 11:13:18 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:13:18 user nova-compute[74683]:     </disk>
Oct 16 11:13:18 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:13:18 user nova-compute[74683]:       <mac address="fa:16:3e:dd:07:47"/>
Oct 16 11:13:18 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:13:18 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:13:18 user nova-compute[74683]:       <target dev="tap05cf5b29-bd"/>
Oct 16 11:13:18 user nova-compute[74683]:     </interface>
Oct 16 11:13:18 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:13:18 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/bd60be9c-0ff3-40a5-aaab-f31fa88a67f1/console.log" append="off"/>
Oct 16 11:13:18 user nova-compute[74683]:     </serial>
Oct 16 11:13:18 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:13:18 user nova-compute[74683]:     <video>
Oct 16 11:13:18 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:13:18 user nova-compute[74683]:     </video>
Oct 16 11:13:18 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:13:18 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:13:18 user nova-compute[74683]:     </rng>
Oct 16 11:13:18 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:13:18 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:13:18 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:13:18 user nova-compute[74683]:     </memballoon>
Oct 16 11:13:18 user nova-compute[74683]:   </devices>
Oct 16 11:13:18 user nova-compute[74683]: </domain>
Oct 16 11:13:18 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:13:18 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:13:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-687235212',display_name='tempest-AttachVolumeNegativeTest-server-687235212',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-687235212',id=3,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOywkcEzrUZv0QsEOR/KzK23mIO19zjdNcrZQotK0DXVfR/PCkmEXQivNn7weVounhNFBFD+tcIW7x+9qvaLgIAsl/ws0bQ5I+kRtdBr1boO2+AuRpkkrMAYOd9PLlvHLA==',key_name='tempest-keypair-895417366',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72c66aa774134aa6a873eabffc28ec07',ramdisk_id='',reservation_id='r-u7l2fvjl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-845934820',owner_user_name='tempest-AttachVolumeNegativeTest-845934820-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:13:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cdc203c025d84efe86e25cfdf75107b8',uuid=bd60be9c-0ff3-40a5-aaab-f31fa88a67f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05cf5b29-bd7b-498d-b3d0-b7de22551793", "address": "fa:16:3e:dd:07:47", "network": {"id": "f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-137528169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c66aa774134aa6a873eabffc28ec07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05cf5b29-bd", "ovs_interfaceid": "05cf5b29-bd7b-498d-b3d0-b7de22551793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:13:18 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Converting VIF {"id": "05cf5b29-bd7b-498d-b3d0-b7de22551793", "address": "fa:16:3e:dd:07:47", "network": {"id": "f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-137528169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c66aa774134aa6a873eabffc28ec07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05cf5b29-bd", "ovs_interfaceid": "05cf5b29-bd7b-498d-b3d0-b7de22551793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:13:18 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:07:47,bridge_name='br-int',has_traffic_filtering=True,id=05cf5b29-bd7b-498d-b3d0-b7de22551793,network=Network(f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05cf5b29-bd') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:13:18 user nova-compute[74683]: DEBUG os_vif [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:07:47,bridge_name='br-int',has_traffic_filtering=True,id=05cf5b29-bd7b-498d-b3d0-b7de22551793,network=Network(f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05cf5b29-bd') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:13:18 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:18 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:13:18 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:13:18 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:18 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8dca3015-de4c-5fb7-b44b-490cc58175f7', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:13:18 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:18 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:13:18 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:18 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap05cf5b29-bd, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:13:18 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap05cf5b29-bd, col_values=(('qos', UUID('a35f6c94-42d4-4866-9a7a-87d2e738d602')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:13:18 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap05cf5b29-bd, col_values=(('external_ids', {'iface-id': '05cf5b29-bd7b-498d-b3d0-b7de22551793', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:07:47', 'vm-uuid': 'bd60be9c-0ff3-40a5-aaab-f31fa88a67f1'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:13:18 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:18 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:13:18 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:18 user nova-compute[74683]: INFO os_vif [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:07:47,bridge_name='br-int',has_traffic_filtering=True,id=05cf5b29-bd7b-498d-b3d0-b7de22551793,network=Network(f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05cf5b29-bd')
Oct 16 11:13:18 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:13:18 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] No VIF found with MAC fa:16:3e:dd:07:47, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:13:19 user nova-compute[74683]: DEBUG nova.compute.manager [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Instance event wait completed in 0 seconds for  {{(pid=74683) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 11:13:19 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Guest created on hypervisor {{(pid=74683) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 11:13:19 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Instance spawned successfully.
Oct 16 11:13:19 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 11:13:19 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Found default for hw_cdrom_bus of ide {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:13:19 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Found default for hw_disk_bus of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:13:19 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Found default for hw_input_bus of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:13:19 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Found default for hw_pointer_model of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:13:19 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Found default for hw_video_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:13:19 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Found default for hw_vif_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:13:19 user nova-compute[74683]: DEBUG nova.compute.manager [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Instance event wait completed in 0 seconds for  {{(pid=74683) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 11:13:19 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Guest created on hypervisor {{(pid=74683) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 11:13:19 user nova-compute[74683]: INFO nova.compute.manager [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Took 16.32 seconds to spawn the instance on the hypervisor.
Oct 16 11:13:19 user nova-compute[74683]: DEBUG nova.compute.manager [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:13:19 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Instance spawned successfully.
Oct 16 11:13:19 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 11:13:19 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Found default for hw_cdrom_bus of ide {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:13:19 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Found default for hw_disk_bus of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:13:19 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Found default for hw_input_bus of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:13:19 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Found default for hw_pointer_model of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:13:19 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Found default for hw_video_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:13:19 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Found default for hw_vif_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:13:19 user nova-compute[74683]: INFO nova.compute.manager [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Took 17.70 seconds to build instance.
Oct 16 11:13:19 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-22eace06-f88d-4e80-9fec-ccaf0eb722c8 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Lock "427b793c-ae47-451c-bbc5-589d6ce1d2bf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.925s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:13:19 user nova-compute[74683]: INFO nova.compute.manager [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Took 12.11 seconds to spawn the instance on the hypervisor.
Oct 16 11:13:19 user nova-compute[74683]: DEBUG nova.compute.manager [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:13:19 user nova-compute[74683]: INFO nova.compute.manager [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Took 13.21 seconds to build instance.
Oct 16 11:13:19 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-5daa9762-b84f-4b2b-b592-a4d8298d6107 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "18a77385-fab9-4ea0-8aa6-666cf7e798a6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.429s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:13:20 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:20 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:20 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:20 user nova-compute[74683]: DEBUG nova.network.neutron [req-6a95faaa-c261-42e7-b5ef-81f269c96626 req-67a88258-1851-4d93-bdab-cecd4e983db4 service nova] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Updated VIF entry in instance network info cache for port 05cf5b29-bd7b-498d-b3d0-b7de22551793. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:13:20 user nova-compute[74683]: DEBUG nova.network.neutron [req-6a95faaa-c261-42e7-b5ef-81f269c96626 req-67a88258-1851-4d93-bdab-cecd4e983db4 service nova] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Updating instance_info_cache with network_info: [{"id": "05cf5b29-bd7b-498d-b3d0-b7de22551793", "address": "fa:16:3e:dd:07:47", "network": {"id": "f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-137528169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c66aa774134aa6a873eabffc28ec07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05cf5b29-bd", "ovs_interfaceid": "05cf5b29-bd7b-498d-b3d0-b7de22551793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:13:20 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-6a95faaa-c261-42e7-b5ef-81f269c96626 req-67a88258-1851-4d93-bdab-cecd4e983db4 service nova] Releasing lock "refresh_cache-bd60be9c-0ff3-40a5-aaab-f31fa88a67f1" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:13:20 user nova-compute[74683]: DEBUG nova.network.neutron [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Successfully updated port: 9476563e-0758-43d9-b920-87f412881869 {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:13:20 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:20 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Acquiring lock "refresh_cache-2f1db5e2-0b25-4d61-9dd3-038811b4eda1" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:13:20 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Acquired lock "refresh_cache-2f1db5e2-0b25-4d61-9dd3-038811b4eda1" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:13:20 user nova-compute[74683]: DEBUG nova.network.neutron [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:13:20 user nova-compute[74683]: DEBUG nova.compute.manager [req-91f95536-a3ba-44dc-86d0-f202bd32e39f req-69149f00-f983-4e42-a787-fc88a5e74a95 service nova] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Received event network-changed-9476563e-0758-43d9-b920-87f412881869 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:13:20 user nova-compute[74683]: DEBUG nova.compute.manager [req-91f95536-a3ba-44dc-86d0-f202bd32e39f req-69149f00-f983-4e42-a787-fc88a5e74a95 service nova] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Refreshing instance network info cache due to event network-changed-9476563e-0758-43d9-b920-87f412881869. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:13:20 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-91f95536-a3ba-44dc-86d0-f202bd32e39f req-69149f00-f983-4e42-a787-fc88a5e74a95 service nova] Acquiring lock "refresh_cache-2f1db5e2-0b25-4d61-9dd3-038811b4eda1" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:13:20 user nova-compute[74683]: DEBUG nova.network.neutron [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:13:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:21 user nova-compute[74683]: DEBUG nova.network.neutron [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Updating instance_info_cache with network_info: [{"id": "9476563e-0758-43d9-b920-87f412881869", "address": "fa:16:3e:18:cc:d6", "network": {"id": "5a04a566-92ef-4300-976b-5c34656ec9c7", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-706076145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "207a79fe27c042d8b081272246b98245", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9476563e-07", "ovs_interfaceid": "9476563e-0758-43d9-b920-87f412881869", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:13:21 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Releasing lock "refresh_cache-2f1db5e2-0b25-4d61-9dd3-038811b4eda1" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:13:21 user nova-compute[74683]: DEBUG nova.compute.manager [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Instance network_info: |[{"id": "9476563e-0758-43d9-b920-87f412881869", "address": "fa:16:3e:18:cc:d6", "network": {"id": "5a04a566-92ef-4300-976b-5c34656ec9c7", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-706076145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "207a79fe27c042d8b081272246b98245", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9476563e-07", "ovs_interfaceid": "9476563e-0758-43d9-b920-87f412881869", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 11:13:21 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-91f95536-a3ba-44dc-86d0-f202bd32e39f req-69149f00-f983-4e42-a787-fc88a5e74a95 service nova] Acquired lock "refresh_cache-2f1db5e2-0b25-4d61-9dd3-038811b4eda1" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:13:21 user nova-compute[74683]: DEBUG nova.network.neutron [req-91f95536-a3ba-44dc-86d0-f202bd32e39f req-69149f00-f983-4e42-a787-fc88a5e74a95 service nova] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Refreshing network info cache for port 9476563e-0758-43d9-b920-87f412881869 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:13:21 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Start _get_guest_xml network_info=[{"id": "9476563e-0758-43d9-b920-87f412881869", "address": "fa:16:3e:18:cc:d6", "network": {"id": "5a04a566-92ef-4300-976b-5c34656ec9c7", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-706076145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "207a79fe27c042d8b081272246b98245", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9476563e-07", "ovs_interfaceid": "9476563e-0758-43d9-b920-87f412881869", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:13:21 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:13:21 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:13:21 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:13:21 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:13:21 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:13:21 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:13:21 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:13:21 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:13:21 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:13:21 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:13:21 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:13:21 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:13:21 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:13:21 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:13:21 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:13:21 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:13:21 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:13:21 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:13:21 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:13:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-649264826',display_name='tempest-ServerStableDeviceRescueTest-server-649264826',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-649264826',id=5,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCHdErqSJAuU5ThrpuRLCA7O8N+5e9cKLBRIOiKAgCYrSh7b9cT3Hw2OzejXwPp8CDDvy7DhOF+OR4lwTCUm5XrYVkiD31OBP/Hh7mTFi6YXdpdChJO0Xma5CTcgqFL8LA==',key_name='tempest-keypair-907110681',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='207a79fe27c042d8b081272246b98245',ramdisk_id='',reservation_id='r-snd9b0xu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-2038287775',owner_user_name='tempest-ServerStableDeviceRescueTest-2038287775-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:13:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da5d2dc55a234fa5a6b09bdc3f489055',uuid=2f1db5e2-0b25-4d61-9dd3-038811b4eda1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9476563e-0758-43d9-b920-87f412881869", "address": "fa:16:3e:18:cc:d6", "network": {"id": "5a04a566-92ef-4300-976b-5c34656ec9c7", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-706076145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "207a79fe27c042d8b081272246b98245", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9476563e-07", "ovs_interfaceid": "9476563e-0758-43d9-b920-87f412881869", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:13:21 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Converting VIF {"id": "9476563e-0758-43d9-b920-87f412881869", "address": "fa:16:3e:18:cc:d6", "network": {"id": "5a04a566-92ef-4300-976b-5c34656ec9c7", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-706076145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "207a79fe27c042d8b081272246b98245", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9476563e-07", "ovs_interfaceid": "9476563e-0758-43d9-b920-87f412881869", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:13:21 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:cc:d6,bridge_name='br-int',has_traffic_filtering=True,id=9476563e-0758-43d9-b920-87f412881869,network=Network(5a04a566-92ef-4300-976b-5c34656ec9c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9476563e-07') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:13:21 user nova-compute[74683]: DEBUG nova.objects.instance [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Lazy-loading 'pci_devices' on Instance uuid 2f1db5e2-0b25-4d61-9dd3-038811b4eda1 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:13:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:21 user nova-compute[74683]: DEBUG nova.network.neutron [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Successfully updated port: dbbeadad-745e-4d28-a242-577b3197b079 {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:13:21 user nova-compute[74683]: DEBUG nova.compute.manager [req-a7c53949-cf73-425a-b9fd-36acbfdcc81b req-37a87c50-070b-4571-9f72-d034307147a3 service nova] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Received event network-changed-dbbeadad-745e-4d28-a242-577b3197b079 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:13:21 user nova-compute[74683]: DEBUG nova.compute.manager [req-a7c53949-cf73-425a-b9fd-36acbfdcc81b req-37a87c50-070b-4571-9f72-d034307147a3 service nova] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Refreshing instance network info cache due to event network-changed-dbbeadad-745e-4d28-a242-577b3197b079. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:13:21 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a7c53949-cf73-425a-b9fd-36acbfdcc81b req-37a87c50-070b-4571-9f72-d034307147a3 service nova] Acquiring lock "refresh_cache-f192d1ec-311d-4a30-9766-361b27a8dae8" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:13:21 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a7c53949-cf73-425a-b9fd-36acbfdcc81b req-37a87c50-070b-4571-9f72-d034307147a3 service nova] Acquired lock "refresh_cache-f192d1ec-311d-4a30-9766-361b27a8dae8" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:13:21 user nova-compute[74683]: DEBUG nova.network.neutron [req-a7c53949-cf73-425a-b9fd-36acbfdcc81b req-37a87c50-070b-4571-9f72-d034307147a3 service nova] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Refreshing network info cache for port dbbeadad-745e-4d28-a242-577b3197b079 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:13:21 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:13:21 user nova-compute[74683]:   <uuid>2f1db5e2-0b25-4d61-9dd3-038811b4eda1</uuid>
Oct 16 11:13:21 user nova-compute[74683]:   <name>instance-00000005</name>
Oct 16 11:13:21 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:13:21 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:13:21 user nova-compute[74683]:   <metadata>
Oct 16 11:13:21 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:13:21 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:13:21 user nova-compute[74683]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-649264826</nova:name>
Oct 16 11:13:21 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:13:21</nova:creationTime>
Oct 16 11:13:21 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:13:21 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:13:21 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:13:21 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:13:21 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:13:21 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:13:21 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:13:21 user nova-compute[74683]:       <nova:owner>
Oct 16 11:13:21 user nova-compute[74683]:         <nova:user uuid="da5d2dc55a234fa5a6b09bdc3f489055">tempest-ServerStableDeviceRescueTest-2038287775-project-member</nova:user>
Oct 16 11:13:21 user nova-compute[74683]:         <nova:project uuid="207a79fe27c042d8b081272246b98245">tempest-ServerStableDeviceRescueTest-2038287775</nova:project>
Oct 16 11:13:21 user nova-compute[74683]:       </nova:owner>
Oct 16 11:13:21 user nova-compute[74683]:       <nova:root type="image" uuid="0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f"/>
Oct 16 11:13:21 user nova-compute[74683]:       <nova:ports>
Oct 16 11:13:21 user nova-compute[74683]:         <nova:port uuid="9476563e-0758-43d9-b920-87f412881869">
Oct 16 11:13:21 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 16 11:13:21 user nova-compute[74683]:         </nova:port>
Oct 16 11:13:21 user nova-compute[74683]:       </nova:ports>
Oct 16 11:13:21 user nova-compute[74683]:     </nova:instance>
Oct 16 11:13:21 user nova-compute[74683]:   </metadata>
Oct 16 11:13:21 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:13:21 user nova-compute[74683]:     <system>
Oct 16 11:13:21 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:13:21 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:13:21 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:13:21 user nova-compute[74683]:       <entry name="serial">2f1db5e2-0b25-4d61-9dd3-038811b4eda1</entry>
Oct 16 11:13:21 user nova-compute[74683]:       <entry name="uuid">2f1db5e2-0b25-4d61-9dd3-038811b4eda1</entry>
Oct 16 11:13:21 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:13:21 user nova-compute[74683]:     </system>
Oct 16 11:13:21 user nova-compute[74683]:   </sysinfo>
Oct 16 11:13:21 user nova-compute[74683]:   <os>
Oct 16 11:13:21 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:13:21 user nova-compute[74683]:     <boot dev="hd"/>
Oct 16 11:13:21 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:13:21 user nova-compute[74683]:   </os>
Oct 16 11:13:21 user nova-compute[74683]:   <features>
Oct 16 11:13:21 user nova-compute[74683]:     <acpi/>
Oct 16 11:13:21 user nova-compute[74683]:     <apic/>
Oct 16 11:13:21 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:13:21 user nova-compute[74683]:   </features>
Oct 16 11:13:21 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:13:21 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:13:21 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:13:21 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:13:21 user nova-compute[74683]:   </clock>
Oct 16 11:13:21 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:13:21 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:13:21 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:13:21 user nova-compute[74683]:   </cpu>
Oct 16 11:13:21 user nova-compute[74683]:   <devices>
Oct 16 11:13:21 user nova-compute[74683]:     <disk type="file" device="disk">
Oct 16 11:13:21 user nova-compute[74683]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 11:13:21 user nova-compute[74683]:       <source file="/opt/stack/data/nova/instances/2f1db5e2-0b25-4d61-9dd3-038811b4eda1/disk"/>
Oct 16 11:13:21 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:13:21 user nova-compute[74683]:     </disk>
Oct 16 11:13:21 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:13:21 user nova-compute[74683]:       <mac address="fa:16:3e:18:cc:d6"/>
Oct 16 11:13:21 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:13:21 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:13:21 user nova-compute[74683]:       <target dev="tap9476563e-07"/>
Oct 16 11:13:21 user nova-compute[74683]:     </interface>
Oct 16 11:13:21 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:13:21 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/2f1db5e2-0b25-4d61-9dd3-038811b4eda1/console.log" append="off"/>
Oct 16 11:13:21 user nova-compute[74683]:     </serial>
Oct 16 11:13:21 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:13:21 user nova-compute[74683]:     <video>
Oct 16 11:13:21 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:13:21 user nova-compute[74683]:     </video>
Oct 16 11:13:21 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:13:21 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:13:21 user nova-compute[74683]:     </rng>
Oct 16 11:13:21 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:13:21 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:13:21 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:13:21 user nova-compute[74683]:     </memballoon>
Oct 16 11:13:21 user nova-compute[74683]:   </devices>
Oct 16 11:13:21 user nova-compute[74683]: </domain>
Oct 16 11:13:21 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:13:21 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:13:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-649264826',display_name='tempest-ServerStableDeviceRescueTest-server-649264826',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-649264826',id=5,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCHdErqSJAuU5ThrpuRLCA7O8N+5e9cKLBRIOiKAgCYrSh7b9cT3Hw2OzejXwPp8CDDvy7DhOF+OR4lwTCUm5XrYVkiD31OBP/Hh7mTFi6YXdpdChJO0Xma5CTcgqFL8LA==',key_name='tempest-keypair-907110681',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='207a79fe27c042d8b081272246b98245',ramdisk_id='',reservation_id='r-snd9b0xu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-2038287775',owner_user_name='tempest-ServerStableDeviceRescueTest-2038287775-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:13:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da5d2dc55a234fa5a6b09bdc3f489055',uuid=2f1db5e2-0b25-4d61-9dd3-038811b4eda1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9476563e-0758-43d9-b920-87f412881869", "address": "fa:16:3e:18:cc:d6", "network": {"id": "5a04a566-92ef-4300-976b-5c34656ec9c7", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-706076145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "207a79fe27c042d8b081272246b98245", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9476563e-07", "ovs_interfaceid": "9476563e-0758-43d9-b920-87f412881869", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:13:21 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Converting VIF {"id": "9476563e-0758-43d9-b920-87f412881869", "address": "fa:16:3e:18:cc:d6", "network": {"id": "5a04a566-92ef-4300-976b-5c34656ec9c7", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-706076145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "207a79fe27c042d8b081272246b98245", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9476563e-07", "ovs_interfaceid": "9476563e-0758-43d9-b920-87f412881869", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:13:21 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:cc:d6,bridge_name='br-int',has_traffic_filtering=True,id=9476563e-0758-43d9-b920-87f412881869,network=Network(5a04a566-92ef-4300-976b-5c34656ec9c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9476563e-07') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:13:21 user nova-compute[74683]: DEBUG os_vif [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:cc:d6,bridge_name='br-int',has_traffic_filtering=True,id=9476563e-0758-43d9-b920-87f412881869,network=Network(5a04a566-92ef-4300-976b-5c34656ec9c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9476563e-07') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:13:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:13:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:13:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0d6f24e3-75df-5eb5-9405-58005d681ac5', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:13:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:13:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9476563e-07, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:13:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9476563e-07, col_values=(('qos', UUID('81bd7e0c-7837-4665-a9f2-c278e13fc089')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:13:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9476563e-07, col_values=(('external_ids', {'iface-id': '9476563e-0758-43d9-b920-87f412881869', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:cc:d6', 'vm-uuid': '2f1db5e2-0b25-4d61-9dd3-038811b4eda1'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:13:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:21 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Acquiring lock "refresh_cache-f192d1ec-311d-4a30-9766-361b27a8dae8" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:13:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:13:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:21 user nova-compute[74683]: INFO os_vif [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:cc:d6,bridge_name='br-int',has_traffic_filtering=True,id=9476563e-0758-43d9-b920-87f412881869,network=Network(5a04a566-92ef-4300-976b-5c34656ec9c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9476563e-07')
Oct 16 11:13:22 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:13:22 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] No VIF found with MAC fa:16:3e:18:cc:d6, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:13:22 user nova-compute[74683]: DEBUG nova.network.neutron [req-a7c53949-cf73-425a-b9fd-36acbfdcc81b req-37a87c50-070b-4571-9f72-d034307147a3 service nova] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:13:22 user nova-compute[74683]: DEBUG nova.network.neutron [req-91f95536-a3ba-44dc-86d0-f202bd32e39f req-69149f00-f983-4e42-a787-fc88a5e74a95 service nova] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Updated VIF entry in instance network info cache for port 9476563e-0758-43d9-b920-87f412881869. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:13:22 user nova-compute[74683]: DEBUG nova.network.neutron [req-91f95536-a3ba-44dc-86d0-f202bd32e39f req-69149f00-f983-4e42-a787-fc88a5e74a95 service nova] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Updating instance_info_cache with network_info: [{"id": "9476563e-0758-43d9-b920-87f412881869", "address": "fa:16:3e:18:cc:d6", "network": {"id": "5a04a566-92ef-4300-976b-5c34656ec9c7", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-706076145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "207a79fe27c042d8b081272246b98245", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9476563e-07", "ovs_interfaceid": "9476563e-0758-43d9-b920-87f412881869", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:13:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-91f95536-a3ba-44dc-86d0-f202bd32e39f req-69149f00-f983-4e42-a787-fc88a5e74a95 service nova] Releasing lock "refresh_cache-2f1db5e2-0b25-4d61-9dd3-038811b4eda1" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:13:22 user nova-compute[74683]: DEBUG nova.network.neutron [req-a7c53949-cf73-425a-b9fd-36acbfdcc81b req-37a87c50-070b-4571-9f72-d034307147a3 service nova] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:13:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a7c53949-cf73-425a-b9fd-36acbfdcc81b req-37a87c50-070b-4571-9f72-d034307147a3 service nova] Releasing lock "refresh_cache-f192d1ec-311d-4a30-9766-361b27a8dae8" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:13:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Acquired lock "refresh_cache-f192d1ec-311d-4a30-9766-361b27a8dae8" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:13:22 user nova-compute[74683]: DEBUG nova.network.neutron [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:13:23 user nova-compute[74683]: DEBUG nova.compute.manager [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Instance event wait completed in 0 seconds for  {{(pid=74683) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 11:13:23 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Guest created on hypervisor {{(pid=74683) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 11:13:23 user nova-compute[74683]: DEBUG nova.network.neutron [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:13:23 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Instance spawned successfully.
Oct 16 11:13:23 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 11:13:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:23 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Found default for hw_cdrom_bus of ide {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:13:23 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Found default for hw_disk_bus of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:13:23 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Found default for hw_input_bus of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:13:23 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Found default for hw_pointer_model of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:13:23 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Found default for hw_video_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:13:23 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Found default for hw_vif_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:13:23 user nova-compute[74683]: INFO nova.compute.manager [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Took 12.23 seconds to spawn the instance on the hypervisor.
Oct 16 11:13:23 user nova-compute[74683]: DEBUG nova.compute.manager [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:13:23 user nova-compute[74683]: INFO nova.compute.manager [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Took 12.93 seconds to build instance.
Oct 16 11:13:23 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-718f3270-e41e-4899-97b7-a2812706ca32 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "bd60be9c-0ff3-40a5-aaab-f31fa88a67f1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.385s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:13:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:23 user nova-compute[74683]: DEBUG nova.network.neutron [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Updating instance_info_cache with network_info: [{"id": "dbbeadad-745e-4d28-a242-577b3197b079", "address": "fa:16:3e:2b:14:bf", "network": {"id": "33f5edce-0901-42ea-b07a-47da2819b133", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-117849665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d7573bebfe47e3989f8eedd90dee6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbbeadad-74", "ovs_interfaceid": "dbbeadad-745e-4d28-a242-577b3197b079", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:13:23 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Releasing lock "refresh_cache-f192d1ec-311d-4a30-9766-361b27a8dae8" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:13:23 user nova-compute[74683]: DEBUG nova.compute.manager [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Instance network_info: |[{"id": "dbbeadad-745e-4d28-a242-577b3197b079", "address": "fa:16:3e:2b:14:bf", "network": {"id": "33f5edce-0901-42ea-b07a-47da2819b133", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-117849665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d7573bebfe47e3989f8eedd90dee6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbbeadad-74", "ovs_interfaceid": "dbbeadad-745e-4d28-a242-577b3197b079", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 11:13:23 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Start _get_guest_xml network_info=[{"id": "dbbeadad-745e-4d28-a242-577b3197b079", "address": "fa:16:3e:2b:14:bf", "network": {"id": "33f5edce-0901-42ea-b07a-47da2819b133", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-117849665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d7573bebfe47e3989f8eedd90dee6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbbeadad-74", "ovs_interfaceid": "dbbeadad-745e-4d28-a242-577b3197b079", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:13:23 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:13:23 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:13:23 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:13:23 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:13:23 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:13:23 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:13:23 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:13:23 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:13:23 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:13:23 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:13:23 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:13:23 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:13:23 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:13:23 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:13:23 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:13:23 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:13:23 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:13:23 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:13:24 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:13:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-983209770',display_name='tempest-ServerActionsTestOtherB-server-983209770',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-983209770',id=4,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9H9XkO3ueDaPVFedHBs8IBjQP+O3m5MP98XnfC/J6UPNHq/d/RZvz6o5PlZR6OTg+H3cDaV7C6HUM8WearORwrzPoJ/Wxd8/4rMuBZ4j1C0aE5FLDGnbq9yp0LqlVHBQ==',key_name='tempest-keypair-650579759',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1d7573bebfe47e3989f8eedd90dee6c',ramdisk_id='',reservation_id='r-wwd9qybu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1241350688',owner_user_name='tempest-ServerActionsTestOtherB-1241350688-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:13:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fc0a33378424a9080c747d4f78528a5',uuid=f192d1ec-311d-4a30-9766-361b27a8dae8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dbbeadad-745e-4d28-a242-577b3197b079", "address": "fa:16:3e:2b:14:bf", "network": {"id": "33f5edce-0901-42ea-b07a-47da2819b133", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-117849665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d7573bebfe47e3989f8eedd90dee6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbbeadad-74", "ovs_interfaceid": "dbbeadad-745e-4d28-a242-577b3197b079", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:13:24 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Converting VIF {"id": "dbbeadad-745e-4d28-a242-577b3197b079", "address": "fa:16:3e:2b:14:bf", "network": {"id": "33f5edce-0901-42ea-b07a-47da2819b133", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-117849665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d7573bebfe47e3989f8eedd90dee6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbbeadad-74", "ovs_interfaceid": "dbbeadad-745e-4d28-a242-577b3197b079", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:13:24 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:14:bf,bridge_name='br-int',has_traffic_filtering=True,id=dbbeadad-745e-4d28-a242-577b3197b079,network=Network(33f5edce-0901-42ea-b07a-47da2819b133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbbeadad-74') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:13:24 user nova-compute[74683]: DEBUG nova.objects.instance [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Lazy-loading 'pci_devices' on Instance uuid f192d1ec-311d-4a30-9766-361b27a8dae8 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:13:24 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:13:24 user nova-compute[74683]:   <uuid>f192d1ec-311d-4a30-9766-361b27a8dae8</uuid>
Oct 16 11:13:24 user nova-compute[74683]:   <name>instance-00000004</name>
Oct 16 11:13:24 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:13:24 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:13:24 user nova-compute[74683]:   <metadata>
Oct 16 11:13:24 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:13:24 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:13:24 user nova-compute[74683]:       <nova:name>tempest-ServerActionsTestOtherB-server-983209770</nova:name>
Oct 16 11:13:24 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:13:23</nova:creationTime>
Oct 16 11:13:24 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:13:24 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:13:24 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:13:24 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:13:24 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:13:24 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:13:24 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:13:24 user nova-compute[74683]:       <nova:owner>
Oct 16 11:13:24 user nova-compute[74683]:         <nova:user uuid="0fc0a33378424a9080c747d4f78528a5">tempest-ServerActionsTestOtherB-1241350688-project-member</nova:user>
Oct 16 11:13:24 user nova-compute[74683]:         <nova:project uuid="e1d7573bebfe47e3989f8eedd90dee6c">tempest-ServerActionsTestOtherB-1241350688</nova:project>
Oct 16 11:13:24 user nova-compute[74683]:       </nova:owner>
Oct 16 11:13:24 user nova-compute[74683]:       <nova:root type="image" uuid="0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f"/>
Oct 16 11:13:24 user nova-compute[74683]:       <nova:ports>
Oct 16 11:13:24 user nova-compute[74683]:         <nova:port uuid="dbbeadad-745e-4d28-a242-577b3197b079">
Oct 16 11:13:24 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 16 11:13:24 user nova-compute[74683]:         </nova:port>
Oct 16 11:13:24 user nova-compute[74683]:       </nova:ports>
Oct 16 11:13:24 user nova-compute[74683]:     </nova:instance>
Oct 16 11:13:24 user nova-compute[74683]:   </metadata>
Oct 16 11:13:24 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:13:24 user nova-compute[74683]:     <system>
Oct 16 11:13:24 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:13:24 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:13:24 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:13:24 user nova-compute[74683]:       <entry name="serial">f192d1ec-311d-4a30-9766-361b27a8dae8</entry>
Oct 16 11:13:24 user nova-compute[74683]:       <entry name="uuid">f192d1ec-311d-4a30-9766-361b27a8dae8</entry>
Oct 16 11:13:24 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:13:24 user nova-compute[74683]:     </system>
Oct 16 11:13:24 user nova-compute[74683]:   </sysinfo>
Oct 16 11:13:24 user nova-compute[74683]:   <os>
Oct 16 11:13:24 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:13:24 user nova-compute[74683]:     <boot dev="hd"/>
Oct 16 11:13:24 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:13:24 user nova-compute[74683]:   </os>
Oct 16 11:13:24 user nova-compute[74683]:   <features>
Oct 16 11:13:24 user nova-compute[74683]:     <acpi/>
Oct 16 11:13:24 user nova-compute[74683]:     <apic/>
Oct 16 11:13:24 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:13:24 user nova-compute[74683]:   </features>
Oct 16 11:13:24 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:13:24 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:13:24 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:13:24 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:13:24 user nova-compute[74683]:   </clock>
Oct 16 11:13:24 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:13:24 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:13:24 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:13:24 user nova-compute[74683]:   </cpu>
Oct 16 11:13:24 user nova-compute[74683]:   <devices>
Oct 16 11:13:24 user nova-compute[74683]:     <disk type="file" device="disk">
Oct 16 11:13:24 user nova-compute[74683]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 11:13:24 user nova-compute[74683]:       <source file="/opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/disk"/>
Oct 16 11:13:24 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:13:24 user nova-compute[74683]:     </disk>
Oct 16 11:13:24 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:13:24 user nova-compute[74683]:       <mac address="fa:16:3e:2b:14:bf"/>
Oct 16 11:13:24 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:13:24 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:13:24 user nova-compute[74683]:       <target dev="tapdbbeadad-74"/>
Oct 16 11:13:24 user nova-compute[74683]:     </interface>
Oct 16 11:13:24 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:13:24 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/console.log" append="off"/>
Oct 16 11:13:24 user nova-compute[74683]:     </serial>
Oct 16 11:13:24 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:13:24 user nova-compute[74683]:     <video>
Oct 16 11:13:24 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:13:24 user nova-compute[74683]:     </video>
Oct 16 11:13:24 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:13:24 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:13:24 user nova-compute[74683]:     </rng>
Oct 16 11:13:24 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:13:24 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:13:24 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:13:24 user nova-compute[74683]:     </memballoon>
Oct 16 11:13:24 user nova-compute[74683]:   </devices>
Oct 16 11:13:24 user nova-compute[74683]: </domain>
Oct 16 11:13:24 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:13:24 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:13:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-983209770',display_name='tempest-ServerActionsTestOtherB-server-983209770',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-983209770',id=4,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9H9XkO3ueDaPVFedHBs8IBjQP+O3m5MP98XnfC/J6UPNHq/d/RZvz6o5PlZR6OTg+H3cDaV7C6HUM8WearORwrzPoJ/Wxd8/4rMuBZ4j1C0aE5FLDGnbq9yp0LqlVHBQ==',key_name='tempest-keypair-650579759',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1d7573bebfe47e3989f8eedd90dee6c',ramdisk_id='',reservation_id='r-wwd9qybu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1241350688',owner_user_name='tempest-ServerActionsTestOtherB-1241350688-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:13:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fc0a33378424a9080c747d4f78528a5',uuid=f192d1ec-311d-4a30-9766-361b27a8dae8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dbbeadad-745e-4d28-a242-577b3197b079", "address": "fa:16:3e:2b:14:bf", "network": {"id": "33f5edce-0901-42ea-b07a-47da2819b133", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-117849665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d7573bebfe47e3989f8eedd90dee6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbbeadad-74", "ovs_interfaceid": "dbbeadad-745e-4d28-a242-577b3197b079", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:13:24 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Converting VIF {"id": "dbbeadad-745e-4d28-a242-577b3197b079", "address": "fa:16:3e:2b:14:bf", "network": {"id": "33f5edce-0901-42ea-b07a-47da2819b133", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-117849665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d7573bebfe47e3989f8eedd90dee6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbbeadad-74", "ovs_interfaceid": "dbbeadad-745e-4d28-a242-577b3197b079", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:13:24 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:14:bf,bridge_name='br-int',has_traffic_filtering=True,id=dbbeadad-745e-4d28-a242-577b3197b079,network=Network(33f5edce-0901-42ea-b07a-47da2819b133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbbeadad-74') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:13:24 user nova-compute[74683]: DEBUG os_vif [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:14:bf,bridge_name='br-int',has_traffic_filtering=True,id=dbbeadad-745e-4d28-a242-577b3197b079,network=Network(33f5edce-0901-42ea-b07a-47da2819b133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbbeadad-74') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:13:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:13:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:13:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '56f2a605-bb46-5863-87e8-d5b8b20d92cc', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:13:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:13:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdbbeadad-74, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:13:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdbbeadad-74, col_values=(('qos', UUID('dafe74bf-c9fe-4fe4-9844-f70576049656')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:13:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdbbeadad-74, col_values=(('external_ids', {'iface-id': 'dbbeadad-745e-4d28-a242-577b3197b079', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:14:bf', 'vm-uuid': 'f192d1ec-311d-4a30-9766-361b27a8dae8'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:13:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:13:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:24 user nova-compute[74683]: INFO os_vif [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:14:bf,bridge_name='br-int',has_traffic_filtering=True,id=dbbeadad-745e-4d28-a242-577b3197b079,network=Network(33f5edce-0901-42ea-b07a-47da2819b133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbbeadad-74')
Oct 16 11:13:24 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:13:24 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] No VIF found with MAC fa:16:3e:2b:14:bf, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:13:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:27 user nova-compute[74683]: DEBUG nova.compute.manager [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Instance event wait completed in 0 seconds for  {{(pid=74683) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 11:13:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Guest created on hypervisor {{(pid=74683) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 11:13:27 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Instance spawned successfully.
Oct 16 11:13:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 11:13:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Found default for hw_cdrom_bus of ide {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:13:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Found default for hw_disk_bus of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:13:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Found default for hw_input_bus of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:13:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Found default for hw_pointer_model of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:13:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Found default for hw_video_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:13:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Found default for hw_vif_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:13:27 user nova-compute[74683]: INFO nova.compute.manager [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Took 12.55 seconds to spawn the instance on the hypervisor.
Oct 16 11:13:27 user nova-compute[74683]: DEBUG nova.compute.manager [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:13:28 user nova-compute[74683]: INFO nova.compute.manager [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Took 13.45 seconds to build instance.
Oct 16 11:13:28 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b069b7e7-87e8-4181-ace2-30def4a3d211 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Lock "2f1db5e2-0b25-4d61-9dd3-038811b4eda1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.634s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:13:28 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:28 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:28 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:28 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:28 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Acquiring lock "fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:13:28 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Lock "fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:13:28 user nova-compute[74683]: DEBUG nova.compute.manager [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Starting instance... {{(pid=74683) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 11:13:28 user nova-compute[74683]: DEBUG nova.compute.manager [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Instance event wait completed in 0 seconds for  {{(pid=74683) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 11:13:28 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Guest created on hypervisor {{(pid=74683) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 11:13:28 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Instance spawned successfully.
Oct 16 11:13:28 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:28 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 11:13:28 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:13:28 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:13:28 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74683) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 11:13:28 user nova-compute[74683]: INFO nova.compute.claims [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Claim successful on node user
Oct 16 11:13:28 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Found default for hw_cdrom_bus of ide {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:13:28 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Found default for hw_disk_bus of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:13:28 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Found default for hw_input_bus of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:13:28 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Found default for hw_pointer_model of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:13:28 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Found default for hw_video_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:13:28 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Found default for hw_vif_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:13:29 user nova-compute[74683]: INFO nova.compute.manager [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Took 14.77 seconds to spawn the instance on the hypervisor.
Oct 16 11:13:29 user nova-compute[74683]: DEBUG nova.compute.manager [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:13:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:29 user nova-compute[74683]: INFO nova.compute.manager [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Took 16.00 seconds to build instance.
Oct 16 11:13:29 user nova-compute[74683]: DEBUG nova.compute.manager [req-b4344dfb-2ea9-4e29-b3a6-41603f62427a req-6eefbd19-e670-48dd-b874-e48dc96fa76e service nova] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Received event network-vif-plugged-d46f88ce-60a8-4ce5-989a-6d7b9eb90d28 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:13:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b4344dfb-2ea9-4e29-b3a6-41603f62427a req-6eefbd19-e670-48dd-b874-e48dc96fa76e service nova] Acquiring lock "427b793c-ae47-451c-bbc5-589d6ce1d2bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:13:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b4344dfb-2ea9-4e29-b3a6-41603f62427a req-6eefbd19-e670-48dd-b874-e48dc96fa76e service nova] Lock "427b793c-ae47-451c-bbc5-589d6ce1d2bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:13:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b4344dfb-2ea9-4e29-b3a6-41603f62427a req-6eefbd19-e670-48dd-b874-e48dc96fa76e service nova] Lock "427b793c-ae47-451c-bbc5-589d6ce1d2bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:13:29 user nova-compute[74683]: DEBUG nova.compute.manager [req-b4344dfb-2ea9-4e29-b3a6-41603f62427a req-6eefbd19-e670-48dd-b874-e48dc96fa76e service nova] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] No waiting events found dispatching network-vif-plugged-d46f88ce-60a8-4ce5-989a-6d7b9eb90d28 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:13:29 user nova-compute[74683]: WARNING nova.compute.manager [req-b4344dfb-2ea9-4e29-b3a6-41603f62427a req-6eefbd19-e670-48dd-b874-e48dc96fa76e service nova] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Received unexpected event network-vif-plugged-d46f88ce-60a8-4ce5-989a-6d7b9eb90d28 for instance with vm_state active and task_state None.
Oct 16 11:13:29 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:13:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-3f753126-c3aa-436f-89e6-03290f37a4c4 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Lock "f192d1ec-311d-4a30-9766-361b27a8dae8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.201s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:13:29 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:13:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.727s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:13:29 user nova-compute[74683]: DEBUG nova.compute.manager [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Start building networks asynchronously for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 11:13:29 user nova-compute[74683]: DEBUG nova.compute.manager [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Allocating IP information in the background. {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 11:13:29 user nova-compute[74683]: DEBUG nova.network.neutron [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] allocate_for_instance() {{(pid=74683) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 11:13:29 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 11:13:29 user nova-compute[74683]: DEBUG nova.compute.manager [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Start building block device mappings for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 11:13:29 user nova-compute[74683]: DEBUG nova.policy [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '77caa7602ea343f4a0932cc033e1fc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e03b7938f054e1fadb9f650ac8db1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74683) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 11:13:30 user nova-compute[74683]: DEBUG nova.compute.manager [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Start spawning the instance on the hypervisor. {{(pid=74683) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 11:13:30 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Creating instance directory {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 11:13:30 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Creating image(s)
Oct 16 11:13:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Acquiring lock "/opt/stack/data/nova/instances/fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:13:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Lock "/opt/stack/data/nova/instances/fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:13:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Lock "/opt/stack/data/nova/instances/fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:13:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:13:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.292s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:13:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Acquiring lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:13:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:13:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:13:30 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.274s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:13:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7/disk 1073741824 {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:13:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7/disk 1073741824" returned: 0 in 0.096s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:13:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.382s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:13:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:13:31 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.320s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:13:31 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7/disk. size=1073741824 {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 11:13:31 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:13:31 user nova-compute[74683]: DEBUG nova.network.neutron [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Successfully created port: 4e82d9f4-a743-4e67-bc9d-e9f7c527b102 {{(pid=74683) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 11:13:31 user nova-compute[74683]: DEBUG nova.compute.manager [req-82e5edc2-348b-4f9f-b4b4-8f751131e0f4 req-6c341849-c7b0-4b75-ae01-6a1a998f3a07 service nova] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Received event network-vif-plugged-d46f88ce-60a8-4ce5-989a-6d7b9eb90d28 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:13:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-82e5edc2-348b-4f9f-b4b4-8f751131e0f4 req-6c341849-c7b0-4b75-ae01-6a1a998f3a07 service nova] Acquiring lock "427b793c-ae47-451c-bbc5-589d6ce1d2bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:13:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-82e5edc2-348b-4f9f-b4b4-8f751131e0f4 req-6c341849-c7b0-4b75-ae01-6a1a998f3a07 service nova] Lock "427b793c-ae47-451c-bbc5-589d6ce1d2bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:13:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-82e5edc2-348b-4f9f-b4b4-8f751131e0f4 req-6c341849-c7b0-4b75-ae01-6a1a998f3a07 service nova] Lock "427b793c-ae47-451c-bbc5-589d6ce1d2bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:13:31 user nova-compute[74683]: DEBUG nova.compute.manager [req-82e5edc2-348b-4f9f-b4b4-8f751131e0f4 req-6c341849-c7b0-4b75-ae01-6a1a998f3a07 service nova] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] No waiting events found dispatching network-vif-plugged-d46f88ce-60a8-4ce5-989a-6d7b9eb90d28 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:13:31 user nova-compute[74683]: WARNING nova.compute.manager [req-82e5edc2-348b-4f9f-b4b4-8f751131e0f4 req-6c341849-c7b0-4b75-ae01-6a1a998f3a07 service nova] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Received unexpected event network-vif-plugged-d46f88ce-60a8-4ce5-989a-6d7b9eb90d28 for instance with vm_state active and task_state None.
Oct 16 11:13:31 user nova-compute[74683]: DEBUG nova.compute.manager [req-82e5edc2-348b-4f9f-b4b4-8f751131e0f4 req-6c341849-c7b0-4b75-ae01-6a1a998f3a07 service nova] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Received event network-vif-plugged-fab663e7-134f-4cde-8cf1-2ccb1c83a812 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:13:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-82e5edc2-348b-4f9f-b4b4-8f751131e0f4 req-6c341849-c7b0-4b75-ae01-6a1a998f3a07 service nova] Acquiring lock "18a77385-fab9-4ea0-8aa6-666cf7e798a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:13:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-82e5edc2-348b-4f9f-b4b4-8f751131e0f4 req-6c341849-c7b0-4b75-ae01-6a1a998f3a07 service nova] Lock "18a77385-fab9-4ea0-8aa6-666cf7e798a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:13:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-82e5edc2-348b-4f9f-b4b4-8f751131e0f4 req-6c341849-c7b0-4b75-ae01-6a1a998f3a07 service nova] Lock "18a77385-fab9-4ea0-8aa6-666cf7e798a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:13:31 user nova-compute[74683]: DEBUG nova.compute.manager [req-82e5edc2-348b-4f9f-b4b4-8f751131e0f4 req-6c341849-c7b0-4b75-ae01-6a1a998f3a07 service nova] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] No waiting events found dispatching network-vif-plugged-fab663e7-134f-4cde-8cf1-2ccb1c83a812 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:13:31 user nova-compute[74683]: WARNING nova.compute.manager [req-82e5edc2-348b-4f9f-b4b4-8f751131e0f4 req-6c341849-c7b0-4b75-ae01-6a1a998f3a07 service nova] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Received unexpected event network-vif-plugged-fab663e7-134f-4cde-8cf1-2ccb1c83a812 for instance with vm_state active and task_state None.
Oct 16 11:13:31 user nova-compute[74683]: DEBUG nova.compute.manager [req-82e5edc2-348b-4f9f-b4b4-8f751131e0f4 req-6c341849-c7b0-4b75-ae01-6a1a998f3a07 service nova] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Received event network-vif-plugged-fab663e7-134f-4cde-8cf1-2ccb1c83a812 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:13:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-82e5edc2-348b-4f9f-b4b4-8f751131e0f4 req-6c341849-c7b0-4b75-ae01-6a1a998f3a07 service nova] Acquiring lock "18a77385-fab9-4ea0-8aa6-666cf7e798a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:13:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-82e5edc2-348b-4f9f-b4b4-8f751131e0f4 req-6c341849-c7b0-4b75-ae01-6a1a998f3a07 service nova] Lock "18a77385-fab9-4ea0-8aa6-666cf7e798a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:13:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-82e5edc2-348b-4f9f-b4b4-8f751131e0f4 req-6c341849-c7b0-4b75-ae01-6a1a998f3a07 service nova] Lock "18a77385-fab9-4ea0-8aa6-666cf7e798a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:13:31 user nova-compute[74683]: DEBUG nova.compute.manager [req-82e5edc2-348b-4f9f-b4b4-8f751131e0f4 req-6c341849-c7b0-4b75-ae01-6a1a998f3a07 service nova] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] No waiting events found dispatching network-vif-plugged-fab663e7-134f-4cde-8cf1-2ccb1c83a812 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:13:31 user nova-compute[74683]: WARNING nova.compute.manager [req-82e5edc2-348b-4f9f-b4b4-8f751131e0f4 req-6c341849-c7b0-4b75-ae01-6a1a998f3a07 service nova] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Received unexpected event network-vif-plugged-fab663e7-134f-4cde-8cf1-2ccb1c83a812 for instance with vm_state active and task_state None.
Oct 16 11:13:31 user nova-compute[74683]: DEBUG nova.compute.manager [req-82e5edc2-348b-4f9f-b4b4-8f751131e0f4 req-6c341849-c7b0-4b75-ae01-6a1a998f3a07 service nova] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Received event network-vif-plugged-05cf5b29-bd7b-498d-b3d0-b7de22551793 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:13:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-82e5edc2-348b-4f9f-b4b4-8f751131e0f4 req-6c341849-c7b0-4b75-ae01-6a1a998f3a07 service nova] Acquiring lock "bd60be9c-0ff3-40a5-aaab-f31fa88a67f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:13:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-82e5edc2-348b-4f9f-b4b4-8f751131e0f4 req-6c341849-c7b0-4b75-ae01-6a1a998f3a07 service nova] Lock "bd60be9c-0ff3-40a5-aaab-f31fa88a67f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:13:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-82e5edc2-348b-4f9f-b4b4-8f751131e0f4 req-6c341849-c7b0-4b75-ae01-6a1a998f3a07 service nova] Lock "bd60be9c-0ff3-40a5-aaab-f31fa88a67f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:13:31 user nova-compute[74683]: DEBUG nova.compute.manager [req-82e5edc2-348b-4f9f-b4b4-8f751131e0f4 req-6c341849-c7b0-4b75-ae01-6a1a998f3a07 service nova] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] No waiting events found dispatching network-vif-plugged-05cf5b29-bd7b-498d-b3d0-b7de22551793 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:13:31 user nova-compute[74683]: WARNING nova.compute.manager [req-82e5edc2-348b-4f9f-b4b4-8f751131e0f4 req-6c341849-c7b0-4b75-ae01-6a1a998f3a07 service nova] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Received unexpected event network-vif-plugged-05cf5b29-bd7b-498d-b3d0-b7de22551793 for instance with vm_state active and task_state None.
Oct 16 11:13:31 user nova-compute[74683]: DEBUG nova.compute.manager [req-82e5edc2-348b-4f9f-b4b4-8f751131e0f4 req-6c341849-c7b0-4b75-ae01-6a1a998f3a07 service nova] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Received event network-vif-plugged-05cf5b29-bd7b-498d-b3d0-b7de22551793 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:13:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-82e5edc2-348b-4f9f-b4b4-8f751131e0f4 req-6c341849-c7b0-4b75-ae01-6a1a998f3a07 service nova] Acquiring lock "bd60be9c-0ff3-40a5-aaab-f31fa88a67f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:13:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-82e5edc2-348b-4f9f-b4b4-8f751131e0f4 req-6c341849-c7b0-4b75-ae01-6a1a998f3a07 service nova] Lock "bd60be9c-0ff3-40a5-aaab-f31fa88a67f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:13:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-82e5edc2-348b-4f9f-b4b4-8f751131e0f4 req-6c341849-c7b0-4b75-ae01-6a1a998f3a07 service nova] Lock "bd60be9c-0ff3-40a5-aaab-f31fa88a67f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:13:31 user nova-compute[74683]: DEBUG nova.compute.manager [req-82e5edc2-348b-4f9f-b4b4-8f751131e0f4 req-6c341849-c7b0-4b75-ae01-6a1a998f3a07 service nova] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] No waiting events found dispatching network-vif-plugged-05cf5b29-bd7b-498d-b3d0-b7de22551793 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:13:31 user nova-compute[74683]: WARNING nova.compute.manager [req-82e5edc2-348b-4f9f-b4b4-8f751131e0f4 req-6c341849-c7b0-4b75-ae01-6a1a998f3a07 service nova] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Received unexpected event network-vif-plugged-05cf5b29-bd7b-498d-b3d0-b7de22551793 for instance with vm_state active and task_state None.
Oct 16 11:13:31 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7/disk --force-share --output=json" returned: 0 in 0.408s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:13:31 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Cannot resize image /opt/stack/data/nova/instances/fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7/disk to a smaller size. {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 11:13:31 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Created local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 11:13:31 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Ensure instance console log exists: /opt/stack/data/nova/instances/fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7/console.log {{(pid=74683) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 11:13:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:13:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:13:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:13:32 user nova-compute[74683]: DEBUG nova.network.neutron [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Successfully updated port: 4e82d9f4-a743-4e67-bc9d-e9f7c527b102 {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:13:32 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Acquiring lock "refresh_cache-fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:13:32 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Acquired lock "refresh_cache-fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:13:32 user nova-compute[74683]: DEBUG nova.network.neutron [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:13:32 user nova-compute[74683]: DEBUG nova.compute.manager [req-02a37cf7-d846-496f-887c-8afcc86e4ea5 req-4dc54672-bc46-4fac-9013-ae82e13fcf3e service nova] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Received event network-vif-plugged-9476563e-0758-43d9-b920-87f412881869 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:13:32 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-02a37cf7-d846-496f-887c-8afcc86e4ea5 req-4dc54672-bc46-4fac-9013-ae82e13fcf3e service nova] Acquiring lock "2f1db5e2-0b25-4d61-9dd3-038811b4eda1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:13:32 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-02a37cf7-d846-496f-887c-8afcc86e4ea5 req-4dc54672-bc46-4fac-9013-ae82e13fcf3e service nova] Lock "2f1db5e2-0b25-4d61-9dd3-038811b4eda1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:13:32 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-02a37cf7-d846-496f-887c-8afcc86e4ea5 req-4dc54672-bc46-4fac-9013-ae82e13fcf3e service nova] Lock "2f1db5e2-0b25-4d61-9dd3-038811b4eda1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:13:32 user nova-compute[74683]: DEBUG nova.compute.manager [req-02a37cf7-d846-496f-887c-8afcc86e4ea5 req-4dc54672-bc46-4fac-9013-ae82e13fcf3e service nova] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] No waiting events found dispatching network-vif-plugged-9476563e-0758-43d9-b920-87f412881869 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:13:32 user nova-compute[74683]: WARNING nova.compute.manager [req-02a37cf7-d846-496f-887c-8afcc86e4ea5 req-4dc54672-bc46-4fac-9013-ae82e13fcf3e service nova] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Received unexpected event network-vif-plugged-9476563e-0758-43d9-b920-87f412881869 for instance with vm_state active and task_state None.
Oct 16 11:13:32 user nova-compute[74683]: DEBUG nova.compute.manager [req-2579297b-7fa0-49c8-ac7a-2fbbd94e6089 req-83f3043c-58be-4446-96bf-dbe21b898af5 service nova] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Received event network-changed-4e82d9f4-a743-4e67-bc9d-e9f7c527b102 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:13:32 user nova-compute[74683]: DEBUG nova.compute.manager [req-2579297b-7fa0-49c8-ac7a-2fbbd94e6089 req-83f3043c-58be-4446-96bf-dbe21b898af5 service nova] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Refreshing instance network info cache due to event network-changed-4e82d9f4-a743-4e67-bc9d-e9f7c527b102. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:13:32 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-2579297b-7fa0-49c8-ac7a-2fbbd94e6089 req-83f3043c-58be-4446-96bf-dbe21b898af5 service nova] Acquiring lock "refresh_cache-fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:13:32 user nova-compute[74683]: DEBUG nova.network.neutron [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:13:33 user nova-compute[74683]: DEBUG nova.network.neutron [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Updating instance_info_cache with network_info: [{"id": "4e82d9f4-a743-4e67-bc9d-e9f7c527b102", "address": "fa:16:3e:5a:7a:f8", "network": {"id": "2bf14a39-69ea-4656-956a-f1578bb1836d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1838676509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e03b7938f054e1fadb9f650ac8db1c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e82d9f4-a7", "ovs_interfaceid": "4e82d9f4-a743-4e67-bc9d-e9f7c527b102", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:13:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Releasing lock "refresh_cache-fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:13:33 user nova-compute[74683]: DEBUG nova.compute.manager [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Instance network_info: |[{"id": "4e82d9f4-a743-4e67-bc9d-e9f7c527b102", "address": "fa:16:3e:5a:7a:f8", "network": {"id": "2bf14a39-69ea-4656-956a-f1578bb1836d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1838676509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e03b7938f054e1fadb9f650ac8db1c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e82d9f4-a7", "ovs_interfaceid": "4e82d9f4-a743-4e67-bc9d-e9f7c527b102", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 11:13:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-2579297b-7fa0-49c8-ac7a-2fbbd94e6089 req-83f3043c-58be-4446-96bf-dbe21b898af5 service nova] Acquired lock "refresh_cache-fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:13:33 user nova-compute[74683]: DEBUG nova.network.neutron [req-2579297b-7fa0-49c8-ac7a-2fbbd94e6089 req-83f3043c-58be-4446-96bf-dbe21b898af5 service nova] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Refreshing network info cache for port 4e82d9f4-a743-4e67-bc9d-e9f7c527b102 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:13:33 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Start _get_guest_xml network_info=[{"id": "4e82d9f4-a743-4e67-bc9d-e9f7c527b102", "address": "fa:16:3e:5a:7a:f8", "network": {"id": "2bf14a39-69ea-4656-956a-f1578bb1836d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1838676509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e03b7938f054e1fadb9f650ac8db1c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e82d9f4-a7", "ovs_interfaceid": "4e82d9f4-a743-4e67-bc9d-e9f7c527b102", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:13:33 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:13:33 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:13:33 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:13:33 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:13:33 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:13:33 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:13:33 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:13:33 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:13:33 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:13:33 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:13:33 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:13:33 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:13:33 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:13:33 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:13:33 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:13:33 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:13:33 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:13:33 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:13:33 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:13:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-676236564',display_name='tempest-VolumesAdminNegativeTest-server-676236564',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-676236564',id=6,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBALOxjnBjjsOSmQoNLhcslR/cpaTlGXDqbHa1zWyvRLB0VJVnnyy1KuXAxc5L+D/MSzkPXdnPtM+JPZK2n0GL1IuR3TXGA40TfU6MQlW8vKtdRUN/3YmKi7Ef9j0Jj3SUg==',key_name='tempest-keypair-2061755854',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e03b7938f054e1fadb9f650ac8db1c9',ramdisk_id='',reservation_id='r-gupj191j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-191985547',owner_user_name='tempest-VolumesAdminNegativeTest-191985547-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:13:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77caa7602ea343f4a0932cc033e1fc82',uuid=fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e82d9f4-a743-4e67-bc9d-e9f7c527b102", "address": "fa:16:3e:5a:7a:f8", "network": {"id": "2bf14a39-69ea-4656-956a-f1578bb1836d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1838676509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e03b7938f054e1fadb9f650ac8db1c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e82d9f4-a7", "ovs_interfaceid": "4e82d9f4-a743-4e67-bc9d-e9f7c527b102", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:13:33 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Converting VIF {"id": "4e82d9f4-a743-4e67-bc9d-e9f7c527b102", "address": "fa:16:3e:5a:7a:f8", "network": {"id": "2bf14a39-69ea-4656-956a-f1578bb1836d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1838676509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e03b7938f054e1fadb9f650ac8db1c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e82d9f4-a7", "ovs_interfaceid": "4e82d9f4-a743-4e67-bc9d-e9f7c527b102", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:13:33 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:7a:f8,bridge_name='br-int',has_traffic_filtering=True,id=4e82d9f4-a743-4e67-bc9d-e9f7c527b102,network=Network(2bf14a39-69ea-4656-956a-f1578bb1836d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e82d9f4-a7') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:13:33 user nova-compute[74683]: DEBUG nova.objects.instance [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Lazy-loading 'pci_devices' on Instance uuid fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:13:33 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:13:33 user nova-compute[74683]:   <uuid>fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7</uuid>
Oct 16 11:13:33 user nova-compute[74683]:   <name>instance-00000006</name>
Oct 16 11:13:33 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:13:33 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:13:33 user nova-compute[74683]:   <metadata>
Oct 16 11:13:33 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:13:33 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:13:33 user nova-compute[74683]:       <nova:name>tempest-VolumesAdminNegativeTest-server-676236564</nova:name>
Oct 16 11:13:33 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:13:33</nova:creationTime>
Oct 16 11:13:33 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:13:33 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:13:33 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:13:33 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:13:33 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:13:33 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:13:33 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:13:33 user nova-compute[74683]:       <nova:owner>
Oct 16 11:13:33 user nova-compute[74683]:         <nova:user uuid="77caa7602ea343f4a0932cc033e1fc82">tempest-VolumesAdminNegativeTest-191985547-project-member</nova:user>
Oct 16 11:13:33 user nova-compute[74683]:         <nova:project uuid="2e03b7938f054e1fadb9f650ac8db1c9">tempest-VolumesAdminNegativeTest-191985547</nova:project>
Oct 16 11:13:33 user nova-compute[74683]:       </nova:owner>
Oct 16 11:13:33 user nova-compute[74683]:       <nova:root type="image" uuid="0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f"/>
Oct 16 11:13:33 user nova-compute[74683]:       <nova:ports>
Oct 16 11:13:33 user nova-compute[74683]:         <nova:port uuid="4e82d9f4-a743-4e67-bc9d-e9f7c527b102">
Oct 16 11:13:33 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 16 11:13:33 user nova-compute[74683]:         </nova:port>
Oct 16 11:13:33 user nova-compute[74683]:       </nova:ports>
Oct 16 11:13:33 user nova-compute[74683]:     </nova:instance>
Oct 16 11:13:33 user nova-compute[74683]:   </metadata>
Oct 16 11:13:33 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:13:33 user nova-compute[74683]:     <system>
Oct 16 11:13:33 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:13:33 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:13:33 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:13:33 user nova-compute[74683]:       <entry name="serial">fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7</entry>
Oct 16 11:13:33 user nova-compute[74683]:       <entry name="uuid">fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7</entry>
Oct 16 11:13:33 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:13:33 user nova-compute[74683]:     </system>
Oct 16 11:13:33 user nova-compute[74683]:   </sysinfo>
Oct 16 11:13:33 user nova-compute[74683]:   <os>
Oct 16 11:13:33 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:13:33 user nova-compute[74683]:     <boot dev="hd"/>
Oct 16 11:13:33 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:13:33 user nova-compute[74683]:   </os>
Oct 16 11:13:33 user nova-compute[74683]:   <features>
Oct 16 11:13:33 user nova-compute[74683]:     <acpi/>
Oct 16 11:13:33 user nova-compute[74683]:     <apic/>
Oct 16 11:13:33 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:13:33 user nova-compute[74683]:   </features>
Oct 16 11:13:33 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:13:33 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:13:33 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:13:33 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:13:33 user nova-compute[74683]:   </clock>
Oct 16 11:13:33 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:13:33 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:13:33 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:13:33 user nova-compute[74683]:   </cpu>
Oct 16 11:13:33 user nova-compute[74683]:   <devices>
Oct 16 11:13:33 user nova-compute[74683]:     <disk type="file" device="disk">
Oct 16 11:13:33 user nova-compute[74683]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 11:13:33 user nova-compute[74683]:       <source file="/opt/stack/data/nova/instances/fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7/disk"/>
Oct 16 11:13:33 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:13:33 user nova-compute[74683]:     </disk>
Oct 16 11:13:33 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:13:33 user nova-compute[74683]:       <mac address="fa:16:3e:5a:7a:f8"/>
Oct 16 11:13:33 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:13:33 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:13:33 user nova-compute[74683]:       <target dev="tap4e82d9f4-a7"/>
Oct 16 11:13:33 user nova-compute[74683]:     </interface>
Oct 16 11:13:33 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:13:33 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7/console.log" append="off"/>
Oct 16 11:13:33 user nova-compute[74683]:     </serial>
Oct 16 11:13:33 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:13:33 user nova-compute[74683]:     <video>
Oct 16 11:13:33 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:13:33 user nova-compute[74683]:     </video>
Oct 16 11:13:33 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:13:33 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:13:33 user nova-compute[74683]:     </rng>
Oct 16 11:13:33 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:13:33 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:13:33 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:13:33 user nova-compute[74683]:     </memballoon>
Oct 16 11:13:33 user nova-compute[74683]:   </devices>
Oct 16 11:13:33 user nova-compute[74683]: </domain>
Oct 16 11:13:33 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:13:33 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:13:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-676236564',display_name='tempest-VolumesAdminNegativeTest-server-676236564',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-676236564',id=6,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBALOxjnBjjsOSmQoNLhcslR/cpaTlGXDqbHa1zWyvRLB0VJVnnyy1KuXAxc5L+D/MSzkPXdnPtM+JPZK2n0GL1IuR3TXGA40TfU6MQlW8vKtdRUN/3YmKi7Ef9j0Jj3SUg==',key_name='tempest-keypair-2061755854',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e03b7938f054e1fadb9f650ac8db1c9',ramdisk_id='',reservation_id='r-gupj191j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-191985547',owner_user_name='tempest-VolumesAdminNegativeTest-191985547-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:13:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77caa7602ea343f4a0932cc033e1fc82',uuid=fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e82d9f4-a743-4e67-bc9d-e9f7c527b102", "address": "fa:16:3e:5a:7a:f8", "network": {"id": "2bf14a39-69ea-4656-956a-f1578bb1836d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1838676509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e03b7938f054e1fadb9f650ac8db1c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e82d9f4-a7", "ovs_interfaceid": "4e82d9f4-a743-4e67-bc9d-e9f7c527b102", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:13:33 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Converting VIF {"id": "4e82d9f4-a743-4e67-bc9d-e9f7c527b102", "address": "fa:16:3e:5a:7a:f8", "network": {"id": "2bf14a39-69ea-4656-956a-f1578bb1836d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1838676509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e03b7938f054e1fadb9f650ac8db1c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e82d9f4-a7", "ovs_interfaceid": "4e82d9f4-a743-4e67-bc9d-e9f7c527b102", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:13:33 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:7a:f8,bridge_name='br-int',has_traffic_filtering=True,id=4e82d9f4-a743-4e67-bc9d-e9f7c527b102,network=Network(2bf14a39-69ea-4656-956a-f1578bb1836d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e82d9f4-a7') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:13:33 user nova-compute[74683]: DEBUG os_vif [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:7a:f8,bridge_name='br-int',has_traffic_filtering=True,id=4e82d9f4-a743-4e67-bc9d-e9f7c527b102,network=Network(2bf14a39-69ea-4656-956a-f1578bb1836d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e82d9f4-a7') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:13:33 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:33 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:13:33 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:13:33 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:33 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3fd4743e-ff13-5470-b13d-685b3716ea7e', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:13:33 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:33 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:13:33 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:33 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4e82d9f4-a7, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:13:33 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4e82d9f4-a7, col_values=(('qos', UUID('1e9f7549-fd76-416f-af4e-5f885a613288')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:13:33 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4e82d9f4-a7, col_values=(('external_ids', {'iface-id': '4e82d9f4-a743-4e67-bc9d-e9f7c527b102', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:7a:f8', 'vm-uuid': 'fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:13:33 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:33 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:13:33 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:33 user nova-compute[74683]: INFO os_vif [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:7a:f8,bridge_name='br-int',has_traffic_filtering=True,id=4e82d9f4-a743-4e67-bc9d-e9f7c527b102,network=Network(2bf14a39-69ea-4656-956a-f1578bb1836d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e82d9f4-a7')
Oct 16 11:13:33 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:13:33 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] No VIF found with MAC fa:16:3e:5a:7a:f8, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:13:33 user nova-compute[74683]: DEBUG nova.network.neutron [req-2579297b-7fa0-49c8-ac7a-2fbbd94e6089 req-83f3043c-58be-4446-96bf-dbe21b898af5 service nova] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Updated VIF entry in instance network info cache for port 4e82d9f4-a743-4e67-bc9d-e9f7c527b102. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:13:33 user nova-compute[74683]: DEBUG nova.network.neutron [req-2579297b-7fa0-49c8-ac7a-2fbbd94e6089 req-83f3043c-58be-4446-96bf-dbe21b898af5 service nova] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Updating instance_info_cache with network_info: [{"id": "4e82d9f4-a743-4e67-bc9d-e9f7c527b102", "address": "fa:16:3e:5a:7a:f8", "network": {"id": "2bf14a39-69ea-4656-956a-f1578bb1836d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1838676509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e03b7938f054e1fadb9f650ac8db1c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e82d9f4-a7", "ovs_interfaceid": "4e82d9f4-a743-4e67-bc9d-e9f7c527b102", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:13:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-2579297b-7fa0-49c8-ac7a-2fbbd94e6089 req-83f3043c-58be-4446-96bf-dbe21b898af5 service nova] Releasing lock "refresh_cache-fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:13:34 user nova-compute[74683]: DEBUG nova.compute.manager [req-5505d4e0-b6f9-4590-9825-f68e68b5c4dd req-7ed2c5e2-3ec6-4666-bcd7-cc7952bcf06c service nova] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Received event network-vif-plugged-9476563e-0758-43d9-b920-87f412881869 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:13:34 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-5505d4e0-b6f9-4590-9825-f68e68b5c4dd req-7ed2c5e2-3ec6-4666-bcd7-cc7952bcf06c service nova] Acquiring lock "2f1db5e2-0b25-4d61-9dd3-038811b4eda1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:13:34 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-5505d4e0-b6f9-4590-9825-f68e68b5c4dd req-7ed2c5e2-3ec6-4666-bcd7-cc7952bcf06c service nova] Lock "2f1db5e2-0b25-4d61-9dd3-038811b4eda1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:13:34 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-5505d4e0-b6f9-4590-9825-f68e68b5c4dd req-7ed2c5e2-3ec6-4666-bcd7-cc7952bcf06c service nova] Lock "2f1db5e2-0b25-4d61-9dd3-038811b4eda1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:13:34 user nova-compute[74683]: DEBUG nova.compute.manager [req-5505d4e0-b6f9-4590-9825-f68e68b5c4dd req-7ed2c5e2-3ec6-4666-bcd7-cc7952bcf06c service nova] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] No waiting events found dispatching network-vif-plugged-9476563e-0758-43d9-b920-87f412881869 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:13:34 user nova-compute[74683]: WARNING nova.compute.manager [req-5505d4e0-b6f9-4590-9825-f68e68b5c4dd req-7ed2c5e2-3ec6-4666-bcd7-cc7952bcf06c service nova] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Received unexpected event network-vif-plugged-9476563e-0758-43d9-b920-87f412881869 for instance with vm_state active and task_state None.
Oct 16 11:13:34 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:35 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:35 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:35 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:35 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:38 user nova-compute[74683]: DEBUG nova.compute.manager [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Instance event wait completed in 0 seconds for  {{(pid=74683) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 11:13:38 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Guest created on hypervisor {{(pid=74683) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 11:13:38 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Instance spawned successfully.
Oct 16 11:13:38 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 11:13:38 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Found default for hw_cdrom_bus of ide {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:13:38 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Found default for hw_disk_bus of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:13:38 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Found default for hw_input_bus of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:13:38 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Found default for hw_pointer_model of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:13:38 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Found default for hw_video_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:13:38 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Found default for hw_vif_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:13:38 user nova-compute[74683]: INFO nova.compute.manager [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Took 8.14 seconds to spawn the instance on the hypervisor.
Oct 16 11:13:38 user nova-compute[74683]: DEBUG nova.compute.manager [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:13:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:38 user nova-compute[74683]: INFO nova.compute.manager [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Took 9.61 seconds to build instance.
Oct 16 11:13:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f046bbd6-2a19-4a3b-a75e-6021a4d3ded9 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Lock "fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.829s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:13:39 user nova-compute[74683]: DEBUG nova.compute.manager [req-f441ba26-652a-4ef8-bd6c-6aaa4f36a9f5 req-3292a2a1-02e8-4f09-a147-8f53f9a51c7d service nova] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Received event network-vif-plugged-4e82d9f4-a743-4e67-bc9d-e9f7c527b102 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:13:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f441ba26-652a-4ef8-bd6c-6aaa4f36a9f5 req-3292a2a1-02e8-4f09-a147-8f53f9a51c7d service nova] Acquiring lock "fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:13:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f441ba26-652a-4ef8-bd6c-6aaa4f36a9f5 req-3292a2a1-02e8-4f09-a147-8f53f9a51c7d service nova] Lock "fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:13:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f441ba26-652a-4ef8-bd6c-6aaa4f36a9f5 req-3292a2a1-02e8-4f09-a147-8f53f9a51c7d service nova] Lock "fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:13:39 user nova-compute[74683]: DEBUG nova.compute.manager [req-f441ba26-652a-4ef8-bd6c-6aaa4f36a9f5 req-3292a2a1-02e8-4f09-a147-8f53f9a51c7d service nova] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] No waiting events found dispatching network-vif-plugged-4e82d9f4-a743-4e67-bc9d-e9f7c527b102 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:13:39 user nova-compute[74683]: WARNING nova.compute.manager [req-f441ba26-652a-4ef8-bd6c-6aaa4f36a9f5 req-3292a2a1-02e8-4f09-a147-8f53f9a51c7d service nova] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Received unexpected event network-vif-plugged-4e82d9f4-a743-4e67-bc9d-e9f7c527b102 for instance with vm_state active and task_state None.
Oct 16 11:13:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Acquiring lock "81290b55-8c05-4925-b445-d121b1bff1a2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:13:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Lock "81290b55-8c05-4925-b445-d121b1bff1a2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:13:40 user nova-compute[74683]: DEBUG nova.compute.manager [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Starting instance... {{(pid=74683) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 11:13:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:13:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:13:40 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74683) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 11:13:40 user nova-compute[74683]: INFO nova.compute.claims [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Claim successful on node user
Oct 16 11:13:40 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:40 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:40 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:13:40 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:13:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.587s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:13:40 user nova-compute[74683]: DEBUG nova.compute.manager [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Start building networks asynchronously for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 11:13:40 user nova-compute[74683]: DEBUG nova.compute.manager [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Allocating IP information in the background. {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 11:13:40 user nova-compute[74683]: DEBUG nova.network.neutron [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] allocate_for_instance() {{(pid=74683) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 11:13:41 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Oct 16 11:13:41 user nova-compute[74683]: DEBUG nova.compute.manager [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Start building block device mappings for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 11:13:41 user nova-compute[74683]: DEBUG nova.policy [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7cc93ef469234e5e832edef72e1efb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c6b7c7954f42638e1075cc9d0afbd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74683) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 11:13:41 user nova-compute[74683]: DEBUG nova.compute.manager [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Start spawning the instance on the hypervisor. {{(pid=74683) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 11:13:41 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Creating instance directory {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 11:13:41 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Creating image(s)
Oct 16 11:13:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Acquiring lock "/opt/stack/data/nova/instances/81290b55-8c05-4925-b445-d121b1bff1a2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:13:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Lock "/opt/stack/data/nova/instances/81290b55-8c05-4925-b445-d121b1bff1a2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:13:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Lock "/opt/stack/data/nova/instances/81290b55-8c05-4925-b445-d121b1bff1a2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:13:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Acquiring lock "ac1a8389430fdf84d804d757a831a83e5e15e188" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:13:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Lock "ac1a8389430fdf84d804d757a831a83e5e15e188" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:13:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ac1a8389430fdf84d804d757a831a83e5e15e188.part --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:13:42 user nova-compute[74683]: DEBUG nova.compute.manager [req-bd486d55-2245-49b9-89c3-87eca908ad62 req-a5a0e81b-9998-4942-9109-a833f3820e8a service nova] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Received event network-vif-plugged-4e82d9f4-a743-4e67-bc9d-e9f7c527b102 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:13:42 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-bd486d55-2245-49b9-89c3-87eca908ad62 req-a5a0e81b-9998-4942-9109-a833f3820e8a service nova] Acquiring lock "fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:13:42 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-bd486d55-2245-49b9-89c3-87eca908ad62 req-a5a0e81b-9998-4942-9109-a833f3820e8a service nova] Lock "fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:13:42 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-bd486d55-2245-49b9-89c3-87eca908ad62 req-a5a0e81b-9998-4942-9109-a833f3820e8a service nova] Lock "fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:13:42 user nova-compute[74683]: DEBUG nova.compute.manager [req-bd486d55-2245-49b9-89c3-87eca908ad62 req-a5a0e81b-9998-4942-9109-a833f3820e8a service nova] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] No waiting events found dispatching network-vif-plugged-4e82d9f4-a743-4e67-bc9d-e9f7c527b102 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:13:42 user nova-compute[74683]: WARNING nova.compute.manager [req-bd486d55-2245-49b9-89c3-87eca908ad62 req-a5a0e81b-9998-4942-9109-a833f3820e8a service nova] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Received unexpected event network-vif-plugged-4e82d9f4-a743-4e67-bc9d-e9f7c527b102 for instance with vm_state active and task_state None.
Oct 16 11:13:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ac1a8389430fdf84d804d757a831a83e5e15e188.part --force-share --output=json" returned: 0 in 0.386s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:13:42 user nova-compute[74683]: DEBUG nova.virt.images [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] f92565e5-7521-42b8-88f7-0e17710e3812 was qcow2, converting to raw {{(pid=74683) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 16 11:13:42 user nova-compute[74683]: DEBUG nova.privsep.utils [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74683) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 11:13:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ac1a8389430fdf84d804d757a831a83e5e15e188.part /opt/stack/data/nova/instances/_base/ac1a8389430fdf84d804d757a831a83e5e15e188.converted {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:13:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ac1a8389430fdf84d804d757a831a83e5e15e188.part /opt/stack/data/nova/instances/_base/ac1a8389430fdf84d804d757a831a83e5e15e188.converted" returned: 0 in 0.193s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:13:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ac1a8389430fdf84d804d757a831a83e5e15e188.converted --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:13:42 user nova-compute[74683]: DEBUG nova.network.neutron [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Successfully created port: 8b5f6bec-c96c-4b1d-bdf6-4012cc0a3fae {{(pid=74683) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 11:13:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ac1a8389430fdf84d804d757a831a83e5e15e188.converted --force-share --output=json" returned: 0 in 0.263s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:13:42 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Lock "ac1a8389430fdf84d804d757a831a83e5e15e188" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.414s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:13:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ac1a8389430fdf84d804d757a831a83e5e15e188 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:13:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ac1a8389430fdf84d804d757a831a83e5e15e188 --force-share --output=json" returned: 0 in 0.252s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:13:42 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Acquiring lock "ac1a8389430fdf84d804d757a831a83e5e15e188" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:13:42 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Lock "ac1a8389430fdf84d804d757a831a83e5e15e188" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:13:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ac1a8389430fdf84d804d757a831a83e5e15e188 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:13:43 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ac1a8389430fdf84d804d757a831a83e5e15e188 --force-share --output=json" returned: 0 in 0.238s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:13:43 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ac1a8389430fdf84d804d757a831a83e5e15e188,backing_fmt=raw /opt/stack/data/nova/instances/81290b55-8c05-4925-b445-d121b1bff1a2/disk 1073741824 {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:13:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:43 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ac1a8389430fdf84d804d757a831a83e5e15e188,backing_fmt=raw /opt/stack/data/nova/instances/81290b55-8c05-4925-b445-d121b1bff1a2/disk 1073741824" returned: 0 in 0.181s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:13:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Lock "ac1a8389430fdf84d804d757a831a83e5e15e188" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.427s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:13:43 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ac1a8389430fdf84d804d757a831a83e5e15e188 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:13:43 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ac1a8389430fdf84d804d757a831a83e5e15e188 --force-share --output=json" returned: 0 in 0.253s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:13:43 user nova-compute[74683]: DEBUG nova.network.neutron [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Successfully updated port: 8b5f6bec-c96c-4b1d-bdf6-4012cc0a3fae {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:13:43 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Checking if we can resize image /opt/stack/data/nova/instances/81290b55-8c05-4925-b445-d121b1bff1a2/disk. size=1073741824 {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 11:13:43 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81290b55-8c05-4925-b445-d121b1bff1a2/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:13:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Acquiring lock "refresh_cache-81290b55-8c05-4925-b445-d121b1bff1a2" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:13:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Acquired lock "refresh_cache-81290b55-8c05-4925-b445-d121b1bff1a2" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:13:43 user nova-compute[74683]: DEBUG nova.network.neutron [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:13:43 user nova-compute[74683]: DEBUG nova.network.neutron [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:13:43 user nova-compute[74683]: DEBUG nova.compute.manager [req-4906029b-31a5-4d5f-bfcd-8a455aca3be8 req-ed478461-59d9-4838-824f-143d60a704a2 service nova] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Received event network-changed-8b5f6bec-c96c-4b1d-bdf6-4012cc0a3fae {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:13:43 user nova-compute[74683]: DEBUG nova.compute.manager [req-4906029b-31a5-4d5f-bfcd-8a455aca3be8 req-ed478461-59d9-4838-824f-143d60a704a2 service nova] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Refreshing instance network info cache due to event network-changed-8b5f6bec-c96c-4b1d-bdf6-4012cc0a3fae. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:13:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-4906029b-31a5-4d5f-bfcd-8a455aca3be8 req-ed478461-59d9-4838-824f-143d60a704a2 service nova] Acquiring lock "refresh_cache-81290b55-8c05-4925-b445-d121b1bff1a2" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:13:44 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81290b55-8c05-4925-b445-d121b1bff1a2/disk --force-share --output=json" returned: 0 in 0.318s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:13:44 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Cannot resize image /opt/stack/data/nova/instances/81290b55-8c05-4925-b445-d121b1bff1a2/disk to a smaller size. {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 11:13:44 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Created local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 11:13:44 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Ensure instance console log exists: /opt/stack/data/nova/instances/81290b55-8c05-4925-b445-d121b1bff1a2/console.log {{(pid=74683) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 11:13:44 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:13:44 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:13:44 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:13:44 user nova-compute[74683]: DEBUG nova.network.neutron [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Updating instance_info_cache with network_info: [{"id": "8b5f6bec-c96c-4b1d-bdf6-4012cc0a3fae", "address": "fa:16:3e:f3:60:b8", "network": {"id": "55de7975-487e-4317-ac3e-9619e78b087c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-563245692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c6b7c7954f42638e1075cc9d0afbd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b5f6bec-c9", "ovs_interfaceid": "8b5f6bec-c96c-4b1d-bdf6-4012cc0a3fae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:13:44 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Releasing lock "refresh_cache-81290b55-8c05-4925-b445-d121b1bff1a2" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:13:44 user nova-compute[74683]: DEBUG nova.compute.manager [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Instance network_info: |[{"id": "8b5f6bec-c96c-4b1d-bdf6-4012cc0a3fae", "address": "fa:16:3e:f3:60:b8", "network": {"id": "55de7975-487e-4317-ac3e-9619e78b087c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-563245692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c6b7c7954f42638e1075cc9d0afbd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b5f6bec-c9", "ovs_interfaceid": "8b5f6bec-c96c-4b1d-bdf6-4012cc0a3fae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 11:13:44 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-4906029b-31a5-4d5f-bfcd-8a455aca3be8 req-ed478461-59d9-4838-824f-143d60a704a2 service nova] Acquired lock "refresh_cache-81290b55-8c05-4925-b445-d121b1bff1a2" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:13:44 user nova-compute[74683]: DEBUG nova.network.neutron [req-4906029b-31a5-4d5f-bfcd-8a455aca3be8 req-ed478461-59d9-4838-824f-143d60a704a2 service nova] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Refreshing network info cache for port 8b5f6bec-c96c-4b1d-bdf6-4012cc0a3fae {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:13:44 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Start _get_guest_xml network_info=[{"id": "8b5f6bec-c96c-4b1d-bdf6-4012cc0a3fae", "address": "fa:16:3e:f3:60:b8", "network": {"id": "55de7975-487e-4317-ac3e-9619e78b087c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-563245692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c6b7c7954f42638e1075cc9d0afbd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b5f6bec-c9", "ovs_interfaceid": "8b5f6bec-c96c-4b1d-bdf6-4012cc0a3fae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:13:31Z,direct_url=<?>,disk_format='qcow2',id=f92565e5-7521-42b8-88f7-0e17710e3812,min_disk=0,min_ram=0,name='',owner='03042ab48b7e4464869459a31c4fc463',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:13:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/sda', 'size': 0, 'guest_format': None, 'encrypted': False, 'disk_bus': 'scsi', 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': 'f92565e5-7521-42b8-88f7-0e17710e3812'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:13:44 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:13:44 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:13:44 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:13:44 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:13:44 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:13:44 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:13:44 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:13:44 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:13:31Z,direct_url=<?>,disk_format='qcow2',id=f92565e5-7521-42b8-88f7-0e17710e3812,min_disk=0,min_ram=0,name='',owner='03042ab48b7e4464869459a31c4fc463',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:13:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:13:44 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:13:44 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:13:44 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:13:44 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:13:44 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:13:44 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:13:44 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:13:44 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:13:44 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:13:44 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:13:44 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T11:13:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-784751833',display_name='tempest-AttachSCSIVolumeTestJSON-server-784751833',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-784751833',id=7,image_ref='f92565e5-7521-42b8-88f7-0e17710e3812',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0LFfgJd4tSBgM40sYw9NrNKYaqU3rN2f4N0VA2hNl1mB8B233GpPKbn5K/WUy40PW7fQ2Ve9UUhStJqOkeAoIcWOyTUqHTK/Shq09jRNNAdDkRV13L1bvaK/Oh8nlk+Q==',key_name='tempest-keypair-821741181',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85c6b7c7954f42638e1075cc9d0afbd2',ramdisk_id='',reservation_id='r-4edzk5tk',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f92565e5-7521-42b8-88f7-0e17710e3812',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-620263426',owner_user_name='tempest-AttachSCSIVolumeTestJSON-620263426-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:13:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cc93ef469234e5e832edef72e1efb9c',uuid=81290b55-8c05-4925-b445-d121b1bff1a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b5f6bec-c96c-4b1d-bdf6-4012cc0a3fae", "address": "fa:16:3e:f3:60:b8", "network": {"id": "55de7975-487e-4317-ac3e-9619e78b087c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-563245692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c6b7c7954f42638e1075cc9d0afbd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b5f6bec-c9", "ovs_interfaceid": "8b5f6bec-c96c-4b1d-bdf6-4012cc0a3fae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:13:44 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Converting VIF {"id": "8b5f6bec-c96c-4b1d-bdf6-4012cc0a3fae", "address": "fa:16:3e:f3:60:b8", "network": {"id": "55de7975-487e-4317-ac3e-9619e78b087c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-563245692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c6b7c7954f42638e1075cc9d0afbd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b5f6bec-c9", "ovs_interfaceid": "8b5f6bec-c96c-4b1d-bdf6-4012cc0a3fae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:13:44 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:60:b8,bridge_name='br-int',has_traffic_filtering=True,id=8b5f6bec-c96c-4b1d-bdf6-4012cc0a3fae,network=Network(55de7975-487e-4317-ac3e-9619e78b087c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b5f6bec-c9') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:13:44 user nova-compute[74683]: DEBUG nova.objects.instance [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Lazy-loading 'pci_devices' on Instance uuid 81290b55-8c05-4925-b445-d121b1bff1a2 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:13:44 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:13:44 user nova-compute[74683]:   <uuid>81290b55-8c05-4925-b445-d121b1bff1a2</uuid>
Oct 16 11:13:44 user nova-compute[74683]:   <name>instance-00000007</name>
Oct 16 11:13:44 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:13:44 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:13:44 user nova-compute[74683]:   <metadata>
Oct 16 11:13:44 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:13:44 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:13:44 user nova-compute[74683]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-784751833</nova:name>
Oct 16 11:13:44 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:13:44</nova:creationTime>
Oct 16 11:13:44 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:13:44 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:13:44 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:13:44 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:13:44 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:13:44 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:13:44 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:13:44 user nova-compute[74683]:       <nova:owner>
Oct 16 11:13:44 user nova-compute[74683]:         <nova:user uuid="7cc93ef469234e5e832edef72e1efb9c">tempest-AttachSCSIVolumeTestJSON-620263426-project-member</nova:user>
Oct 16 11:13:44 user nova-compute[74683]:         <nova:project uuid="85c6b7c7954f42638e1075cc9d0afbd2">tempest-AttachSCSIVolumeTestJSON-620263426</nova:project>
Oct 16 11:13:44 user nova-compute[74683]:       </nova:owner>
Oct 16 11:13:44 user nova-compute[74683]:       <nova:root type="image" uuid="f92565e5-7521-42b8-88f7-0e17710e3812"/>
Oct 16 11:13:44 user nova-compute[74683]:       <nova:ports>
Oct 16 11:13:44 user nova-compute[74683]:         <nova:port uuid="8b5f6bec-c96c-4b1d-bdf6-4012cc0a3fae">
Oct 16 11:13:44 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 16 11:13:44 user nova-compute[74683]:         </nova:port>
Oct 16 11:13:44 user nova-compute[74683]:       </nova:ports>
Oct 16 11:13:44 user nova-compute[74683]:     </nova:instance>
Oct 16 11:13:44 user nova-compute[74683]:   </metadata>
Oct 16 11:13:44 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:13:44 user nova-compute[74683]:     <system>
Oct 16 11:13:44 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:13:44 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:13:44 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:13:44 user nova-compute[74683]:       <entry name="serial">81290b55-8c05-4925-b445-d121b1bff1a2</entry>
Oct 16 11:13:44 user nova-compute[74683]:       <entry name="uuid">81290b55-8c05-4925-b445-d121b1bff1a2</entry>
Oct 16 11:13:44 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:13:44 user nova-compute[74683]:     </system>
Oct 16 11:13:44 user nova-compute[74683]:   </sysinfo>
Oct 16 11:13:44 user nova-compute[74683]:   <os>
Oct 16 11:13:44 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:13:44 user nova-compute[74683]:     <boot dev="hd"/>
Oct 16 11:13:44 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:13:44 user nova-compute[74683]:   </os>
Oct 16 11:13:44 user nova-compute[74683]:   <features>
Oct 16 11:13:44 user nova-compute[74683]:     <acpi/>
Oct 16 11:13:44 user nova-compute[74683]:     <apic/>
Oct 16 11:13:44 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:13:44 user nova-compute[74683]:   </features>
Oct 16 11:13:44 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:13:44 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:13:44 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:13:44 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:13:44 user nova-compute[74683]:   </clock>
Oct 16 11:13:44 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:13:44 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:13:44 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:13:44 user nova-compute[74683]:   </cpu>
Oct 16 11:13:44 user nova-compute[74683]:   <devices>
Oct 16 11:13:44 user nova-compute[74683]:     <disk type="file" device="disk">
Oct 16 11:13:44 user nova-compute[74683]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 11:13:44 user nova-compute[74683]:       <source file="/opt/stack/data/nova/instances/81290b55-8c05-4925-b445-d121b1bff1a2/disk"/>
Oct 16 11:13:44 user nova-compute[74683]:       <target dev="sda" bus="scsi"/>
Oct 16 11:13:44 user nova-compute[74683]:       <address type="drive" controller="0" unit="0"/>
Oct 16 11:13:44 user nova-compute[74683]:     </disk>
Oct 16 11:13:44 user nova-compute[74683]:     <disk type="file" device="cdrom">
Oct 16 11:13:44 user nova-compute[74683]:       <driver name="qemu" type="raw" cache="none"/>
Oct 16 11:13:44 user nova-compute[74683]:       <source file="/opt/stack/data/nova/instances/81290b55-8c05-4925-b445-d121b1bff1a2/disk.config"/>
Oct 16 11:13:44 user nova-compute[74683]:       <target dev="sdb" bus="scsi"/>
Oct 16 11:13:44 user nova-compute[74683]:       <address type="drive" controller="0" unit="1"/>
Oct 16 11:13:44 user nova-compute[74683]:     </disk>
Oct 16 11:13:44 user nova-compute[74683]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Oct 16 11:13:44 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:13:44 user nova-compute[74683]:       <mac address="fa:16:3e:f3:60:b8"/>
Oct 16 11:13:44 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:13:44 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:13:44 user nova-compute[74683]:       <target dev="tap8b5f6bec-c9"/>
Oct 16 11:13:44 user nova-compute[74683]:     </interface>
Oct 16 11:13:44 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:13:44 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/81290b55-8c05-4925-b445-d121b1bff1a2/console.log" append="off"/>
Oct 16 11:13:44 user nova-compute[74683]:     </serial>
Oct 16 11:13:44 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:13:44 user nova-compute[74683]:     <video>
Oct 16 11:13:44 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:13:44 user nova-compute[74683]:     </video>
Oct 16 11:13:44 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:13:44 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:13:44 user nova-compute[74683]:     </rng>
Oct 16 11:13:44 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:13:44 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:13:44 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:13:44 user nova-compute[74683]:     </memballoon>
Oct 16 11:13:44 user nova-compute[74683]:   </devices>
Oct 16 11:13:44 user nova-compute[74683]: </domain>
Oct 16 11:13:44 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:13:44 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T11:13:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-784751833',display_name='tempest-AttachSCSIVolumeTestJSON-server-784751833',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-784751833',id=7,image_ref='f92565e5-7521-42b8-88f7-0e17710e3812',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0LFfgJd4tSBgM40sYw9NrNKYaqU3rN2f4N0VA2hNl1mB8B233GpPKbn5K/WUy40PW7fQ2Ve9UUhStJqOkeAoIcWOyTUqHTK/Shq09jRNNAdDkRV13L1bvaK/Oh8nlk+Q==',key_name='tempest-keypair-821741181',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85c6b7c7954f42638e1075cc9d0afbd2',ramdisk_id='',reservation_id='r-4edzk5tk',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f92565e5-7521-42b8-88f7-0e17710e3812',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-620263426',owner_user_name='tempest-AttachSCSIVolumeTestJSON-620263426-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:13:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cc93ef469234e5e832edef72e1efb9c',uuid=81290b55-8c05-4925-b445-d121b1bff1a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b5f6bec-c96c-4b1d-bdf6-4012cc0a3fae", "address": "fa:16:3e:f3:60:b8", "network": {"id": "55de7975-487e-4317-ac3e-9619e78b087c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-563245692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c6b7c7954f42638e1075cc9d0afbd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b5f6bec-c9", "ovs_interfaceid": "8b5f6bec-c96c-4b1d-bdf6-4012cc0a3fae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:13:44 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Converting VIF {"id": "8b5f6bec-c96c-4b1d-bdf6-4012cc0a3fae", "address": "fa:16:3e:f3:60:b8", "network": {"id": "55de7975-487e-4317-ac3e-9619e78b087c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-563245692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c6b7c7954f42638e1075cc9d0afbd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b5f6bec-c9", "ovs_interfaceid": "8b5f6bec-c96c-4b1d-bdf6-4012cc0a3fae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:13:44 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:60:b8,bridge_name='br-int',has_traffic_filtering=True,id=8b5f6bec-c96c-4b1d-bdf6-4012cc0a3fae,network=Network(55de7975-487e-4317-ac3e-9619e78b087c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b5f6bec-c9') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:13:44 user nova-compute[74683]: DEBUG os_vif [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:60:b8,bridge_name='br-int',has_traffic_filtering=True,id=8b5f6bec-c96c-4b1d-bdf6-4012cc0a3fae,network=Network(55de7975-487e-4317-ac3e-9619e78b087c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b5f6bec-c9') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:13:44 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:44 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:13:44 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:13:44 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:44 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9c189e3c-0605-5160-9ad5-df4b768e50ba', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:13:44 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:44 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:13:44 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:44 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b5f6bec-c9, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:13:44 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8b5f6bec-c9, col_values=(('qos', UUID('fea5ae54-e363-4302-98ce-cd33c6de9003')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:13:44 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8b5f6bec-c9, col_values=(('external_ids', {'iface-id': '8b5f6bec-c96c-4b1d-bdf6-4012cc0a3fae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:60:b8', 'vm-uuid': '81290b55-8c05-4925-b445-d121b1bff1a2'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:13:44 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:13:44 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:44 user nova-compute[74683]: INFO os_vif [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:60:b8,bridge_name='br-int',has_traffic_filtering=True,id=8b5f6bec-c96c-4b1d-bdf6-4012cc0a3fae,network=Network(55de7975-487e-4317-ac3e-9619e78b087c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b5f6bec-c9')
Oct 16 11:13:44 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] No BDM found with device name sda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:13:44 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:13:44 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] No VIF found with MAC fa:16:3e:f3:60:b8, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:13:44 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Using config drive
Oct 16 11:13:44 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Creating config drive at /opt/stack/data/nova/instances/81290b55-8c05-4925-b445-d121b1bff1a2/disk.config
Oct 16 11:13:44 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/81290b55-8c05-4925-b445-d121b1bff1a2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp173dsvxd {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:13:44 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/81290b55-8c05-4925-b445-d121b1bff1a2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp173dsvxd" returned: 0 in 0.087s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:13:45 user nova-compute[74683]: DEBUG nova.network.neutron [req-4906029b-31a5-4d5f-bfcd-8a455aca3be8 req-ed478461-59d9-4838-824f-143d60a704a2 service nova] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Updated VIF entry in instance network info cache for port 8b5f6bec-c96c-4b1d-bdf6-4012cc0a3fae. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:13:45 user nova-compute[74683]: DEBUG nova.network.neutron [req-4906029b-31a5-4d5f-bfcd-8a455aca3be8 req-ed478461-59d9-4838-824f-143d60a704a2 service nova] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Updating instance_info_cache with network_info: [{"id": "8b5f6bec-c96c-4b1d-bdf6-4012cc0a3fae", "address": "fa:16:3e:f3:60:b8", "network": {"id": "55de7975-487e-4317-ac3e-9619e78b087c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-563245692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c6b7c7954f42638e1075cc9d0afbd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b5f6bec-c9", "ovs_interfaceid": "8b5f6bec-c96c-4b1d-bdf6-4012cc0a3fae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:13:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-4906029b-31a5-4d5f-bfcd-8a455aca3be8 req-ed478461-59d9-4838-824f-143d60a704a2 service nova] Releasing lock "refresh_cache-81290b55-8c05-4925-b445-d121b1bff1a2" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:13:45 user nova-compute[74683]: DEBUG nova.compute.manager [req-b0b799cb-0fbf-4e68-b313-b89bc6d84e6e req-4f4a2a96-16a0-4347-9864-e2627448725f service nova] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Received event network-vif-plugged-dbbeadad-745e-4d28-a242-577b3197b079 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:13:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b0b799cb-0fbf-4e68-b313-b89bc6d84e6e req-4f4a2a96-16a0-4347-9864-e2627448725f service nova] Acquiring lock "f192d1ec-311d-4a30-9766-361b27a8dae8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:13:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b0b799cb-0fbf-4e68-b313-b89bc6d84e6e req-4f4a2a96-16a0-4347-9864-e2627448725f service nova] Lock "f192d1ec-311d-4a30-9766-361b27a8dae8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:13:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b0b799cb-0fbf-4e68-b313-b89bc6d84e6e req-4f4a2a96-16a0-4347-9864-e2627448725f service nova] Lock "f192d1ec-311d-4a30-9766-361b27a8dae8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:13:45 user nova-compute[74683]: DEBUG nova.compute.manager [req-b0b799cb-0fbf-4e68-b313-b89bc6d84e6e req-4f4a2a96-16a0-4347-9864-e2627448725f service nova] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] No waiting events found dispatching network-vif-plugged-dbbeadad-745e-4d28-a242-577b3197b079 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:13:45 user nova-compute[74683]: WARNING nova.compute.manager [req-b0b799cb-0fbf-4e68-b313-b89bc6d84e6e req-4f4a2a96-16a0-4347-9864-e2627448725f service nova] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Received unexpected event network-vif-plugged-dbbeadad-745e-4d28-a242-577b3197b079 for instance with vm_state active and task_state None.
Oct 16 11:13:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:46 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:46 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:46 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:47 user nova-compute[74683]: DEBUG nova.compute.manager [req-7864bfec-a627-4ee5-936b-be1f489a2194 req-e6b0cc68-d8ff-489f-9d1b-1d542ee88dca service nova] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Received event network-vif-plugged-dbbeadad-745e-4d28-a242-577b3197b079 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:13:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-7864bfec-a627-4ee5-936b-be1f489a2194 req-e6b0cc68-d8ff-489f-9d1b-1d542ee88dca service nova] Acquiring lock "f192d1ec-311d-4a30-9766-361b27a8dae8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:13:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-7864bfec-a627-4ee5-936b-be1f489a2194 req-e6b0cc68-d8ff-489f-9d1b-1d542ee88dca service nova] Lock "f192d1ec-311d-4a30-9766-361b27a8dae8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:13:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-7864bfec-a627-4ee5-936b-be1f489a2194 req-e6b0cc68-d8ff-489f-9d1b-1d542ee88dca service nova] Lock "f192d1ec-311d-4a30-9766-361b27a8dae8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:13:47 user nova-compute[74683]: DEBUG nova.compute.manager [req-7864bfec-a627-4ee5-936b-be1f489a2194 req-e6b0cc68-d8ff-489f-9d1b-1d542ee88dca service nova] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] No waiting events found dispatching network-vif-plugged-dbbeadad-745e-4d28-a242-577b3197b079 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:13:47 user nova-compute[74683]: WARNING nova.compute.manager [req-7864bfec-a627-4ee5-936b-be1f489a2194 req-e6b0cc68-d8ff-489f-9d1b-1d542ee88dca service nova] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Received unexpected event network-vif-plugged-dbbeadad-745e-4d28-a242-577b3197b079 for instance with vm_state active and task_state None.
Oct 16 11:13:47 user nova-compute[74683]: DEBUG nova.compute.manager [req-7864bfec-a627-4ee5-936b-be1f489a2194 req-e6b0cc68-d8ff-489f-9d1b-1d542ee88dca service nova] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Received event network-vif-plugged-8b5f6bec-c96c-4b1d-bdf6-4012cc0a3fae {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:13:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-7864bfec-a627-4ee5-936b-be1f489a2194 req-e6b0cc68-d8ff-489f-9d1b-1d542ee88dca service nova] Acquiring lock "81290b55-8c05-4925-b445-d121b1bff1a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:13:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-7864bfec-a627-4ee5-936b-be1f489a2194 req-e6b0cc68-d8ff-489f-9d1b-1d542ee88dca service nova] Lock "81290b55-8c05-4925-b445-d121b1bff1a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:13:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-7864bfec-a627-4ee5-936b-be1f489a2194 req-e6b0cc68-d8ff-489f-9d1b-1d542ee88dca service nova] Lock "81290b55-8c05-4925-b445-d121b1bff1a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:13:47 user nova-compute[74683]: DEBUG nova.compute.manager [req-7864bfec-a627-4ee5-936b-be1f489a2194 req-e6b0cc68-d8ff-489f-9d1b-1d542ee88dca service nova] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] No waiting events found dispatching network-vif-plugged-8b5f6bec-c96c-4b1d-bdf6-4012cc0a3fae {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:13:47 user nova-compute[74683]: WARNING nova.compute.manager [req-7864bfec-a627-4ee5-936b-be1f489a2194 req-e6b0cc68-d8ff-489f-9d1b-1d542ee88dca service nova] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Received unexpected event network-vif-plugged-8b5f6bec-c96c-4b1d-bdf6-4012cc0a3fae for instance with vm_state building and task_state spawning.
Oct 16 11:13:47 user nova-compute[74683]: DEBUG nova.compute.manager [req-7864bfec-a627-4ee5-936b-be1f489a2194 req-e6b0cc68-d8ff-489f-9d1b-1d542ee88dca service nova] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Received event network-vif-plugged-8b5f6bec-c96c-4b1d-bdf6-4012cc0a3fae {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:13:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-7864bfec-a627-4ee5-936b-be1f489a2194 req-e6b0cc68-d8ff-489f-9d1b-1d542ee88dca service nova] Acquiring lock "81290b55-8c05-4925-b445-d121b1bff1a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:13:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-7864bfec-a627-4ee5-936b-be1f489a2194 req-e6b0cc68-d8ff-489f-9d1b-1d542ee88dca service nova] Lock "81290b55-8c05-4925-b445-d121b1bff1a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:13:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-7864bfec-a627-4ee5-936b-be1f489a2194 req-e6b0cc68-d8ff-489f-9d1b-1d542ee88dca service nova] Lock "81290b55-8c05-4925-b445-d121b1bff1a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:13:47 user nova-compute[74683]: DEBUG nova.compute.manager [req-7864bfec-a627-4ee5-936b-be1f489a2194 req-e6b0cc68-d8ff-489f-9d1b-1d542ee88dca service nova] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] No waiting events found dispatching network-vif-plugged-8b5f6bec-c96c-4b1d-bdf6-4012cc0a3fae {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:13:47 user nova-compute[74683]: WARNING nova.compute.manager [req-7864bfec-a627-4ee5-936b-be1f489a2194 req-e6b0cc68-d8ff-489f-9d1b-1d542ee88dca service nova] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Received unexpected event network-vif-plugged-8b5f6bec-c96c-4b1d-bdf6-4012cc0a3fae for instance with vm_state building and task_state spawning.
Oct 16 11:13:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:49 user nova-compute[74683]: DEBUG nova.compute.manager [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Instance event wait completed in 0 seconds for  {{(pid=74683) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 11:13:49 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Guest created on hypervisor {{(pid=74683) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 11:13:49 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Instance spawned successfully.
Oct 16 11:13:49 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 11:13:49 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Found default for hw_input_bus of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:13:49 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Found default for hw_pointer_model of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:13:49 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Found default for hw_video_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:13:49 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Found default for hw_vif_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:13:49 user nova-compute[74683]: INFO nova.compute.manager [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Took 7.95 seconds to spawn the instance on the hypervisor.
Oct 16 11:13:49 user nova-compute[74683]: DEBUG nova.compute.manager [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:13:49 user nova-compute[74683]: INFO nova.compute.manager [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Took 9.22 seconds to build instance.
Oct 16 11:13:49 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-638f5fac-df32-42f4-9407-cbec413b78c7 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Lock "81290b55-8c05-4925-b445-d121b1bff1a2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.385s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:13:49 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:50 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Acquiring lock "c8d3f594-1f38-41d3-90aa-3dfba95ce077" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:13:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Lock "c8d3f594-1f38-41d3-90aa-3dfba95ce077" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:13:50 user nova-compute[74683]: DEBUG nova.compute.manager [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Starting instance... {{(pid=74683) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 11:13:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:13:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.007s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:13:50 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74683) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 11:13:50 user nova-compute[74683]: INFO nova.compute.claims [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Claim successful on node user
Oct 16 11:13:51 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:13:51 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:13:51 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.520s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:13:51 user nova-compute[74683]: DEBUG nova.compute.manager [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Start building networks asynchronously for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 11:13:51 user nova-compute[74683]: DEBUG nova.compute.manager [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Allocating IP information in the background. {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 11:13:51 user nova-compute[74683]: DEBUG nova.network.neutron [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] allocate_for_instance() {{(pid=74683) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 11:13:51 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 11:13:51 user nova-compute[74683]: DEBUG nova.compute.manager [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Start building block device mappings for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 11:13:51 user nova-compute[74683]: DEBUG nova.policy [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3205976849b2442b81d3e9e4be43eccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c84099ff9940018a403eba219b0370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74683) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 11:13:51 user nova-compute[74683]: DEBUG nova.compute.manager [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Start spawning the instance on the hypervisor. {{(pid=74683) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 11:13:51 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Creating instance directory {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 11:13:51 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Creating image(s)
Oct 16 11:13:51 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Acquiring lock "/opt/stack/data/nova/instances/c8d3f594-1f38-41d3-90aa-3dfba95ce077/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:13:51 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Lock "/opt/stack/data/nova/instances/c8d3f594-1f38-41d3-90aa-3dfba95ce077/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:13:51 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Lock "/opt/stack/data/nova/instances/c8d3f594-1f38-41d3-90aa-3dfba95ce077/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:13:51 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:13:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.235s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:13:52 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Acquiring lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:13:52 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:13:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:13:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.194s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:13:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/c8d3f594-1f38-41d3-90aa-3dfba95ce077/disk 1073741824 {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:13:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/c8d3f594-1f38-41d3-90aa-3dfba95ce077/disk 1073741824" returned: 0 in 0.077s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:13:52 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:13:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:13:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.189s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:13:52 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c8d3f594-1f38-41d3-90aa-3dfba95ce077/disk. size=1073741824 {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 11:13:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d3f594-1f38-41d3-90aa-3dfba95ce077/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:13:52 user nova-compute[74683]: DEBUG nova.network.neutron [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Successfully created port: 84c66881-3b9a-4448-a984-840fab1521e4 {{(pid=74683) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 11:13:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d3f594-1f38-41d3-90aa-3dfba95ce077/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:13:52 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Cannot resize image /opt/stack/data/nova/instances/c8d3f594-1f38-41d3-90aa-3dfba95ce077/disk to a smaller size. {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 11:13:52 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Created local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 11:13:52 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Ensure instance console log exists: /opt/stack/data/nova/instances/c8d3f594-1f38-41d3-90aa-3dfba95ce077/console.log {{(pid=74683) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 11:13:52 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:13:52 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:13:52 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:13:53 user nova-compute[74683]: DEBUG nova.network.neutron [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Successfully updated port: 84c66881-3b9a-4448-a984-840fab1521e4 {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:13:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Acquiring lock "refresh_cache-c8d3f594-1f38-41d3-90aa-3dfba95ce077" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:13:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Acquired lock "refresh_cache-c8d3f594-1f38-41d3-90aa-3dfba95ce077" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:13:53 user nova-compute[74683]: DEBUG nova.network.neutron [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:13:53 user nova-compute[74683]: DEBUG nova.compute.manager [req-322ebaa4-c4f4-4f18-ab22-f55b4396a187 req-c2e62726-46eb-4014-8c25-1b4631733ad2 service nova] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Received event network-changed-84c66881-3b9a-4448-a984-840fab1521e4 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:13:53 user nova-compute[74683]: DEBUG nova.compute.manager [req-322ebaa4-c4f4-4f18-ab22-f55b4396a187 req-c2e62726-46eb-4014-8c25-1b4631733ad2 service nova] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Refreshing instance network info cache due to event network-changed-84c66881-3b9a-4448-a984-840fab1521e4. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:13:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-322ebaa4-c4f4-4f18-ab22-f55b4396a187 req-c2e62726-46eb-4014-8c25-1b4631733ad2 service nova] Acquiring lock "refresh_cache-c8d3f594-1f38-41d3-90aa-3dfba95ce077" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:13:53 user nova-compute[74683]: DEBUG nova.network.neutron [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:13:53 user nova-compute[74683]: DEBUG nova.network.neutron [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Updating instance_info_cache with network_info: [{"id": "84c66881-3b9a-4448-a984-840fab1521e4", "address": "fa:16:3e:bf:fd:e3", "network": {"id": "8bd06e2b-a2a2-47c6-a513-9e0bdfb1964e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2134820244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97c84099ff9940018a403eba219b0370", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c66881-3b", "ovs_interfaceid": "84c66881-3b9a-4448-a984-840fab1521e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:13:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Releasing lock "refresh_cache-c8d3f594-1f38-41d3-90aa-3dfba95ce077" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:13:53 user nova-compute[74683]: DEBUG nova.compute.manager [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Instance network_info: |[{"id": "84c66881-3b9a-4448-a984-840fab1521e4", "address": "fa:16:3e:bf:fd:e3", "network": {"id": "8bd06e2b-a2a2-47c6-a513-9e0bdfb1964e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2134820244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97c84099ff9940018a403eba219b0370", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c66881-3b", "ovs_interfaceid": "84c66881-3b9a-4448-a984-840fab1521e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 11:13:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-322ebaa4-c4f4-4f18-ab22-f55b4396a187 req-c2e62726-46eb-4014-8c25-1b4631733ad2 service nova] Acquired lock "refresh_cache-c8d3f594-1f38-41d3-90aa-3dfba95ce077" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:13:53 user nova-compute[74683]: DEBUG nova.network.neutron [req-322ebaa4-c4f4-4f18-ab22-f55b4396a187 req-c2e62726-46eb-4014-8c25-1b4631733ad2 service nova] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Refreshing network info cache for port 84c66881-3b9a-4448-a984-840fab1521e4 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:13:53 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Start _get_guest_xml network_info=[{"id": "84c66881-3b9a-4448-a984-840fab1521e4", "address": "fa:16:3e:bf:fd:e3", "network": {"id": "8bd06e2b-a2a2-47c6-a513-9e0bdfb1964e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2134820244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97c84099ff9940018a403eba219b0370", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c66881-3b", "ovs_interfaceid": "84c66881-3b9a-4448-a984-840fab1521e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:13:53 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:13:53 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:13:53 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:13:53 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:13:53 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:13:53 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:13:53 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:13:53 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:13:53 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:13:53 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:13:53 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:13:53 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:13:53 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:13:53 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:13:53 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:13:53 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:13:53 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:13:53 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:13:53 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:13:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-2114004726',display_name='tempest-VolumesAssistedSnapshotsTest-server-2114004726',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-2114004726',id=8,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3v1E9Wc1FznpHJ1hGPoknkKO/e/T0NlyrxZYLLiRxRK/jh7vR6Ura8z8xR5Kzac1BUlwP5LtryMQhfEbYH1nwKd2wZ6lmd9xshz6idTA4dfiWTKYBovHu/zjAAutb5VA==',key_name='tempest-keypair-715136135',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97c84099ff9940018a403eba219b0370',ramdisk_id='',reservation_id='r-gcdokve1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-998320029',owner_user_name='tempest-VolumesAssistedSnapshotsTest-998320029-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:13:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3205976849b2442b81d3e9e4be43eccb',uuid=c8d3f594-1f38-41d3-90aa-3dfba95ce077,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84c66881-3b9a-4448-a984-840fab1521e4", "address": "fa:16:3e:bf:fd:e3", "network": {"id": "8bd06e2b-a2a2-47c6-a513-9e0bdfb1964e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2134820244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97c84099ff9940018a403eba219b0370", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c66881-3b", "ovs_interfaceid": "84c66881-3b9a-4448-a984-840fab1521e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:13:53 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Converting VIF {"id": "84c66881-3b9a-4448-a984-840fab1521e4", "address": "fa:16:3e:bf:fd:e3", "network": {"id": "8bd06e2b-a2a2-47c6-a513-9e0bdfb1964e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2134820244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97c84099ff9940018a403eba219b0370", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c66881-3b", "ovs_interfaceid": "84c66881-3b9a-4448-a984-840fab1521e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:13:53 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:fd:e3,bridge_name='br-int',has_traffic_filtering=True,id=84c66881-3b9a-4448-a984-840fab1521e4,network=Network(8bd06e2b-a2a2-47c6-a513-9e0bdfb1964e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c66881-3b') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:13:53 user nova-compute[74683]: DEBUG nova.objects.instance [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Lazy-loading 'pci_devices' on Instance uuid c8d3f594-1f38-41d3-90aa-3dfba95ce077 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:13:53 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:13:53 user nova-compute[74683]:   <uuid>c8d3f594-1f38-41d3-90aa-3dfba95ce077</uuid>
Oct 16 11:13:53 user nova-compute[74683]:   <name>instance-00000008</name>
Oct 16 11:13:53 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:13:53 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:13:53 user nova-compute[74683]:   <metadata>
Oct 16 11:13:53 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:13:53 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:13:53 user nova-compute[74683]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-2114004726</nova:name>
Oct 16 11:13:53 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:13:53</nova:creationTime>
Oct 16 11:13:53 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:13:53 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:13:53 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:13:53 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:13:53 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:13:53 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:13:53 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:13:53 user nova-compute[74683]:       <nova:owner>
Oct 16 11:13:53 user nova-compute[74683]:         <nova:user uuid="3205976849b2442b81d3e9e4be43eccb">tempest-VolumesAssistedSnapshotsTest-998320029-project-member</nova:user>
Oct 16 11:13:53 user nova-compute[74683]:         <nova:project uuid="97c84099ff9940018a403eba219b0370">tempest-VolumesAssistedSnapshotsTest-998320029</nova:project>
Oct 16 11:13:53 user nova-compute[74683]:       </nova:owner>
Oct 16 11:13:53 user nova-compute[74683]:       <nova:root type="image" uuid="0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f"/>
Oct 16 11:13:53 user nova-compute[74683]:       <nova:ports>
Oct 16 11:13:53 user nova-compute[74683]:         <nova:port uuid="84c66881-3b9a-4448-a984-840fab1521e4">
Oct 16 11:13:53 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 16 11:13:53 user nova-compute[74683]:         </nova:port>
Oct 16 11:13:53 user nova-compute[74683]:       </nova:ports>
Oct 16 11:13:53 user nova-compute[74683]:     </nova:instance>
Oct 16 11:13:53 user nova-compute[74683]:   </metadata>
Oct 16 11:13:53 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:13:53 user nova-compute[74683]:     <system>
Oct 16 11:13:53 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:13:53 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:13:53 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:13:53 user nova-compute[74683]:       <entry name="serial">c8d3f594-1f38-41d3-90aa-3dfba95ce077</entry>
Oct 16 11:13:53 user nova-compute[74683]:       <entry name="uuid">c8d3f594-1f38-41d3-90aa-3dfba95ce077</entry>
Oct 16 11:13:53 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:13:53 user nova-compute[74683]:     </system>
Oct 16 11:13:53 user nova-compute[74683]:   </sysinfo>
Oct 16 11:13:53 user nova-compute[74683]:   <os>
Oct 16 11:13:53 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:13:53 user nova-compute[74683]:     <boot dev="hd"/>
Oct 16 11:13:53 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:13:53 user nova-compute[74683]:   </os>
Oct 16 11:13:53 user nova-compute[74683]:   <features>
Oct 16 11:13:53 user nova-compute[74683]:     <acpi/>
Oct 16 11:13:53 user nova-compute[74683]:     <apic/>
Oct 16 11:13:53 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:13:53 user nova-compute[74683]:   </features>
Oct 16 11:13:53 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:13:53 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:13:53 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:13:53 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:13:53 user nova-compute[74683]:   </clock>
Oct 16 11:13:53 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:13:53 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:13:53 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:13:53 user nova-compute[74683]:   </cpu>
Oct 16 11:13:53 user nova-compute[74683]:   <devices>
Oct 16 11:13:53 user nova-compute[74683]:     <disk type="file" device="disk">
Oct 16 11:13:53 user nova-compute[74683]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 11:13:53 user nova-compute[74683]:       <source file="/opt/stack/data/nova/instances/c8d3f594-1f38-41d3-90aa-3dfba95ce077/disk"/>
Oct 16 11:13:53 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:13:53 user nova-compute[74683]:     </disk>
Oct 16 11:13:53 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:13:53 user nova-compute[74683]:       <mac address="fa:16:3e:bf:fd:e3"/>
Oct 16 11:13:53 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:13:53 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:13:53 user nova-compute[74683]:       <target dev="tap84c66881-3b"/>
Oct 16 11:13:53 user nova-compute[74683]:     </interface>
Oct 16 11:13:53 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:13:53 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/c8d3f594-1f38-41d3-90aa-3dfba95ce077/console.log" append="off"/>
Oct 16 11:13:53 user nova-compute[74683]:     </serial>
Oct 16 11:13:53 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:13:53 user nova-compute[74683]:     <video>
Oct 16 11:13:53 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:13:53 user nova-compute[74683]:     </video>
Oct 16 11:13:53 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:13:53 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:13:53 user nova-compute[74683]:     </rng>
Oct 16 11:13:53 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:13:53 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:13:53 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:13:53 user nova-compute[74683]:     </memballoon>
Oct 16 11:13:53 user nova-compute[74683]:   </devices>
Oct 16 11:13:53 user nova-compute[74683]: </domain>
Oct 16 11:13:53 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:13:53 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:13:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-2114004726',display_name='tempest-VolumesAssistedSnapshotsTest-server-2114004726',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-2114004726',id=8,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3v1E9Wc1FznpHJ1hGPoknkKO/e/T0NlyrxZYLLiRxRK/jh7vR6Ura8z8xR5Kzac1BUlwP5LtryMQhfEbYH1nwKd2wZ6lmd9xshz6idTA4dfiWTKYBovHu/zjAAutb5VA==',key_name='tempest-keypair-715136135',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97c84099ff9940018a403eba219b0370',ramdisk_id='',reservation_id='r-gcdokve1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-998320029',owner_user_name='tempest-VolumesAssistedSnapshotsTest-998320029-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:13:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3205976849b2442b81d3e9e4be43eccb',uuid=c8d3f594-1f38-41d3-90aa-3dfba95ce077,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84c66881-3b9a-4448-a984-840fab1521e4", "address": "fa:16:3e:bf:fd:e3", "network": {"id": "8bd06e2b-a2a2-47c6-a513-9e0bdfb1964e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2134820244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97c84099ff9940018a403eba219b0370", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c66881-3b", "ovs_interfaceid": "84c66881-3b9a-4448-a984-840fab1521e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:13:53 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Converting VIF {"id": "84c66881-3b9a-4448-a984-840fab1521e4", "address": "fa:16:3e:bf:fd:e3", "network": {"id": "8bd06e2b-a2a2-47c6-a513-9e0bdfb1964e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2134820244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97c84099ff9940018a403eba219b0370", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c66881-3b", "ovs_interfaceid": "84c66881-3b9a-4448-a984-840fab1521e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:13:53 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:fd:e3,bridge_name='br-int',has_traffic_filtering=True,id=84c66881-3b9a-4448-a984-840fab1521e4,network=Network(8bd06e2b-a2a2-47c6-a513-9e0bdfb1964e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c66881-3b') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:13:53 user nova-compute[74683]: DEBUG os_vif [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:fd:e3,bridge_name='br-int',has_traffic_filtering=True,id=84c66881-3b9a-4448-a984-840fab1521e4,network=Network(8bd06e2b-a2a2-47c6-a513-9e0bdfb1964e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c66881-3b') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:13:53 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:53 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:13:53 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:13:53 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:53 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ab57478a-8e8f-5f99-868f-075d684d9288', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:13:53 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:53 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:13:53 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:53 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84c66881-3b, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:13:53 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap84c66881-3b, col_values=(('qos', UUID('71051800-d7cd-4512-b075-2b257ebb8d3d')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:13:53 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap84c66881-3b, col_values=(('external_ids', {'iface-id': '84c66881-3b9a-4448-a984-840fab1521e4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:fd:e3', 'vm-uuid': 'c8d3f594-1f38-41d3-90aa-3dfba95ce077'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:13:53 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:53 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:13:53 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:53 user nova-compute[74683]: INFO os_vif [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:fd:e3,bridge_name='br-int',has_traffic_filtering=True,id=84c66881-3b9a-4448-a984-840fab1521e4,network=Network(8bd06e2b-a2a2-47c6-a513-9e0bdfb1964e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c66881-3b')
Oct 16 11:13:53 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:13:53 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] No VIF found with MAC fa:16:3e:bf:fd:e3, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:13:54 user nova-compute[74683]: DEBUG nova.network.neutron [req-322ebaa4-c4f4-4f18-ab22-f55b4396a187 req-c2e62726-46eb-4014-8c25-1b4631733ad2 service nova] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Updated VIF entry in instance network info cache for port 84c66881-3b9a-4448-a984-840fab1521e4. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:13:54 user nova-compute[74683]: DEBUG nova.network.neutron [req-322ebaa4-c4f4-4f18-ab22-f55b4396a187 req-c2e62726-46eb-4014-8c25-1b4631733ad2 service nova] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Updating instance_info_cache with network_info: [{"id": "84c66881-3b9a-4448-a984-840fab1521e4", "address": "fa:16:3e:bf:fd:e3", "network": {"id": "8bd06e2b-a2a2-47c6-a513-9e0bdfb1964e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2134820244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97c84099ff9940018a403eba219b0370", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c66881-3b", "ovs_interfaceid": "84c66881-3b9a-4448-a984-840fab1521e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:13:54 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-322ebaa4-c4f4-4f18-ab22-f55b4396a187 req-c2e62726-46eb-4014-8c25-1b4631733ad2 service nova] Releasing lock "refresh_cache-c8d3f594-1f38-41d3-90aa-3dfba95ce077" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:13:55 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:55 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:55 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:55 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:13:55 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Cleaning up deleted instances {{(pid=74683) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 16 11:13:55 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] There are 0 instances to clean {{(pid=74683) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 16 11:13:55 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:13:55 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Cleaning up deleted instances with incomplete migration  {{(pid=74683) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 16 11:13:55 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:13:56 user nova-compute[74683]: DEBUG nova.compute.manager [req-5aa9e1f8-45cf-4736-aaaf-2a711c1ceae5 req-035a7107-8aa5-4635-a235-37af056236a3 service nova] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Received event network-vif-plugged-84c66881-3b9a-4448-a984-840fab1521e4 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:13:56 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-5aa9e1f8-45cf-4736-aaaf-2a711c1ceae5 req-035a7107-8aa5-4635-a235-37af056236a3 service nova] Acquiring lock "c8d3f594-1f38-41d3-90aa-3dfba95ce077-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:13:56 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-5aa9e1f8-45cf-4736-aaaf-2a711c1ceae5 req-035a7107-8aa5-4635-a235-37af056236a3 service nova] Lock "c8d3f594-1f38-41d3-90aa-3dfba95ce077-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:13:56 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-5aa9e1f8-45cf-4736-aaaf-2a711c1ceae5 req-035a7107-8aa5-4635-a235-37af056236a3 service nova] Lock "c8d3f594-1f38-41d3-90aa-3dfba95ce077-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:13:56 user nova-compute[74683]: DEBUG nova.compute.manager [req-5aa9e1f8-45cf-4736-aaaf-2a711c1ceae5 req-035a7107-8aa5-4635-a235-37af056236a3 service nova] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] No waiting events found dispatching network-vif-plugged-84c66881-3b9a-4448-a984-840fab1521e4 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:13:56 user nova-compute[74683]: WARNING nova.compute.manager [req-5aa9e1f8-45cf-4736-aaaf-2a711c1ceae5 req-035a7107-8aa5-4635-a235-37af056236a3 service nova] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Received unexpected event network-vif-plugged-84c66881-3b9a-4448-a984-840fab1521e4 for instance with vm_state building and task_state spawning.
Oct 16 11:13:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:56 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:13:57 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:13:57 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:13:58 user nova-compute[74683]: DEBUG nova.compute.manager [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Instance event wait completed in 0 seconds for  {{(pid=74683) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 11:13:58 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Guest created on hypervisor {{(pid=74683) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 11:13:58 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Instance spawned successfully.
Oct 16 11:13:58 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 11:13:58 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Found default for hw_cdrom_bus of ide {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:13:58 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Found default for hw_disk_bus of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:13:58 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Found default for hw_input_bus of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:13:58 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Found default for hw_pointer_model of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:13:58 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Found default for hw_video_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:13:58 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Found default for hw_vif_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:13:58 user nova-compute[74683]: INFO nova.compute.manager [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Took 6.47 seconds to spawn the instance on the hypervisor.
Oct 16 11:13:58 user nova-compute[74683]: DEBUG nova.compute.manager [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:13:58 user nova-compute[74683]: DEBUG nova.compute.manager [req-fed9badf-039d-4bee-aa9f-7f922b616961 req-c9847dd6-64e5-4bfe-bedc-6a686ac7b900 service nova] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Received event network-vif-plugged-84c66881-3b9a-4448-a984-840fab1521e4 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:13:58 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-fed9badf-039d-4bee-aa9f-7f922b616961 req-c9847dd6-64e5-4bfe-bedc-6a686ac7b900 service nova] Acquiring lock "c8d3f594-1f38-41d3-90aa-3dfba95ce077-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:13:58 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-fed9badf-039d-4bee-aa9f-7f922b616961 req-c9847dd6-64e5-4bfe-bedc-6a686ac7b900 service nova] Lock "c8d3f594-1f38-41d3-90aa-3dfba95ce077-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:13:58 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-fed9badf-039d-4bee-aa9f-7f922b616961 req-c9847dd6-64e5-4bfe-bedc-6a686ac7b900 service nova] Lock "c8d3f594-1f38-41d3-90aa-3dfba95ce077-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:13:58 user nova-compute[74683]: DEBUG nova.compute.manager [req-fed9badf-039d-4bee-aa9f-7f922b616961 req-c9847dd6-64e5-4bfe-bedc-6a686ac7b900 service nova] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] No waiting events found dispatching network-vif-plugged-84c66881-3b9a-4448-a984-840fab1521e4 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:13:58 user nova-compute[74683]: WARNING nova.compute.manager [req-fed9badf-039d-4bee-aa9f-7f922b616961 req-c9847dd6-64e5-4bfe-bedc-6a686ac7b900 service nova] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Received unexpected event network-vif-plugged-84c66881-3b9a-4448-a984-840fab1521e4 for instance with vm_state building and task_state spawning.
Oct 16 11:13:58 user nova-compute[74683]: INFO nova.compute.manager [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Took 7.44 seconds to build instance.
Oct 16 11:13:58 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ef6b431b-40a5-4766-978a-61b8dc9f9eb1 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Lock "c8d3f594-1f38-41d3-90aa-3dfba95ce077" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.573s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:13:58 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:13:58 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:13:59 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:13:59 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:13:59 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Starting heal instance info cache {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 11:13:59 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Rebuilding the list of instances to heal {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 11:13:59 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "refresh_cache-427b793c-ae47-451c-bbc5-589d6ce1d2bf" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:13:59 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquired lock "refresh_cache-427b793c-ae47-451c-bbc5-589d6ce1d2bf" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:13:59 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Forcefully refreshing network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 11:13:59 user nova-compute[74683]: DEBUG nova.objects.instance [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lazy-loading 'info_cache' on Instance uuid 427b793c-ae47-451c-bbc5-589d6ce1d2bf {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:14:00 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Updating instance_info_cache with network_info: [{"id": "d46f88ce-60a8-4ce5-989a-6d7b9eb90d28", "address": "fa:16:3e:a1:28:21", "network": {"id": "f5b8ede2-9ce3-4748-b782-dd18a611cc53", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2023834343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f99f352b52b94e32808b154ede6c1eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd46f88ce-60", "ovs_interfaceid": "d46f88ce-60a8-4ce5-989a-6d7b9eb90d28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:14:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Releasing lock "refresh_cache-427b793c-ae47-451c-bbc5-589d6ce1d2bf" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:14:00 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Updated the network info_cache for instance {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 11:14:00 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:14:00 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74683) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 11:14:00 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:14:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:14:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:14:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:14:00 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Auditing locally available compute resources for user (node: user) {{(pid=74683) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 11:14:00 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:14:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:14:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:14:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:14:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:14:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1db5e2-0b25-4d61-9dd3-038811b4eda1/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:14:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1db5e2-0b25-4d61-9dd3-038811b4eda1/disk --force-share --output=json" returned: 0 in 0.341s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:14:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1db5e2-0b25-4d61-9dd3-038811b4eda1/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:14:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1db5e2-0b25-4d61-9dd3-038811b4eda1/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:14:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:14:02 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:14:02 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:14:02 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:14:02 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/427b793c-ae47-451c-bbc5-589d6ce1d2bf/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:14:02 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/427b793c-ae47-451c-bbc5-589d6ce1d2bf/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:14:02 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/427b793c-ae47-451c-bbc5-589d6ce1d2bf/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:14:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/427b793c-ae47-451c-bbc5-589d6ce1d2bf/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:14:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd60be9c-0ff3-40a5-aaab-f31fa88a67f1/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:14:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd60be9c-0ff3-40a5-aaab-f31fa88a67f1/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:14:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd60be9c-0ff3-40a5-aaab-f31fa88a67f1/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:14:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd60be9c-0ff3-40a5-aaab-f31fa88a67f1/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:14:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d3f594-1f38-41d3-90aa-3dfba95ce077/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:14:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d3f594-1f38-41d3-90aa-3dfba95ce077/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:14:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d3f594-1f38-41d3-90aa-3dfba95ce077/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:14:03 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:14:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d3f594-1f38-41d3-90aa-3dfba95ce077/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:14:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81290b55-8c05-4925-b445-d121b1bff1a2/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:14:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81290b55-8c05-4925-b445-d121b1bff1a2/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:14:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81290b55-8c05-4925-b445-d121b1bff1a2/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:14:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81290b55-8c05-4925-b445-d121b1bff1a2/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:14:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:14:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:14:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:14:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:14:05 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:14:05 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:14:05 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Hypervisor/Node resource view: name=user free_ram=7659MB free_disk=25.63439178466797GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74683) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 11:14:05 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:14:05 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:14:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:14:06 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 427b793c-ae47-451c-bbc5-589d6ce1d2bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:14:06 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 18a77385-fab9-4ea0-8aa6-666cf7e798a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:14:06 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance bd60be9c-0ff3-40a5-aaab-f31fa88a67f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:14:06 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance f192d1ec-311d-4a30-9766-361b27a8dae8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:14:06 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 2f1db5e2-0b25-4d61-9dd3-038811b4eda1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:14:06 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:14:06 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 81290b55-8c05-4925-b445-d121b1bff1a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:14:06 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance c8d3f594-1f38-41d3-90aa-3dfba95ce077 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:14:06 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 11:14:06 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 11:14:06 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Refreshing inventories for resource provider 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 16 11:14:06 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Updating ProviderTree inventory for provider 7142d606-df50-4cbe-b5ed-1802caa31862 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 16 11:14:06 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Updating inventory in ProviderTree for provider 7142d606-df50-4cbe-b5ed-1802caa31862 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 16 11:14:06 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Refreshing aggregate associations for resource provider 7142d606-df50-4cbe-b5ed-1802caa31862, aggregates: None {{(pid=74683) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 16 11:14:06 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Refreshing trait associations for resource provider 7142d606-df50-4cbe-b5ed-1802caa31862, traits: COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VMVGA {{(pid=74683) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 16 11:14:06 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:14:06 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:14:06 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Compute_service record updated for user:user {{(pid=74683) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 11:14:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.148s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:14:06 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:14:08 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:14:10 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:14:13 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:14:15 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:14:18 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:14:20 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:14:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:14:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:14:28 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:14:30 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:14:33 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:14:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Acquiring lock "9df7866f-28e9-46d0-9f35-24484adfffd7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:14:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Lock "9df7866f-28e9-46d0-9f35-24484adfffd7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:14:38 user nova-compute[74683]: DEBUG nova.compute.manager [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Starting instance... {{(pid=74683) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 11:14:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:14:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:14:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:14:39 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74683) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 11:14:39 user nova-compute[74683]: INFO nova.compute.claims [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Claim successful on node user
Oct 16 11:14:39 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:14:39 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:14:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.402s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:14:39 user nova-compute[74683]: DEBUG nova.compute.manager [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Start building networks asynchronously for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 11:14:39 user nova-compute[74683]: DEBUG nova.compute.manager [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Allocating IP information in the background. {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 11:14:39 user nova-compute[74683]: DEBUG nova.network.neutron [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] allocate_for_instance() {{(pid=74683) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 11:14:39 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 11:14:39 user nova-compute[74683]: DEBUG nova.compute.manager [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Start building block device mappings for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 11:14:39 user nova-compute[74683]: DEBUG nova.policy [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a5ad8d732f364377bca4aac914efec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4876261cd344bf91c3263bf1a20ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74683) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 11:14:39 user nova-compute[74683]: INFO nova.virt.block_device [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Booting with volume 7416aefd-313c-4b26-b1f6-06786088d9c2 at /dev/vda
Oct 16 11:14:39 user nova-compute[74683]: DEBUG os_brick.utils [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:14:39 user nova-compute[74683]: INFO oslo.privsep.daemon [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpuwwzsz3u/privsep.sock']
Oct 16 11:14:39 user sudo[85663]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpuwwzsz3u/privsep.sock
Oct 16 11:14:39 user sudo[85663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 16 11:14:40 user nova-compute[74683]: DEBUG nova.network.neutron [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Successfully created port: 1509ff6e-10c0-4f96-95ae-660dfc1402cc {{(pid=74683) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 11:14:41 user nova-compute[74683]: DEBUG nova.network.neutron [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Successfully created port: 8c0a030c-cf2d-4d14-b5c3-6d0563b346b9 {{(pid=74683) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 11:14:41 user sudo[85663]: pam_unix(sudo:session): session closed for user root
Oct 16 11:14:41 user nova-compute[74683]: INFO oslo.privsep.daemon [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Spawned new privsep daemon via rootwrap
Oct 16 11:14:41 user nova-compute[74683]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 16 11:14:41 user nova-compute[74683]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 16 11:14:41 user nova-compute[74683]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Oct 16 11:14:41 user nova-compute[74683]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85666
Oct 16 11:14:41 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a73360-25ce-4ce7-bf0c-d34d6faa7183]: (2,) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:14:41 user nova-compute[74683]: DEBUG nova.network.neutron [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Successfully created port: 82f47635-6e3f-492d-9819-4d77ae46fb29 {{(pid=74683) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 11:14:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:14:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:14:41 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[721d30ad-ff54-4427-9b08-e8e0dfac53c6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:70b9d336ab7d\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:14:41 user nova-compute[74683]: WARNING os_brick.initiator.connectors.nvmeof [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Oct 16 11:14:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:14:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:14:41 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc1f6e8-5112-4fab-97be-7046280eeea2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:14:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:14:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:14:41 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2c54ec-a486-4cd0-bb18-4cda628a566f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:14:41 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[660e8db0-f6dc-4f60-9aec-59ed66a0e24a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:14:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Running cmd (subprocess): nvme version {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:14:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] 'nvme version' failed. Not Retrying. {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:14:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] nvme not present on system {{(pid=74683) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 11:14:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:14:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:14:41 user nova-compute[74683]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 11:14:41 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[4acd4860-4323-4df6-a08e-73b51362df44]: (4, '') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:14:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74683) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 11:14:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 11:14:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] LIGHTOS: no hostnqn found. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 11:14:41 user nova-compute[74683]: DEBUG os_brick.utils [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] <== get_connector_properties: return (1908ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:70b9d336ab7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:14:41 user nova-compute[74683]: DEBUG nova.virt.block_device [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Updating existing volume attachment record: fd85c238-0938-40ae-9337-6a68436cf6ab {{(pid=74683) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 11:14:42 user nova-compute[74683]: DEBUG nova.network.neutron [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Successfully created port: 8a9e59f4-7708-438f-8411-499c6e38ec1b {{(pid=74683) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 11:14:42 user nova-compute[74683]: DEBUG nova.network.neutron [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Successfully created port: 698c4ef8-286a-4bc1-a789-3276dc6defea {{(pid=74683) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 11:14:43 user nova-compute[74683]: DEBUG nova.network.neutron [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Successfully updated port: 1509ff6e-10c0-4f96-95ae-660dfc1402cc {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:14:43 user nova-compute[74683]: DEBUG nova.compute.manager [req-b1d29602-3927-40bc-a674-bb4f6cb7c43f req-8dcec644-0f78-48de-bc59-298fe373737b service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received event network-changed-1509ff6e-10c0-4f96-95ae-660dfc1402cc {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:14:43 user nova-compute[74683]: DEBUG nova.compute.manager [req-b1d29602-3927-40bc-a674-bb4f6cb7c43f req-8dcec644-0f78-48de-bc59-298fe373737b service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Refreshing instance network info cache due to event network-changed-1509ff6e-10c0-4f96-95ae-660dfc1402cc. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:14:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b1d29602-3927-40bc-a674-bb4f6cb7c43f req-8dcec644-0f78-48de-bc59-298fe373737b service nova] Acquiring lock "refresh_cache-9df7866f-28e9-46d0-9f35-24484adfffd7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:14:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b1d29602-3927-40bc-a674-bb4f6cb7c43f req-8dcec644-0f78-48de-bc59-298fe373737b service nova] Acquired lock "refresh_cache-9df7866f-28e9-46d0-9f35-24484adfffd7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:14:43 user nova-compute[74683]: DEBUG nova.network.neutron [req-b1d29602-3927-40bc-a674-bb4f6cb7c43f req-8dcec644-0f78-48de-bc59-298fe373737b service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Refreshing network info cache for port 1509ff6e-10c0-4f96-95ae-660dfc1402cc {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:14:43 user nova-compute[74683]: DEBUG nova.network.neutron [req-b1d29602-3927-40bc-a674-bb4f6cb7c43f req-8dcec644-0f78-48de-bc59-298fe373737b service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:14:43 user nova-compute[74683]: DEBUG nova.network.neutron [req-b1d29602-3927-40bc-a674-bb4f6cb7c43f req-8dcec644-0f78-48de-bc59-298fe373737b service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:14:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b1d29602-3927-40bc-a674-bb4f6cb7c43f req-8dcec644-0f78-48de-bc59-298fe373737b service nova] Releasing lock "refresh_cache-9df7866f-28e9-46d0-9f35-24484adfffd7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:14:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Acquiring lock "53bce625-6aa9-42df-9cb4-c08958c18a47" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:14:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Lock "53bce625-6aa9-42df-9cb4-c08958c18a47" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:14:43 user nova-compute[74683]: DEBUG nova.compute.manager [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] [instance: 53bce625-6aa9-42df-9cb4-c08958c18a47] Starting instance... {{(pid=74683) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 11:14:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:14:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:14:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:14:43 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74683) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 11:14:43 user nova-compute[74683]: INFO nova.compute.claims [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] [instance: 53bce625-6aa9-42df-9cb4-c08958c18a47] Claim successful on node user
Oct 16 11:14:44 user nova-compute[74683]: DEBUG nova.network.neutron [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Successfully updated port: 7cfcd210-0e45-4f0e-b04b-1e933ec87734 {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:14:44 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:14:44 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:14:44 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.689s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:14:44 user nova-compute[74683]: DEBUG nova.compute.manager [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] [instance: 53bce625-6aa9-42df-9cb4-c08958c18a47] Start building networks asynchronously for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 11:14:44 user nova-compute[74683]: DEBUG nova.compute.manager [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] [instance: 53bce625-6aa9-42df-9cb4-c08958c18a47] Allocating IP information in the background. {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 11:14:44 user nova-compute[74683]: DEBUG nova.network.neutron [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] [instance: 53bce625-6aa9-42df-9cb4-c08958c18a47] allocate_for_instance() {{(pid=74683) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 11:14:44 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] [instance: 53bce625-6aa9-42df-9cb4-c08958c18a47] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 11:14:44 user nova-compute[74683]: DEBUG nova.compute.manager [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] [instance: 53bce625-6aa9-42df-9cb4-c08958c18a47] Start building block device mappings for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 11:14:44 user nova-compute[74683]: DEBUG nova.compute.manager [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] [instance: 53bce625-6aa9-42df-9cb4-c08958c18a47] Start spawning the instance on the hypervisor. {{(pid=74683) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 11:14:44 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] [instance: 53bce625-6aa9-42df-9cb4-c08958c18a47] Creating instance directory {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 11:14:44 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] [instance: 53bce625-6aa9-42df-9cb4-c08958c18a47] Creating image(s)
Oct 16 11:14:44 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Acquiring lock "/opt/stack/data/nova/instances/53bce625-6aa9-42df-9cb4-c08958c18a47/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:14:44 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Lock "/opt/stack/data/nova/instances/53bce625-6aa9-42df-9cb4-c08958c18a47/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:14:44 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Lock "/opt/stack/data/nova/instances/53bce625-6aa9-42df-9cb4-c08958c18a47/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:14:44 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:14:44 user nova-compute[74683]: DEBUG nova.network.neutron [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Successfully updated port: bfe231c8-ff2a-46fd-9af6-9982a54d7846 {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:14:45 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.216s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:14:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Acquiring lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:14:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:14:45 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:14:45 user nova-compute[74683]: DEBUG nova.policy [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1b891ebf84554097b0111e5cfa52431b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdc52ddb386435fa34000baf394c578', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74683) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 11:14:45 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.177s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:14:45 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/53bce625-6aa9-42df-9cb4-c08958c18a47/disk 1073741824 {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:14:45 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/53bce625-6aa9-42df-9cb4-c08958c18a47/disk 1073741824" returned: 0 in 0.050s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:14:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:14:45 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:14:45 user nova-compute[74683]: DEBUG nova.compute.manager [req-c11eb390-836a-4a4d-ba23-46d322fdc2ed req-665d506b-333c-41c8-8f37-b38ceba504a4 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received event network-changed-7cfcd210-0e45-4f0e-b04b-1e933ec87734 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:14:45 user nova-compute[74683]: DEBUG nova.compute.manager [req-c11eb390-836a-4a4d-ba23-46d322fdc2ed req-665d506b-333c-41c8-8f37-b38ceba504a4 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Refreshing instance network info cache due to event network-changed-7cfcd210-0e45-4f0e-b04b-1e933ec87734. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:14:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c11eb390-836a-4a4d-ba23-46d322fdc2ed req-665d506b-333c-41c8-8f37-b38ceba504a4 service nova] Acquiring lock "refresh_cache-9df7866f-28e9-46d0-9f35-24484adfffd7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:14:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c11eb390-836a-4a4d-ba23-46d322fdc2ed req-665d506b-333c-41c8-8f37-b38ceba504a4 service nova] Acquired lock "refresh_cache-9df7866f-28e9-46d0-9f35-24484adfffd7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:14:45 user nova-compute[74683]: DEBUG nova.network.neutron [req-c11eb390-836a-4a4d-ba23-46d322fdc2ed req-665d506b-333c-41c8-8f37-b38ceba504a4 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Refreshing network info cache for port 7cfcd210-0e45-4f0e-b04b-1e933ec87734 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:14:45 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.218s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:14:45 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Checking if we can resize image /opt/stack/data/nova/instances/53bce625-6aa9-42df-9cb4-c08958c18a47/disk. size=1073741824 {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 11:14:45 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53bce625-6aa9-42df-9cb4-c08958c18a47/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:14:45 user nova-compute[74683]: DEBUG nova.network.neutron [req-c11eb390-836a-4a4d-ba23-46d322fdc2ed req-665d506b-333c-41c8-8f37-b38ceba504a4 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:14:45 user nova-compute[74683]: DEBUG nova.network.neutron [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Successfully updated port: 8c0a030c-cf2d-4d14-b5c3-6d0563b346b9 {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:14:45 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53bce625-6aa9-42df-9cb4-c08958c18a47/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:14:45 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Cannot resize image /opt/stack/data/nova/instances/53bce625-6aa9-42df-9cb4-c08958c18a47/disk to a smaller size. {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 11:14:45 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] [instance: 53bce625-6aa9-42df-9cb4-c08958c18a47] Created local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 11:14:45 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] [instance: 53bce625-6aa9-42df-9cb4-c08958c18a47] Ensure instance console log exists: /opt/stack/data/nova/instances/53bce625-6aa9-42df-9cb4-c08958c18a47/console.log {{(pid=74683) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 11:14:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:14:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:14:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:14:45 user nova-compute[74683]: DEBUG nova.network.neutron [req-c11eb390-836a-4a4d-ba23-46d322fdc2ed req-665d506b-333c-41c8-8f37-b38ceba504a4 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:14:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c11eb390-836a-4a4d-ba23-46d322fdc2ed req-665d506b-333c-41c8-8f37-b38ceba504a4 service nova] Releasing lock "refresh_cache-9df7866f-28e9-46d0-9f35-24484adfffd7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:14:45 user nova-compute[74683]: DEBUG nova.compute.manager [req-c11eb390-836a-4a4d-ba23-46d322fdc2ed req-665d506b-333c-41c8-8f37-b38ceba504a4 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received event network-changed-bfe231c8-ff2a-46fd-9af6-9982a54d7846 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:14:45 user nova-compute[74683]: DEBUG nova.compute.manager [req-c11eb390-836a-4a4d-ba23-46d322fdc2ed req-665d506b-333c-41c8-8f37-b38ceba504a4 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Refreshing instance network info cache due to event network-changed-bfe231c8-ff2a-46fd-9af6-9982a54d7846. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:14:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c11eb390-836a-4a4d-ba23-46d322fdc2ed req-665d506b-333c-41c8-8f37-b38ceba504a4 service nova] Acquiring lock "refresh_cache-9df7866f-28e9-46d0-9f35-24484adfffd7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:14:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c11eb390-836a-4a4d-ba23-46d322fdc2ed req-665d506b-333c-41c8-8f37-b38ceba504a4 service nova] Acquired lock "refresh_cache-9df7866f-28e9-46d0-9f35-24484adfffd7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:14:45 user nova-compute[74683]: DEBUG nova.network.neutron [req-c11eb390-836a-4a4d-ba23-46d322fdc2ed req-665d506b-333c-41c8-8f37-b38ceba504a4 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Refreshing network info cache for port bfe231c8-ff2a-46fd-9af6-9982a54d7846 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:14:46 user nova-compute[74683]: DEBUG nova.network.neutron [req-c11eb390-836a-4a4d-ba23-46d322fdc2ed req-665d506b-333c-41c8-8f37-b38ceba504a4 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:14:46 user nova-compute[74683]: DEBUG nova.network.neutron [req-c11eb390-836a-4a4d-ba23-46d322fdc2ed req-665d506b-333c-41c8-8f37-b38ceba504a4 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:14:46 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c11eb390-836a-4a4d-ba23-46d322fdc2ed req-665d506b-333c-41c8-8f37-b38ceba504a4 service nova] Releasing lock "refresh_cache-9df7866f-28e9-46d0-9f35-24484adfffd7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:14:46 user nova-compute[74683]: DEBUG nova.network.neutron [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] [instance: 53bce625-6aa9-42df-9cb4-c08958c18a47] Successfully created port: 758c0bbb-32ee-46bc-8731-37d03568a858 {{(pid=74683) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 11:14:46 user nova-compute[74683]: DEBUG nova.network.neutron [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Successfully updated port: 82f47635-6e3f-492d-9819-4d77ae46fb29 {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:14:47 user nova-compute[74683]: DEBUG nova.network.neutron [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] [instance: 53bce625-6aa9-42df-9cb4-c08958c18a47] Successfully updated port: 758c0bbb-32ee-46bc-8731-37d03568a858 {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:14:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Acquiring lock "refresh_cache-53bce625-6aa9-42df-9cb4-c08958c18a47" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:14:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Acquired lock "refresh_cache-53bce625-6aa9-42df-9cb4-c08958c18a47" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:14:47 user nova-compute[74683]: DEBUG nova.network.neutron [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] [instance: 53bce625-6aa9-42df-9cb4-c08958c18a47] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:14:47 user nova-compute[74683]: DEBUG nova.compute.manager [req-7dd70e08-914d-4529-a0c2-35867f5db2ec req-eb6a8b7a-cfec-4bd9-aa68-157c06a753d2 service nova] [instance: 53bce625-6aa9-42df-9cb4-c08958c18a47] Received event network-changed-758c0bbb-32ee-46bc-8731-37d03568a858 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:14:47 user nova-compute[74683]: DEBUG nova.compute.manager [req-7dd70e08-914d-4529-a0c2-35867f5db2ec req-eb6a8b7a-cfec-4bd9-aa68-157c06a753d2 service nova] [instance: 53bce625-6aa9-42df-9cb4-c08958c18a47] Refreshing instance network info cache due to event network-changed-758c0bbb-32ee-46bc-8731-37d03568a858. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:14:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-7dd70e08-914d-4529-a0c2-35867f5db2ec req-eb6a8b7a-cfec-4bd9-aa68-157c06a753d2 service nova] Acquiring lock "refresh_cache-53bce625-6aa9-42df-9cb4-c08958c18a47" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:14:47 user nova-compute[74683]: DEBUG nova.network.neutron [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] [instance: 53bce625-6aa9-42df-9cb4-c08958c18a47] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:14:47 user nova-compute[74683]: DEBUG nova.network.neutron [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Successfully updated port: 8a9e59f4-7708-438f-8411-499c6e38ec1b {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:14:47 user nova-compute[74683]: DEBUG nova.network.neutron [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] [instance: 53bce625-6aa9-42df-9cb4-c08958c18a47] Updating instance_info_cache with network_info: [{"id": "758c0bbb-32ee-46bc-8731-37d03568a858", "address": "fa:16:3e:70:7c:00", "network": {"id": "459c55ed-5b55-4a59-9b66-ec757f05d8c6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bb523d6f2b3446f8a5e869f72a4f150b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758c0bbb-32", "ovs_interfaceid": "758c0bbb-32ee-46bc-8731-37d03568a858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:14:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Releasing lock "refresh_cache-53bce625-6aa9-42df-9cb4-c08958c18a47" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:14:47 user nova-compute[74683]: DEBUG nova.compute.manager [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] [instance: 53bce625-6aa9-42df-9cb4-c08958c18a47] Instance network_info: |[{"id": "758c0bbb-32ee-46bc-8731-37d03568a858", "address": "fa:16:3e:70:7c:00", "network": {"id": "459c55ed-5b55-4a59-9b66-ec757f05d8c6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bb523d6f2b3446f8a5e869f72a4f150b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758c0bbb-32", "ovs_interfaceid": "758c0bbb-32ee-46bc-8731-37d03568a858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 11:14:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-7dd70e08-914d-4529-a0c2-35867f5db2ec req-eb6a8b7a-cfec-4bd9-aa68-157c06a753d2 service nova] Acquired lock "refresh_cache-53bce625-6aa9-42df-9cb4-c08958c18a47" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:14:47 user nova-compute[74683]: DEBUG nova.network.neutron [req-7dd70e08-914d-4529-a0c2-35867f5db2ec req-eb6a8b7a-cfec-4bd9-aa68-157c06a753d2 service nova] [instance: 53bce625-6aa9-42df-9cb4-c08958c18a47] Refreshing network info cache for port 758c0bbb-32ee-46bc-8731-37d03568a858 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:14:47 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] [instance: 53bce625-6aa9-42df-9cb4-c08958c18a47] Start _get_guest_xml network_info=[{"id": "758c0bbb-32ee-46bc-8731-37d03568a858", "address": "fa:16:3e:70:7c:00", "network": {"id": "459c55ed-5b55-4a59-9b66-ec757f05d8c6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bb523d6f2b3446f8a5e869f72a4f150b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758c0bbb-32", "ovs_interfaceid": "758c0bbb-32ee-46bc-8731-37d03568a858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:14:47 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:14:47 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:14:47 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:14:47 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:14:47 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:14:47 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:14:47 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:14:47 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:14:47 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:14:47 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:14:47 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:14:47 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:14:47 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:14:47 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:14:47 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:14:47 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:14:47 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:14:47 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:14:47 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:14:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-64854216',display_name='tempest-VolumesNegativeTest-instance-64854216',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-64854216',id=10,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0cdc52ddb386435fa34000baf394c578',ramdisk_id='',reservation_id='r-sfc0k5xt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-173141477',owner_user_name='tempest-VolumesNegativeTest-173141477-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:14:45Z,user_data=None,user_id='1b891ebf84554097b0111e5cfa52431b',uuid=53bce625-6aa9-42df-9cb4-c08958c18a47,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "758c0bbb-32ee-46bc-8731-37d03568a858", "address": "fa:16:3e:70:7c:00", "network": {"id": "459c55ed-5b55-4a59-9b66-ec757f05d8c6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bb523d6f2b3446f8a5e869f72a4f150b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758c0bbb-32", "ovs_interfaceid": "758c0bbb-32ee-46bc-8731-37d03568a858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:14:47 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Converting VIF {"id": "758c0bbb-32ee-46bc-8731-37d03568a858", "address": "fa:16:3e:70:7c:00", "network": {"id": "459c55ed-5b55-4a59-9b66-ec757f05d8c6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bb523d6f2b3446f8a5e869f72a4f150b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758c0bbb-32", "ovs_interfaceid": "758c0bbb-32ee-46bc-8731-37d03568a858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:14:47 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:7c:00,bridge_name='br-int',has_traffic_filtering=True,id=758c0bbb-32ee-46bc-8731-37d03568a858,network=Network(459c55ed-5b55-4a59-9b66-ec757f05d8c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap758c0bbb-32') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:14:47 user nova-compute[74683]: DEBUG nova.objects.instance [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Lazy-loading 'pci_devices' on Instance uuid 53bce625-6aa9-42df-9cb4-c08958c18a47 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:14:47 user nova-compute[74683]: DEBUG nova.compute.manager [req-780b42f9-5e3d-41b2-a918-636f10fbfaef req-389df813-95f7-44e9-92ea-5871ea52769c service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received event network-changed-8c0a030c-cf2d-4d14-b5c3-6d0563b346b9 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:14:47 user nova-compute[74683]: DEBUG nova.compute.manager [req-780b42f9-5e3d-41b2-a918-636f10fbfaef req-389df813-95f7-44e9-92ea-5871ea52769c service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Refreshing instance network info cache due to event network-changed-8c0a030c-cf2d-4d14-b5c3-6d0563b346b9. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:14:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-780b42f9-5e3d-41b2-a918-636f10fbfaef req-389df813-95f7-44e9-92ea-5871ea52769c service nova] Acquiring lock "refresh_cache-9df7866f-28e9-46d0-9f35-24484adfffd7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:14:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-780b42f9-5e3d-41b2-a918-636f10fbfaef req-389df813-95f7-44e9-92ea-5871ea52769c service nova] Acquired lock "refresh_cache-9df7866f-28e9-46d0-9f35-24484adfffd7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:14:47 user nova-compute[74683]: DEBUG nova.network.neutron [req-780b42f9-5e3d-41b2-a918-636f10fbfaef req-389df813-95f7-44e9-92ea-5871ea52769c service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Refreshing network info cache for port 8c0a030c-cf2d-4d14-b5c3-6d0563b346b9 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:14:47 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] [instance: 53bce625-6aa9-42df-9cb4-c08958c18a47] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:14:47 user nova-compute[74683]:   <uuid>53bce625-6aa9-42df-9cb4-c08958c18a47</uuid>
Oct 16 11:14:47 user nova-compute[74683]:   <name>instance-0000000a</name>
Oct 16 11:14:47 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:14:47 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:14:47 user nova-compute[74683]:   <metadata>
Oct 16 11:14:47 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:14:47 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:14:47 user nova-compute[74683]:       <nova:name>tempest-VolumesNegativeTest-instance-64854216</nova:name>
Oct 16 11:14:47 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:14:47</nova:creationTime>
Oct 16 11:14:47 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:14:47 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:14:47 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:14:47 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:14:47 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:14:47 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:14:47 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:14:47 user nova-compute[74683]:       <nova:owner>
Oct 16 11:14:47 user nova-compute[74683]:         <nova:user uuid="1b891ebf84554097b0111e5cfa52431b">tempest-VolumesNegativeTest-173141477-project-member</nova:user>
Oct 16 11:14:47 user nova-compute[74683]:         <nova:project uuid="0cdc52ddb386435fa34000baf394c578">tempest-VolumesNegativeTest-173141477</nova:project>
Oct 16 11:14:47 user nova-compute[74683]:       </nova:owner>
Oct 16 11:14:47 user nova-compute[74683]:       <nova:root type="image" uuid="0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f"/>
Oct 16 11:14:47 user nova-compute[74683]:       <nova:ports>
Oct 16 11:14:47 user nova-compute[74683]:         <nova:port uuid="758c0bbb-32ee-46bc-8731-37d03568a858">
Oct 16 11:14:47 user nova-compute[74683]:           <nova:ip type="fixed" address="192.168.233.69" ipVersion="4"/>
Oct 16 11:14:47 user nova-compute[74683]:         </nova:port>
Oct 16 11:14:47 user nova-compute[74683]:       </nova:ports>
Oct 16 11:14:47 user nova-compute[74683]:     </nova:instance>
Oct 16 11:14:47 user nova-compute[74683]:   </metadata>
Oct 16 11:14:47 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:14:47 user nova-compute[74683]:     <system>
Oct 16 11:14:47 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:14:47 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:14:47 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:14:47 user nova-compute[74683]:       <entry name="serial">53bce625-6aa9-42df-9cb4-c08958c18a47</entry>
Oct 16 11:14:47 user nova-compute[74683]:       <entry name="uuid">53bce625-6aa9-42df-9cb4-c08958c18a47</entry>
Oct 16 11:14:47 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:14:47 user nova-compute[74683]:     </system>
Oct 16 11:14:47 user nova-compute[74683]:   </sysinfo>
Oct 16 11:14:47 user nova-compute[74683]:   <os>
Oct 16 11:14:47 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:14:47 user nova-compute[74683]:     <boot dev="hd"/>
Oct 16 11:14:47 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:14:47 user nova-compute[74683]:   </os>
Oct 16 11:14:47 user nova-compute[74683]:   <features>
Oct 16 11:14:47 user nova-compute[74683]:     <acpi/>
Oct 16 11:14:47 user nova-compute[74683]:     <apic/>
Oct 16 11:14:47 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:14:47 user nova-compute[74683]:   </features>
Oct 16 11:14:47 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:14:47 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:14:47 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:14:47 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:14:47 user nova-compute[74683]:   </clock>
Oct 16 11:14:47 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:14:47 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:14:47 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:14:47 user nova-compute[74683]:   </cpu>
Oct 16 11:14:47 user nova-compute[74683]:   <devices>
Oct 16 11:14:47 user nova-compute[74683]:     <disk type="file" device="disk">
Oct 16 11:14:47 user nova-compute[74683]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 11:14:47 user nova-compute[74683]:       <source file="/opt/stack/data/nova/instances/53bce625-6aa9-42df-9cb4-c08958c18a47/disk"/>
Oct 16 11:14:47 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:14:47 user nova-compute[74683]:     </disk>
Oct 16 11:14:47 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:14:47 user nova-compute[74683]:       <mac address="fa:16:3e:70:7c:00"/>
Oct 16 11:14:47 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:14:47 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:14:47 user nova-compute[74683]:       <target dev="tap758c0bbb-32"/>
Oct 16 11:14:47 user nova-compute[74683]:     </interface>
Oct 16 11:14:47 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:14:47 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/53bce625-6aa9-42df-9cb4-c08958c18a47/console.log" append="off"/>
Oct 16 11:14:47 user nova-compute[74683]:     </serial>
Oct 16 11:14:47 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:14:47 user nova-compute[74683]:     <video>
Oct 16 11:14:47 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:14:47 user nova-compute[74683]:     </video>
Oct 16 11:14:47 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:14:47 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:14:47 user nova-compute[74683]:     </rng>
Oct 16 11:14:47 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:14:47 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:14:47 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:14:47 user nova-compute[74683]:     </memballoon>
Oct 16 11:14:47 user nova-compute[74683]:   </devices>
Oct 16 11:14:47 user nova-compute[74683]: </domain>
Oct 16 11:14:47 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:14:47 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:14:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-64854216',display_name='tempest-VolumesNegativeTest-instance-64854216',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-64854216',id=10,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0cdc52ddb386435fa34000baf394c578',ramdisk_id='',reservation_id='r-sfc0k5xt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-173141477',owner_user_name='tempest-VolumesNegativeTest-173141477-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:14:45Z,user_data=None,user_id='1b891ebf84554097b0111e5cfa52431b',uuid=53bce625-6aa9-42df-9cb4-c08958c18a47,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "758c0bbb-32ee-46bc-8731-37d03568a858", "address": "fa:16:3e:70:7c:00", "network": {"id": "459c55ed-5b55-4a59-9b66-ec757f05d8c6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bb523d6f2b3446f8a5e869f72a4f150b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758c0bbb-32", "ovs_interfaceid": "758c0bbb-32ee-46bc-8731-37d03568a858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:14:47 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Converting VIF {"id": "758c0bbb-32ee-46bc-8731-37d03568a858", "address": "fa:16:3e:70:7c:00", "network": {"id": "459c55ed-5b55-4a59-9b66-ec757f05d8c6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bb523d6f2b3446f8a5e869f72a4f150b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758c0bbb-32", "ovs_interfaceid": "758c0bbb-32ee-46bc-8731-37d03568a858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:14:47 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:7c:00,bridge_name='br-int',has_traffic_filtering=True,id=758c0bbb-32ee-46bc-8731-37d03568a858,network=Network(459c55ed-5b55-4a59-9b66-ec757f05d8c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap758c0bbb-32') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:14:47 user nova-compute[74683]: DEBUG os_vif [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:7c:00,bridge_name='br-int',has_traffic_filtering=True,id=758c0bbb-32ee-46bc-8731-37d03568a858,network=Network(459c55ed-5b55-4a59-9b66-ec757f05d8c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap758c0bbb-32') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:14:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:14:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:14:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:14:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:14:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd945a9ac-7bbb-585d-ba6f-53b3922fb633', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:14:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:14:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:14:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:14:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap758c0bbb-32, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:14:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap758c0bbb-32, col_values=(('qos', UUID('775d527c-a723-4e2b-8e03-a58f7edbc8d9')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:14:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap758c0bbb-32, col_values=(('external_ids', {'iface-id': '758c0bbb-32ee-46bc-8731-37d03568a858', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:7c:00', 'vm-uuid': '53bce625-6aa9-42df-9cb4-c08958c18a47'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:14:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:14:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:14:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:14:47 user nova-compute[74683]: INFO os_vif [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:7c:00,bridge_name='br-int',has_traffic_filtering=True,id=758c0bbb-32ee-46bc-8731-37d03568a858,network=Network(459c55ed-5b55-4a59-9b66-ec757f05d8c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap758c0bbb-32')
Oct 16 11:14:47 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:14:47 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] No VIF found with MAC fa:16:3e:70:7c:00, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:14:47 user nova-compute[74683]: DEBUG nova.network.neutron [req-780b42f9-5e3d-41b2-a918-636f10fbfaef req-389df813-95f7-44e9-92ea-5871ea52769c service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:14:47 user nova-compute[74683]: DEBUG nova.network.neutron [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Successfully updated port: 698c4ef8-286a-4bc1-a789-3276dc6defea {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:14:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Acquiring lock "refresh_cache-9df7866f-28e9-46d0-9f35-24484adfffd7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:14:48 user nova-compute[74683]: DEBUG nova.network.neutron [req-780b42f9-5e3d-41b2-a918-636f10fbfaef req-389df813-95f7-44e9-92ea-5871ea52769c service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:14:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-780b42f9-5e3d-41b2-a918-636f10fbfaef req-389df813-95f7-44e9-92ea-5871ea52769c service nova] Releasing lock "refresh_cache-9df7866f-28e9-46d0-9f35-24484adfffd7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:14:48 user nova-compute[74683]: DEBUG nova.compute.manager [req-780b42f9-5e3d-41b2-a918-636f10fbfaef req-389df813-95f7-44e9-92ea-5871ea52769c service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received event network-changed-82f47635-6e3f-492d-9819-4d77ae46fb29 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:14:48 user nova-compute[74683]: DEBUG nova.compute.manager [req-780b42f9-5e3d-41b2-a918-636f10fbfaef req-389df813-95f7-44e9-92ea-5871ea52769c service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Refreshing instance network info cache due to event network-changed-82f47635-6e3f-492d-9819-4d77ae46fb29. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:14:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-780b42f9-5e3d-41b2-a918-636f10fbfaef req-389df813-95f7-44e9-92ea-5871ea52769c service nova] Acquiring lock "refresh_cache-9df7866f-28e9-46d0-9f35-24484adfffd7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:14:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-780b42f9-5e3d-41b2-a918-636f10fbfaef req-389df813-95f7-44e9-92ea-5871ea52769c service nova] Acquired lock "refresh_cache-9df7866f-28e9-46d0-9f35-24484adfffd7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:14:48 user nova-compute[74683]: DEBUG nova.network.neutron [req-780b42f9-5e3d-41b2-a918-636f10fbfaef req-389df813-95f7-44e9-92ea-5871ea52769c service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Refreshing network info cache for port 82f47635-6e3f-492d-9819-4d77ae46fb29 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:14:48 user nova-compute[74683]: DEBUG nova.network.neutron [req-780b42f9-5e3d-41b2-a918-636f10fbfaef req-389df813-95f7-44e9-92ea-5871ea52769c service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:14:48 user nova-compute[74683]: DEBUG nova.network.neutron [req-7dd70e08-914d-4529-a0c2-35867f5db2ec req-eb6a8b7a-cfec-4bd9-aa68-157c06a753d2 service nova] [instance: 53bce625-6aa9-42df-9cb4-c08958c18a47] Updated VIF entry in instance network info cache for port 758c0bbb-32ee-46bc-8731-37d03568a858. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:14:48 user nova-compute[74683]: DEBUG nova.network.neutron [req-7dd70e08-914d-4529-a0c2-35867f5db2ec req-eb6a8b7a-cfec-4bd9-aa68-157c06a753d2 service nova] [instance: 53bce625-6aa9-42df-9cb4-c08958c18a47] Updating instance_info_cache with network_info: [{"id": "758c0bbb-32ee-46bc-8731-37d03568a858", "address": "fa:16:3e:70:7c:00", "network": {"id": "459c55ed-5b55-4a59-9b66-ec757f05d8c6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bb523d6f2b3446f8a5e869f72a4f150b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758c0bbb-32", "ovs_interfaceid": "758c0bbb-32ee-46bc-8731-37d03568a858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:14:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-7dd70e08-914d-4529-a0c2-35867f5db2ec req-eb6a8b7a-cfec-4bd9-aa68-157c06a753d2 service nova] Releasing lock "refresh_cache-53bce625-6aa9-42df-9cb4-c08958c18a47" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:14:48 user nova-compute[74683]: DEBUG nova.network.neutron [req-780b42f9-5e3d-41b2-a918-636f10fbfaef req-389df813-95f7-44e9-92ea-5871ea52769c service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:14:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-780b42f9-5e3d-41b2-a918-636f10fbfaef req-389df813-95f7-44e9-92ea-5871ea52769c service nova] Releasing lock "refresh_cache-9df7866f-28e9-46d0-9f35-24484adfffd7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:14:48 user nova-compute[74683]: DEBUG nova.compute.manager [req-780b42f9-5e3d-41b2-a918-636f10fbfaef req-389df813-95f7-44e9-92ea-5871ea52769c service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received event network-changed-8a9e59f4-7708-438f-8411-499c6e38ec1b {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:14:48 user nova-compute[74683]: DEBUG nova.compute.manager [req-780b42f9-5e3d-41b2-a918-636f10fbfaef req-389df813-95f7-44e9-92ea-5871ea52769c service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Refreshing instance network info cache due to event network-changed-8a9e59f4-7708-438f-8411-499c6e38ec1b. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:14:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-780b42f9-5e3d-41b2-a918-636f10fbfaef req-389df813-95f7-44e9-92ea-5871ea52769c service nova] Acquiring lock "refresh_cache-9df7866f-28e9-46d0-9f35-24484adfffd7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:14:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-780b42f9-5e3d-41b2-a918-636f10fbfaef req-389df813-95f7-44e9-92ea-5871ea52769c service nova] Acquired lock "refresh_cache-9df7866f-28e9-46d0-9f35-24484adfffd7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:14:48 user nova-compute[74683]: DEBUG nova.network.neutron [req-780b42f9-5e3d-41b2-a918-636f10fbfaef req-389df813-95f7-44e9-92ea-5871ea52769c service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Refreshing network info cache for port 8a9e59f4-7708-438f-8411-499c6e38ec1b {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:14:48 user nova-compute[74683]: DEBUG nova.network.neutron [req-780b42f9-5e3d-41b2-a918-636f10fbfaef req-389df813-95f7-44e9-92ea-5871ea52769c service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:14:48 user nova-compute[74683]: DEBUG nova.network.neutron [req-780b42f9-5e3d-41b2-a918-636f10fbfaef req-389df813-95f7-44e9-92ea-5871ea52769c service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:14:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-780b42f9-5e3d-41b2-a918-636f10fbfaef req-389df813-95f7-44e9-92ea-5871ea52769c service nova] Releasing lock "refresh_cache-9df7866f-28e9-46d0-9f35-24484adfffd7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:14:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Acquired lock "refresh_cache-9df7866f-28e9-46d0-9f35-24484adfffd7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:14:48 user nova-compute[74683]: DEBUG nova.network.neutron [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:14:48 user nova-compute[74683]: DEBUG nova.network.neutron [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:14:48 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:14:49 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:14:49 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:14:49 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:14:49 user nova-compute[74683]: DEBUG nova.compute.manager [req-af09cbf8-28c3-46b7-9da5-fcdb3cd47643 req-b58bc507-cda4-4a91-8626-2ff9f51a0d04 service nova] [instance: 53bce625-6aa9-42df-9cb4-c08958c18a47] Received event network-vif-plugged-758c0bbb-32ee-46bc-8731-37d03568a858 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:14:49 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-af09cbf8-28c3-46b7-9da5-fcdb3cd47643 req-b58bc507-cda4-4a91-8626-2ff9f51a0d04 service nova] Acquiring lock "53bce625-6aa9-42df-9cb4-c08958c18a47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:14:49 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-af09cbf8-28c3-46b7-9da5-fcdb3cd47643 req-b58bc507-cda4-4a91-8626-2ff9f51a0d04 service nova] Lock "53bce625-6aa9-42df-9cb4-c08958c18a47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:14:49 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-af09cbf8-28c3-46b7-9da5-fcdb3cd47643 req-b58bc507-cda4-4a91-8626-2ff9f51a0d04 service nova] Lock "53bce625-6aa9-42df-9cb4-c08958c18a47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:14:49 user nova-compute[74683]: DEBUG nova.compute.manager [req-af09cbf8-28c3-46b7-9da5-fcdb3cd47643 req-b58bc507-cda4-4a91-8626-2ff9f51a0d04 service nova] [instance: 53bce625-6aa9-42df-9cb4-c08958c18a47] No waiting events found dispatching network-vif-plugged-758c0bbb-32ee-46bc-8731-37d03568a858 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:14:49 user nova-compute[74683]: WARNING nova.compute.manager [req-af09cbf8-28c3-46b7-9da5-fcdb3cd47643 req-b58bc507-cda4-4a91-8626-2ff9f51a0d04 service nova] [instance: 53bce625-6aa9-42df-9cb4-c08958c18a47] Received unexpected event network-vif-plugged-758c0bbb-32ee-46bc-8731-37d03568a858 for instance with vm_state building and task_state spawning.
Oct 16 11:14:49 user nova-compute[74683]: DEBUG nova.compute.manager [req-7109b3b0-0e14-435f-a80d-6481af9607ae req-c051175b-7c91-449b-a12c-3d68c56a209f service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received event network-changed-698c4ef8-286a-4bc1-a789-3276dc6defea {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:14:49 user nova-compute[74683]: DEBUG nova.compute.manager [req-7109b3b0-0e14-435f-a80d-6481af9607ae req-c051175b-7c91-449b-a12c-3d68c56a209f service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Refreshing instance network info cache due to event network-changed-698c4ef8-286a-4bc1-a789-3276dc6defea. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:14:49 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-7109b3b0-0e14-435f-a80d-6481af9607ae req-c051175b-7c91-449b-a12c-3d68c56a209f service nova] Acquiring lock "refresh_cache-9df7866f-28e9-46d0-9f35-24484adfffd7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:14:49 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:14:49 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:14:49 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:14:50 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:14:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Acquiring lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:14:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:14:50 user nova-compute[74683]: DEBUG nova.compute.manager [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Starting instance... {{(pid=74683) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 11:14:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:14:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:14:50 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74683) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 11:14:50 user nova-compute[74683]: INFO nova.compute.claims [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Claim successful on node user
Oct 16 11:14:50 user nova-compute[74683]: DEBUG nova.network.neutron [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Updating instance_info_cache with network_info: [{"id": "1509ff6e-10c0-4f96-95ae-660dfc1402cc", "address": "fa:16:3e:7e:c7:90", "network": {"id": "6e171460-714f-45db-a77d-ba03b50b892e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-531792258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1509ff6e-10", "ovs_interfaceid": "1509ff6e-10c0-4f96-95ae-660dfc1402cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7cfcd210-0e45-4f0e-b04b-1e933ec87734", "address": "fa:16:3e:d6:13:bf", "network": {"id": "0ab5f993-73f7-4963-9a4a-768145c101ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1056805143", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cfcd210-0e", "ovs_interfaceid": "7cfcd210-0e45-4f0e-b04b-1e933ec87734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bfe231c8-ff2a-46fd-9af6-9982a54d7846", "address": "fa:16:3e:52:f5:40", "network": {"id": "0ab5f993-73f7-4963-9a4a-768145c101ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1056805143", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe231c8-ff", "ovs_interfaceid": "bfe231c8-ff2a-46fd-9af6-9982a54d7846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8c0a030c-cf2d-4d14-b5c3-6d0563b346b9", "address": "fa:16:3e:b2:3c:35", "network": {"id": "0ab5f993-73f7-4963-9a4a-768145c101ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1056805143", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c0a030c-cf", "ovs_interfaceid": "8c0a030c-cf2d-4d14-b5c3-6d0563b346b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "82f47635-6e3f-492d-9819-4d77ae46fb29", "address": "fa:16:3e:24:20:65", "network": {"id": "0ab5f993-73f7-4963-9a4a-768145c101ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1056805143", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82f47635-6e", "ovs_interfaceid": "82f47635-6e3f-492d-9819-4d77ae46fb29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8a9e59f4-7708-438f-8411-499c6e38ec1b", "address": "fa:16:3e:42:50:56", "network": {"id": "e2c37b04-3414-40bf-a284-f1f9123d0ccb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1623055457", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a9e59f4-77", "ovs_interfaceid": "8a9e59f4-7708-438f-8411-499c6e38ec1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "698c4ef8-286a-4bc1-a789-3276dc6defea", "address": "fa:16:3e:f8:2c:0c", "network": {"id": "e2c37b04-3414-40bf-a284-f1f9123d0ccb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1623055457", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap698c4ef8-28", "ovs_interfaceid": "698c4ef8-286a-4bc1-a789-3276dc6defea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:14:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Releasing lock "refresh_cache-9df7866f-28e9-46d0-9f35-24484adfffd7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:14:50 user nova-compute[74683]: DEBUG nova.compute.manager [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Instance network_info: |[{"id": "1509ff6e-10c0-4f96-95ae-660dfc1402cc", "address": "fa:16:3e:7e:c7:90", "network": {"id": "6e171460-714f-45db-a77d-ba03b50b892e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-531792258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1509ff6e-10", "ovs_interfaceid": "1509ff6e-10c0-4f96-95ae-660dfc1402cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7cfcd210-0e45-4f0e-b04b-1e933ec87734", "address": "fa:16:3e:d6:13:bf", "network": {"id": "0ab5f993-73f7-4963-9a4a-768145c101ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1056805143", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cfcd210-0e", "ovs_interfaceid": "7cfcd210-0e45-4f0e-b04b-1e933ec87734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bfe231c8-ff2a-46fd-9af6-9982a54d7846", "address": "fa:16:3e:52:f5:40", "network": {"id": "0ab5f993-73f7-4963-9a4a-768145c101ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1056805143", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe231c8-ff", "ovs_interfaceid": "bfe231c8-ff2a-46fd-9af6-9982a54d7846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8c0a030c-cf2d-4d14-b5c3-6d0563b346b9", "address": "fa:16:3e:b2:3c:35", "network": {"id": "0ab5f993-73f7-4963-9a4a-768145c101ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1056805143", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c0a030c-cf", "ovs_interfaceid": "8c0a030c-cf2d-4d14-b5c3-6d0563b346b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "82f47635-6e3f-492d-9819-4d77ae46fb29", "address": "fa:16:3e:24:20:65", "network": {"id": "0ab5f993-73f7-4963-9a4a-768145c101ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1056805143", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82f47635-6e", "ovs_interfaceid": "82f47635-6e3f-492d-9819-4d77ae46fb29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8a9e59f4-7708-438f-8411-499c6e38ec1b", "address": "fa:16:3e:42:50:56", "network": {"id": "e2c37b04-3414-40bf-a284-f1f9123d0ccb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1623055457", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a9e59f4-77", "ovs_interfaceid": "8a9e59f4-7708-438f-8411-499c6e38ec1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "698c4ef8-286a-4bc1-a789-3276dc6defea", "address": "fa:16:3e:f8:2c:0c", "network": {"id": "e2c37b04-3414-40bf-a284-f1f9123d0ccb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1623055457", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap698c4ef8-28", "ovs_interfaceid": "698c4ef8-286a-4bc1-a789-3276dc6defea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 11:14:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-7109b3b0-0e14-435f-a80d-6481af9607ae req-c051175b-7c91-449b-a12c-3d68c56a209f service nova] Acquired lock "refresh_cache-9df7866f-28e9-46d0-9f35-24484adfffd7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:14:50 user nova-compute[74683]: DEBUG nova.network.neutron [req-7109b3b0-0e14-435f-a80d-6481af9607ae req-c051175b-7c91-449b-a12c-3d68c56a209f service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Refreshing network info cache for port 698c4ef8-286a-4bc1-a789-3276dc6defea {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:14:51 user nova-compute[74683]: DEBUG nova.compute.manager [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] [instance: 53bce625-6aa9-42df-9cb4-c08958c18a47] Instance event wait completed in 0 seconds for  {{(pid=74683) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 11:14:51 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] [instance: 53bce625-6aa9-42df-9cb4-c08958c18a47] Guest created on hypervisor {{(pid=74683) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 11:14:51 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:14:51 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 53bce625-6aa9-42df-9cb4-c08958c18a47] Instance spawned successfully.
Oct 16 11:14:51 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:14:51 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] [instance: 53bce625-6aa9-42df-9cb4-c08958c18a47] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 11:14:51 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.518s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:14:51 user nova-compute[74683]: DEBUG nova.compute.manager [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Start building networks asynchronously for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 11:14:51 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] [instance: 53bce625-6aa9-42df-9cb4-c08958c18a47] Found default for hw_cdrom_bus of ide {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:14:51 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] [instance: 53bce625-6aa9-42df-9cb4-c08958c18a47] Found default for hw_disk_bus of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:14:51 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] [instance: 53bce625-6aa9-42df-9cb4-c08958c18a47] Found default for hw_input_bus of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:14:51 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] [instance: 53bce625-6aa9-42df-9cb4-c08958c18a47] Found default for hw_pointer_model of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:14:51 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] [instance: 53bce625-6aa9-42df-9cb4-c08958c18a47] Found default for hw_video_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:14:51 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] [instance: 53bce625-6aa9-42df-9cb4-c08958c18a47] Found default for hw_vif_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:14:51 user nova-compute[74683]: DEBUG nova.network.neutron [req-7109b3b0-0e14-435f-a80d-6481af9607ae req-c051175b-7c91-449b-a12c-3d68c56a209f service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Updated VIF entry in instance network info cache for port 698c4ef8-286a-4bc1-a789-3276dc6defea. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:14:51 user nova-compute[74683]: DEBUG nova.network.neutron [req-7109b3b0-0e14-435f-a80d-6481af9607ae req-c051175b-7c91-449b-a12c-3d68c56a209f service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Updating instance_info_cache with network_info: [{"id": "1509ff6e-10c0-4f96-95ae-660dfc1402cc", "address": "fa:16:3e:7e:c7:90", "network": {"id": "6e171460-714f-45db-a77d-ba03b50b892e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-531792258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1509ff6e-10", "ovs_interfaceid": "1509ff6e-10c0-4f96-95ae-660dfc1402cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7cfcd210-0e45-4f0e-b04b-1e933ec87734", "address": "fa:16:3e:d6:13:bf", "network": {"id": "0ab5f993-73f7-4963-9a4a-768145c101ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1056805143", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cfcd210-0e", "ovs_interfaceid": "7cfcd210-0e45-4f0e-b04b-1e933ec87734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bfe231c8-ff2a-46fd-9af6-9982a54d7846", "address": "fa:16:3e:52:f5:40", "network": {"id": "0ab5f993-73f7-4963-9a4a-768145c101ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1056805143", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe231c8-ff", "ovs_interfaceid": "bfe231c8-ff2a-46fd-9af6-9982a54d7846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8c0a030c-cf2d-4d14-b5c3-6d0563b346b9", "address": "fa:16:3e:b2:3c:35", "network": {"id": "0ab5f993-73f7-4963-9a4a-768145c101ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1056805143", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c0a030c-cf", "ovs_interfaceid": "8c0a030c-cf2d-4d14-b5c3-6d0563b346b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "82f47635-6e3f-492d-9819-4d77ae46fb29", "address": "fa:16:3e:24:20:65", "network": {"id": "0ab5f993-73f7-4963-9a4a-768145c101ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1056805143", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82f47635-6e", "ovs_interfaceid": "82f47635-6e3f-492d-9819-4d77ae46fb29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8a9e59f4-7708-438f-8411-499c6e38ec1b", "address": "fa:16:3e:42:50:56", "network": {"id": "e2c37b04-3414-40bf-a284-f1f9123d0ccb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1623055457", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a9e59f4-77", "ovs_interfaceid": "8a9e59f4-7708-438f-8411-499c6e38ec1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "698c4ef8-286a-4bc1-a789-3276dc6defea", "address": "fa:16:3e:f8:2c:0c", "network": {"id": "e2c37b04-3414-40bf-a284-f1f9123d0ccb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1623055457", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap698c4ef8-28", "ovs_interfaceid": "698c4ef8-286a-4bc1-a789-3276dc6defea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:14:51 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-7109b3b0-0e14-435f-a80d-6481af9607ae req-c051175b-7c91-449b-a12c-3d68c56a209f service nova] Releasing lock "refresh_cache-9df7866f-28e9-46d0-9f35-24484adfffd7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:14:51 user nova-compute[74683]: INFO nova.compute.manager [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] [instance: 53bce625-6aa9-42df-9cb4-c08958c18a47] Took 6.61 seconds to spawn the instance on the hypervisor.
Oct 16 11:14:51 user nova-compute[74683]: DEBUG nova.compute.manager [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] [instance: 53bce625-6aa9-42df-9cb4-c08958c18a47] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:14:51 user nova-compute[74683]: DEBUG nova.compute.manager [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Allocating IP information in the background. {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 11:14:51 user nova-compute[74683]: DEBUG nova.network.neutron [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] allocate_for_instance() {{(pid=74683) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 11:14:51 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 11:14:51 user nova-compute[74683]: INFO nova.compute.manager [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] [instance: 53bce625-6aa9-42df-9cb4-c08958c18a47] Took 7.70 seconds to build instance.
Oct 16 11:14:51 user nova-compute[74683]: DEBUG nova.compute.manager [req-80632980-2643-421f-b24a-c3ca72854ce4 req-763a8c56-8c24-4cb3-954e-94ef3db6bd64 service nova] [instance: 53bce625-6aa9-42df-9cb4-c08958c18a47] Received event network-vif-plugged-758c0bbb-32ee-46bc-8731-37d03568a858 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:14:51 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-80632980-2643-421f-b24a-c3ca72854ce4 req-763a8c56-8c24-4cb3-954e-94ef3db6bd64 service nova] Acquiring lock "53bce625-6aa9-42df-9cb4-c08958c18a47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:14:51 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-80632980-2643-421f-b24a-c3ca72854ce4 req-763a8c56-8c24-4cb3-954e-94ef3db6bd64 service nova] Lock "53bce625-6aa9-42df-9cb4-c08958c18a47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:14:51 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-80632980-2643-421f-b24a-c3ca72854ce4 req-763a8c56-8c24-4cb3-954e-94ef3db6bd64 service nova] Lock "53bce625-6aa9-42df-9cb4-c08958c18a47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:14:51 user nova-compute[74683]: DEBUG nova.compute.manager [req-80632980-2643-421f-b24a-c3ca72854ce4 req-763a8c56-8c24-4cb3-954e-94ef3db6bd64 service nova] [instance: 53bce625-6aa9-42df-9cb4-c08958c18a47] No waiting events found dispatching network-vif-plugged-758c0bbb-32ee-46bc-8731-37d03568a858 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:14:51 user nova-compute[74683]: WARNING nova.compute.manager [req-80632980-2643-421f-b24a-c3ca72854ce4 req-763a8c56-8c24-4cb3-954e-94ef3db6bd64 service nova] [instance: 53bce625-6aa9-42df-9cb4-c08958c18a47] Received unexpected event network-vif-plugged-758c0bbb-32ee-46bc-8731-37d03568a858 for instance with vm_state active and task_state None.
Oct 16 11:14:51 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-95b555e9-ea39-4dc2-8258-a19b31958545 tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Lock "53bce625-6aa9-42df-9cb4-c08958c18a47" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.824s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:14:51 user nova-compute[74683]: DEBUG nova.compute.manager [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Start building block device mappings for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 11:14:51 user nova-compute[74683]: INFO nova.virt.block_device [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Booting with volume 2d1cac00-6344-49fe-9d7a-1c6fe160414e at /dev/vda
Oct 16 11:14:51 user nova-compute[74683]: DEBUG os_brick.utils [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:14:51 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:14:51 user nova-compute[74683]: DEBUG nova.policy [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '08a96cdfeb5746cea70a478c307e5998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac0a84f26f244dcb698429bb447feff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74683) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 11:14:51 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:14:51 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62a0cd9-e400-441c-ab86-117325561586]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:70b9d336ab7d\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:14:51 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:14:51 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:14:51 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80ccd06-eede-4236-b639-b0487f00a648]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:14:51 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:14:51 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:14:51 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[94528da1-cef1-4e38-942d-6b326408d00f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:14:51 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e222732-f99f-412b-878e-d32f518340f2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:14:51 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Running cmd (subprocess): nvme version {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:14:51 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] 'nvme version' failed. Not Retrying. {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:14:51 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] nvme not present on system {{(pid=74683) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 11:14:51 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:14:51 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:14:51 user nova-compute[74683]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 11:14:51 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a1230c-e9c9-4687-9e95-17d0427bcca8]: (4, '') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:14:51 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74683) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 11:14:51 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 11:14:51 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] LIGHTOS: no hostnqn found. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 11:14:51 user nova-compute[74683]: DEBUG os_brick.utils [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:70b9d336ab7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:14:51 user nova-compute[74683]: DEBUG nova.virt.block_device [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Updating existing volume attachment record: 6f135fb0-7644-4089-ae3a-fcf0562a8102 {{(pid=74683) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 11:14:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:14:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:14:52 user nova-compute[74683]: DEBUG nova.network.neutron [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Successfully created port: e57a2375-e447-4210-bbcf-41b3e5fc247c {{(pid=74683) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 11:14:53 user nova-compute[74683]: DEBUG nova.network.neutron [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Successfully created port: 9cb93e0f-104e-4f2b-9b61-6d89781b34ca {{(pid=74683) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 11:14:54 user nova-compute[74683]: DEBUG nova.network.neutron [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Successfully created port: 890aa3e7-41ea-4c2a-bcef-7f412d80f1ac {{(pid=74683) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 11:14:54 user nova-compute[74683]: DEBUG nova.network.neutron [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Successfully created port: f447e989-eb77-4618-9ce5-271b79c2441f {{(pid=74683) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 11:14:55 user nova-compute[74683]: DEBUG nova.network.neutron [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Successfully created port: 4a78f612-a4ed-431d-b6c6-b62a23d83a95 {{(pid=74683) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 11:14:55 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:14:56 user nova-compute[74683]: DEBUG nova.network.neutron [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Successfully updated port: e57a2375-e447-4210-bbcf-41b3e5fc247c {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:14:56 user nova-compute[74683]: DEBUG nova.compute.manager [req-b3cd1fc0-2147-4ab2-8e50-a7b44a51034a req-288fdff1-9a4f-492e-913c-0e13a469720e service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received event network-changed-e57a2375-e447-4210-bbcf-41b3e5fc247c {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:14:56 user nova-compute[74683]: DEBUG nova.compute.manager [req-b3cd1fc0-2147-4ab2-8e50-a7b44a51034a req-288fdff1-9a4f-492e-913c-0e13a469720e service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Refreshing instance network info cache due to event network-changed-e57a2375-e447-4210-bbcf-41b3e5fc247c. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:14:56 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b3cd1fc0-2147-4ab2-8e50-a7b44a51034a req-288fdff1-9a4f-492e-913c-0e13a469720e service nova] Acquiring lock "refresh_cache-d944f646-4c4d-4712-8dfe-9b1f0ff60683" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:14:56 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b3cd1fc0-2147-4ab2-8e50-a7b44a51034a req-288fdff1-9a4f-492e-913c-0e13a469720e service nova] Acquired lock "refresh_cache-d944f646-4c4d-4712-8dfe-9b1f0ff60683" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:14:56 user nova-compute[74683]: DEBUG nova.network.neutron [req-b3cd1fc0-2147-4ab2-8e50-a7b44a51034a req-288fdff1-9a4f-492e-913c-0e13a469720e service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Refreshing network info cache for port e57a2375-e447-4210-bbcf-41b3e5fc247c {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:14:56 user nova-compute[74683]: DEBUG nova.network.neutron [req-b3cd1fc0-2147-4ab2-8e50-a7b44a51034a req-288fdff1-9a4f-492e-913c-0e13a469720e service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:14:56 user nova-compute[74683]: DEBUG nova.network.neutron [req-b3cd1fc0-2147-4ab2-8e50-a7b44a51034a req-288fdff1-9a4f-492e-913c-0e13a469720e service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:14:56 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b3cd1fc0-2147-4ab2-8e50-a7b44a51034a req-288fdff1-9a4f-492e-913c-0e13a469720e service nova] Releasing lock "refresh_cache-d944f646-4c4d-4712-8dfe-9b1f0ff60683" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:14:57 user nova-compute[74683]: DEBUG nova.network.neutron [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Successfully updated port: ce7eb587-a6b4-4512-b0e2-80a4da1dbfb4 {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:14:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-69f93183-929b-43b6-a703-9aa0305e3eb6 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Acquiring lock "427b793c-ae47-451c-bbc5-589d6ce1d2bf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:14:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-69f93183-929b-43b6-a703-9aa0305e3eb6 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Lock "427b793c-ae47-451c-bbc5-589d6ce1d2bf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:14:57 user nova-compute[74683]: DEBUG nova.objects.instance [None req-69f93183-929b-43b6-a703-9aa0305e3eb6 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Lazy-loading 'flavor' on Instance uuid 427b793c-ae47-451c-bbc5-589d6ce1d2bf {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:14:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-69f93183-929b-43b6-a703-9aa0305e3eb6 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Lock "427b793c-ae47-451c-bbc5-589d6ce1d2bf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.155s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:14:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:14:57 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:14:58 user nova-compute[74683]: DEBUG nova.network.neutron [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Successfully updated port: a6b7eb88-42a3-46b9-8cd2-5b5b06d8849a {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:14:58 user nova-compute[74683]: DEBUG nova.compute.manager [None req-7df6bbfa-0a4a-4d9c-b145-cc5f96b489fe tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:14:58 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-69f93183-929b-43b6-a703-9aa0305e3eb6 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Acquiring lock "427b793c-ae47-451c-bbc5-589d6ce1d2bf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:14:58 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-69f93183-929b-43b6-a703-9aa0305e3eb6 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Lock "427b793c-ae47-451c-bbc5-589d6ce1d2bf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:14:58 user nova-compute[74683]: INFO nova.compute.manager [None req-69f93183-929b-43b6-a703-9aa0305e3eb6 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Attaching volume afb38837-f564-4468-b956-3e774068d208 to /dev/vdb
Oct 16 11:14:58 user nova-compute[74683]: INFO nova.compute.manager [None req-7df6bbfa-0a4a-4d9c-b145-cc5f96b489fe tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] instance snapshotting
Oct 16 11:14:58 user nova-compute[74683]: DEBUG os_brick.utils [None req-69f93183-929b-43b6-a703-9aa0305e3eb6 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:14:58 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:14:58 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:14:58 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[399c9e67-beec-4e67-afa2-cd082ceb77f5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:70b9d336ab7d\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:14:58 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:14:58 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:14:58 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[12202967-3d85-4965-a5a3-a29a94b17976]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:14:58 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:14:58 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:14:58 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[abfceadd-57f2-4802-a07c-b5a74d64d529]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:14:58 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[8350d405-748a-4356-9fd8-777a8a61f2b8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:14:58 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-69f93183-929b-43b6-a703-9aa0305e3eb6 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Running cmd (subprocess): nvme version {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:14:58 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-69f93183-929b-43b6-a703-9aa0305e3eb6 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] 'nvme version' failed. Not Retrying. {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:14:58 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.nvmeof [None req-69f93183-929b-43b6-a703-9aa0305e3eb6 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] nvme not present on system {{(pid=74683) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 11:14:58 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:14:58 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-7df6bbfa-0a4a-4d9c-b145-cc5f96b489fe tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Beginning live snapshot process
Oct 16 11:14:58 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:14:58 user nova-compute[74683]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 11:14:58 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8fb61f-c9b3-4252-9509-d9ad6ad9cd07]: (4, '') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:14:58 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-69f93183-929b-43b6-a703-9aa0305e3eb6 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74683) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 11:14:58 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-69f93183-929b-43b6-a703-9aa0305e3eb6 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 11:14:58 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-69f93183-929b-43b6-a703-9aa0305e3eb6 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] LIGHTOS: no hostnqn found. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 11:14:58 user nova-compute[74683]: DEBUG os_brick.utils [None req-69f93183-929b-43b6-a703-9aa0305e3eb6 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:70b9d336ab7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:14:58 user nova-compute[74683]: DEBUG nova.virt.block_device [None req-69f93183-929b-43b6-a703-9aa0305e3eb6 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Updating existing volume attachment record: 47101412-25d6-4059-b04b-ec8edcac3418 {{(pid=74683) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 11:14:58 user nova-compute[74683]: DEBUG nova.compute.manager [req-773ea983-73b4-4239-be36-6ab00cb45709 req-e75344f8-6121-4b91-a4a8-2c9aed99a645 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received event network-changed-ce7eb587-a6b4-4512-b0e2-80a4da1dbfb4 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:14:58 user nova-compute[74683]: DEBUG nova.compute.manager [req-773ea983-73b4-4239-be36-6ab00cb45709 req-e75344f8-6121-4b91-a4a8-2c9aed99a645 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Refreshing instance network info cache due to event network-changed-ce7eb587-a6b4-4512-b0e2-80a4da1dbfb4. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:14:58 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-773ea983-73b4-4239-be36-6ab00cb45709 req-e75344f8-6121-4b91-a4a8-2c9aed99a645 service nova] Acquiring lock "refresh_cache-d944f646-4c4d-4712-8dfe-9b1f0ff60683" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:14:58 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-773ea983-73b4-4239-be36-6ab00cb45709 req-e75344f8-6121-4b91-a4a8-2c9aed99a645 service nova] Acquired lock "refresh_cache-d944f646-4c4d-4712-8dfe-9b1f0ff60683" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:14:58 user nova-compute[74683]: DEBUG nova.network.neutron [req-773ea983-73b4-4239-be36-6ab00cb45709 req-e75344f8-6121-4b91-a4a8-2c9aed99a645 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Refreshing network info cache for port ce7eb587-a6b4-4512-b0e2-80a4da1dbfb4 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:14:58 user nova-compute[74683]: DEBUG nova.network.neutron [req-773ea983-73b4-4239-be36-6ab00cb45709 req-e75344f8-6121-4b91-a4a8-2c9aed99a645 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:14:58 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-7df6bbfa-0a4a-4d9c-b145-cc5f96b489fe tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json -f qcow2 {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:14:58 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:14:58 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:14:58 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-7df6bbfa-0a4a-4d9c-b145-cc5f96b489fe tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json -f qcow2" returned: 0 in 0.203s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:14:58 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-7df6bbfa-0a4a-4d9c-b145-cc5f96b489fe tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json -f qcow2 {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:14:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-7df6bbfa-0a4a-4d9c-b145-cc5f96b489fe tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json -f qcow2" returned: 0 in 0.210s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:14:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-7df6bbfa-0a4a-4d9c-b145-cc5f96b489fe tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:14:59 user nova-compute[74683]: DEBUG nova.network.neutron [req-773ea983-73b4-4239-be36-6ab00cb45709 req-e75344f8-6121-4b91-a4a8-2c9aed99a645 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:14:59 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-773ea983-73b4-4239-be36-6ab00cb45709 req-e75344f8-6121-4b91-a4a8-2c9aed99a645 service nova] Releasing lock "refresh_cache-d944f646-4c4d-4712-8dfe-9b1f0ff60683" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:14:59 user nova-compute[74683]: DEBUG nova.compute.manager [req-773ea983-73b4-4239-be36-6ab00cb45709 req-e75344f8-6121-4b91-a4a8-2c9aed99a645 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received event network-changed-a6b7eb88-42a3-46b9-8cd2-5b5b06d8849a {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:14:59 user nova-compute[74683]: DEBUG nova.compute.manager [req-773ea983-73b4-4239-be36-6ab00cb45709 req-e75344f8-6121-4b91-a4a8-2c9aed99a645 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Refreshing instance network info cache due to event network-changed-a6b7eb88-42a3-46b9-8cd2-5b5b06d8849a. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:14:59 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-773ea983-73b4-4239-be36-6ab00cb45709 req-e75344f8-6121-4b91-a4a8-2c9aed99a645 service nova] Acquiring lock "refresh_cache-d944f646-4c4d-4712-8dfe-9b1f0ff60683" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:14:59 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-773ea983-73b4-4239-be36-6ab00cb45709 req-e75344f8-6121-4b91-a4a8-2c9aed99a645 service nova] Acquired lock "refresh_cache-d944f646-4c4d-4712-8dfe-9b1f0ff60683" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:14:59 user nova-compute[74683]: DEBUG nova.network.neutron [req-773ea983-73b4-4239-be36-6ab00cb45709 req-e75344f8-6121-4b91-a4a8-2c9aed99a645 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Refreshing network info cache for port a6b7eb88-42a3-46b9-8cd2-5b5b06d8849a {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:14:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-7df6bbfa-0a4a-4d9c-b145-cc5f96b489fe tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.360s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:14:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-7df6bbfa-0a4a-4d9c-b145-cc5f96b489fe tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp8lnoizkc/555a249bc16a401891fd95ca453d410b.delta 1073741824 {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:14:59 user nova-compute[74683]: DEBUG nova.network.neutron [req-773ea983-73b4-4239-be36-6ab00cb45709 req-e75344f8-6121-4b91-a4a8-2c9aed99a645 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:14:59 user nova-compute[74683]: DEBUG nova.network.neutron [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Successfully updated port: 9cb93e0f-104e-4f2b-9b61-6d89781b34ca {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:14:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-7df6bbfa-0a4a-4d9c-b145-cc5f96b489fe tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp8lnoizkc/555a249bc16a401891fd95ca453d410b.delta 1073741824" returned: 0 in 0.058s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:14:59 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-7df6bbfa-0a4a-4d9c-b145-cc5f96b489fe tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 16 11:14:59 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-7df6bbfa-0a4a-4d9c-b145-cc5f96b489fe tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74683) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Oct 16 11:14:59 user nova-compute[74683]: INFO nova.virt.libvirt.host [None req-7df6bbfa-0a4a-4d9c-b145-cc5f96b489fe tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] UEFI support detected
Oct 16 11:14:59 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:14:59 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Starting heal instance info cache {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 11:14:59 user nova-compute[74683]: DEBUG nova.network.neutron [req-773ea983-73b4-4239-be36-6ab00cb45709 req-e75344f8-6121-4b91-a4a8-2c9aed99a645 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:14:59 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-773ea983-73b4-4239-be36-6ab00cb45709 req-e75344f8-6121-4b91-a4a8-2c9aed99a645 service nova] Releasing lock "refresh_cache-d944f646-4c4d-4712-8dfe-9b1f0ff60683" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:14:59 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "refresh_cache-18a77385-fab9-4ea0-8aa6-666cf7e798a6" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:14:59 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquired lock "refresh_cache-18a77385-fab9-4ea0-8aa6-666cf7e798a6" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:14:59 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Forcefully refreshing network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 11:15:00 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-7df6bbfa-0a4a-4d9c-b145-cc5f96b489fe tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74683) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 11:15:00 user nova-compute[74683]: DEBUG nova.compute.manager [req-787eb2f1-eb34-40c3-9e04-d1663851e309 req-0c327d94-edc9-41d4-ba3f-2d654ed76c1d service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received event network-changed-9cb93e0f-104e-4f2b-9b61-6d89781b34ca {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:15:00 user nova-compute[74683]: DEBUG nova.compute.manager [req-787eb2f1-eb34-40c3-9e04-d1663851e309 req-0c327d94-edc9-41d4-ba3f-2d654ed76c1d service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Refreshing instance network info cache due to event network-changed-9cb93e0f-104e-4f2b-9b61-6d89781b34ca. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:15:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-787eb2f1-eb34-40c3-9e04-d1663851e309 req-0c327d94-edc9-41d4-ba3f-2d654ed76c1d service nova] Acquiring lock "refresh_cache-d944f646-4c4d-4712-8dfe-9b1f0ff60683" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:15:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-787eb2f1-eb34-40c3-9e04-d1663851e309 req-0c327d94-edc9-41d4-ba3f-2d654ed76c1d service nova] Acquired lock "refresh_cache-d944f646-4c4d-4712-8dfe-9b1f0ff60683" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:15:00 user nova-compute[74683]: DEBUG nova.network.neutron [req-787eb2f1-eb34-40c3-9e04-d1663851e309 req-0c327d94-edc9-41d4-ba3f-2d654ed76c1d service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Refreshing network info cache for port 9cb93e0f-104e-4f2b-9b61-6d89781b34ca {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:15:00 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-7df6bbfa-0a4a-4d9c-b145-cc5f96b489fe tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] COPY block job progress, current cursor: 48496640 final cursor: 75497472 {{(pid=74683) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 11:15:00 user nova-compute[74683]: INFO nova.virt.block_device [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Booting with volume b6c6fe01-d34b-4fd1-8939-72ecd365df7b at /dev/vdb
Oct 16 11:15:00 user nova-compute[74683]: DEBUG nova.network.neutron [req-787eb2f1-eb34-40c3-9e04-d1663851e309 req-0c327d94-edc9-41d4-ba3f-2d654ed76c1d service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:15:00 user nova-compute[74683]: DEBUG os_brick.utils [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:15:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:00 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2357b3a-d82d-4818-b212-2de715e53a77]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:70b9d336ab7d\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:00 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[97816b41-3c7d-4885-9e14-e9b04d079e79]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:00 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3bbdbb-9b86-4086-b306-bca7fe50fa56]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:00 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce923a5-b168-4a5d-87bc-d2fe6bb81ec6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Running cmd (subprocess): nvme version {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] 'nvme version' failed. Not Retrying. {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:15:00 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] nvme not present on system {{(pid=74683) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 11:15:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:15:00 user nova-compute[74683]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 11:15:00 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[697a0e5c-3af6-4c7e-bace-5ad2cd8a825d]: (4, '') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:00 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74683) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 11:15:00 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 11:15:00 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] LIGHTOS: no hostnqn found. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 11:15:00 user nova-compute[74683]: DEBUG os_brick.utils [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:70b9d336ab7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:15:00 user nova-compute[74683]: DEBUG nova.virt.block_device [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Updating existing volume attachment record: 8cf002cd-a00c-4f06-9c36-80dc8224f6bf {{(pid=74683) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 11:15:01 user nova-compute[74683]: DEBUG nova.network.neutron [req-787eb2f1-eb34-40c3-9e04-d1663851e309 req-0c327d94-edc9-41d4-ba3f-2d654ed76c1d service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:15:01 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-787eb2f1-eb34-40c3-9e04-d1663851e309 req-0c327d94-edc9-41d4-ba3f-2d654ed76c1d service nova] Releasing lock "refresh_cache-d944f646-4c4d-4712-8dfe-9b1f0ff60683" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:15:01 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-7df6bbfa-0a4a-4d9c-b145-cc5f96b489fe tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74683) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 11:15:01 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-7df6bbfa-0a4a-4d9c-b145-cc5f96b489fe tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 16 11:15:01 user nova-compute[74683]: DEBUG nova.privsep.utils [None req-7df6bbfa-0a4a-4d9c-b145-cc5f96b489fe tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74683) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 11:15:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-7df6bbfa-0a4a-4d9c-b145-cc5f96b489fe tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp8lnoizkc/555a249bc16a401891fd95ca453d410b.delta /opt/stack/data/nova/instances/snapshots/tmp8lnoizkc/555a249bc16a401891fd95ca453d410b {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:01 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Updating instance_info_cache with network_info: [{"id": "fab663e7-134f-4cde-8cf1-2ccb1c83a812", "address": "fa:16:3e:8c:d5:b1", "network": {"id": "4d43cc12-d2cd-4552-90a4-884a0ff3dc66", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-825513246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6e0046017b4bba85caf2a39d1c67b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfab663e7-13", "ovs_interfaceid": "fab663e7-134f-4cde-8cf1-2ccb1c83a812", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:15:01 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Releasing lock "refresh_cache-18a77385-fab9-4ea0-8aa6-666cf7e798a6" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:15:01 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Updated the network info_cache for instance {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 11:15:01 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:15:01 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:15:01 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74683) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 11:15:01 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:15:01 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:15:01 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:15:01 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:15:01 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:15:01 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:15:01 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Auditing locally available compute resources for user (node: user) {{(pid=74683) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 11:15:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-7df6bbfa-0a4a-4d9c-b145-cc5f96b489fe tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp8lnoizkc/555a249bc16a401891fd95ca453d410b.delta /opt/stack/data/nova/instances/snapshots/tmp8lnoizkc/555a249bc16a401891fd95ca453d410b" returned: 0 in 0.389s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:01 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-7df6bbfa-0a4a-4d9c-b145-cc5f96b489fe tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Snapshot extracted, beginning image upload
Oct 16 11:15:02 user nova-compute[74683]: DEBUG nova.network.neutron [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Successfully updated port: 890aa3e7-41ea-4c2a-bcef-7f412d80f1ac {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:15:02 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:02 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:02 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:15:02 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:02 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1db5e2-0b25-4d61-9dd3-038811b4eda1/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:02 user nova-compute[74683]: DEBUG nova.compute.manager [req-76b0f7f8-a2ce-4c5c-b650-37c6c208eb9e req-cb873dee-1edd-4ab6-842e-618a88a6e12a service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received event network-changed-890aa3e7-41ea-4c2a-bcef-7f412d80f1ac {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:15:02 user nova-compute[74683]: DEBUG nova.compute.manager [req-76b0f7f8-a2ce-4c5c-b650-37c6c208eb9e req-cb873dee-1edd-4ab6-842e-618a88a6e12a service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Refreshing instance network info cache due to event network-changed-890aa3e7-41ea-4c2a-bcef-7f412d80f1ac. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:15:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-76b0f7f8-a2ce-4c5c-b650-37c6c208eb9e req-cb873dee-1edd-4ab6-842e-618a88a6e12a service nova] Acquiring lock "refresh_cache-d944f646-4c4d-4712-8dfe-9b1f0ff60683" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:15:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-76b0f7f8-a2ce-4c5c-b650-37c6c208eb9e req-cb873dee-1edd-4ab6-842e-618a88a6e12a service nova] Acquired lock "refresh_cache-d944f646-4c4d-4712-8dfe-9b1f0ff60683" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:15:02 user nova-compute[74683]: DEBUG nova.network.neutron [req-76b0f7f8-a2ce-4c5c-b650-37c6c208eb9e req-cb873dee-1edd-4ab6-842e-618a88a6e12a service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Refreshing network info cache for port 890aa3e7-41ea-4c2a-bcef-7f412d80f1ac {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:15:02 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1db5e2-0b25-4d61-9dd3-038811b4eda1/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:02 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1db5e2-0b25-4d61-9dd3-038811b4eda1/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:03 user nova-compute[74683]: DEBUG nova.network.neutron [req-76b0f7f8-a2ce-4c5c-b650-37c6c208eb9e req-cb873dee-1edd-4ab6-842e-618a88a6e12a service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:15:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1db5e2-0b25-4d61-9dd3-038811b4eda1/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:03 user nova-compute[74683]: DEBUG nova.network.neutron [req-76b0f7f8-a2ce-4c5c-b650-37c6c208eb9e req-cb873dee-1edd-4ab6-842e-618a88a6e12a service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:15:03 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-76b0f7f8-a2ce-4c5c-b650-37c6c208eb9e req-cb873dee-1edd-4ab6-842e-618a88a6e12a service nova] Releasing lock "refresh_cache-d944f646-4c4d-4712-8dfe-9b1f0ff60683" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:15:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/427b793c-ae47-451c-bbc5-589d6ce1d2bf/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:03 user nova-compute[74683]: DEBUG nova.network.neutron [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Successfully updated port: f447e989-eb77-4618-9ce5-271b79c2441f {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:15:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/427b793c-ae47-451c-bbc5-589d6ce1d2bf/disk --force-share --output=json" returned: 0 in 0.293s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/427b793c-ae47-451c-bbc5-589d6ce1d2bf/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/427b793c-ae47-451c-bbc5-589d6ce1d2bf/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53bce625-6aa9-42df-9cb4-c08958c18a47/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53bce625-6aa9-42df-9cb4-c08958c18a47/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53bce625-6aa9-42df-9cb4-c08958c18a47/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:04 user nova-compute[74683]: DEBUG nova.network.neutron [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Successfully updated port: 4a78f612-a4ed-431d-b6c6-b62a23d83a95 {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:15:04 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Acquiring lock "refresh_cache-d944f646-4c4d-4712-8dfe-9b1f0ff60683" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:15:04 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Acquired lock "refresh_cache-d944f646-4c4d-4712-8dfe-9b1f0ff60683" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:15:04 user nova-compute[74683]: DEBUG nova.network.neutron [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:15:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53bce625-6aa9-42df-9cb4-c08958c18a47/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd60be9c-0ff3-40a5-aaab-f31fa88a67f1/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:04 user nova-compute[74683]: DEBUG nova.network.neutron [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:15:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd60be9c-0ff3-40a5-aaab-f31fa88a67f1/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd60be9c-0ff3-40a5-aaab-f31fa88a67f1/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:04 user nova-compute[74683]: DEBUG nova.compute.manager [req-853427e2-ae58-40ed-8899-ab6e61a42878 req-8acd2196-ed84-4cd5-b982-7c29d8ceee18 service nova] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Received event network-changed-05cf5b29-bd7b-498d-b3d0-b7de22551793 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:15:04 user nova-compute[74683]: DEBUG nova.compute.manager [req-853427e2-ae58-40ed-8899-ab6e61a42878 req-8acd2196-ed84-4cd5-b982-7c29d8ceee18 service nova] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Refreshing instance network info cache due to event network-changed-05cf5b29-bd7b-498d-b3d0-b7de22551793. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:15:04 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-853427e2-ae58-40ed-8899-ab6e61a42878 req-8acd2196-ed84-4cd5-b982-7c29d8ceee18 service nova] Acquiring lock "refresh_cache-bd60be9c-0ff3-40a5-aaab-f31fa88a67f1" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:15:04 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-853427e2-ae58-40ed-8899-ab6e61a42878 req-8acd2196-ed84-4cd5-b982-7c29d8ceee18 service nova] Acquired lock "refresh_cache-bd60be9c-0ff3-40a5-aaab-f31fa88a67f1" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:15:04 user nova-compute[74683]: DEBUG nova.network.neutron [req-853427e2-ae58-40ed-8899-ab6e61a42878 req-8acd2196-ed84-4cd5-b982-7c29d8ceee18 service nova] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Refreshing network info cache for port 05cf5b29-bd7b-498d-b3d0-b7de22551793 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:15:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd60be9c-0ff3-40a5-aaab-f31fa88a67f1/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d3f594-1f38-41d3-90aa-3dfba95ce077/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:05 user nova-compute[74683]: DEBUG nova.compute.manager [req-aebf6f99-42fb-4a37-9991-dafcb864eeae req-2c8a74cf-c9b9-40f2-a4c0-4ddae7370526 service nova] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Received event network-changed-dbbeadad-745e-4d28-a242-577b3197b079 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:15:05 user nova-compute[74683]: DEBUG nova.compute.manager [req-aebf6f99-42fb-4a37-9991-dafcb864eeae req-2c8a74cf-c9b9-40f2-a4c0-4ddae7370526 service nova] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Refreshing instance network info cache due to event network-changed-dbbeadad-745e-4d28-a242-577b3197b079. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:15:05 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-aebf6f99-42fb-4a37-9991-dafcb864eeae req-2c8a74cf-c9b9-40f2-a4c0-4ddae7370526 service nova] Acquiring lock "refresh_cache-f192d1ec-311d-4a30-9766-361b27a8dae8" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:15:05 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-aebf6f99-42fb-4a37-9991-dafcb864eeae req-2c8a74cf-c9b9-40f2-a4c0-4ddae7370526 service nova] Acquired lock "refresh_cache-f192d1ec-311d-4a30-9766-361b27a8dae8" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:15:05 user nova-compute[74683]: DEBUG nova.network.neutron [req-aebf6f99-42fb-4a37-9991-dafcb864eeae req-2c8a74cf-c9b9-40f2-a4c0-4ddae7370526 service nova] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Refreshing network info cache for port dbbeadad-745e-4d28-a242-577b3197b079 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:15:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d3f594-1f38-41d3-90aa-3dfba95ce077/disk --force-share --output=json" returned: 0 in 0.322s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d3f594-1f38-41d3-90aa-3dfba95ce077/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d3f594-1f38-41d3-90aa-3dfba95ce077/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:05 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-7df6bbfa-0a4a-4d9c-b145-cc5f96b489fe tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Snapshot image upload complete
Oct 16 11:15:05 user nova-compute[74683]: INFO nova.compute.manager [None req-7df6bbfa-0a4a-4d9c-b145-cc5f96b489fe tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Took 7.72 seconds to snapshot the instance on the hypervisor.
Oct 16 11:15:05 user nova-compute[74683]: DEBUG nova.network.neutron [req-853427e2-ae58-40ed-8899-ab6e61a42878 req-8acd2196-ed84-4cd5-b982-7c29d8ceee18 service nova] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Updated VIF entry in instance network info cache for port 05cf5b29-bd7b-498d-b3d0-b7de22551793. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:15:05 user nova-compute[74683]: DEBUG nova.network.neutron [req-853427e2-ae58-40ed-8899-ab6e61a42878 req-8acd2196-ed84-4cd5-b982-7c29d8ceee18 service nova] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Updating instance_info_cache with network_info: [{"id": "05cf5b29-bd7b-498d-b3d0-b7de22551793", "address": "fa:16:3e:dd:07:47", "network": {"id": "f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-137528169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c66aa774134aa6a873eabffc28ec07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05cf5b29-bd", "ovs_interfaceid": "05cf5b29-bd7b-498d-b3d0-b7de22551793", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:15:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81290b55-8c05-4925-b445-d121b1bff1a2/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:05 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-853427e2-ae58-40ed-8899-ab6e61a42878 req-8acd2196-ed84-4cd5-b982-7c29d8ceee18 service nova] Releasing lock "refresh_cache-bd60be9c-0ff3-40a5-aaab-f31fa88a67f1" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:15:05 user nova-compute[74683]: DEBUG nova.compute.manager [req-853427e2-ae58-40ed-8899-ab6e61a42878 req-8acd2196-ed84-4cd5-b982-7c29d8ceee18 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received event network-changed-f447e989-eb77-4618-9ce5-271b79c2441f {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:15:05 user nova-compute[74683]: DEBUG nova.compute.manager [req-853427e2-ae58-40ed-8899-ab6e61a42878 req-8acd2196-ed84-4cd5-b982-7c29d8ceee18 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Refreshing instance network info cache due to event network-changed-f447e989-eb77-4618-9ce5-271b79c2441f. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:15:05 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-853427e2-ae58-40ed-8899-ab6e61a42878 req-8acd2196-ed84-4cd5-b982-7c29d8ceee18 service nova] Acquiring lock "refresh_cache-d944f646-4c4d-4712-8dfe-9b1f0ff60683" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:15:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81290b55-8c05-4925-b445-d121b1bff1a2/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81290b55-8c05-4925-b445-d121b1bff1a2/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81290b55-8c05-4925-b445-d121b1bff1a2/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:07 user nova-compute[74683]: DEBUG nova.network.neutron [req-aebf6f99-42fb-4a37-9991-dafcb864eeae req-2c8a74cf-c9b9-40f2-a4c0-4ddae7370526 service nova] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Updated VIF entry in instance network info cache for port dbbeadad-745e-4d28-a242-577b3197b079. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:15:07 user nova-compute[74683]: DEBUG nova.network.neutron [req-aebf6f99-42fb-4a37-9991-dafcb864eeae req-2c8a74cf-c9b9-40f2-a4c0-4ddae7370526 service nova] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Updating instance_info_cache with network_info: [{"id": "dbbeadad-745e-4d28-a242-577b3197b079", "address": "fa:16:3e:2b:14:bf", "network": {"id": "33f5edce-0901-42ea-b07a-47da2819b133", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-117849665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d7573bebfe47e3989f8eedd90dee6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbbeadad-74", "ovs_interfaceid": "dbbeadad-745e-4d28-a242-577b3197b079", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:15:07 user nova-compute[74683]: DEBUG nova.compute.manager [req-5d04a1b5-febb-4429-a2cc-bc9a7d0cd58f req-b14159ec-cf35-4271-aab4-255380c46397 service nova] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Received event network-changed-9476563e-0758-43d9-b920-87f412881869 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:15:07 user nova-compute[74683]: DEBUG nova.compute.manager [req-5d04a1b5-febb-4429-a2cc-bc9a7d0cd58f req-b14159ec-cf35-4271-aab4-255380c46397 service nova] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Refreshing instance network info cache due to event network-changed-9476563e-0758-43d9-b920-87f412881869. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:15:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-5d04a1b5-febb-4429-a2cc-bc9a7d0cd58f req-b14159ec-cf35-4271-aab4-255380c46397 service nova] Acquiring lock "refresh_cache-2f1db5e2-0b25-4d61-9dd3-038811b4eda1" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:15:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-5d04a1b5-febb-4429-a2cc-bc9a7d0cd58f req-b14159ec-cf35-4271-aab4-255380c46397 service nova] Acquired lock "refresh_cache-2f1db5e2-0b25-4d61-9dd3-038811b4eda1" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:15:07 user nova-compute[74683]: DEBUG nova.network.neutron [req-5d04a1b5-febb-4429-a2cc-bc9a7d0cd58f req-b14159ec-cf35-4271-aab4-255380c46397 service nova] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Refreshing network info cache for port 9476563e-0758-43d9-b920-87f412881869 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:15:07 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:15:07 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:15:07 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Hypervisor/Node resource view: name=user free_ram=7362MB free_disk=25.500843048095703GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74683) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 11:15:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:15:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:15:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-aebf6f99-42fb-4a37-9991-dafcb864eeae req-2c8a74cf-c9b9-40f2-a4c0-4ddae7370526 service nova] Releasing lock "refresh_cache-f192d1ec-311d-4a30-9766-361b27a8dae8" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:15:07 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 427b793c-ae47-451c-bbc5-589d6ce1d2bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:15:07 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 18a77385-fab9-4ea0-8aa6-666cf7e798a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:15:07 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance bd60be9c-0ff3-40a5-aaab-f31fa88a67f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:15:07 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance f192d1ec-311d-4a30-9766-361b27a8dae8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:15:07 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 2f1db5e2-0b25-4d61-9dd3-038811b4eda1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:15:07 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:15:07 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 81290b55-8c05-4925-b445-d121b1bff1a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:15:07 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance c8d3f594-1f38-41d3-90aa-3dfba95ce077 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:15:07 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 9df7866f-28e9-46d0-9f35-24484adfffd7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:15:07 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 53bce625-6aa9-42df-9cb4-c08958c18a47 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:15:07 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance d944f646-4c4d-4712-8dfe-9b1f0ff60683 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:15:07 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 11:15:07 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 11:15:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:07 user nova-compute[74683]: DEBUG nova.network.neutron [req-5d04a1b5-febb-4429-a2cc-bc9a7d0cd58f req-b14159ec-cf35-4271-aab4-255380c46397 service nova] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Updated VIF entry in instance network info cache for port 9476563e-0758-43d9-b920-87f412881869. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:15:07 user nova-compute[74683]: DEBUG nova.network.neutron [req-5d04a1b5-febb-4429-a2cc-bc9a7d0cd58f req-b14159ec-cf35-4271-aab4-255380c46397 service nova] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Updating instance_info_cache with network_info: [{"id": "9476563e-0758-43d9-b920-87f412881869", "address": "fa:16:3e:18:cc:d6", "network": {"id": "5a04a566-92ef-4300-976b-5c34656ec9c7", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-706076145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "207a79fe27c042d8b081272246b98245", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9476563e-07", "ovs_interfaceid": "9476563e-0758-43d9-b920-87f412881869", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:15:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-5d04a1b5-febb-4429-a2cc-bc9a7d0cd58f req-b14159ec-cf35-4271-aab4-255380c46397 service nova] Releasing lock "refresh_cache-2f1db5e2-0b25-4d61-9dd3-038811b4eda1" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:15:07 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:15:07 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:15:07 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Compute_service record updated for user:user {{(pid=74683) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 11:15:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.597s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:15:08 user nova-compute[74683]: DEBUG nova.compute.manager [None req-3a8de8e6-3089-4582-b1af-5de0cf08f813 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:15:08 user nova-compute[74683]: DEBUG nova.network.neutron [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Updating instance_info_cache with network_info: [{"id": "e57a2375-e447-4210-bbcf-41b3e5fc247c", "address": "fa:16:3e:20:c8:bf", "network": {"id": "540c0f36-606c-4006-8d84-50054c6727fa", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-308363250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape57a2375-e4", "ovs_interfaceid": "e57a2375-e447-4210-bbcf-41b3e5fc247c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ce7eb587-a6b4-4512-b0e2-80a4da1dbfb4", "address": "fa:16:3e:63:d7:c6", "network": {"id": "c1575c96-f936-4f92-9b3c-6355d69d0f52", "bridge": "br-int", "label": "tempest-device-tagging-net1-1179473676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce7eb587-a6", "ovs_interfaceid": "ce7eb587-a6b4-4512-b0e2-80a4da1dbfb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a6b7eb88-42a3-46b9-8cd2-5b5b06d8849a", "address": "fa:16:3e:9b:41:93", "network": {"id": "c1575c96-f936-4f92-9b3c-6355d69d0f52", "bridge": "br-int", "label": "tempest-device-tagging-net1-1179473676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6b7eb88-42", "ovs_interfaceid": "a6b7eb88-42a3-46b9-8cd2-5b5b06d8849a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9cb93e0f-104e-4f2b-9b61-6d89781b34ca", "address": "fa:16:3e:cd:71:b8", "network": {"id": "c1575c96-f936-4f92-9b3c-6355d69d0f52", "bridge": "br-int", "label": "tempest-device-tagging-net1-1179473676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cb93e0f-10", "ovs_interfaceid": "9cb93e0f-104e-4f2b-9b61-6d89781b34ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "890aa3e7-41ea-4c2a-bcef-7f412d80f1ac", "address": "fa:16:3e:75:e3:67", "network": {"id": "c1575c96-f936-4f92-9b3c-6355d69d0f52", "bridge": "br-int", "label": "tempest-device-tagging-net1-1179473676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap890aa3e7-41", "ovs_interfaceid": "890aa3e7-41ea-4c2a-bcef-7f412d80f1ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f447e989-eb77-4618-9ce5-271b79c2441f", "address": "fa:16:3e:d8:a4:a5", "network": {"id": "92db7fdf-c810-43ef-883b-69a04a04e5e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-66216092", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf447e989-eb", "ovs_interfaceid": "f447e989-eb77-4618-9ce5-271b79c2441f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4a78f612-a4ed-431d-b6c6-b62a23d83a95", "address": "fa:16:3e:13:b8:ac", "network": {"id": "92db7fdf-c810-43ef-883b-69a04a04e5e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-66216092", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a78f612-a4", "ovs_interfaceid": "4a78f612-a4ed-431d-b6c6-b62a23d83a95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:15:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Releasing lock "refresh_cache-d944f646-4c4d-4712-8dfe-9b1f0ff60683" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:15:08 user nova-compute[74683]: DEBUG nova.compute.manager [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Instance network_info: |[{"id": "e57a2375-e447-4210-bbcf-41b3e5fc247c", "address": "fa:16:3e:20:c8:bf", "network": {"id": "540c0f36-606c-4006-8d84-50054c6727fa", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-308363250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape57a2375-e4", "ovs_interfaceid": "e57a2375-e447-4210-bbcf-41b3e5fc247c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ce7eb587-a6b4-4512-b0e2-80a4da1dbfb4", "address": "fa:16:3e:63:d7:c6", "network": {"id": "c1575c96-f936-4f92-9b3c-6355d69d0f52", "bridge": "br-int", "label": "tempest-device-tagging-net1-1179473676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce7eb587-a6", "ovs_interfaceid": "ce7eb587-a6b4-4512-b0e2-80a4da1dbfb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a6b7eb88-42a3-46b9-8cd2-5b5b06d8849a", "address": "fa:16:3e:9b:41:93", "network": {"id": "c1575c96-f936-4f92-9b3c-6355d69d0f52", "bridge": "br-int", "label": "tempest-device-tagging-net1-1179473676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6b7eb88-42", "ovs_interfaceid": "a6b7eb88-42a3-46b9-8cd2-5b5b06d8849a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9cb93e0f-104e-4f2b-9b61-6d89781b34ca", "address": "fa:16:3e:cd:71:b8", "network": {"id": "c1575c96-f936-4f92-9b3c-6355d69d0f52", "bridge": "br-int", "label": "tempest-device-tagging-net1-1179473676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cb93e0f-10", "ovs_interfaceid": "9cb93e0f-104e-4f2b-9b61-6d89781b34ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "890aa3e7-41ea-4c2a-bcef-7f412d80f1ac", "address": "fa:16:3e:75:e3:67", "network": {"id": "c1575c96-f936-4f92-9b3c-6355d69d0f52", "bridge": "br-int", "label": "tempest-device-tagging-net1-1179473676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap890aa3e7-41", "ovs_interfaceid": "890aa3e7-41ea-4c2a-bcef-7f412d80f1ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f447e989-eb77-4618-9ce5-271b79c2441f", "address": "fa:16:3e:d8:a4:a5", "network": {"id": "92db7fdf-c810-43ef-883b-69a04a04e5e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-66216092", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf447e989-eb", "ovs_interfaceid": "f447e989-eb77-4618-9ce5-271b79c2441f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4a78f612-a4ed-431d-b6c6-b62a23d83a95", "address": "fa:16:3e:13:b8:ac", "network": {"id": "92db7fdf-c810-43ef-883b-69a04a04e5e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-66216092", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a78f612-a4", "ovs_interfaceid": "4a78f612-a4ed-431d-b6c6-b62a23d83a95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 11:15:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-853427e2-ae58-40ed-8899-ab6e61a42878 req-8acd2196-ed84-4cd5-b982-7c29d8ceee18 service nova] Acquired lock "refresh_cache-d944f646-4c4d-4712-8dfe-9b1f0ff60683" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:15:08 user nova-compute[74683]: DEBUG nova.network.neutron [req-853427e2-ae58-40ed-8899-ab6e61a42878 req-8acd2196-ed84-4cd5-b982-7c29d8ceee18 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Refreshing network info cache for port f447e989-eb77-4618-9ce5-271b79c2441f {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:15:08 user nova-compute[74683]: INFO nova.compute.manager [None req-3a8de8e6-3089-4582-b1af-5de0cf08f813 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] instance snapshotting
Oct 16 11:15:08 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-3a8de8e6-3089-4582-b1af-5de0cf08f813 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Beginning live snapshot process
Oct 16 11:15:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-3a8de8e6-3089-4582-b1af-5de0cf08f813 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1db5e2-0b25-4d61-9dd3-038811b4eda1/disk --force-share --output=json -f qcow2 {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:08 user nova-compute[74683]: DEBUG nova.network.neutron [req-853427e2-ae58-40ed-8899-ab6e61a42878 req-8acd2196-ed84-4cd5-b982-7c29d8ceee18 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Updated VIF entry in instance network info cache for port f447e989-eb77-4618-9ce5-271b79c2441f. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:15:08 user nova-compute[74683]: DEBUG nova.network.neutron [req-853427e2-ae58-40ed-8899-ab6e61a42878 req-8acd2196-ed84-4cd5-b982-7c29d8ceee18 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Updating instance_info_cache with network_info: [{"id": "e57a2375-e447-4210-bbcf-41b3e5fc247c", "address": "fa:16:3e:20:c8:bf", "network": {"id": "540c0f36-606c-4006-8d84-50054c6727fa", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-308363250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape57a2375-e4", "ovs_interfaceid": "e57a2375-e447-4210-bbcf-41b3e5fc247c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ce7eb587-a6b4-4512-b0e2-80a4da1dbfb4", "address": "fa:16:3e:63:d7:c6", "network": {"id": "c1575c96-f936-4f92-9b3c-6355d69d0f52", "bridge": "br-int", "label": "tempest-device-tagging-net1-1179473676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce7eb587-a6", "ovs_interfaceid": "ce7eb587-a6b4-4512-b0e2-80a4da1dbfb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a6b7eb88-42a3-46b9-8cd2-5b5b06d8849a", "address": "fa:16:3e:9b:41:93", "network": {"id": "c1575c96-f936-4f92-9b3c-6355d69d0f52", "bridge": "br-int", "label": "tempest-device-tagging-net1-1179473676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6b7eb88-42", "ovs_interfaceid": "a6b7eb88-42a3-46b9-8cd2-5b5b06d8849a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9cb93e0f-104e-4f2b-9b61-6d89781b34ca", "address": "fa:16:3e:cd:71:b8", "network": {"id": "c1575c96-f936-4f92-9b3c-6355d69d0f52", "bridge": "br-int", "label": "tempest-device-tagging-net1-1179473676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cb93e0f-10", "ovs_interfaceid": "9cb93e0f-104e-4f2b-9b61-6d89781b34ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "890aa3e7-41ea-4c2a-bcef-7f412d80f1ac", "address": "fa:16:3e:75:e3:67", "network": {"id": "c1575c96-f936-4f92-9b3c-6355d69d0f52", "bridge": "br-int", "label": "tempest-device-tagging-net1-1179473676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap890aa3e7-41", "ovs_interfaceid": "890aa3e7-41ea-4c2a-bcef-7f412d80f1ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f447e989-eb77-4618-9ce5-271b79c2441f", "address": "fa:16:3e:d8:a4:a5", "network": {"id": "92db7fdf-c810-43ef-883b-69a04a04e5e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-66216092", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf447e989-eb", "ovs_interfaceid": "f447e989-eb77-4618-9ce5-271b79c2441f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4a78f612-a4ed-431d-b6c6-b62a23d83a95", "address": "fa:16:3e:13:b8:ac", "network": {"id": "92db7fdf-c810-43ef-883b-69a04a04e5e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-66216092", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a78f612-a4", "ovs_interfaceid": "4a78f612-a4ed-431d-b6c6-b62a23d83a95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:15:09 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-853427e2-ae58-40ed-8899-ab6e61a42878 req-8acd2196-ed84-4cd5-b982-7c29d8ceee18 service nova] Releasing lock "refresh_cache-d944f646-4c4d-4712-8dfe-9b1f0ff60683" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:15:09 user nova-compute[74683]: DEBUG nova.compute.manager [req-853427e2-ae58-40ed-8899-ab6e61a42878 req-8acd2196-ed84-4cd5-b982-7c29d8ceee18 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received event network-changed-4a78f612-a4ed-431d-b6c6-b62a23d83a95 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:15:09 user nova-compute[74683]: DEBUG nova.compute.manager [req-853427e2-ae58-40ed-8899-ab6e61a42878 req-8acd2196-ed84-4cd5-b982-7c29d8ceee18 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Refreshing instance network info cache due to event network-changed-4a78f612-a4ed-431d-b6c6-b62a23d83a95. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:15:09 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-853427e2-ae58-40ed-8899-ab6e61a42878 req-8acd2196-ed84-4cd5-b982-7c29d8ceee18 service nova] Acquiring lock "refresh_cache-d944f646-4c4d-4712-8dfe-9b1f0ff60683" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:15:09 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-853427e2-ae58-40ed-8899-ab6e61a42878 req-8acd2196-ed84-4cd5-b982-7c29d8ceee18 service nova] Acquired lock "refresh_cache-d944f646-4c4d-4712-8dfe-9b1f0ff60683" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:15:09 user nova-compute[74683]: DEBUG nova.network.neutron [req-853427e2-ae58-40ed-8899-ab6e61a42878 req-8acd2196-ed84-4cd5-b982-7c29d8ceee18 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Refreshing network info cache for port 4a78f612-a4ed-431d-b6c6-b62a23d83a95 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:15:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-3a8de8e6-3089-4582-b1af-5de0cf08f813 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1db5e2-0b25-4d61-9dd3-038811b4eda1/disk --force-share --output=json -f qcow2" returned: 0 in 0.238s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-3a8de8e6-3089-4582-b1af-5de0cf08f813 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1db5e2-0b25-4d61-9dd3-038811b4eda1/disk --force-share --output=json -f qcow2 {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-3a8de8e6-3089-4582-b1af-5de0cf08f813 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1db5e2-0b25-4d61-9dd3-038811b4eda1/disk --force-share --output=json -f qcow2" returned: 0 in 0.210s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-3a8de8e6-3089-4582-b1af-5de0cf08f813 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:09 user nova-compute[74683]: DEBUG nova.network.neutron [req-853427e2-ae58-40ed-8899-ab6e61a42878 req-8acd2196-ed84-4cd5-b982-7c29d8ceee18 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Updated VIF entry in instance network info cache for port 4a78f612-a4ed-431d-b6c6-b62a23d83a95. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:15:09 user nova-compute[74683]: DEBUG nova.network.neutron [req-853427e2-ae58-40ed-8899-ab6e61a42878 req-8acd2196-ed84-4cd5-b982-7c29d8ceee18 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Updating instance_info_cache with network_info: [{"id": "e57a2375-e447-4210-bbcf-41b3e5fc247c", "address": "fa:16:3e:20:c8:bf", "network": {"id": "540c0f36-606c-4006-8d84-50054c6727fa", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-308363250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape57a2375-e4", "ovs_interfaceid": "e57a2375-e447-4210-bbcf-41b3e5fc247c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ce7eb587-a6b4-4512-b0e2-80a4da1dbfb4", "address": "fa:16:3e:63:d7:c6", "network": {"id": "c1575c96-f936-4f92-9b3c-6355d69d0f52", "bridge": "br-int", "label": "tempest-device-tagging-net1-1179473676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce7eb587-a6", "ovs_interfaceid": "ce7eb587-a6b4-4512-b0e2-80a4da1dbfb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a6b7eb88-42a3-46b9-8cd2-5b5b06d8849a", "address": "fa:16:3e:9b:41:93", "network": {"id": "c1575c96-f936-4f92-9b3c-6355d69d0f52", "bridge": "br-int", "label": "tempest-device-tagging-net1-1179473676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6b7eb88-42", "ovs_interfaceid": "a6b7eb88-42a3-46b9-8cd2-5b5b06d8849a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9cb93e0f-104e-4f2b-9b61-6d89781b34ca", "address": "fa:16:3e:cd:71:b8", "network": {"id": "c1575c96-f936-4f92-9b3c-6355d69d0f52", "bridge": "br-int", "label": "tempest-device-tagging-net1-1179473676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cb93e0f-10", "ovs_interfaceid": "9cb93e0f-104e-4f2b-9b61-6d89781b34ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "890aa3e7-41ea-4c2a-bcef-7f412d80f1ac", "address": "fa:16:3e:75:e3:67", "network": {"id": "c1575c96-f936-4f92-9b3c-6355d69d0f52", "bridge": "br-int", "label": "tempest-device-tagging-net1-1179473676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap890aa3e7-41", "ovs_interfaceid": "890aa3e7-41ea-4c2a-bcef-7f412d80f1ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f447e989-eb77-4618-9ce5-271b79c2441f", "address": "fa:16:3e:d8:a4:a5", "network": {"id": "92db7fdf-c810-43ef-883b-69a04a04e5e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-66216092", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf447e989-eb", "ovs_interfaceid": "f447e989-eb77-4618-9ce5-271b79c2441f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4a78f612-a4ed-431d-b6c6-b62a23d83a95", "address": "fa:16:3e:13:b8:ac", "network": {"id": "92db7fdf-c810-43ef-883b-69a04a04e5e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-66216092", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a78f612-a4", "ovs_interfaceid": "4a78f612-a4ed-431d-b6c6-b62a23d83a95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:15:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-3a8de8e6-3089-4582-b1af-5de0cf08f813 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.187s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-3a8de8e6-3089-4582-b1af-5de0cf08f813 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpg3wdeba_/057dbeacc4c5427d8aca84eebdc3d643.delta 1073741824 {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:09 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-853427e2-ae58-40ed-8899-ab6e61a42878 req-8acd2196-ed84-4cd5-b982-7c29d8ceee18 service nova] Releasing lock "refresh_cache-d944f646-4c4d-4712-8dfe-9b1f0ff60683" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:15:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-3a8de8e6-3089-4582-b1af-5de0cf08f813 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpg3wdeba_/057dbeacc4c5427d8aca84eebdc3d643.delta 1073741824" returned: 0 in 0.062s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:09 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-3a8de8e6-3089-4582-b1af-5de0cf08f813 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 16 11:15:09 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:15:10 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-3a8de8e6-3089-4582-b1af-5de0cf08f813 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74683) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 11:15:10 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:10 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-3a8de8e6-3089-4582-b1af-5de0cf08f813 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74683) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 11:15:10 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-3a8de8e6-3089-4582-b1af-5de0cf08f813 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 16 11:15:10 user nova-compute[74683]: DEBUG nova.privsep.utils [None req-3a8de8e6-3089-4582-b1af-5de0cf08f813 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74683) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 11:15:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-3a8de8e6-3089-4582-b1af-5de0cf08f813 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpg3wdeba_/057dbeacc4c5427d8aca84eebdc3d643.delta /opt/stack/data/nova/instances/snapshots/tmpg3wdeba_/057dbeacc4c5427d8aca84eebdc3d643 {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-3a8de8e6-3089-4582-b1af-5de0cf08f813 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpg3wdeba_/057dbeacc4c5427d8aca84eebdc3d643.delta /opt/stack/data/nova/instances/snapshots/tmpg3wdeba_/057dbeacc4c5427d8aca84eebdc3d643" returned: 0 in 0.358s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:11 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-3a8de8e6-3089-4582-b1af-5de0cf08f813 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Snapshot extracted, beginning image upload
Oct 16 11:15:12 user nova-compute[74683]: INFO nova.virt.block_device [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Booting with volume c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 at /dev/vdb
Oct 16 11:15:12 user nova-compute[74683]: DEBUG os_brick.utils [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:15:12 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:12 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:12 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[6191e5f1-ba95-4976-9759-6a8c05aa3563]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:70b9d336ab7d\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:12 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:12 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:12 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[76874fdf-d7e0-4392-ba1b-4ffbd6c758ba]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:12 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:12 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:12 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad01bd3-77a0-4fbd-b261-fa6237263a63]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:12 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[14356214-6c8e-4681-960c-a1c6452af479]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:12 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Running cmd (subprocess): nvme version {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:12 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] 'nvme version' failed. Not Retrying. {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:15:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:12 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] nvme not present on system {{(pid=74683) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 11:15:12 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:12 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:15:12 user nova-compute[74683]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 11:15:12 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f7fe72-cb00-4dd4-8830-7ea1e79949d4]: (4, '') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:12 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74683) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 11:15:12 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 11:15:12 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] LIGHTOS: no hostnqn found. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 11:15:12 user nova-compute[74683]: DEBUG os_brick.utils [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:70b9d336ab7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:15:12 user nova-compute[74683]: DEBUG nova.virt.block_device [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Updating existing volume attachment record: e2d25ade-8919-4346-a207-1c68f1180eea {{(pid=74683) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 11:15:13 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-3a8de8e6-3089-4582-b1af-5de0cf08f813 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Snapshot image upload complete
Oct 16 11:15:13 user nova-compute[74683]: INFO nova.compute.manager [None req-3a8de8e6-3089-4582-b1af-5de0cf08f813 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Took 5.21 seconds to snapshot the instance on the hypervisor.
Oct 16 11:15:15 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:19 user nova-compute[74683]: DEBUG nova.compute.manager [req-a444f217-03e7-4445-9644-f59da08874a5 req-36686ee6-e16e-455d-af7c-64f250d44875 service nova] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Received event network-changed-4e82d9f4-a743-4e67-bc9d-e9f7c527b102 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:15:19 user nova-compute[74683]: DEBUG nova.compute.manager [req-a444f217-03e7-4445-9644-f59da08874a5 req-36686ee6-e16e-455d-af7c-64f250d44875 service nova] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Refreshing instance network info cache due to event network-changed-4e82d9f4-a743-4e67-bc9d-e9f7c527b102. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:15:19 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a444f217-03e7-4445-9644-f59da08874a5 req-36686ee6-e16e-455d-af7c-64f250d44875 service nova] Acquiring lock "refresh_cache-fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:15:19 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a444f217-03e7-4445-9644-f59da08874a5 req-36686ee6-e16e-455d-af7c-64f250d44875 service nova] Acquired lock "refresh_cache-fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:15:19 user nova-compute[74683]: DEBUG nova.network.neutron [req-a444f217-03e7-4445-9644-f59da08874a5 req-36686ee6-e16e-455d-af7c-64f250d44875 service nova] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Refreshing network info cache for port 4e82d9f4-a743-4e67-bc9d-e9f7c527b102 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:15:19 user nova-compute[74683]: DEBUG nova.network.neutron [req-a444f217-03e7-4445-9644-f59da08874a5 req-36686ee6-e16e-455d-af7c-64f250d44875 service nova] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Updated VIF entry in instance network info cache for port 4e82d9f4-a743-4e67-bc9d-e9f7c527b102. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:15:19 user nova-compute[74683]: DEBUG nova.network.neutron [req-a444f217-03e7-4445-9644-f59da08874a5 req-36686ee6-e16e-455d-af7c-64f250d44875 service nova] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Updating instance_info_cache with network_info: [{"id": "4e82d9f4-a743-4e67-bc9d-e9f7c527b102", "address": "fa:16:3e:5a:7a:f8", "network": {"id": "2bf14a39-69ea-4656-956a-f1578bb1836d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1838676509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e03b7938f054e1fadb9f650ac8db1c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e82d9f4-a7", "ovs_interfaceid": "4e82d9f4-a743-4e67-bc9d-e9f7c527b102", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:15:19 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a444f217-03e7-4445-9644-f59da08874a5 req-36686ee6-e16e-455d-af7c-64f250d44875 service nova] Releasing lock "refresh_cache-fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:15:19 user nova-compute[74683]: INFO nova.virt.block_device [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Booting with volume 3f88fd55-edd7-479f-9c45-ac2456b4e59d at /dev/vdc
Oct 16 11:15:20 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-a139d9c2-9c6d-4a92-8fb3-341588da1b7a tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Acquiring lock "bd60be9c-0ff3-40a5-aaab-f31fa88a67f1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:15:20 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-a139d9c2-9c6d-4a92-8fb3-341588da1b7a tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "bd60be9c-0ff3-40a5-aaab-f31fa88a67f1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:15:20 user nova-compute[74683]: DEBUG nova.objects.instance [None req-a139d9c2-9c6d-4a92-8fb3-341588da1b7a tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lazy-loading 'flavor' on Instance uuid bd60be9c-0ff3-40a5-aaab-f31fa88a67f1 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:15:20 user nova-compute[74683]: DEBUG os_brick.utils [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:15:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:20 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-a139d9c2-9c6d-4a92-8fb3-341588da1b7a tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "bd60be9c-0ff3-40a5-aaab-f31fa88a67f1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.102s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:15:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:20 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd0846b-6597-4f52-87d9-307b0033988a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:70b9d336ab7d\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:20 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d07b189-2cfb-4165-9e8e-bee9b8824a5b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:20 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[024d9a25-46cf-4ef8-b237-620f8e18dbf3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:20 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[efff01a2-7340-4df7-a3c6-4faa7c1bccac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Running cmd (subprocess): nvme version {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] 'nvme version' failed. Not Retrying. {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:15:20 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] nvme not present on system {{(pid=74683) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 11:15:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:15:20 user nova-compute[74683]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 11:15:20 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ecad53a-7e52-449e-be2e-c5b04c420dea]: (4, '') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:20 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74683) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 11:15:20 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 11:15:20 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] LIGHTOS: no hostnqn found. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 11:15:20 user nova-compute[74683]: DEBUG os_brick.utils [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:70b9d336ab7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:15:20 user nova-compute[74683]: DEBUG nova.virt.block_device [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Updating existing volume attachment record: c7850a72-e75e-40de-8fae-753a06498be8 {{(pid=74683) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 11:15:20 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-a139d9c2-9c6d-4a92-8fb3-341588da1b7a tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Acquiring lock "bd60be9c-0ff3-40a5-aaab-f31fa88a67f1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:15:20 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-a139d9c2-9c6d-4a92-8fb3-341588da1b7a tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "bd60be9c-0ff3-40a5-aaab-f31fa88a67f1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:15:20 user nova-compute[74683]: INFO nova.compute.manager [None req-a139d9c2-9c6d-4a92-8fb3-341588da1b7a tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Attaching volume 77512c13-eaac-4b26-8c71-57564bfca020 to /dev/vdb
Oct 16 11:15:20 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-69f93183-929b-43b6-a703-9aa0305e3eb6 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-69f93183-929b-43b6-a703-9aa0305e3eb6 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG os_brick.initiator.connector [None req-69f93183-929b-43b6-a703-9aa0305e3eb6 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Factory for ISCSI on None {{(pid=74683) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-69f93183-929b-43b6-a703-9aa0305e3eb6 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.006s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69f93183-929b-43b6-a703-9aa0305e3eb6 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Calling os-brick to attach iSCSI Volume {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f93183-929b-43b6-a703-9aa0305e3eb6 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:afb38837-f564-4468-b956-3e774068d208', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GKUpajVY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:15:21 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-69f93183-929b-43b6-a703-9aa0305e3eb6 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:15:21 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-69f93183-929b-43b6-a703-9aa0305e3eb6 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-69f93183-929b-43b6-a703-9aa0305e3eb6 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:15:21 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-69f93183-929b-43b6-a703-9aa0305e3eb6 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:15:21 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-69f93183-929b-43b6-a703-9aa0305e3eb6 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afb38837-f564-4468-b956-3e774068d208" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-69f93183-929b-43b6-a703-9aa0305e3eb6 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afb38837-f564-4468-b956-3e774068d208" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:15:21 user nova-compute[74683]: INFO os_brick.initiator.connectors.iscsi [None req-69f93183-929b-43b6-a703-9aa0305e3eb6 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 11:15:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afb38837-f564-4468-b956-3e774068d208 -p 172.16.0.220:3260 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afb38837-f564-4468-b956-3e774068d208 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e60c70-5175-43ff-9c1c-60a239275850]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f93183-929b-43b6-a703-9aa0305e3eb6 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 11:15:21 user nova-compute[74683]:  {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afb38837-f564-4468-b956-3e774068d208 -p 172.16.0.220:3260 --interface default --op new {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afb38837-f564-4468-b956-3e774068d208 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0f5aa2-1a3f-4e52-9994-232ae0611b9f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:afb38837-f564-4468-b956-3e774068d208] added\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f93183-929b-43b6-a703-9aa0305e3eb6 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:afb38837-f564-4468-b956-3e774068d208] added
Oct 16 11:15:21 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afb38837-f564-4468-b956-3e774068d208 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afb38837-f564-4468-b956-3e774068d208 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fad80b6-cc8a-46cf-860f-e56d7bb746b3]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f93183-929b-43b6-a703-9aa0305e3eb6 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afb38837-f564-4468-b956-3e774068d208 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afb38837-f564-4468-b956-3e774068d208 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[c070c2da-0f13-4b32-904d-b7961bfedf00]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f93183-929b-43b6-a703-9aa0305e3eb6 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afb38837-f564-4468-b956-3e774068d208 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GKUpajVY {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afb38837-f564-4468-b956-3e774068d208 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GKUpajVY" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64c5761-851c-42d5-bb54-77cb9a8fd3e2]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f93183-929b-43b6-a703-9aa0305e3eb6 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GKUpajVY'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afb38837-f564-4468-b956-3e774068d208 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afb38837-f564-4468-b956-3e774068d208 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a6ed08-1eb5-44dc-94a2-0653fbddb0e9]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f93183-929b-43b6-a703-9aa0305e3eb6 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[9792b523-be70-4f03-9d4e-88b4b4eb256c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f93183-929b-43b6-a703-9aa0305e3eb6 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 16 11:15:21 user nova-compute[74683]:  {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f93183-929b-43b6-a703-9aa0305e3eb6 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 16 11:15:21 user nova-compute[74683]:  {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:15:21 user nova-compute[74683]: WARNING os_brick.initiator.connectors.iscsi [None req-69f93183-929b-43b6-a703-9aa0305e3eb6 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 16 11:15:21 user nova-compute[74683]: 
Oct 16 11:15:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afb38837-f564-4468-b956-3e774068d208 -p 172.16.0.220:3260 --login {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG os_brick.utils [None req-a139d9c2-9c6d-4a92-8fb3-341588da1b7a tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f16c9ac-fb39-4f16-8d32-a7623f00c0d4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:70b9d336ab7d\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[825cec1c-b718-4b29-9635-3ea58205a0a7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afb38837-f564-4468-b956-3e774068d208 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4805a9f-fb89-4a7c-b545-2117ac1d5aab]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:afb38837-f564-4468-b956-3e774068d208, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:afb38837-f564-4468-b956-3e774068d208, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f93183-929b-43b6-a703-9aa0305e3eb6 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:afb38837-f564-4468-b956-3e774068d208, portal: 172.16.0.220,3260]
Oct 16 11:15:21 user nova-compute[74683]: Login to [iface: default, target: iqn.2010-10.org.openstack:afb38837-f564-4468-b956-3e774068d208, portal: 172.16.0.220,3260] successful.
Oct 16 11:15:21 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afb38837-f564-4468-b956-3e774068d208 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[4115b0ba-8209-4aa0-9927-6060c361f91b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3be84a-674e-402d-84b2-1fb944f8d65d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-a139d9c2-9c6d-4a92-8fb3-341588da1b7a tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Running cmd (subprocess): nvme version {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-a139d9c2-9c6d-4a92-8fb3-341588da1b7a tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] 'nvme version' failed. Not Retrying. {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afb38837-f564-4468-b956-3e774068d208 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a458168-fdcc-4b27-a70b-65d7c2de1de9]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a139d9c2-9c6d-4a92-8fb3-341588da1b7a tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] nvme not present on system {{(pid=74683) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f93183-929b-43b6-a703-9aa0305e3eb6 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:15:21 user nova-compute[74683]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 11:15:21 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c8e890-f33a-41d9-9ee7-1d14a33fb382]: (4, '') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-a139d9c2-9c6d-4a92-8fb3-341588da1b7a tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74683) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-a139d9c2-9c6d-4a92-8fb3-341588da1b7a tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-a139d9c2-9c6d-4a92-8fb3-341588da1b7a tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] LIGHTOS: no hostnqn found. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG os_brick.utils [None req-a139d9c2-9c6d-4a92-8fb3-341588da1b7a tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:70b9d336ab7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG nova.virt.block_device [None req-a139d9c2-9c6d-4a92-8fb3-341588da1b7a tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Updating existing volume attachment record: fd4a66fb-e792-4748-80aa-cc4caeb51121 {{(pid=74683) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab58a50c-3995-445d-bfef-1ea410c0951c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb38837-f564-4468-b956-3e774068d208 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f93183-929b-43b6-a703-9aa0305e3eb6 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb38837-f564-4468-b956-3e774068d208 (non-flash)
Oct 16 11:15:21 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f93183-929b-43b6-a703-9aa0305e3eb6 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb38837-f564-4468-b956-3e774068d208 (non-flash)
Oct 16 11:15:21 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-69f93183-929b-43b6-a703-9aa0305e3eb6 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afb38837-f564-4468-b956-3e774068d208" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f93183-929b-43b6-a703-9aa0305e3eb6 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Connected to 172.16.0.220:3260 {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-69f93183-929b-43b6-a703-9aa0305e3eb6 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74683) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-69f93183-929b-43b6-a703-9aa0305e3eb6 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74683) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a823c20-57eb-4e63-aff3-6522737d1a31]: (4, ('- - 0', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-69f93183-929b-43b6-a703-9aa0305e3eb6 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:15:21 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f93183-929b-43b6-a703-9aa0305e3eb6 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:afb38837-f564-4468-b956-3e774068d208', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GKUpajVY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 11:15:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:22 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-69f93183-929b-43b6-a703-9aa0305e3eb6 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:15:22 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f93183-929b-43b6-a703-9aa0305e3eb6 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '23733386533376564', 'path': '/dev/sdb'} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:15:22 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69f93183-929b-43b6-a703-9aa0305e3eb6 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733386533376564', 'path': '/dev/sdb'} {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 11:15:22 user nova-compute[74683]: DEBUG nova.objects.instance [None req-69f93183-929b-43b6-a703-9aa0305e3eb6 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Lazy-loading 'flavor' on Instance uuid 427b793c-ae47-451c-bbc5-589d6ce1d2bf {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:15:22 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-69f93183-929b-43b6-a703-9aa0305e3eb6 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 11:15:22 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:15:22 user nova-compute[74683]:   <source dev="/dev/sdb"/>
Oct 16 11:15:22 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:15:22 user nova-compute[74683]:   <serial>afb38837-f564-4468-b956-3e774068d208</serial>
Oct 16 11:15:22 user nova-compute[74683]: </disk>
Oct 16 11:15:22 user nova-compute[74683]:  {{(pid=74683) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 11:15:23 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-69f93183-929b-43b6-a703-9aa0305e3eb6 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:15:23 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-69f93183-929b-43b6-a703-9aa0305e3eb6 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:15:23 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-69f93183-929b-43b6-a703-9aa0305e3eb6 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] No VIF found with MAC fa:16:3e:a1:28:21, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:15:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:30 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:30 user nova-compute[74683]: DEBUG nova.compute.manager [req-67cddf12-d09b-44b3-a249-9f615bab203e req-9d84fc32-3b22-4bb7-a596-7b2af67d3006 service nova] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Received event network-changed-8b5f6bec-c96c-4b1d-bdf6-4012cc0a3fae {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:15:30 user nova-compute[74683]: DEBUG nova.compute.manager [req-67cddf12-d09b-44b3-a249-9f615bab203e req-9d84fc32-3b22-4bb7-a596-7b2af67d3006 service nova] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Refreshing instance network info cache due to event network-changed-8b5f6bec-c96c-4b1d-bdf6-4012cc0a3fae. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:15:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-67cddf12-d09b-44b3-a249-9f615bab203e req-9d84fc32-3b22-4bb7-a596-7b2af67d3006 service nova] Acquiring lock "refresh_cache-81290b55-8c05-4925-b445-d121b1bff1a2" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:15:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-67cddf12-d09b-44b3-a249-9f615bab203e req-9d84fc32-3b22-4bb7-a596-7b2af67d3006 service nova] Acquired lock "refresh_cache-81290b55-8c05-4925-b445-d121b1bff1a2" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:15:30 user nova-compute[74683]: DEBUG nova.network.neutron [req-67cddf12-d09b-44b3-a249-9f615bab203e req-9d84fc32-3b22-4bb7-a596-7b2af67d3006 service nova] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Refreshing network info cache for port 8b5f6bec-c96c-4b1d-bdf6-4012cc0a3fae {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:15:31 user nova-compute[74683]: DEBUG nova.network.neutron [req-67cddf12-d09b-44b3-a249-9f615bab203e req-9d84fc32-3b22-4bb7-a596-7b2af67d3006 service nova] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Updated VIF entry in instance network info cache for port 8b5f6bec-c96c-4b1d-bdf6-4012cc0a3fae. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:15:31 user nova-compute[74683]: DEBUG nova.network.neutron [req-67cddf12-d09b-44b3-a249-9f615bab203e req-9d84fc32-3b22-4bb7-a596-7b2af67d3006 service nova] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Updating instance_info_cache with network_info: [{"id": "8b5f6bec-c96c-4b1d-bdf6-4012cc0a3fae", "address": "fa:16:3e:f3:60:b8", "network": {"id": "55de7975-487e-4317-ac3e-9619e78b087c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-563245692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c6b7c7954f42638e1075cc9d0afbd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b5f6bec-c9", "ovs_interfaceid": "8b5f6bec-c96c-4b1d-bdf6-4012cc0a3fae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:15:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-67cddf12-d09b-44b3-a249-9f615bab203e req-9d84fc32-3b22-4bb7-a596-7b2af67d3006 service nova] Releasing lock "refresh_cache-81290b55-8c05-4925-b445-d121b1bff1a2" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:15:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:35 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-69f93183-929b-43b6-a703-9aa0305e3eb6 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Lock "427b793c-ae47-451c-bbc5-589d6ce1d2bf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 39.290s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:15:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:37 user nova-compute[74683]: DEBUG nova.compute.manager [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Start spawning the instance on the hypervisor. {{(pid=74683) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 11:15:37 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Creating instance directory {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 11:15:37 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Creating image(s)
Oct 16 11:15:37 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Did not create local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 16 11:15:37 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Ensure instance console log exists: /opt/stack/data/nova/instances/9df7866f-28e9-46d0-9f35-24484adfffd7/console.log {{(pid=74683) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 11:15:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:15:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:15:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:15:37 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Start _get_guest_xml network_info=[{"id": "1509ff6e-10c0-4f96-95ae-660dfc1402cc", "address": "fa:16:3e:7e:c7:90", "network": {"id": "6e171460-714f-45db-a77d-ba03b50b892e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-531792258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1509ff6e-10", "ovs_interfaceid": "1509ff6e-10c0-4f96-95ae-660dfc1402cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7cfcd210-0e45-4f0e-b04b-1e933ec87734", "address": "fa:16:3e:d6:13:bf", "network": {"id": "0ab5f993-73f7-4963-9a4a-768145c101ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1056805143", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cfcd210-0e", "ovs_interfaceid": "7cfcd210-0e45-4f0e-b04b-1e933ec87734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bfe231c8-ff2a-46fd-9af6-9982a54d7846", "address": "fa:16:3e:52:f5:40", "network": {"id": "0ab5f993-73f7-4963-9a4a-768145c101ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1056805143", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe231c8-ff", "ovs_interfaceid": "bfe231c8-ff2a-46fd-9af6-9982a54d7846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8c0a030c-cf2d-4d14-b5c3-6d0563b346b9", "address": "fa:16:3e:b2:3c:35", "network": {"id": "0ab5f993-73f7-4963-9a4a-768145c101ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1056805143", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c0a030c-cf", "ovs_interfaceid": "8c0a030c-cf2d-4d14-b5c3-6d0563b346b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "82f47635-6e3f-492d-9819-4d77ae46fb29", "address": "fa:16:3e:24:20:65", "network": {"id": "0ab5f993-73f7-4963-9a4a-768145c101ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1056805143", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82f47635-6e", "ovs_interfaceid": "82f47635-6e3f-492d-9819-4d77ae46fb29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8a9e59f4-7708-438f-8411-499c6e38ec1b", "address": "fa:16:3e:42:50:56", "network": {"id": "e2c37b04-3414-40bf-a284-f1f9123d0ccb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1623055457", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a9e59f4-77", "ovs_interfaceid": "8a9e59f4-7708-438f-8411-499c6e38ec1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "698c4ef8-286a-4bc1-a789-3276dc6defea", "address": "fa:16:3e:f8:2c:0c", "network": {"id": "e2c37b04-3414-40bf-a284-f1f9123d0ccb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1623055457", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap698c4ef8-28", "ovs_interfaceid": "698c4ef8-286a-4bc1-a789-3276dc6defea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tDvjqJkp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9df7866f-28e9-46d0-9f35-24484adfffd7', 'attached_at': '', 'detached_at': '', 'volume_id': '7416aefd-313c-4b26-b1f6-06786088d9c2', 'serial': '7416aefd-313c-4b26-b1f6-06786088d9c2'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': 'fd85c238-0938-40ae-9337-6a68436cf6ab', 'volume_type': None}, {'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FQGKODjE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9df7866f-28e9-46d0-9f35-24484adfffd7', 'attached_at': '', 'detached_at': '', 'volume_id': 'b6c6fe01-d34b-4fd1-8939-72ecd365df7b', 'serial': 'b6c6fe01-d34b-4fd1-8939-72ecd365df7b'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 1, 'delete_on_termination': False, 'attachment_id': '8cf002cd-a00c-4f06-9c36-80dc8224f6bf', 'volume_type': None}, {'guest_format': None, 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CxQZfzcS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9df7866f-28e9-46d0-9f35-24484adfffd7', 'attached_at': '', 'detached_at': '', 'volume_id': '3f88fd55-edd7-479f-9c45-ac2456b4e59d', 'serial': '3f88fd55-edd7-479f-9c45-ac2456b4e59d'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 2, 'delete_on_termination': False, 'attachment_id': 'c7850a72-e75e-40de-8fae-753a06498be8', 'volume_type': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:15:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-c35f2928-a8ae-4088-916e-14b1a48401d6 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Acquiring lock "fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:15:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-c35f2928-a8ae-4088-916e-14b1a48401d6 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Lock "fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:15:37 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:15:37 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:15:37 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:15:37 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:15:37 user nova-compute[74683]: DEBUG nova.objects.instance [None req-c35f2928-a8ae-4088-916e-14b1a48401d6 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Lazy-loading 'flavor' on Instance uuid fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:15:37 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:15:37 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:15:37 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:15:37 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:15:37 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:15:37 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:15:37 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:15:37 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:15:37 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:15:37 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:15:37 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:15:37 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:15:37 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:15:37 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:15:37 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Calling os-brick to attach iSCSI Volume {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 11:15:37 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tDvjqJkp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:15:37 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:15:37 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:15:37 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:15:37 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:15:37 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:15:37 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:15:37 user nova-compute[74683]: INFO os_brick.initiator.connectors.iscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 11:15:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 -p 172.16.0.220:3260 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:37 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e2e7cd-a1fc-4787-9df4-336d330f8386]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:37 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 11:15:37 user nova-compute[74683]:  {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:15:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-c35f2928-a8ae-4088-916e-14b1a48401d6 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Lock "fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.100s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:15:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:37 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee0d748-d4ac-4998-b0a4-9bed652f9453]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2] added\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:37 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2] added
Oct 16 11:15:37 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:15:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:37 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[217d53c5-d2fc-4fd6-a3fe-1eb64ea9cf78]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:37 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:15:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:37 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b16bc0-c539-47cd-9e0e-30dffd695818]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:37 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:15:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tDvjqJkp {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tDvjqJkp" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f42e5b-5139-4cdb-823e-adc51d55bda7]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tDvjqJkp'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:15:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[0571a8d6-b8ae-4bed-8c55-6e16ee8dc224]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:15:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[6617af70-01d3-4461-ac97-22e2002cd549]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb38837-f564-4468-b956-3e774068d208 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb38837-f564-4468-b956-3e774068d208 (non-flash)
Oct 16 11:15:38 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:15:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb38837-f564-4468-b956-3e774068d208 (non-flash)
Oct 16 11:15:38 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:15:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 -p 172.16.0.220:3260 --login {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[abbb3f97-5b0e-4836-a02c-1f0e6d51d174]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2, portal: 172.16.0.220,3260]
Oct 16 11:15:38 user nova-compute[74683]: Login to [iface: default, target: iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2, portal: 172.16.0.220,3260] successful.
Oct 16 11:15:38 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:15:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-c35f2928-a8ae-4088-916e-14b1a48401d6 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Acquiring lock "fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:15:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-c35f2928-a8ae-4088-916e-14b1a48401d6 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Lock "fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:15:38 user nova-compute[74683]: INFO nova.compute.manager [None req-c35f2928-a8ae-4088-916e-14b1a48401d6 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Attaching volume 0aa00a0e-fa1e-4032-91f6-af020f1e986f to /dev/vdb
Oct 16 11:15:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.040s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d2b898-7e08-4ff9-9efc-abcb2db90ee1]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:15:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[1552c13d-2175-4077-970b-a3ba89ed8281]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb38837-f564-4468-b956-3e774068d208 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb38837-f564-4468-b956-3e774068d208 (non-flash)
Oct 16 11:15:38 user nova-compute[74683]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)
Oct 16 11:15:38 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:15:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb38837-f564-4468-b956-3e774068d208 (non-flash)
Oct 16 11:15:38 user nova-compute[74683]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)
Oct 16 11:15:38 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:15:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:15:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Connected to 172.16.0.220:3260 {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 11:15:38 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=74683) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 11:15:38 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74683) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 11:15:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[1159027c-7bc2-41f2-933e-8ae42b9c6abc]: (4, ('- - 0', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:38 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: None {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:15:38 user nova-compute[74683]: DEBUG os_brick.utils [None req-c35f2928-a8ae-4088-916e-14b1a48401d6 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:15:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee23cb31-9a3b-453b-8554-a1f19396f090]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:70b9d336ab7d\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bdf2805-641e-4e03-86e4-53f5fd5df97c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa995b8-314c-4993-8278-23872ee48c9b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6be7082-d1f0-4862-aef8-fe3e4d401b45]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-c35f2928-a8ae-4088-916e-14b1a48401d6 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Running cmd (subprocess): nvme version {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-c35f2928-a8ae-4088-916e-14b1a48401d6 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] 'nvme version' failed. Not Retrying. {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:15:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c35f2928-a8ae-4088-916e-14b1a48401d6 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] nvme not present on system {{(pid=74683) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 11:15:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:15:38 user nova-compute[74683]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 11:15:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f129ff95-9a0b-4b97-a195-2e8b1c1f7118]: (4, '') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-c35f2928-a8ae-4088-916e-14b1a48401d6 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74683) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 11:15:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-c35f2928-a8ae-4088-916e-14b1a48401d6 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 11:15:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-c35f2928-a8ae-4088-916e-14b1a48401d6 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] LIGHTOS: no hostnqn found. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 11:15:38 user nova-compute[74683]: DEBUG os_brick.utils [None req-c35f2928-a8ae-4088-916e-14b1a48401d6 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:70b9d336ab7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:15:38 user nova-compute[74683]: DEBUG nova.virt.block_device [None req-c35f2928-a8ae-4088-916e-14b1a48401d6 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Updating existing volume attachment record: 2fc207b8-a80f-4b90-878d-e7fbbd55c19d {{(pid=74683) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 11:15:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1b9145e1-577e-4aec-a236-83d58da7dc40 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Acquiring lock "427b793c-ae47-451c-bbc5-589d6ce1d2bf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:15:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1b9145e1-577e-4aec-a236-83d58da7dc40 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Lock "427b793c-ae47-451c-bbc5-589d6ce1d2bf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:15:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1b9145e1-577e-4aec-a236-83d58da7dc40 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Acquiring lock "427b793c-ae47-451c-bbc5-589d6ce1d2bf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:15:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1b9145e1-577e-4aec-a236-83d58da7dc40 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Lock "427b793c-ae47-451c-bbc5-589d6ce1d2bf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:15:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1b9145e1-577e-4aec-a236-83d58da7dc40 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Lock "427b793c-ae47-451c-bbc5-589d6ce1d2bf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:15:38 user nova-compute[74683]: INFO nova.compute.manager [None req-1b9145e1-577e-4aec-a236-83d58da7dc40 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Terminating instance
Oct 16 11:15:38 user nova-compute[74683]: DEBUG nova.compute.manager [None req-1b9145e1-577e-4aec-a236-83d58da7dc40 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Start destroying the instance on the hypervisor. {{(pid=74683) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 11:15:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG nova.compute.manager [req-50eea198-c8dc-4b44-b48f-e86f30bae03b req-d9afe5f1-e4e7-48cc-8f62-a0eb220de107 service nova] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Received event network-vif-unplugged-d46f88ce-60a8-4ce5-989a-6d7b9eb90d28 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-50eea198-c8dc-4b44-b48f-e86f30bae03b req-d9afe5f1-e4e7-48cc-8f62-a0eb220de107 service nova] Acquiring lock "427b793c-ae47-451c-bbc5-589d6ce1d2bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-50eea198-c8dc-4b44-b48f-e86f30bae03b req-d9afe5f1-e4e7-48cc-8f62-a0eb220de107 service nova] Lock "427b793c-ae47-451c-bbc5-589d6ce1d2bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-50eea198-c8dc-4b44-b48f-e86f30bae03b req-d9afe5f1-e4e7-48cc-8f62-a0eb220de107 service nova] Lock "427b793c-ae47-451c-bbc5-589d6ce1d2bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG nova.compute.manager [req-50eea198-c8dc-4b44-b48f-e86f30bae03b req-d9afe5f1-e4e7-48cc-8f62-a0eb220de107 service nova] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] No waiting events found dispatching network-vif-unplugged-d46f88ce-60a8-4ce5-989a-6d7b9eb90d28 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG nova.compute.manager [req-50eea198-c8dc-4b44-b48f-e86f30bae03b req-d9afe5f1-e4e7-48cc-8f62-a0eb220de107 service nova] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Received event network-vif-unplugged-d46f88ce-60a8-4ce5-989a-6d7b9eb90d28 for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tDvjqJkp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23262373039656133', 'path': '/dev/sdc'} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23262373039656133', 'path': '/dev/sdc'} {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Calling os-brick to attach iSCSI Volume {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FQGKODjE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:15:39 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:15:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:15:39 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:15:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:15:39 user nova-compute[74683]: INFO os_brick.initiator.connectors.iscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 11:15:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b -p 172.16.0.220:3260 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9d7265-d6d0-4308-a882-87fee8e099a0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 11:15:39 user nova-compute[74683]:  {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b -p 172.16.0.220:3260 --interface default --op new {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce04b20-2873-4c65-b353-885544dfa80b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b] added\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b] added
Oct 16 11:15:39 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[81662038-768b-4766-b0a0-e48ec440f017]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb34a514-97d5-4714-b9b0-215e97bd3f41]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FQGKODjE {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FQGKODjE" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06da1f7-3e8e-47b1-826f-ec15472156b3]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FQGKODjE'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef0b6ce-819e-4e23-8942-3f7060572327]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e595bd9-91a6-4a58-a81c-d9f762d36fa2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb38837-f564-4468-b956-3e774068d208 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb38837-f564-4468-b956-3e774068d208 (non-flash)
Oct 16 11:15:39 user nova-compute[74683]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)
Oct 16 11:15:39 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb38837-f564-4468-b956-3e774068d208 (non-flash)
Oct 16 11:15:39 user nova-compute[74683]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)
Oct 16 11:15:39 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b -p 172.16.0.220:3260 --login {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2fc56a-58da-4c1b-a809-1dfeec059fac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b, portal: 172.16.0.220,3260]
Oct 16 11:15:39 user nova-compute[74683]: Login to [iface: default, target: iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b, portal: 172.16.0.220,3260] successful.
Oct 16 11:15:39 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1b6136-cd2b-47cb-9e67-35ff735f9d67]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d39ca0-6fd1-42e0-995e-b9459d000490]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb38837-f564-4468-b956-3e774068d208 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb38837-f564-4468-b956-3e774068d208 (non-flash)
Oct 16 11:15:39 user nova-compute[74683]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)
Oct 16 11:15:39 user nova-compute[74683]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)
Oct 16 11:15:39 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb38837-f564-4468-b956-3e774068d208 (non-flash)
Oct 16 11:15:39 user nova-compute[74683]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)
Oct 16 11:15:39 user nova-compute[74683]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)
Oct 16 11:15:39 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Connected to 172.16.0.220:3260 {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=74683) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74683) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[8560006d-111d-418e-ba2c-76dcb0ed3a5d]: (4, ('- - 0', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FQGKODjE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:39 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Instance destroyed successfully.
Oct 16 11:15:39 user nova-compute[74683]: DEBUG nova.objects.instance [None req-1b9145e1-577e-4aec-a236-83d58da7dc40 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Lazy-loading 'resources' on Instance uuid 427b793c-ae47-451c-bbc5-589d6ce1d2bf {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-1b9145e1-577e-4aec-a236-83d58da7dc40 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:13:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-943938581',display_name='tempest-DeleteServersTestJSON-server-943938581',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-943938581',id=1,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:13:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f99f352b52b94e32808b154ede6c1eac',ramdisk_id='',reservation_id='r-ewr0m06v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-2005547870',owner_user_name='tempest-DeleteServersTestJSON-2005547870-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:13:19Z,user_data=None,user_id='4fbd806ac68b4b76982426e5f68452a3',uuid=427b793c-ae47-451c-bbc5-589d6ce1d2bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d46f88ce-60a8-4ce5-989a-6d7b9eb90d28", "address": "fa:16:3e:a1:28:21", "network": {"id": "f5b8ede2-9ce3-4748-b782-dd18a611cc53", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2023834343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f99f352b52b94e32808b154ede6c1eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd46f88ce-60", "ovs_interfaceid": "d46f88ce-60a8-4ce5-989a-6d7b9eb90d28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-1b9145e1-577e-4aec-a236-83d58da7dc40 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Converting VIF {"id": "d46f88ce-60a8-4ce5-989a-6d7b9eb90d28", "address": "fa:16:3e:a1:28:21", "network": {"id": "f5b8ede2-9ce3-4748-b782-dd18a611cc53", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2023834343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f99f352b52b94e32808b154ede6c1eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd46f88ce-60", "ovs_interfaceid": "d46f88ce-60a8-4ce5-989a-6d7b9eb90d28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-1b9145e1-577e-4aec-a236-83d58da7dc40 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:28:21,bridge_name='br-int',has_traffic_filtering=True,id=d46f88ce-60a8-4ce5-989a-6d7b9eb90d28,network=Network(f5b8ede2-9ce3-4748-b782-dd18a611cc53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd46f88ce-60') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG os_vif [None req-1b9145e1-577e-4aec-a236-83d58da7dc40 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:28:21,bridge_name='br-int',has_traffic_filtering=True,id=d46f88ce-60a8-4ce5-989a-6d7b9eb90d28,network=Network(f5b8ede2-9ce3-4748-b782-dd18a611cc53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd46f88ce-60') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd46f88ce-60, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=80f52798-75b3-4f0e-8d1b-36751e5aa703) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:15:39 user nova-compute[74683]: INFO os_vif [None req-1b9145e1-577e-4aec-a236-83d58da7dc40 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:28:21,bridge_name='br-int',has_traffic_filtering=True,id=d46f88ce-60a8-4ce5-989a-6d7b9eb90d28,network=Network(f5b8ede2-9ce3-4748-b782-dd18a611cc53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd46f88ce-60')
Oct 16 11:15:39 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b9145e1-577e-4aec-a236-83d58da7dc40 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] calling os-brick to detach iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9145e1-577e-4aec-a236-83d58da7dc40 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, {'target_iqn': 'iqn.2010-10.org.openstack:afb38837-f564-4468-b956-3e774068d208', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GKUpajVY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:15:39 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-1b9145e1-577e-4aec-a236-83d58da7dc40 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:15:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-1b9145e1-577e-4aec-a236-83d58da7dc40 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:15:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:40 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:40 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:40 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:40 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:40 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:40 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:15:40 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '23233643738383539', 'path': '/dev/sdd'} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:15:40 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23233643738383539', 'path': '/dev/sdd'} {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 11:15:40 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-1b9145e1-577e-4aec-a236-83d58da7dc40 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.872s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:15:40 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:40 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Calling os-brick to attach iSCSI Volume {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 11:15:40 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CxQZfzcS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:15:40 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:15:40 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:15:40 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:40 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a698965-fabf-447f-8a87-bd95a4df321c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:afb38837-f564-4468-b956-3e774068d208\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:40 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9145e1-577e-4aec-a236-83d58da7dc40 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 11:15:40 user nova-compute[74683]: No targets found.
Oct 16 11:15:40 user nova-compute[74683]: iSNS:
Oct 16 11:15:40 user nova-compute[74683]: No targets found.
Oct 16 11:15:40 user nova-compute[74683]: STATIC:
Oct 16 11:15:40 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2
Oct 16 11:15:40 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:15:40 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:15:40 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:afb38837-f564-4468-b956-3e774068d208
Oct 16 11:15:40 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:15:40 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:15:40 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b
Oct 16 11:15:40 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:15:40 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:15:40 user nova-compute[74683]: FIRMWARE:
Oct 16 11:15:40 user nova-compute[74683]: No targets found.
Oct 16 11:15:40 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:15:40 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9145e1-577e-4aec-a236-83d58da7dc40 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 11:15:40 user nova-compute[74683]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 11:15:40 user nova-compute[74683]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74683) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 11:15:40 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9145e1-577e-4aec-a236-83d58da7dc40 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afb38837-f564-4468-b956-3e774068d208', 0)] {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 11:15:40 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:40 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:40 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a813d8-c201-4b9e-8fa3-0490e8129ee7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afb38837-f564-4468-b956-3e774068d208\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:40 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:40 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:40 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b155191-add2-46e6-bd0c-c00d3258abfb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb38837-f564-4468-b956-3e774068d208 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:40 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9145e1-577e-4aec-a236-83d58da7dc40 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb38837-f564-4468-b956-3e774068d208 (non-flash)
Oct 16 11:15:40 user nova-compute[74683]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)
Oct 16 11:15:40 user nova-compute[74683]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)
Oct 16 11:15:40 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:15:40 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9145e1-577e-4aec-a236-83d58da7dc40 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb38837-f564-4468-b956-3e774068d208 (non-flash)
Oct 16 11:15:40 user nova-compute[74683]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)
Oct 16 11:15:40 user nova-compute[74683]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)
Oct 16 11:15:40 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:15:40 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9145e1-577e-4aec-a236-83d58da7dc40 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda6c183eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afb38837-f564-4468-b956-3e774068d208'): ({'sdb'}, set())}) {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 11:15:40 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-1b9145e1-577e-4aec-a236-83d58da7dc40 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Removing single pathed devices sdb {{(pid=74683) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 11:15:40 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:40 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:40 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[316b99af-0870-4e67-b7e9-3c90d41fd2fd]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:40 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:40 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:40 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace7f2d4-b2f7-4cfd-98ca-aaf66390413e]: (4, ('ok\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:40 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-1b9145e1-577e-4aec-a236-83d58da7dc40 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Flushing IO for device /dev/sdb {{(pid=74683) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 11:15:40 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:40 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:40 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:40 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[c474f8b9-ab2d-4181-8e15-48f76c5faebe]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:40 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-1b9145e1-577e-4aec-a236-83d58da7dc40 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74683) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 11:15:40 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:40 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:40 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[19bab2ea-b4af-4377-bc06-65056a198833]: (4, ('1', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:40 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-1b9145e1-577e-4aec-a236-83d58da7dc40 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 11:15:40 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-1b9145e1-577e-4aec-a236-83d58da7dc40 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] SCSI volumes sdb have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 11:15:40 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9145e1-577e-4aec-a236-83d58da7dc40 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afb38837-f564-4468-b956-3e774068d208')] {{(pid=74683) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 11:15:40 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afb38837-f564-4468-b956-3e774068d208 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:40 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afb38837-f564-4468-b956-3e774068d208 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:40 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d951bd-edfe-4d9d-9b4c-a6aa05cd62cb]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:40 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9145e1-577e-4aec-a236-83d58da7dc40 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:15:40 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afb38837-f564-4468-b956-3e774068d208 -p 172.16.0.220:3260 --logout {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:40 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afb38837-f564-4468-b956-3e774068d208 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:40 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[6caabbe5-0931-4aff-b3ff-2c27d3d54720]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:afb38837-f564-4468-b956-3e774068d208, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:afb38837-f564-4468-b956-3e774068d208, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:40 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9145e1-577e-4aec-a236-83d58da7dc40 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:afb38837-f564-4468-b956-3e774068d208, portal: 172.16.0.220,3260]
Oct 16 11:15:40 user nova-compute[74683]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:afb38837-f564-4468-b956-3e774068d208, portal: 172.16.0.220,3260] successful.
Oct 16 11:15:40 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:15:40 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afb38837-f564-4468-b956-3e774068d208 -p 172.16.0.220:3260 --op delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afb38837-f564-4468-b956-3e774068d208 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.187s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3eabfe5-4acc-4c09-9e75-c3667273a913]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9145e1-577e-4aec-a236-83d58da7dc40 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-1b9145e1-577e-4aec-a236-83d58da7dc40 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.514s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9145e1-577e-4aec-a236-83d58da7dc40 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] <== disconnect_volume: return (1386ms) None {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b9145e1-577e-4aec-a236-83d58da7dc40 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Disconnected iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 11:15:41 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-1b9145e1-577e-4aec-a236-83d58da7dc40 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Deleting instance files /opt/stack/data/nova/instances/427b793c-ae47-451c-bbc5-589d6ce1d2bf_del
Oct 16 11:15:41 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-1b9145e1-577e-4aec-a236-83d58da7dc40 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Deletion of /opt/stack/data/nova/instances/427b793c-ae47-451c-bbc5-589d6ce1d2bf_del complete
Oct 16 11:15:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.495s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:15:41 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:15:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:15:41 user nova-compute[74683]: INFO os_brick.initiator.connectors.iscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 11:15:41 user nova-compute[74683]: DEBUG nova.compute.manager [req-fa54715d-ef6e-4123-9b7d-f8db806b9f56 req-e64690f9-676b-46b0-b743-59a3f5cb6027 service nova] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Received event network-vif-plugged-d46f88ce-60a8-4ce5-989a-6d7b9eb90d28 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-fa54715d-ef6e-4123-9b7d-f8db806b9f56 req-e64690f9-676b-46b0-b743-59a3f5cb6027 service nova] Acquiring lock "427b793c-ae47-451c-bbc5-589d6ce1d2bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-fa54715d-ef6e-4123-9b7d-f8db806b9f56 req-e64690f9-676b-46b0-b743-59a3f5cb6027 service nova] Lock "427b793c-ae47-451c-bbc5-589d6ce1d2bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-fa54715d-ef6e-4123-9b7d-f8db806b9f56 req-e64690f9-676b-46b0-b743-59a3f5cb6027 service nova] Lock "427b793c-ae47-451c-bbc5-589d6ce1d2bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG nova.compute.manager [req-fa54715d-ef6e-4123-9b7d-f8db806b9f56 req-e64690f9-676b-46b0-b743-59a3f5cb6027 service nova] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] No waiting events found dispatching network-vif-plugged-d46f88ce-60a8-4ce5-989a-6d7b9eb90d28 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:15:41 user nova-compute[74683]: WARNING nova.compute.manager [req-fa54715d-ef6e-4123-9b7d-f8db806b9f56 req-e64690f9-676b-46b0-b743-59a3f5cb6027 service nova] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Received unexpected event network-vif-plugged-d46f88ce-60a8-4ce5-989a-6d7b9eb90d28 for instance with vm_state active and task_state deleting.
Oct 16 11:15:41 user nova-compute[74683]: DEBUG nova.compute.manager [req-fa54715d-ef6e-4123-9b7d-f8db806b9f56 req-e64690f9-676b-46b0-b743-59a3f5cb6027 service nova] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Received event network-vif-plugged-d46f88ce-60a8-4ce5-989a-6d7b9eb90d28 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-fa54715d-ef6e-4123-9b7d-f8db806b9f56 req-e64690f9-676b-46b0-b743-59a3f5cb6027 service nova] Acquiring lock "427b793c-ae47-451c-bbc5-589d6ce1d2bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-fa54715d-ef6e-4123-9b7d-f8db806b9f56 req-e64690f9-676b-46b0-b743-59a3f5cb6027 service nova] Lock "427b793c-ae47-451c-bbc5-589d6ce1d2bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-fa54715d-ef6e-4123-9b7d-f8db806b9f56 req-e64690f9-676b-46b0-b743-59a3f5cb6027 service nova] Lock "427b793c-ae47-451c-bbc5-589d6ce1d2bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG nova.compute.manager [req-fa54715d-ef6e-4123-9b7d-f8db806b9f56 req-e64690f9-676b-46b0-b743-59a3f5cb6027 service nova] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] No waiting events found dispatching network-vif-plugged-d46f88ce-60a8-4ce5-989a-6d7b9eb90d28 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:15:41 user nova-compute[74683]: WARNING nova.compute.manager [req-fa54715d-ef6e-4123-9b7d-f8db806b9f56 req-e64690f9-676b-46b0-b743-59a3f5cb6027 service nova] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Received unexpected event network-vif-plugged-d46f88ce-60a8-4ce5-989a-6d7b9eb90d28 for instance with vm_state active and task_state deleting.
Oct 16 11:15:41 user nova-compute[74683]: DEBUG nova.compute.manager [req-fa54715d-ef6e-4123-9b7d-f8db806b9f56 req-e64690f9-676b-46b0-b743-59a3f5cb6027 service nova] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Received event network-vif-plugged-d46f88ce-60a8-4ce5-989a-6d7b9eb90d28 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-fa54715d-ef6e-4123-9b7d-f8db806b9f56 req-e64690f9-676b-46b0-b743-59a3f5cb6027 service nova] Acquiring lock "427b793c-ae47-451c-bbc5-589d6ce1d2bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-fa54715d-ef6e-4123-9b7d-f8db806b9f56 req-e64690f9-676b-46b0-b743-59a3f5cb6027 service nova] Lock "427b793c-ae47-451c-bbc5-589d6ce1d2bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-fa54715d-ef6e-4123-9b7d-f8db806b9f56 req-e64690f9-676b-46b0-b743-59a3f5cb6027 service nova] Lock "427b793c-ae47-451c-bbc5-589d6ce1d2bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG nova.compute.manager [req-fa54715d-ef6e-4123-9b7d-f8db806b9f56 req-e64690f9-676b-46b0-b743-59a3f5cb6027 service nova] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] No waiting events found dispatching network-vif-plugged-d46f88ce-60a8-4ce5-989a-6d7b9eb90d28 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:15:41 user nova-compute[74683]: WARNING nova.compute.manager [req-fa54715d-ef6e-4123-9b7d-f8db806b9f56 req-e64690f9-676b-46b0-b743-59a3f5cb6027 service nova] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Received unexpected event network-vif-plugged-d46f88ce-60a8-4ce5-989a-6d7b9eb90d28 for instance with vm_state active and task_state deleting.
Oct 16 11:15:41 user nova-compute[74683]: DEBUG nova.compute.manager [req-fa54715d-ef6e-4123-9b7d-f8db806b9f56 req-e64690f9-676b-46b0-b743-59a3f5cb6027 service nova] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Received event network-vif-unplugged-d46f88ce-60a8-4ce5-989a-6d7b9eb90d28 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-fa54715d-ef6e-4123-9b7d-f8db806b9f56 req-e64690f9-676b-46b0-b743-59a3f5cb6027 service nova] Acquiring lock "427b793c-ae47-451c-bbc5-589d6ce1d2bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-fa54715d-ef6e-4123-9b7d-f8db806b9f56 req-e64690f9-676b-46b0-b743-59a3f5cb6027 service nova] Lock "427b793c-ae47-451c-bbc5-589d6ce1d2bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-fa54715d-ef6e-4123-9b7d-f8db806b9f56 req-e64690f9-676b-46b0-b743-59a3f5cb6027 service nova] Lock "427b793c-ae47-451c-bbc5-589d6ce1d2bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG nova.compute.manager [req-fa54715d-ef6e-4123-9b7d-f8db806b9f56 req-e64690f9-676b-46b0-b743-59a3f5cb6027 service nova] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] No waiting events found dispatching network-vif-unplugged-d46f88ce-60a8-4ce5-989a-6d7b9eb90d28 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG nova.compute.manager [req-fa54715d-ef6e-4123-9b7d-f8db806b9f56 req-e64690f9-676b-46b0-b743-59a3f5cb6027 service nova] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Received event network-vif-unplugged-d46f88ce-60a8-4ce5-989a-6d7b9eb90d28 for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG nova.compute.manager [req-fa54715d-ef6e-4123-9b7d-f8db806b9f56 req-e64690f9-676b-46b0-b743-59a3f5cb6027 service nova] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Received event network-vif-plugged-d46f88ce-60a8-4ce5-989a-6d7b9eb90d28 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-fa54715d-ef6e-4123-9b7d-f8db806b9f56 req-e64690f9-676b-46b0-b743-59a3f5cb6027 service nova] Acquiring lock "427b793c-ae47-451c-bbc5-589d6ce1d2bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-fa54715d-ef6e-4123-9b7d-f8db806b9f56 req-e64690f9-676b-46b0-b743-59a3f5cb6027 service nova] Lock "427b793c-ae47-451c-bbc5-589d6ce1d2bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-fa54715d-ef6e-4123-9b7d-f8db806b9f56 req-e64690f9-676b-46b0-b743-59a3f5cb6027 service nova] Lock "427b793c-ae47-451c-bbc5-589d6ce1d2bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG nova.compute.manager [req-fa54715d-ef6e-4123-9b7d-f8db806b9f56 req-e64690f9-676b-46b0-b743-59a3f5cb6027 service nova] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] No waiting events found dispatching network-vif-plugged-d46f88ce-60a8-4ce5-989a-6d7b9eb90d28 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:15:41 user nova-compute[74683]: WARNING nova.compute.manager [req-fa54715d-ef6e-4123-9b7d-f8db806b9f56 req-e64690f9-676b-46b0-b743-59a3f5cb6027 service nova] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Received unexpected event network-vif-plugged-d46f88ce-60a8-4ce5-989a-6d7b9eb90d28 for instance with vm_state active and task_state deleting.
Oct 16 11:15:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d -p 172.16.0.220:3260 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[8096ed83-e828-482d-8ffc-63bca40532eb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 11:15:41 user nova-compute[74683]:  {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d -p 172.16.0.220:3260 --interface default --op new {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea8588c-02f5-4c9c-98bb-13dfe3e8f352]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d] added\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d] added
Oct 16 11:15:41 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[742c9da7-e026-472c-bad8-45717f5dd6b9]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:41 user nova-compute[74683]: INFO nova.compute.manager [None req-1b9145e1-577e-4aec-a236-83d58da7dc40 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Took 2.41 seconds to destroy the instance on the hypervisor.
Oct 16 11:15:41 user nova-compute[74683]: DEBUG oslo.service.loopingcall [None req-1b9145e1-577e-4aec-a236-83d58da7dc40 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74683) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG nova.compute.manager [-] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Deallocating network for instance {{(pid=74683) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] deallocate_for_instance() {{(pid=74683) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[878c1cf6-f27b-4972-acf7-36afb840a3b2]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CxQZfzcS {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CxQZfzcS" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6db577-c1c6-4fac-b705-bb28fa55377d]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CxQZfzcS'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01504d4-a167-4f4c-b9ac-fe2b3d1f3663]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a83fffc-6a63-49c0-a58a-93f0cfb93e01]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)
Oct 16 11:15:41 user nova-compute[74683]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)
Oct 16 11:15:41 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)
Oct 16 11:15:41 user nova-compute[74683]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)
Oct 16 11:15:41 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d -p 172.16.0.220:3260 --login {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e7164b-5e79-42f7-a546-707f99049e1f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d, portal: 172.16.0.220,3260]
Oct 16 11:15:41 user nova-compute[74683]: Login to [iface: default, target: iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d, portal: 172.16.0.220,3260] successful.
Oct 16 11:15:41 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2fe3f7-ab9d-40db-b169-03f8292d8cc0]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56c8ade-8023-4331-bc4c-19545444a5f1]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)
Oct 16 11:15:41 user nova-compute[74683]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)
Oct 16 11:15:41 user nova-compute[74683]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)
Oct 16 11:15:41 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)
Oct 16 11:15:41 user nova-compute[74683]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)
Oct 16 11:15:41 user nova-compute[74683]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)
Oct 16 11:15:41 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Connected to 172.16.0.220:3260 {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] HCTL ('33', '-', '-', 0) found on session 5 with lun 0 {{(pid=74683) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74683) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[da68b886-f3fe-4a3b-831f-99121088b093]: (4, ('- - 0', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Searching for a device in session 5 and hctl ['33', '*', '*', 0] yield: None {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:15:41 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:15:41 user nova-compute[74683]: INFO nova.compute.manager [-] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Took 0.65 seconds to deallocate network for instance.
Oct 16 11:15:41 user nova-compute[74683]: DEBUG nova.compute.manager [req-3b4a35dc-3822-4b59-a4b5-d859bffd8c99 req-9f7d338c-a13d-4f53-8f16-f50ba6eb8957 service nova] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Received event network-vif-deleted-d46f88ce-60a8-4ce5-989a-6d7b9eb90d28 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Searching for a device in session 5 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CxQZfzcS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] <== connect_volume: return (1865ms) {'type': 'block', 'scsi_wwn': '23462323638366664', 'path': '/dev/sdb'} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23462323638366664', 'path': '/dev/sdb'} {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T11:14:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-70304386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-70304386',id=9,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMaNfqPfIvkH/+eTEOkzkwyEVHeMqBbroH4XHs/VsM+32arQrPWLULM+KkAha5uKcIYXUQvzuK/i2uKi7/k+3+r15xjXIht8P92ImSNq2UpDCIQUhnRpXUQIyECbXNOdkg==',key_name='tempest-keypair-1984050809',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f4876261cd344bf91c3263bf1a20ae9',ramdisk_id='',reservation_id='r-im2wrlm4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-652208384',owner_user_name='tempest-TaggedBootDevicesTest-652208384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:14:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5ad8d732f364377bca4aac914efec8f',uuid=9df7866f-28e9-46d0-9f35-24484adfffd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1509ff6e-10c0-4f96-95ae-660dfc1402cc", "address": "fa:16:3e:7e:c7:90", "network": {"id": "6e171460-714f-45db-a77d-ba03b50b892e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-531792258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1509ff6e-10", "ovs_interfaceid": "1509ff6e-10c0-4f96-95ae-660dfc1402cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Converting VIF {"id": "1509ff6e-10c0-4f96-95ae-660dfc1402cc", "address": "fa:16:3e:7e:c7:90", "network": {"id": "6e171460-714f-45db-a77d-ba03b50b892e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-531792258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1509ff6e-10", "ovs_interfaceid": "1509ff6e-10c0-4f96-95ae-660dfc1402cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:c7:90,bridge_name='br-int',has_traffic_filtering=True,id=1509ff6e-10c0-4f96-95ae-660dfc1402cc,network=Network(6e171460-714f-45db-a77d-ba03b50b892e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1509ff6e-10') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T11:14:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-70304386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-70304386',id=9,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMaNfqPfIvkH/+eTEOkzkwyEVHeMqBbroH4XHs/VsM+32arQrPWLULM+KkAha5uKcIYXUQvzuK/i2uKi7/k+3+r15xjXIht8P92ImSNq2UpDCIQUhnRpXUQIyECbXNOdkg==',key_name='tempest-keypair-1984050809',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f4876261cd344bf91c3263bf1a20ae9',ramdisk_id='',reservation_id='r-im2wrlm4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-652208384',owner_user_name='tempest-TaggedBootDevicesTest-652208384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:14:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5ad8d732f364377bca4aac914efec8f',uuid=9df7866f-28e9-46d0-9f35-24484adfffd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7cfcd210-0e45-4f0e-b04b-1e933ec87734", "address": "fa:16:3e:d6:13:bf", "network": {"id": "0ab5f993-73f7-4963-9a4a-768145c101ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1056805143", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cfcd210-0e", "ovs_interfaceid": "7cfcd210-0e45-4f0e-b04b-1e933ec87734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Converting VIF {"id": "7cfcd210-0e45-4f0e-b04b-1e933ec87734", "address": "fa:16:3e:d6:13:bf", "network": {"id": "0ab5f993-73f7-4963-9a4a-768145c101ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1056805143", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cfcd210-0e", "ovs_interfaceid": "7cfcd210-0e45-4f0e-b04b-1e933ec87734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:13:bf,bridge_name='br-int',has_traffic_filtering=True,id=7cfcd210-0e45-4f0e-b04b-1e933ec87734,network=Network(0ab5f993-73f7-4963-9a4a-768145c101ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7cfcd210-0e') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T11:14:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-70304386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-70304386',id=9,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMaNfqPfIvkH/+eTEOkzkwyEVHeMqBbroH4XHs/VsM+32arQrPWLULM+KkAha5uKcIYXUQvzuK/i2uKi7/k+3+r15xjXIht8P92ImSNq2UpDCIQUhnRpXUQIyECbXNOdkg==',key_name='tempest-keypair-1984050809',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f4876261cd344bf91c3263bf1a20ae9',ramdisk_id='',reservation_id='r-im2wrlm4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-652208384',owner_user_name='tempest-TaggedBootDevicesTest-652208384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:14:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5ad8d732f364377bca4aac914efec8f',uuid=9df7866f-28e9-46d0-9f35-24484adfffd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bfe231c8-ff2a-46fd-9af6-9982a54d7846", "address": "fa:16:3e:52:f5:40", "network": {"id": "0ab5f993-73f7-4963-9a4a-768145c101ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1056805143", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe231c8-ff", "ovs_interfaceid": "bfe231c8-ff2a-46fd-9af6-9982a54d7846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Converting VIF {"id": "bfe231c8-ff2a-46fd-9af6-9982a54d7846", "address": "fa:16:3e:52:f5:40", "network": {"id": "0ab5f993-73f7-4963-9a4a-768145c101ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1056805143", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe231c8-ff", "ovs_interfaceid": "bfe231c8-ff2a-46fd-9af6-9982a54d7846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:f5:40,bridge_name='br-int',has_traffic_filtering=True,id=bfe231c8-ff2a-46fd-9af6-9982a54d7846,network=Network(0ab5f993-73f7-4963-9a4a-768145c101ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbfe231c8-ff') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T11:14:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-70304386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-70304386',id=9,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMaNfqPfIvkH/+eTEOkzkwyEVHeMqBbroH4XHs/VsM+32arQrPWLULM+KkAha5uKcIYXUQvzuK/i2uKi7/k+3+r15xjXIht8P92ImSNq2UpDCIQUhnRpXUQIyECbXNOdkg==',key_name='tempest-keypair-1984050809',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f4876261cd344bf91c3263bf1a20ae9',ramdisk_id='',reservation_id='r-im2wrlm4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-652208384',owner_user_name='tempest-TaggedBootDevicesTest-652208384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:14:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5ad8d732f364377bca4aac914efec8f',uuid=9df7866f-28e9-46d0-9f35-24484adfffd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c0a030c-cf2d-4d14-b5c3-6d0563b346b9", "address": "fa:16:3e:b2:3c:35", "network": {"id": "0ab5f993-73f7-4963-9a4a-768145c101ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1056805143", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c0a030c-cf", "ovs_interfaceid": "8c0a030c-cf2d-4d14-b5c3-6d0563b346b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Converting VIF {"id": "8c0a030c-cf2d-4d14-b5c3-6d0563b346b9", "address": "fa:16:3e:b2:3c:35", "network": {"id": "0ab5f993-73f7-4963-9a4a-768145c101ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1056805143", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c0a030c-cf", "ovs_interfaceid": "8c0a030c-cf2d-4d14-b5c3-6d0563b346b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:3c:35,bridge_name='br-int',has_traffic_filtering=True,id=8c0a030c-cf2d-4d14-b5c3-6d0563b346b9,network=Network(0ab5f993-73f7-4963-9a4a-768145c101ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c0a030c-cf') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T11:14:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-70304386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-70304386',id=9,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMaNfqPfIvkH/+eTEOkzkwyEVHeMqBbroH4XHs/VsM+32arQrPWLULM+KkAha5uKcIYXUQvzuK/i2uKi7/k+3+r15xjXIht8P92ImSNq2UpDCIQUhnRpXUQIyECbXNOdkg==',key_name='tempest-keypair-1984050809',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f4876261cd344bf91c3263bf1a20ae9',ramdisk_id='',reservation_id='r-im2wrlm4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-652208384',owner_user_name='tempest-TaggedBootDevicesTest-652208384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:14:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5ad8d732f364377bca4aac914efec8f',uuid=9df7866f-28e9-46d0-9f35-24484adfffd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82f47635-6e3f-492d-9819-4d77ae46fb29", "address": "fa:16:3e:24:20:65", "network": {"id": "0ab5f993-73f7-4963-9a4a-768145c101ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1056805143", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82f47635-6e", "ovs_interfaceid": "82f47635-6e3f-492d-9819-4d77ae46fb29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Converting VIF {"id": "82f47635-6e3f-492d-9819-4d77ae46fb29", "address": "fa:16:3e:24:20:65", "network": {"id": "0ab5f993-73f7-4963-9a4a-768145c101ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1056805143", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82f47635-6e", "ovs_interfaceid": "82f47635-6e3f-492d-9819-4d77ae46fb29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:20:65,bridge_name='br-int',has_traffic_filtering=True,id=82f47635-6e3f-492d-9819-4d77ae46fb29,network=Network(0ab5f993-73f7-4963-9a4a-768145c101ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82f47635-6e') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T11:14:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-70304386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-70304386',id=9,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMaNfqPfIvkH/+eTEOkzkwyEVHeMqBbroH4XHs/VsM+32arQrPWLULM+KkAha5uKcIYXUQvzuK/i2uKi7/k+3+r15xjXIht8P92ImSNq2UpDCIQUhnRpXUQIyECbXNOdkg==',key_name='tempest-keypair-1984050809',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f4876261cd344bf91c3263bf1a20ae9',ramdisk_id='',reservation_id='r-im2wrlm4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-652208384',owner_user_name='tempest-TaggedBootDevicesTest-652208384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:14:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5ad8d732f364377bca4aac914efec8f',uuid=9df7866f-28e9-46d0-9f35-24484adfffd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a9e59f4-7708-438f-8411-499c6e38ec1b", "address": "fa:16:3e:42:50:56", "network": {"id": "e2c37b04-3414-40bf-a284-f1f9123d0ccb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1623055457", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a9e59f4-77", "ovs_interfaceid": "8a9e59f4-7708-438f-8411-499c6e38ec1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Converting VIF {"id": "8a9e59f4-7708-438f-8411-499c6e38ec1b", "address": "fa:16:3e:42:50:56", "network": {"id": "e2c37b04-3414-40bf-a284-f1f9123d0ccb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1623055457", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a9e59f4-77", "ovs_interfaceid": "8a9e59f4-7708-438f-8411-499c6e38ec1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:50:56,bridge_name='br-int',has_traffic_filtering=True,id=8a9e59f4-7708-438f-8411-499c6e38ec1b,network=Network(e2c37b04-3414-40bf-a284-f1f9123d0ccb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a9e59f4-77') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T11:14:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-70304386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-70304386',id=9,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMaNfqPfIvkH/+eTEOkzkwyEVHeMqBbroH4XHs/VsM+32arQrPWLULM+KkAha5uKcIYXUQvzuK/i2uKi7/k+3+r15xjXIht8P92ImSNq2UpDCIQUhnRpXUQIyECbXNOdkg==',key_name='tempest-keypair-1984050809',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f4876261cd344bf91c3263bf1a20ae9',ramdisk_id='',reservation_id='r-im2wrlm4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-652208384',owner_user_name='tempest-TaggedBootDevicesTest-652208384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:14:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5ad8d732f364377bca4aac914efec8f',uuid=9df7866f-28e9-46d0-9f35-24484adfffd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "698c4ef8-286a-4bc1-a789-3276dc6defea", "address": "fa:16:3e:f8:2c:0c", "network": {"id": "e2c37b04-3414-40bf-a284-f1f9123d0ccb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1623055457", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap698c4ef8-28", "ovs_interfaceid": "698c4ef8-286a-4bc1-a789-3276dc6defea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Converting VIF {"id": "698c4ef8-286a-4bc1-a789-3276dc6defea", "address": "fa:16:3e:f8:2c:0c", "network": {"id": "e2c37b04-3414-40bf-a284-f1f9123d0ccb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1623055457", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap698c4ef8-28", "ovs_interfaceid": "698c4ef8-286a-4bc1-a789-3276dc6defea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:2c:0c,bridge_name='br-int',has_traffic_filtering=True,id=698c4ef8-286a-4bc1-a789-3276dc6defea,network=Network(e2c37b04-3414-40bf-a284-f1f9123d0ccb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap698c4ef8-28') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG nova.objects.instance [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Lazy-loading 'pci_devices' on Instance uuid 9df7866f-28e9-46d0-9f35-24484adfffd7 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:15:42 user nova-compute[74683]:   <uuid>9df7866f-28e9-46d0-9f35-24484adfffd7</uuid>
Oct 16 11:15:42 user nova-compute[74683]:   <name>instance-00000009</name>
Oct 16 11:15:42 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:15:42 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:15:42 user nova-compute[74683]:   <metadata>
Oct 16 11:15:42 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:15:42 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:15:42 user nova-compute[74683]:       <nova:name>tempest-device-tagging-server-70304386</nova:name>
Oct 16 11:15:42 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:15:37</nova:creationTime>
Oct 16 11:15:42 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:15:42 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:15:42 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:15:42 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:15:42 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:15:42 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:15:42 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:15:42 user nova-compute[74683]:       <nova:owner>
Oct 16 11:15:42 user nova-compute[74683]:         <nova:user uuid="a5ad8d732f364377bca4aac914efec8f">tempest-TaggedBootDevicesTest-652208384-project-member</nova:user>
Oct 16 11:15:42 user nova-compute[74683]:         <nova:project uuid="9f4876261cd344bf91c3263bf1a20ae9">tempest-TaggedBootDevicesTest-652208384</nova:project>
Oct 16 11:15:42 user nova-compute[74683]:       </nova:owner>
Oct 16 11:15:42 user nova-compute[74683]:       <nova:root type="image" uuid="0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f"/>
Oct 16 11:15:42 user nova-compute[74683]:       <nova:ports>
Oct 16 11:15:42 user nova-compute[74683]:         <nova:port uuid="1509ff6e-10c0-4f96-95ae-660dfc1402cc">
Oct 16 11:15:42 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 16 11:15:42 user nova-compute[74683]:         </nova:port>
Oct 16 11:15:42 user nova-compute[74683]:         <nova:port uuid="7cfcd210-0e45-4f0e-b04b-1e933ec87734">
Oct 16 11:15:42 user nova-compute[74683]:           <nova:ip type="fixed" address="10.1.1.54" ipVersion="4"/>
Oct 16 11:15:42 user nova-compute[74683]:         </nova:port>
Oct 16 11:15:42 user nova-compute[74683]:         <nova:port uuid="bfe231c8-ff2a-46fd-9af6-9982a54d7846">
Oct 16 11:15:42 user nova-compute[74683]:           <nova:ip type="fixed" address="10.1.1.248" ipVersion="4"/>
Oct 16 11:15:42 user nova-compute[74683]:         </nova:port>
Oct 16 11:15:42 user nova-compute[74683]:         <nova:port uuid="8c0a030c-cf2d-4d14-b5c3-6d0563b346b9">
Oct 16 11:15:42 user nova-compute[74683]:           <nova:ip type="fixed" address="10.1.1.87" ipVersion="4"/>
Oct 16 11:15:42 user nova-compute[74683]:         </nova:port>
Oct 16 11:15:42 user nova-compute[74683]:         <nova:port uuid="82f47635-6e3f-492d-9819-4d77ae46fb29">
Oct 16 11:15:42 user nova-compute[74683]:           <nova:ip type="fixed" address="10.1.1.146" ipVersion="4"/>
Oct 16 11:15:42 user nova-compute[74683]:         </nova:port>
Oct 16 11:15:42 user nova-compute[74683]:         <nova:port uuid="8a9e59f4-7708-438f-8411-499c6e38ec1b">
Oct 16 11:15:42 user nova-compute[74683]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Oct 16 11:15:42 user nova-compute[74683]:         </nova:port>
Oct 16 11:15:42 user nova-compute[74683]:         <nova:port uuid="698c4ef8-286a-4bc1-a789-3276dc6defea">
Oct 16 11:15:42 user nova-compute[74683]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Oct 16 11:15:42 user nova-compute[74683]:         </nova:port>
Oct 16 11:15:42 user nova-compute[74683]:       </nova:ports>
Oct 16 11:15:42 user nova-compute[74683]:     </nova:instance>
Oct 16 11:15:42 user nova-compute[74683]:   </metadata>
Oct 16 11:15:42 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:15:42 user nova-compute[74683]:     <system>
Oct 16 11:15:42 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:15:42 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:15:42 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:15:42 user nova-compute[74683]:       <entry name="serial">9df7866f-28e9-46d0-9f35-24484adfffd7</entry>
Oct 16 11:15:42 user nova-compute[74683]:       <entry name="uuid">9df7866f-28e9-46d0-9f35-24484adfffd7</entry>
Oct 16 11:15:42 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:15:42 user nova-compute[74683]:     </system>
Oct 16 11:15:42 user nova-compute[74683]:   </sysinfo>
Oct 16 11:15:42 user nova-compute[74683]:   <os>
Oct 16 11:15:42 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:15:42 user nova-compute[74683]:     <boot dev="hd"/>
Oct 16 11:15:42 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:15:42 user nova-compute[74683]:   </os>
Oct 16 11:15:42 user nova-compute[74683]:   <features>
Oct 16 11:15:42 user nova-compute[74683]:     <acpi/>
Oct 16 11:15:42 user nova-compute[74683]:     <apic/>
Oct 16 11:15:42 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:15:42 user nova-compute[74683]:   </features>
Oct 16 11:15:42 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:15:42 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:15:42 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:15:42 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:15:42 user nova-compute[74683]:   </clock>
Oct 16 11:15:42 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:15:42 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:15:42 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:15:42 user nova-compute[74683]:   </cpu>
Oct 16 11:15:42 user nova-compute[74683]:   <devices>
Oct 16 11:15:42 user nova-compute[74683]:     <disk type="file" device="cdrom">
Oct 16 11:15:42 user nova-compute[74683]:       <driver name="qemu" type="raw" cache="none"/>
Oct 16 11:15:42 user nova-compute[74683]:       <source file="/opt/stack/data/nova/instances/9df7866f-28e9-46d0-9f35-24484adfffd7/disk.config"/>
Oct 16 11:15:42 user nova-compute[74683]:       <target dev="hda" bus="ide"/>
Oct 16 11:15:42 user nova-compute[74683]:     </disk>
Oct 16 11:15:42 user nova-compute[74683]:     <disk type="block" device="disk">
Oct 16 11:15:42 user nova-compute[74683]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:15:42 user nova-compute[74683]:       <source dev="/dev/sdc"/>
Oct 16 11:15:42 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:15:42 user nova-compute[74683]:       <serial>7416aefd-313c-4b26-b1f6-06786088d9c2</serial>
Oct 16 11:15:42 user nova-compute[74683]:     </disk>
Oct 16 11:15:42 user nova-compute[74683]:     <disk type="block" device="disk">
Oct 16 11:15:42 user nova-compute[74683]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:15:42 user nova-compute[74683]:       <source dev="/dev/sdd"/>
Oct 16 11:15:42 user nova-compute[74683]:       <target dev="vdb" bus="virtio"/>
Oct 16 11:15:42 user nova-compute[74683]:       <serial>b6c6fe01-d34b-4fd1-8939-72ecd365df7b</serial>
Oct 16 11:15:42 user nova-compute[74683]:     </disk>
Oct 16 11:15:42 user nova-compute[74683]:     <disk type="block" device="disk">
Oct 16 11:15:42 user nova-compute[74683]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:15:42 user nova-compute[74683]:       <source dev="/dev/sdb"/>
Oct 16 11:15:42 user nova-compute[74683]:       <target dev="vdc" bus="virtio"/>
Oct 16 11:15:42 user nova-compute[74683]:       <serial>3f88fd55-edd7-479f-9c45-ac2456b4e59d</serial>
Oct 16 11:15:42 user nova-compute[74683]:     </disk>
Oct 16 11:15:42 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:15:42 user nova-compute[74683]:       <mac address="fa:16:3e:7e:c7:90"/>
Oct 16 11:15:42 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:15:42 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:15:42 user nova-compute[74683]:       <target dev="tap1509ff6e-10"/>
Oct 16 11:15:42 user nova-compute[74683]:     </interface>
Oct 16 11:15:42 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:15:42 user nova-compute[74683]:       <mac address="fa:16:3e:d6:13:bf"/>
Oct 16 11:15:42 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:15:42 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:15:42 user nova-compute[74683]:       <target dev="tap7cfcd210-0e"/>
Oct 16 11:15:42 user nova-compute[74683]:     </interface>
Oct 16 11:15:42 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:15:42 user nova-compute[74683]:       <mac address="fa:16:3e:52:f5:40"/>
Oct 16 11:15:42 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:15:42 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:15:42 user nova-compute[74683]:       <target dev="tapbfe231c8-ff"/>
Oct 16 11:15:42 user nova-compute[74683]:     </interface>
Oct 16 11:15:42 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:15:42 user nova-compute[74683]:       <mac address="fa:16:3e:b2:3c:35"/>
Oct 16 11:15:42 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:15:42 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:15:42 user nova-compute[74683]:       <target dev="tap8c0a030c-cf"/>
Oct 16 11:15:42 user nova-compute[74683]:     </interface>
Oct 16 11:15:42 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:15:42 user nova-compute[74683]:       <mac address="fa:16:3e:24:20:65"/>
Oct 16 11:15:42 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:15:42 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:15:42 user nova-compute[74683]:       <target dev="tap82f47635-6e"/>
Oct 16 11:15:42 user nova-compute[74683]:     </interface>
Oct 16 11:15:42 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:15:42 user nova-compute[74683]:       <mac address="fa:16:3e:42:50:56"/>
Oct 16 11:15:42 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:15:42 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:15:42 user nova-compute[74683]:       <target dev="tap8a9e59f4-77"/>
Oct 16 11:15:42 user nova-compute[74683]:     </interface>
Oct 16 11:15:42 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:15:42 user nova-compute[74683]:       <mac address="fa:16:3e:f8:2c:0c"/>
Oct 16 11:15:42 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:15:42 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:15:42 user nova-compute[74683]:       <target dev="tap698c4ef8-28"/>
Oct 16 11:15:42 user nova-compute[74683]:     </interface>
Oct 16 11:15:42 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:15:42 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/9df7866f-28e9-46d0-9f35-24484adfffd7/console.log" append="off"/>
Oct 16 11:15:42 user nova-compute[74683]:     </serial>
Oct 16 11:15:42 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:15:42 user nova-compute[74683]:     <video>
Oct 16 11:15:42 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:15:42 user nova-compute[74683]:     </video>
Oct 16 11:15:42 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:15:42 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:15:42 user nova-compute[74683]:     </rng>
Oct 16 11:15:42 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:15:42 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:15:42 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:15:42 user nova-compute[74683]:     </memballoon>
Oct 16 11:15:42 user nova-compute[74683]:   </devices>
Oct 16 11:15:42 user nova-compute[74683]: </domain>
Oct 16 11:15:42 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T11:14:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-70304386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-70304386',id=9,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMaNfqPfIvkH/+eTEOkzkwyEVHeMqBbroH4XHs/VsM+32arQrPWLULM+KkAha5uKcIYXUQvzuK/i2uKi7/k+3+r15xjXIht8P92ImSNq2UpDCIQUhnRpXUQIyECbXNOdkg==',key_name='tempest-keypair-1984050809',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f4876261cd344bf91c3263bf1a20ae9',ramdisk_id='',reservation_id='r-im2wrlm4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-652208384',owner_user_name='tempest-TaggedBootDevicesTest-652208384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:14:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5ad8d732f364377bca4aac914efec8f',uuid=9df7866f-28e9-46d0-9f35-24484adfffd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1509ff6e-10c0-4f96-95ae-660dfc1402cc", "address": "fa:16:3e:7e:c7:90", "network": {"id": "6e171460-714f-45db-a77d-ba03b50b892e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-531792258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1509ff6e-10", "ovs_interfaceid": "1509ff6e-10c0-4f96-95ae-660dfc1402cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Converting VIF {"id": "1509ff6e-10c0-4f96-95ae-660dfc1402cc", "address": "fa:16:3e:7e:c7:90", "network": {"id": "6e171460-714f-45db-a77d-ba03b50b892e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-531792258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1509ff6e-10", "ovs_interfaceid": "1509ff6e-10c0-4f96-95ae-660dfc1402cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:c7:90,bridge_name='br-int',has_traffic_filtering=True,id=1509ff6e-10c0-4f96-95ae-660dfc1402cc,network=Network(6e171460-714f-45db-a77d-ba03b50b892e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1509ff6e-10') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG os_vif [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:c7:90,bridge_name='br-int',has_traffic_filtering=True,id=1509ff6e-10c0-4f96-95ae-660dfc1402cc,network=Network(6e171460-714f-45db-a77d-ba03b50b892e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1509ff6e-10') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '09a49c60-49ad-59a9-a5ce-22ed22162fad', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1509ff6e-10, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1509ff6e-10, col_values=(('qos', UUID('585ef633-09c5-4509-9027-0aa31ee3cb2b')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1509ff6e-10, col_values=(('external_ids', {'iface-id': '1509ff6e-10c0-4f96-95ae-660dfc1402cc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:c7:90', 'vm-uuid': '9df7866f-28e9-46d0-9f35-24484adfffd7'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:42 user nova-compute[74683]: INFO os_vif [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:c7:90,bridge_name='br-int',has_traffic_filtering=True,id=1509ff6e-10c0-4f96-95ae-660dfc1402cc,network=Network(6e171460-714f-45db-a77d-ba03b50b892e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1509ff6e-10')
Oct 16 11:15:42 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T11:14:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-70304386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-70304386',id=9,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMaNfqPfIvkH/+eTEOkzkwyEVHeMqBbroH4XHs/VsM+32arQrPWLULM+KkAha5uKcIYXUQvzuK/i2uKi7/k+3+r15xjXIht8P92ImSNq2UpDCIQUhnRpXUQIyECbXNOdkg==',key_name='tempest-keypair-1984050809',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f4876261cd344bf91c3263bf1a20ae9',ramdisk_id='',reservation_id='r-im2wrlm4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-652208384',owner_user_name='tempest-TaggedBootDevicesTest-652208384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:14:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5ad8d732f364377bca4aac914efec8f',uuid=9df7866f-28e9-46d0-9f35-24484adfffd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7cfcd210-0e45-4f0e-b04b-1e933ec87734", "address": "fa:16:3e:d6:13:bf", "network": {"id": "0ab5f993-73f7-4963-9a4a-768145c101ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1056805143", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cfcd210-0e", "ovs_interfaceid": "7cfcd210-0e45-4f0e-b04b-1e933ec87734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Converting VIF {"id": "7cfcd210-0e45-4f0e-b04b-1e933ec87734", "address": "fa:16:3e:d6:13:bf", "network": {"id": "0ab5f993-73f7-4963-9a4a-768145c101ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1056805143", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cfcd210-0e", "ovs_interfaceid": "7cfcd210-0e45-4f0e-b04b-1e933ec87734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:13:bf,bridge_name='br-int',has_traffic_filtering=True,id=7cfcd210-0e45-4f0e-b04b-1e933ec87734,network=Network(0ab5f993-73f7-4963-9a4a-768145c101ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7cfcd210-0e') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG os_vif [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:13:bf,bridge_name='br-int',has_traffic_filtering=True,id=7cfcd210-0e45-4f0e-b04b-1e933ec87734,network=Network(0ab5f993-73f7-4963-9a4a-768145c101ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7cfcd210-0e') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2f105da9-0e91-5f3c-9918-db58446e3d1e', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7cfcd210-0e, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7cfcd210-0e, col_values=(('qos', UUID('1877fc68-1135-44eb-8786-f562c44d3a25')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7cfcd210-0e, col_values=(('external_ids', {'iface-id': '7cfcd210-0e45-4f0e-b04b-1e933ec87734', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:13:bf', 'vm-uuid': '9df7866f-28e9-46d0-9f35-24484adfffd7'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:42 user nova-compute[74683]: INFO os_vif [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:13:bf,bridge_name='br-int',has_traffic_filtering=True,id=7cfcd210-0e45-4f0e-b04b-1e933ec87734,network=Network(0ab5f993-73f7-4963-9a4a-768145c101ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7cfcd210-0e')
Oct 16 11:15:42 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T11:14:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-70304386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-70304386',id=9,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMaNfqPfIvkH/+eTEOkzkwyEVHeMqBbroH4XHs/VsM+32arQrPWLULM+KkAha5uKcIYXUQvzuK/i2uKi7/k+3+r15xjXIht8P92ImSNq2UpDCIQUhnRpXUQIyECbXNOdkg==',key_name='tempest-keypair-1984050809',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f4876261cd344bf91c3263bf1a20ae9',ramdisk_id='',reservation_id='r-im2wrlm4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-652208384',owner_user_name='tempest-TaggedBootDevicesTest-652208384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:14:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5ad8d732f364377bca4aac914efec8f',uuid=9df7866f-28e9-46d0-9f35-24484adfffd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bfe231c8-ff2a-46fd-9af6-9982a54d7846", "address": "fa:16:3e:52:f5:40", "network": {"id": "0ab5f993-73f7-4963-9a4a-768145c101ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1056805143", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe231c8-ff", "ovs_interfaceid": "bfe231c8-ff2a-46fd-9af6-9982a54d7846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Converting VIF {"id": "bfe231c8-ff2a-46fd-9af6-9982a54d7846", "address": "fa:16:3e:52:f5:40", "network": {"id": "0ab5f993-73f7-4963-9a4a-768145c101ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1056805143", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe231c8-ff", "ovs_interfaceid": "bfe231c8-ff2a-46fd-9af6-9982a54d7846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:f5:40,bridge_name='br-int',has_traffic_filtering=True,id=bfe231c8-ff2a-46fd-9af6-9982a54d7846,network=Network(0ab5f993-73f7-4963-9a4a-768145c101ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbfe231c8-ff') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG os_vif [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:f5:40,bridge_name='br-int',has_traffic_filtering=True,id=bfe231c8-ff2a-46fd-9af6-9982a54d7846,network=Network(0ab5f993-73f7-4963-9a4a-768145c101ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbfe231c8-ff') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c4878ce4-598e-5262-b981-0016f6795843', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbfe231c8-ff, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbfe231c8-ff, col_values=(('qos', UUID('665de395-1f56-4a7b-9d6c-59bc236b3063')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbfe231c8-ff, col_values=(('external_ids', {'iface-id': 'bfe231c8-ff2a-46fd-9af6-9982a54d7846', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:f5:40', 'vm-uuid': '9df7866f-28e9-46d0-9f35-24484adfffd7'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:42 user nova-compute[74683]: INFO os_vif [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:f5:40,bridge_name='br-int',has_traffic_filtering=True,id=bfe231c8-ff2a-46fd-9af6-9982a54d7846,network=Network(0ab5f993-73f7-4963-9a4a-768145c101ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbfe231c8-ff')
Oct 16 11:15:42 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T11:14:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-70304386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-70304386',id=9,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMaNfqPfIvkH/+eTEOkzkwyEVHeMqBbroH4XHs/VsM+32arQrPWLULM+KkAha5uKcIYXUQvzuK/i2uKi7/k+3+r15xjXIht8P92ImSNq2UpDCIQUhnRpXUQIyECbXNOdkg==',key_name='tempest-keypair-1984050809',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f4876261cd344bf91c3263bf1a20ae9',ramdisk_id='',reservation_id='r-im2wrlm4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-652208384',owner_user_name='tempest-TaggedBootDevicesTest-652208384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:14:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5ad8d732f364377bca4aac914efec8f',uuid=9df7866f-28e9-46d0-9f35-24484adfffd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c0a030c-cf2d-4d14-b5c3-6d0563b346b9", "address": "fa:16:3e:b2:3c:35", "network": {"id": "0ab5f993-73f7-4963-9a4a-768145c101ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1056805143", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c0a030c-cf", "ovs_interfaceid": "8c0a030c-cf2d-4d14-b5c3-6d0563b346b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Converting VIF {"id": "8c0a030c-cf2d-4d14-b5c3-6d0563b346b9", "address": "fa:16:3e:b2:3c:35", "network": {"id": "0ab5f993-73f7-4963-9a4a-768145c101ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1056805143", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c0a030c-cf", "ovs_interfaceid": "8c0a030c-cf2d-4d14-b5c3-6d0563b346b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:3c:35,bridge_name='br-int',has_traffic_filtering=True,id=8c0a030c-cf2d-4d14-b5c3-6d0563b346b9,network=Network(0ab5f993-73f7-4963-9a4a-768145c101ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c0a030c-cf') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG os_vif [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:3c:35,bridge_name='br-int',has_traffic_filtering=True,id=8c0a030c-cf2d-4d14-b5c3-6d0563b346b9,network=Network(0ab5f993-73f7-4963-9a4a-768145c101ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c0a030c-cf') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f50bba90-7305-5cd8-b4bf-09cdb9b8a555', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c0a030c-cf, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8c0a030c-cf, col_values=(('qos', UUID('6496909c-2d75-4916-bdca-66a0e78e9fcd')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8c0a030c-cf, col_values=(('external_ids', {'iface-id': '8c0a030c-cf2d-4d14-b5c3-6d0563b346b9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:3c:35', 'vm-uuid': '9df7866f-28e9-46d0-9f35-24484adfffd7'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:42 user nova-compute[74683]: INFO os_vif [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:3c:35,bridge_name='br-int',has_traffic_filtering=True,id=8c0a030c-cf2d-4d14-b5c3-6d0563b346b9,network=Network(0ab5f993-73f7-4963-9a4a-768145c101ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c0a030c-cf')
Oct 16 11:15:42 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T11:14:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-70304386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-70304386',id=9,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMaNfqPfIvkH/+eTEOkzkwyEVHeMqBbroH4XHs/VsM+32arQrPWLULM+KkAha5uKcIYXUQvzuK/i2uKi7/k+3+r15xjXIht8P92ImSNq2UpDCIQUhnRpXUQIyECbXNOdkg==',key_name='tempest-keypair-1984050809',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f4876261cd344bf91c3263bf1a20ae9',ramdisk_id='',reservation_id='r-im2wrlm4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-652208384',owner_user_name='tempest-TaggedBootDevicesTest-652208384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:14:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5ad8d732f364377bca4aac914efec8f',uuid=9df7866f-28e9-46d0-9f35-24484adfffd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82f47635-6e3f-492d-9819-4d77ae46fb29", "address": "fa:16:3e:24:20:65", "network": {"id": "0ab5f993-73f7-4963-9a4a-768145c101ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1056805143", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82f47635-6e", "ovs_interfaceid": "82f47635-6e3f-492d-9819-4d77ae46fb29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Converting VIF {"id": "82f47635-6e3f-492d-9819-4d77ae46fb29", "address": "fa:16:3e:24:20:65", "network": {"id": "0ab5f993-73f7-4963-9a4a-768145c101ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1056805143", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82f47635-6e", "ovs_interfaceid": "82f47635-6e3f-492d-9819-4d77ae46fb29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:20:65,bridge_name='br-int',has_traffic_filtering=True,id=82f47635-6e3f-492d-9819-4d77ae46fb29,network=Network(0ab5f993-73f7-4963-9a4a-768145c101ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82f47635-6e') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG os_vif [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:20:65,bridge_name='br-int',has_traffic_filtering=True,id=82f47635-6e3f-492d-9819-4d77ae46fb29,network=Network(0ab5f993-73f7-4963-9a4a-768145c101ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82f47635-6e') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '015a63b2-d716-52bb-95a0-38dce283742d', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap82f47635-6e, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap82f47635-6e, col_values=(('qos', UUID('18b7d2e3-e28b-4e49-b99d-a9289339de4b')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap82f47635-6e, col_values=(('external_ids', {'iface-id': '82f47635-6e3f-492d-9819-4d77ae46fb29', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:20:65', 'vm-uuid': '9df7866f-28e9-46d0-9f35-24484adfffd7'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:42 user nova-compute[74683]: INFO os_vif [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:20:65,bridge_name='br-int',has_traffic_filtering=True,id=82f47635-6e3f-492d-9819-4d77ae46fb29,network=Network(0ab5f993-73f7-4963-9a4a-768145c101ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82f47635-6e')
Oct 16 11:15:42 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T11:14:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-70304386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-70304386',id=9,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMaNfqPfIvkH/+eTEOkzkwyEVHeMqBbroH4XHs/VsM+32arQrPWLULM+KkAha5uKcIYXUQvzuK/i2uKi7/k+3+r15xjXIht8P92ImSNq2UpDCIQUhnRpXUQIyECbXNOdkg==',key_name='tempest-keypair-1984050809',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f4876261cd344bf91c3263bf1a20ae9',ramdisk_id='',reservation_id='r-im2wrlm4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-652208384',owner_user_name='tempest-TaggedBootDevicesTest-652208384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:14:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5ad8d732f364377bca4aac914efec8f',uuid=9df7866f-28e9-46d0-9f35-24484adfffd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a9e59f4-7708-438f-8411-499c6e38ec1b", "address": "fa:16:3e:42:50:56", "network": {"id": "e2c37b04-3414-40bf-a284-f1f9123d0ccb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1623055457", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a9e59f4-77", "ovs_interfaceid": "8a9e59f4-7708-438f-8411-499c6e38ec1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Converting VIF {"id": "8a9e59f4-7708-438f-8411-499c6e38ec1b", "address": "fa:16:3e:42:50:56", "network": {"id": "e2c37b04-3414-40bf-a284-f1f9123d0ccb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1623055457", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a9e59f4-77", "ovs_interfaceid": "8a9e59f4-7708-438f-8411-499c6e38ec1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:50:56,bridge_name='br-int',has_traffic_filtering=True,id=8a9e59f4-7708-438f-8411-499c6e38ec1b,network=Network(e2c37b04-3414-40bf-a284-f1f9123d0ccb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a9e59f4-77') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG os_vif [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:50:56,bridge_name='br-int',has_traffic_filtering=True,id=8a9e59f4-7708-438f-8411-499c6e38ec1b,network=Network(e2c37b04-3414-40bf-a284-f1f9123d0ccb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a9e59f4-77') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '58abd847-24cc-5f7e-8b3b-3a62c7ff513e', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:15:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a9e59f4-77, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:15:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8a9e59f4-77, col_values=(('qos', UUID('894ab6eb-3319-4f60-a3b8-5a43b2a095e4')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:15:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8a9e59f4-77, col_values=(('external_ids', {'iface-id': '8a9e59f4-7708-438f-8411-499c6e38ec1b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:50:56', 'vm-uuid': '9df7866f-28e9-46d0-9f35-24484adfffd7'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:15:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:15:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:43 user nova-compute[74683]: INFO os_vif [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:50:56,bridge_name='br-int',has_traffic_filtering=True,id=8a9e59f4-7708-438f-8411-499c6e38ec1b,network=Network(e2c37b04-3414-40bf-a284-f1f9123d0ccb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a9e59f4-77')
Oct 16 11:15:43 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T11:14:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-70304386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-70304386',id=9,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMaNfqPfIvkH/+eTEOkzkwyEVHeMqBbroH4XHs/VsM+32arQrPWLULM+KkAha5uKcIYXUQvzuK/i2uKi7/k+3+r15xjXIht8P92ImSNq2UpDCIQUhnRpXUQIyECbXNOdkg==',key_name='tempest-keypair-1984050809',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f4876261cd344bf91c3263bf1a20ae9',ramdisk_id='',reservation_id='r-im2wrlm4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-652208384',owner_user_name='tempest-TaggedBootDevicesTest-652208384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:14:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5ad8d732f364377bca4aac914efec8f',uuid=9df7866f-28e9-46d0-9f35-24484adfffd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "698c4ef8-286a-4bc1-a789-3276dc6defea", "address": "fa:16:3e:f8:2c:0c", "network": {"id": "e2c37b04-3414-40bf-a284-f1f9123d0ccb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1623055457", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap698c4ef8-28", "ovs_interfaceid": "698c4ef8-286a-4bc1-a789-3276dc6defea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:15:43 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Converting VIF {"id": "698c4ef8-286a-4bc1-a789-3276dc6defea", "address": "fa:16:3e:f8:2c:0c", "network": {"id": "e2c37b04-3414-40bf-a284-f1f9123d0ccb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1623055457", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap698c4ef8-28", "ovs_interfaceid": "698c4ef8-286a-4bc1-a789-3276dc6defea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:15:43 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:2c:0c,bridge_name='br-int',has_traffic_filtering=True,id=698c4ef8-286a-4bc1-a789-3276dc6defea,network=Network(e2c37b04-3414-40bf-a284-f1f9123d0ccb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap698c4ef8-28') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:15:43 user nova-compute[74683]: DEBUG os_vif [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:2c:0c,bridge_name='br-int',has_traffic_filtering=True,id=698c4ef8-286a-4bc1-a789-3276dc6defea,network=Network(e2c37b04-3414-40bf-a284-f1f9123d0ccb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap698c4ef8-28') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:15:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:15:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:15:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4da81455-9475-59e9-a1a3-7296e62d245a', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:15:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:15:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap698c4ef8-28, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:15:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap698c4ef8-28, col_values=(('qos', UUID('0901b418-1490-4cf6-aaa8-f35626da3a0d')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:15:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap698c4ef8-28, col_values=(('external_ids', {'iface-id': '698c4ef8-286a-4bc1-a789-3276dc6defea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:2c:0c', 'vm-uuid': '9df7866f-28e9-46d0-9f35-24484adfffd7'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:15:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:15:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:43 user nova-compute[74683]: INFO os_vif [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:2c:0c,bridge_name='br-int',has_traffic_filtering=True,id=698c4ef8-286a-4bc1-a789-3276dc6defea,network=Network(e2c37b04-3414-40bf-a284-f1f9123d0ccb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap698c4ef8-28')
Oct 16 11:15:43 user nova-compute[74683]: DEBUG nova.compute.manager [req-2bea0a2a-796c-4f34-9a5e-7ce22373be0c req-95af20ad-c24d-41b8-ba87-05b2a1cff89b service nova] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Received event network-changed-84c66881-3b9a-4448-a984-840fab1521e4 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:15:43 user nova-compute[74683]: DEBUG nova.compute.manager [req-2bea0a2a-796c-4f34-9a5e-7ce22373be0c req-95af20ad-c24d-41b8-ba87-05b2a1cff89b service nova] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Refreshing instance network info cache due to event network-changed-84c66881-3b9a-4448-a984-840fab1521e4. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:15:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-2bea0a2a-796c-4f34-9a5e-7ce22373be0c req-95af20ad-c24d-41b8-ba87-05b2a1cff89b service nova] Acquiring lock "refresh_cache-c8d3f594-1f38-41d3-90aa-3dfba95ce077" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:15:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-2bea0a2a-796c-4f34-9a5e-7ce22373be0c req-95af20ad-c24d-41b8-ba87-05b2a1cff89b service nova] Acquired lock "refresh_cache-c8d3f594-1f38-41d3-90aa-3dfba95ce077" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:15:43 user nova-compute[74683]: DEBUG nova.network.neutron [req-2bea0a2a-796c-4f34-9a5e-7ce22373be0c req-95af20ad-c24d-41b8-ba87-05b2a1cff89b service nova] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Refreshing network info cache for port 84c66881-3b9a-4448-a984-840fab1521e4 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:15:43 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] No BDM found with device name hda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:15:43 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:15:43 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] No VIF found with MAC fa:16:3e:7e:c7:90, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:15:43 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] No VIF found with MAC fa:16:3e:24:20:65, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:15:43 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Using config drive
Oct 16 11:15:43 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Creating config drive at /opt/stack/data/nova/instances/9df7866f-28e9-46d0-9f35-24484adfffd7/disk.config
Oct 16 11:15:43 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9df7866f-28e9-46d0-9f35-24484adfffd7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmphvdj6yej {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:43 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9df7866f-28e9-46d0-9f35-24484adfffd7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmphvdj6yej" returned: 0 in 0.057s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:43 user nova-compute[74683]: DEBUG nova.network.neutron [req-2bea0a2a-796c-4f34-9a5e-7ce22373be0c req-95af20ad-c24d-41b8-ba87-05b2a1cff89b service nova] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Updated VIF entry in instance network info cache for port 84c66881-3b9a-4448-a984-840fab1521e4. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:15:43 user nova-compute[74683]: DEBUG nova.network.neutron [req-2bea0a2a-796c-4f34-9a5e-7ce22373be0c req-95af20ad-c24d-41b8-ba87-05b2a1cff89b service nova] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Updating instance_info_cache with network_info: [{"id": "84c66881-3b9a-4448-a984-840fab1521e4", "address": "fa:16:3e:bf:fd:e3", "network": {"id": "8bd06e2b-a2a2-47c6-a513-9e0bdfb1964e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2134820244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97c84099ff9940018a403eba219b0370", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c66881-3b", "ovs_interfaceid": "84c66881-3b9a-4448-a984-840fab1521e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:15:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-2bea0a2a-796c-4f34-9a5e-7ce22373be0c req-95af20ad-c24d-41b8-ba87-05b2a1cff89b service nova] Releasing lock "refresh_cache-c8d3f594-1f38-41d3-90aa-3dfba95ce077" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:15:44 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:44 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:44 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:44 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:45 user nova-compute[74683]: DEBUG nova.compute.manager [req-87901901-8dbb-4fa0-acc8-6ffa13f9f25b req-d2f783e1-989f-4a23-9637-c86cab5ca151 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received event network-vif-plugged-1509ff6e-10c0-4f96-95ae-660dfc1402cc {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:15:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-87901901-8dbb-4fa0-acc8-6ffa13f9f25b req-d2f783e1-989f-4a23-9637-c86cab5ca151 service nova] Acquiring lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:15:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-87901901-8dbb-4fa0-acc8-6ffa13f9f25b req-d2f783e1-989f-4a23-9637-c86cab5ca151 service nova] Lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:15:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-87901901-8dbb-4fa0-acc8-6ffa13f9f25b req-d2f783e1-989f-4a23-9637-c86cab5ca151 service nova] Lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:15:45 user nova-compute[74683]: DEBUG nova.compute.manager [req-87901901-8dbb-4fa0-acc8-6ffa13f9f25b req-d2f783e1-989f-4a23-9637-c86cab5ca151 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] No waiting events found dispatching network-vif-plugged-1509ff6e-10c0-4f96-95ae-660dfc1402cc {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:15:45 user nova-compute[74683]: WARNING nova.compute.manager [req-87901901-8dbb-4fa0-acc8-6ffa13f9f25b req-d2f783e1-989f-4a23-9637-c86cab5ca151 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received unexpected event network-vif-plugged-1509ff6e-10c0-4f96-95ae-660dfc1402cc for instance with vm_state building and task_state spawning.
Oct 16 11:15:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:45 user nova-compute[74683]: DEBUG nova.compute.manager [req-f4ad4bfb-16c6-4c4f-b29c-aef851b9abbc req-b330d508-3b20-4977-a4a4-7f3a377c7244 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received event network-vif-plugged-7cfcd210-0e45-4f0e-b04b-1e933ec87734 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:15:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f4ad4bfb-16c6-4c4f-b29c-aef851b9abbc req-b330d508-3b20-4977-a4a4-7f3a377c7244 service nova] Acquiring lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:15:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f4ad4bfb-16c6-4c4f-b29c-aef851b9abbc req-b330d508-3b20-4977-a4a4-7f3a377c7244 service nova] Lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:15:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f4ad4bfb-16c6-4c4f-b29c-aef851b9abbc req-b330d508-3b20-4977-a4a4-7f3a377c7244 service nova] Lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:15:45 user nova-compute[74683]: DEBUG nova.compute.manager [req-f4ad4bfb-16c6-4c4f-b29c-aef851b9abbc req-b330d508-3b20-4977-a4a4-7f3a377c7244 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] No waiting events found dispatching network-vif-plugged-7cfcd210-0e45-4f0e-b04b-1e933ec87734 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:15:45 user nova-compute[74683]: WARNING nova.compute.manager [req-f4ad4bfb-16c6-4c4f-b29c-aef851b9abbc req-b330d508-3b20-4977-a4a4-7f3a377c7244 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received unexpected event network-vif-plugged-7cfcd210-0e45-4f0e-b04b-1e933ec87734 for instance with vm_state building and task_state spawning.
Oct 16 11:15:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:46 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:46 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:46 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:46 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:46 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:46 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:46 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:47 user nova-compute[74683]: DEBUG nova.compute.manager [req-5f05ef49-2776-40ee-a133-8e44b42c61c9 req-8c5a955a-db80-4a96-9fd8-8d7d3328bee5 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received event network-vif-plugged-1509ff6e-10c0-4f96-95ae-660dfc1402cc {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:15:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-5f05ef49-2776-40ee-a133-8e44b42c61c9 req-8c5a955a-db80-4a96-9fd8-8d7d3328bee5 service nova] Acquiring lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:15:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-5f05ef49-2776-40ee-a133-8e44b42c61c9 req-8c5a955a-db80-4a96-9fd8-8d7d3328bee5 service nova] Lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:15:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-5f05ef49-2776-40ee-a133-8e44b42c61c9 req-8c5a955a-db80-4a96-9fd8-8d7d3328bee5 service nova] Lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:15:47 user nova-compute[74683]: DEBUG nova.compute.manager [req-5f05ef49-2776-40ee-a133-8e44b42c61c9 req-8c5a955a-db80-4a96-9fd8-8d7d3328bee5 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] No waiting events found dispatching network-vif-plugged-1509ff6e-10c0-4f96-95ae-660dfc1402cc {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:15:47 user nova-compute[74683]: WARNING nova.compute.manager [req-5f05ef49-2776-40ee-a133-8e44b42c61c9 req-8c5a955a-db80-4a96-9fd8-8d7d3328bee5 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received unexpected event network-vif-plugged-1509ff6e-10c0-4f96-95ae-660dfc1402cc for instance with vm_state building and task_state spawning.
Oct 16 11:15:47 user nova-compute[74683]: DEBUG nova.compute.manager [req-5f05ef49-2776-40ee-a133-8e44b42c61c9 req-8c5a955a-db80-4a96-9fd8-8d7d3328bee5 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received event network-vif-plugged-bfe231c8-ff2a-46fd-9af6-9982a54d7846 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:15:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-5f05ef49-2776-40ee-a133-8e44b42c61c9 req-8c5a955a-db80-4a96-9fd8-8d7d3328bee5 service nova] Acquiring lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:15:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-5f05ef49-2776-40ee-a133-8e44b42c61c9 req-8c5a955a-db80-4a96-9fd8-8d7d3328bee5 service nova] Lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:15:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-5f05ef49-2776-40ee-a133-8e44b42c61c9 req-8c5a955a-db80-4a96-9fd8-8d7d3328bee5 service nova] Lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:15:47 user nova-compute[74683]: DEBUG nova.compute.manager [req-5f05ef49-2776-40ee-a133-8e44b42c61c9 req-8c5a955a-db80-4a96-9fd8-8d7d3328bee5 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] No waiting events found dispatching network-vif-plugged-bfe231c8-ff2a-46fd-9af6-9982a54d7846 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:15:47 user nova-compute[74683]: WARNING nova.compute.manager [req-5f05ef49-2776-40ee-a133-8e44b42c61c9 req-8c5a955a-db80-4a96-9fd8-8d7d3328bee5 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received unexpected event network-vif-plugged-bfe231c8-ff2a-46fd-9af6-9982a54d7846 for instance with vm_state building and task_state spawning.
Oct 16 11:15:47 user nova-compute[74683]: DEBUG nova.compute.manager [req-5f05ef49-2776-40ee-a133-8e44b42c61c9 req-8c5a955a-db80-4a96-9fd8-8d7d3328bee5 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received event network-vif-plugged-bfe231c8-ff2a-46fd-9af6-9982a54d7846 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:15:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-5f05ef49-2776-40ee-a133-8e44b42c61c9 req-8c5a955a-db80-4a96-9fd8-8d7d3328bee5 service nova] Acquiring lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:15:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-5f05ef49-2776-40ee-a133-8e44b42c61c9 req-8c5a955a-db80-4a96-9fd8-8d7d3328bee5 service nova] Lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:15:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-5f05ef49-2776-40ee-a133-8e44b42c61c9 req-8c5a955a-db80-4a96-9fd8-8d7d3328bee5 service nova] Lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:15:47 user nova-compute[74683]: DEBUG nova.compute.manager [req-5f05ef49-2776-40ee-a133-8e44b42c61c9 req-8c5a955a-db80-4a96-9fd8-8d7d3328bee5 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] No waiting events found dispatching network-vif-plugged-bfe231c8-ff2a-46fd-9af6-9982a54d7846 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:15:47 user nova-compute[74683]: WARNING nova.compute.manager [req-5f05ef49-2776-40ee-a133-8e44b42c61c9 req-8c5a955a-db80-4a96-9fd8-8d7d3328bee5 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received unexpected event network-vif-plugged-bfe231c8-ff2a-46fd-9af6-9982a54d7846 for instance with vm_state building and task_state spawning.
Oct 16 11:15:47 user nova-compute[74683]: DEBUG nova.compute.manager [req-5f05ef49-2776-40ee-a133-8e44b42c61c9 req-8c5a955a-db80-4a96-9fd8-8d7d3328bee5 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received event network-vif-plugged-8a9e59f4-7708-438f-8411-499c6e38ec1b {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:15:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-5f05ef49-2776-40ee-a133-8e44b42c61c9 req-8c5a955a-db80-4a96-9fd8-8d7d3328bee5 service nova] Acquiring lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:15:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-5f05ef49-2776-40ee-a133-8e44b42c61c9 req-8c5a955a-db80-4a96-9fd8-8d7d3328bee5 service nova] Lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:15:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-5f05ef49-2776-40ee-a133-8e44b42c61c9 req-8c5a955a-db80-4a96-9fd8-8d7d3328bee5 service nova] Lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:15:47 user nova-compute[74683]: DEBUG nova.compute.manager [req-5f05ef49-2776-40ee-a133-8e44b42c61c9 req-8c5a955a-db80-4a96-9fd8-8d7d3328bee5 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] No waiting events found dispatching network-vif-plugged-8a9e59f4-7708-438f-8411-499c6e38ec1b {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:15:47 user nova-compute[74683]: WARNING nova.compute.manager [req-5f05ef49-2776-40ee-a133-8e44b42c61c9 req-8c5a955a-db80-4a96-9fd8-8d7d3328bee5 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received unexpected event network-vif-plugged-8a9e59f4-7708-438f-8411-499c6e38ec1b for instance with vm_state building and task_state spawning.
Oct 16 11:15:47 user nova-compute[74683]: DEBUG nova.compute.manager [req-c839977d-d89d-42df-b95b-ff3ddb961d7c req-3e0dff35-8e40-4f34-881e-0ac5353cf279 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received event network-vif-plugged-7cfcd210-0e45-4f0e-b04b-1e933ec87734 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:15:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c839977d-d89d-42df-b95b-ff3ddb961d7c req-3e0dff35-8e40-4f34-881e-0ac5353cf279 service nova] Acquiring lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:15:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c839977d-d89d-42df-b95b-ff3ddb961d7c req-3e0dff35-8e40-4f34-881e-0ac5353cf279 service nova] Lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:15:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c839977d-d89d-42df-b95b-ff3ddb961d7c req-3e0dff35-8e40-4f34-881e-0ac5353cf279 service nova] Lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:15:47 user nova-compute[74683]: DEBUG nova.compute.manager [req-c839977d-d89d-42df-b95b-ff3ddb961d7c req-3e0dff35-8e40-4f34-881e-0ac5353cf279 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] No waiting events found dispatching network-vif-plugged-7cfcd210-0e45-4f0e-b04b-1e933ec87734 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:15:47 user nova-compute[74683]: WARNING nova.compute.manager [req-c839977d-d89d-42df-b95b-ff3ddb961d7c req-3e0dff35-8e40-4f34-881e-0ac5353cf279 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received unexpected event network-vif-plugged-7cfcd210-0e45-4f0e-b04b-1e933ec87734 for instance with vm_state building and task_state spawning.
Oct 16 11:15:47 user nova-compute[74683]: DEBUG nova.compute.manager [req-c839977d-d89d-42df-b95b-ff3ddb961d7c req-3e0dff35-8e40-4f34-881e-0ac5353cf279 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received event network-vif-plugged-8c0a030c-cf2d-4d14-b5c3-6d0563b346b9 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:15:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c839977d-d89d-42df-b95b-ff3ddb961d7c req-3e0dff35-8e40-4f34-881e-0ac5353cf279 service nova] Acquiring lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:15:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c839977d-d89d-42df-b95b-ff3ddb961d7c req-3e0dff35-8e40-4f34-881e-0ac5353cf279 service nova] Lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:15:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c839977d-d89d-42df-b95b-ff3ddb961d7c req-3e0dff35-8e40-4f34-881e-0ac5353cf279 service nova] Lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:15:47 user nova-compute[74683]: DEBUG nova.compute.manager [req-c839977d-d89d-42df-b95b-ff3ddb961d7c req-3e0dff35-8e40-4f34-881e-0ac5353cf279 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] No waiting events found dispatching network-vif-plugged-8c0a030c-cf2d-4d14-b5c3-6d0563b346b9 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:15:47 user nova-compute[74683]: WARNING nova.compute.manager [req-c839977d-d89d-42df-b95b-ff3ddb961d7c req-3e0dff35-8e40-4f34-881e-0ac5353cf279 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received unexpected event network-vif-plugged-8c0a030c-cf2d-4d14-b5c3-6d0563b346b9 for instance with vm_state building and task_state spawning.
Oct 16 11:15:47 user nova-compute[74683]: DEBUG nova.compute.manager [req-c839977d-d89d-42df-b95b-ff3ddb961d7c req-3e0dff35-8e40-4f34-881e-0ac5353cf279 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received event network-vif-plugged-8c0a030c-cf2d-4d14-b5c3-6d0563b346b9 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:15:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c839977d-d89d-42df-b95b-ff3ddb961d7c req-3e0dff35-8e40-4f34-881e-0ac5353cf279 service nova] Acquiring lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:15:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c839977d-d89d-42df-b95b-ff3ddb961d7c req-3e0dff35-8e40-4f34-881e-0ac5353cf279 service nova] Lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:15:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c839977d-d89d-42df-b95b-ff3ddb961d7c req-3e0dff35-8e40-4f34-881e-0ac5353cf279 service nova] Lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:15:47 user nova-compute[74683]: DEBUG nova.compute.manager [req-c839977d-d89d-42df-b95b-ff3ddb961d7c req-3e0dff35-8e40-4f34-881e-0ac5353cf279 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] No waiting events found dispatching network-vif-plugged-8c0a030c-cf2d-4d14-b5c3-6d0563b346b9 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:15:47 user nova-compute[74683]: WARNING nova.compute.manager [req-c839977d-d89d-42df-b95b-ff3ddb961d7c req-3e0dff35-8e40-4f34-881e-0ac5353cf279 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received unexpected event network-vif-plugged-8c0a030c-cf2d-4d14-b5c3-6d0563b346b9 for instance with vm_state building and task_state spawning.
Oct 16 11:15:47 user nova-compute[74683]: DEBUG nova.compute.manager [req-c839977d-d89d-42df-b95b-ff3ddb961d7c req-3e0dff35-8e40-4f34-881e-0ac5353cf279 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received event network-vif-plugged-82f47635-6e3f-492d-9819-4d77ae46fb29 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:15:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c839977d-d89d-42df-b95b-ff3ddb961d7c req-3e0dff35-8e40-4f34-881e-0ac5353cf279 service nova] Acquiring lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:15:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c839977d-d89d-42df-b95b-ff3ddb961d7c req-3e0dff35-8e40-4f34-881e-0ac5353cf279 service nova] Lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:15:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c839977d-d89d-42df-b95b-ff3ddb961d7c req-3e0dff35-8e40-4f34-881e-0ac5353cf279 service nova] Lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:15:47 user nova-compute[74683]: DEBUG nova.compute.manager [req-c839977d-d89d-42df-b95b-ff3ddb961d7c req-3e0dff35-8e40-4f34-881e-0ac5353cf279 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] No waiting events found dispatching network-vif-plugged-82f47635-6e3f-492d-9819-4d77ae46fb29 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:15:47 user nova-compute[74683]: WARNING nova.compute.manager [req-c839977d-d89d-42df-b95b-ff3ddb961d7c req-3e0dff35-8e40-4f34-881e-0ac5353cf279 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received unexpected event network-vif-plugged-82f47635-6e3f-492d-9819-4d77ae46fb29 for instance with vm_state building and task_state spawning.
Oct 16 11:15:47 user nova-compute[74683]: DEBUG nova.compute.manager [req-c839977d-d89d-42df-b95b-ff3ddb961d7c req-3e0dff35-8e40-4f34-881e-0ac5353cf279 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received event network-vif-plugged-82f47635-6e3f-492d-9819-4d77ae46fb29 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:15:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c839977d-d89d-42df-b95b-ff3ddb961d7c req-3e0dff35-8e40-4f34-881e-0ac5353cf279 service nova] Acquiring lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:15:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c839977d-d89d-42df-b95b-ff3ddb961d7c req-3e0dff35-8e40-4f34-881e-0ac5353cf279 service nova] Lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:15:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c839977d-d89d-42df-b95b-ff3ddb961d7c req-3e0dff35-8e40-4f34-881e-0ac5353cf279 service nova] Lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:15:47 user nova-compute[74683]: DEBUG nova.compute.manager [req-c839977d-d89d-42df-b95b-ff3ddb961d7c req-3e0dff35-8e40-4f34-881e-0ac5353cf279 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] No waiting events found dispatching network-vif-plugged-82f47635-6e3f-492d-9819-4d77ae46fb29 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:15:47 user nova-compute[74683]: WARNING nova.compute.manager [req-c839977d-d89d-42df-b95b-ff3ddb961d7c req-3e0dff35-8e40-4f34-881e-0ac5353cf279 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received unexpected event network-vif-plugged-82f47635-6e3f-492d-9819-4d77ae46fb29 for instance with vm_state building and task_state spawning.
Oct 16 11:15:47 user nova-compute[74683]: DEBUG nova.compute.manager [req-c839977d-d89d-42df-b95b-ff3ddb961d7c req-3e0dff35-8e40-4f34-881e-0ac5353cf279 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received event network-vif-plugged-698c4ef8-286a-4bc1-a789-3276dc6defea {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:15:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c839977d-d89d-42df-b95b-ff3ddb961d7c req-3e0dff35-8e40-4f34-881e-0ac5353cf279 service nova] Acquiring lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:15:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c839977d-d89d-42df-b95b-ff3ddb961d7c req-3e0dff35-8e40-4f34-881e-0ac5353cf279 service nova] Lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:15:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c839977d-d89d-42df-b95b-ff3ddb961d7c req-3e0dff35-8e40-4f34-881e-0ac5353cf279 service nova] Lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:15:47 user nova-compute[74683]: DEBUG nova.compute.manager [req-c839977d-d89d-42df-b95b-ff3ddb961d7c req-3e0dff35-8e40-4f34-881e-0ac5353cf279 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] No waiting events found dispatching network-vif-plugged-698c4ef8-286a-4bc1-a789-3276dc6defea {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:15:47 user nova-compute[74683]: WARNING nova.compute.manager [req-c839977d-d89d-42df-b95b-ff3ddb961d7c req-3e0dff35-8e40-4f34-881e-0ac5353cf279 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received unexpected event network-vif-plugged-698c4ef8-286a-4bc1-a789-3276dc6defea for instance with vm_state building and task_state spawning.
Oct 16 11:15:47 user nova-compute[74683]: DEBUG nova.compute.manager [req-c839977d-d89d-42df-b95b-ff3ddb961d7c req-3e0dff35-8e40-4f34-881e-0ac5353cf279 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received event network-vif-plugged-698c4ef8-286a-4bc1-a789-3276dc6defea {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:15:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c839977d-d89d-42df-b95b-ff3ddb961d7c req-3e0dff35-8e40-4f34-881e-0ac5353cf279 service nova] Acquiring lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:15:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c839977d-d89d-42df-b95b-ff3ddb961d7c req-3e0dff35-8e40-4f34-881e-0ac5353cf279 service nova] Lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:15:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c839977d-d89d-42df-b95b-ff3ddb961d7c req-3e0dff35-8e40-4f34-881e-0ac5353cf279 service nova] Lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:15:47 user nova-compute[74683]: DEBUG nova.compute.manager [req-c839977d-d89d-42df-b95b-ff3ddb961d7c req-3e0dff35-8e40-4f34-881e-0ac5353cf279 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] No waiting events found dispatching network-vif-plugged-698c4ef8-286a-4bc1-a789-3276dc6defea {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:15:47 user nova-compute[74683]: WARNING nova.compute.manager [req-c839977d-d89d-42df-b95b-ff3ddb961d7c req-3e0dff35-8e40-4f34-881e-0ac5353cf279 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received unexpected event network-vif-plugged-698c4ef8-286a-4bc1-a789-3276dc6defea for instance with vm_state building and task_state spawning.
Oct 16 11:15:48 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:48 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:48 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:48 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:48 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:49 user nova-compute[74683]: DEBUG nova.compute.manager [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Instance event wait completed in 0 seconds for  {{(pid=74683) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 11:15:49 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Guest created on hypervisor {{(pid=74683) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 11:15:49 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Instance spawned successfully.
Oct 16 11:15:49 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 11:15:49 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Found default for hw_cdrom_bus of ide {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:15:49 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Found default for hw_disk_bus of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:15:49 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Found default for hw_input_bus of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:15:49 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Found default for hw_pointer_model of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:15:49 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Found default for hw_video_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:15:49 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Found default for hw_vif_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:15:49 user nova-compute[74683]: INFO nova.compute.manager [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Took 11.58 seconds to spawn the instance on the hypervisor.
Oct 16 11:15:49 user nova-compute[74683]: DEBUG nova.compute.manager [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:15:49 user nova-compute[74683]: INFO nova.compute.manager [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Took 70.49 seconds to build instance.
Oct 16 11:15:49 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ea523699-d617-4b92-bdf9-9979919cb0a1 tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Lock "9df7866f-28e9-46d0-9f35-24484adfffd7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 70.607s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:15:49 user nova-compute[74683]: DEBUG nova.compute.manager [req-db68dc1b-d88b-48f6-8267-ce9d1d69df95 req-59179a5c-579f-4da4-9896-46f29b1a601c service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received event network-vif-plugged-8a9e59f4-7708-438f-8411-499c6e38ec1b {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:15:49 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-db68dc1b-d88b-48f6-8267-ce9d1d69df95 req-59179a5c-579f-4da4-9896-46f29b1a601c service nova] Acquiring lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:15:49 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-db68dc1b-d88b-48f6-8267-ce9d1d69df95 req-59179a5c-579f-4da4-9896-46f29b1a601c service nova] Lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:15:49 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-db68dc1b-d88b-48f6-8267-ce9d1d69df95 req-59179a5c-579f-4da4-9896-46f29b1a601c service nova] Lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:15:49 user nova-compute[74683]: DEBUG nova.compute.manager [req-db68dc1b-d88b-48f6-8267-ce9d1d69df95 req-59179a5c-579f-4da4-9896-46f29b1a601c service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] No waiting events found dispatching network-vif-plugged-8a9e59f4-7708-438f-8411-499c6e38ec1b {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:15:49 user nova-compute[74683]: WARNING nova.compute.manager [req-db68dc1b-d88b-48f6-8267-ce9d1d69df95 req-59179a5c-579f-4da4-9896-46f29b1a601c service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received unexpected event network-vif-plugged-8a9e59f4-7708-438f-8411-499c6e38ec1b for instance with vm_state active and task_state None.
Oct 16 11:15:50 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:53 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a139d9c2-9c6d-4a92-8fb3-341588da1b7a tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Calling os-brick to attach iSCSI Volume {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a139d9c2-9c6d-4a92-8fb3-341588da1b7a tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wFLNUMEY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:15:57 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-a139d9c2-9c6d-4a92-8fb3-341588da1b7a tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:15:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-a139d9c2-9c6d-4a92-8fb3-341588da1b7a tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-a139d9c2-9c6d-4a92-8fb3-341588da1b7a tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:15:57 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-a139d9c2-9c6d-4a92-8fb3-341588da1b7a tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:15:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-a139d9c2-9c6d-4a92-8fb3-341588da1b7a tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-a139d9c2-9c6d-4a92-8fb3-341588da1b7a tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:15:57 user nova-compute[74683]: INFO os_brick.initiator.connectors.iscsi [None req-a139d9c2-9c6d-4a92-8fb3-341588da1b7a tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 11:15:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 -p 172.16.0.220:3260 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c35f2928-a8ae-4088-916e-14b1a48401d6 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Calling os-brick to attach iSCSI Volume {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-c35f2928-a8ae-4088-916e-14b1a48401d6 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fLruHFKd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:15:57 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-c35f2928-a8ae-4088-916e-14b1a48401d6 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:15:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-c35f2928-a8ae-4088-916e-14b1a48401d6 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e9082a-4628-4f26-9b1e-e1722be6b7fd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a139d9c2-9c6d-4a92-8fb3-341588da1b7a tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 11:15:57 user nova-compute[74683]:  {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 -p 172.16.0.220:3260 --interface default --op new {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[62255094-ec69-4c05-b045-a47fd7aa8af8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020] added\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a139d9c2-9c6d-4a92-8fb3-341588da1b7a tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020] added
Oct 16 11:15:57 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-89d409b3-f428-462e-8698-0d52fbfa0c5e tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] Acquiring lock "c8d3f594-1f38-41d3-90aa-3dfba95ce077" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-89d409b3-f428-462e-8698-0d52fbfa0c5e tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] Lock "c8d3f594-1f38-41d3-90aa-3dfba95ce077" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a010c94c-14f4-4222-8223-1db94b02ffbc]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a139d9c2-9c6d-4a92-8fb3-341588da1b7a tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG nova.objects.instance [None req-89d409b3-f428-462e-8698-0d52fbfa0c5e tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] Lazy-loading 'flavor' on Instance uuid c8d3f594-1f38-41d3-90aa-3dfba95ce077 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[0220d3b8-816e-466e-93bd-99ff16cf0aeb]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a139d9c2-9c6d-4a92-8fb3-341588da1b7a tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wFLNUMEY {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:57 user nova-compute[74683]: INFO nova.virt.block_device [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Booting with volume 80b502e7-5d0d-489c-8f84-29551a9e5e0e at /dev/vdc
Oct 16 11:15:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wFLNUMEY" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b6a41b-bec5-4cff-a68e-acd68a433840]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a139d9c2-9c6d-4a92-8fb3-341588da1b7a tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wFLNUMEY'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-89d409b3-f428-462e-8698-0d52fbfa0c5e tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] Lock "c8d3f594-1f38-41d3-90aa-3dfba95ce077" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.087s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2304ed9-d83e-4090-bbf9-32a81bff6b0a]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a139d9c2-9c6d-4a92-8fb3-341588da1b7a tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-126ab16a-2480-4126-a74f-68166e9a632a tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Acquiring lock "81290b55-8c05-4925-b445-d121b1bff1a2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-126ab16a-2480-4126-a74f-68166e9a632a tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Lock "81290b55-8c05-4925-b445-d121b1bff1a2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9376868-2781-4e78-96f2-37ffd1d6304f]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a139d9c2-9c6d-4a92-8fb3-341588da1b7a tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)
Oct 16 11:15:57 user nova-compute[74683]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)
Oct 16 11:15:57 user nova-compute[74683]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)
Oct 16 11:15:57 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a139d9c2-9c6d-4a92-8fb3-341588da1b7a tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)
Oct 16 11:15:57 user nova-compute[74683]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)
Oct 16 11:15:57 user nova-compute[74683]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)
Oct 16 11:15:57 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 -p 172.16.0.220:3260 --login {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG nova.objects.instance [None req-126ab16a-2480-4126-a74f-68166e9a632a tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Lazy-loading 'flavor' on Instance uuid 81290b55-8c05-4925-b445-d121b1bff1a2 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG os_brick.utils [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc51517c-ca85-4a1a-b441-2b3f70e524a8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:70b9d336ab7d\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-126ab16a-2480-4126-a74f-68166e9a632a tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Lock "81290b55-8c05-4925-b445-d121b1bff1a2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[de75e8fc-e5ae-4e3b-9c28-310d82a5773a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3362de-e534-4d21-bd63-c2ffe60c46c5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a139d9c2-9c6d-4a92-8fb3-341588da1b7a tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020, portal: 172.16.0.220,3260]
Oct 16 11:15:57 user nova-compute[74683]: Login to [iface: default, target: iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020, portal: 172.16.0.220,3260] successful.
Oct 16 11:15:57 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.029s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[1873335c-2850-496f-9dfc-5f1d2e04e26f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0857a42-31a3-4184-9154-355e9056eeac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Running cmd (subprocess): nvme version {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] 'nvme version' failed. Not Retrying. {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[50247d09-1029-46b2-b35f-0fb71e673aec]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] nvme not present on system {{(pid=74683) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a139d9c2-9c6d-4a92-8fb3-341588da1b7a tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:15:57 user nova-compute[74683]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 11:15:57 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[7532d1d3-d0f5-49e1-823e-e1d2302d8107]: (4, '') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74683) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] LIGHTOS: no hostnqn found. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG os_brick.utils [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:70b9d336ab7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG nova.virt.block_device [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Updating existing volume attachment record: ca229502-f51a-4201-83f8-5cb227085e94 {{(pid=74683) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0556674-5fa2-4f61-9923-dca2fb0bf81c]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a139d9c2-9c6d-4a92-8fb3-341588da1b7a tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)
Oct 16 11:15:57 user nova-compute[74683]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)
Oct 16 11:15:57 user nova-compute[74683]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)
Oct 16 11:15:57 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:15:57 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a139d9c2-9c6d-4a92-8fb3-341588da1b7a tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)
Oct 16 11:15:57 user nova-compute[74683]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)
Oct 16 11:15:57 user nova-compute[74683]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)
Oct 16 11:15:57 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:15:57 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-a139d9c2-9c6d-4a92-8fb3-341588da1b7a tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.392s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a139d9c2-9c6d-4a92-8fb3-341588da1b7a tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Connected to 172.16.0.220:3260 {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-a139d9c2-9c6d-4a92-8fb3-341588da1b7a tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=74683) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-a139d9c2-9c6d-4a92-8fb3-341588da1b7a tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74683) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-89d409b3-f428-462e-8698-0d52fbfa0c5e tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] Acquiring lock "c8d3f594-1f38-41d3-90aa-3dfba95ce077" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-89d409b3-f428-462e-8698-0d52fbfa0c5e tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] Lock "c8d3f594-1f38-41d3-90aa-3dfba95ce077" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:15:57 user nova-compute[74683]: INFO nova.compute.manager [None req-89d409b3-f428-462e-8698-0d52fbfa0c5e tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Attaching volume 03f18968-f0d6-4c71-8294-125c0bdcc9b6 to /dev/vdb
Oct 16 11:15:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d85ec2f-40e6-4976-82e6-d4f1b5af9eda]: (4, ('- - 0', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-a139d9c2-9c6d-4a92-8fb3-341588da1b7a tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a139d9c2-9c6d-4a92-8fb3-341588da1b7a tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wFLNUMEY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-126ab16a-2480-4126-a74f-68166e9a632a tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Acquiring lock "81290b55-8c05-4925-b445-d121b1bff1a2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:15:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-126ab16a-2480-4126-a74f-68166e9a632a tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Lock "81290b55-8c05-4925-b445-d121b1bff1a2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:15:57 user nova-compute[74683]: INFO nova.compute.manager [None req-126ab16a-2480-4126-a74f-68166e9a632a tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Attaching volume 7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b to /dev/sdc
Oct 16 11:15:58 user nova-compute[74683]: DEBUG os_brick.utils [None req-89d409b3-f428-462e-8698-0d52fbfa0c5e tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:15:58 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:58 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:58 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a648695b-4d72-4d5e-b499-2b8dab342baa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:70b9d336ab7d\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:58 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:58 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:58 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ca0d11-9d1a-44df-b9e2-5b8bcade2d89]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:58 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:58 user nova-compute[74683]: DEBUG os_brick.utils [None req-126ab16a-2480-4126-a74f-68166e9a632a tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:15:58 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:58 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:58 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b704be-c522-4088-8425-9d192e40dbf5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:58 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[58febedd-0d72-4e9e-88f8-a6aae6ed35a0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:58 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-89d409b3-f428-462e-8698-0d52fbfa0c5e tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] Running cmd (subprocess): nvme version {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:58 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-89d409b3-f428-462e-8698-0d52fbfa0c5e tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:15:58 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:58 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b45a5d8-a244-4256-90a3-bccac3af7b9d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:70b9d336ab7d\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:58 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:15:58 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.nvmeof [None req-89d409b3-f428-462e-8698-0d52fbfa0c5e tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] nvme not present on system {{(pid=74683) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 11:15:58 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:58 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:58 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:15:58 user nova-compute[74683]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 11:15:58 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d406f4bd-8de6-4c0d-9418-c01ec569ba62]: (4, '') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:58 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-89d409b3-f428-462e-8698-0d52fbfa0c5e tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74683) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 11:15:58 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-89d409b3-f428-462e-8698-0d52fbfa0c5e tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 11:15:58 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-89d409b3-f428-462e-8698-0d52fbfa0c5e tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] LIGHTOS: no hostnqn found. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 11:15:58 user nova-compute[74683]: DEBUG os_brick.utils [None req-89d409b3-f428-462e-8698-0d52fbfa0c5e tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:70b9d336ab7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:15:58 user nova-compute[74683]: DEBUG nova.virt.block_device [None req-89d409b3-f428-462e-8698-0d52fbfa0c5e tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Updating existing volume attachment record: a079ba75-cb1f-44f0-931e-86cd1c879f12 {{(pid=74683) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 11:15:58 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:58 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb0b448-bf5a-4cd2-b883-48d55b6b181c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:58 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:58 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:58 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5aba41-0fcc-43ba-a3bd-383148e33fe6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:58 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c498f3-fe83-409a-b782-db49fc2016b4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:58 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-126ab16a-2480-4126-a74f-68166e9a632a tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Running cmd (subprocess): nvme version {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:58 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-126ab16a-2480-4126-a74f-68166e9a632a tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] 'nvme version' failed. Not Retrying. {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:15:58 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.nvmeof [None req-126ab16a-2480-4126-a74f-68166e9a632a tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] nvme not present on system {{(pid=74683) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 11:15:58 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:58 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:15:58 user nova-compute[74683]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 11:15:58 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2dffb2-0828-45af-9df3-935272704589]: (4, '') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:58 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-126ab16a-2480-4126-a74f-68166e9a632a tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74683) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 11:15:58 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-126ab16a-2480-4126-a74f-68166e9a632a tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 11:15:58 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-126ab16a-2480-4126-a74f-68166e9a632a tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] LIGHTOS: no hostnqn found. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 11:15:58 user nova-compute[74683]: DEBUG os_brick.utils [None req-126ab16a-2480-4126-a74f-68166e9a632a tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] <== get_connector_properties: return (194ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:70b9d336ab7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:15:58 user nova-compute[74683]: DEBUG nova.virt.block_device [None req-126ab16a-2480-4126-a74f-68166e9a632a tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Updating existing volume attachment record: 3d4f7344-8626-42a3-8212-9ac0dc05b5ee {{(pid=74683) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 11:15:58 user nova-compute[74683]: INFO nova.compute.manager [None req-1b9145e1-577e-4aec-a236-83d58da7dc40 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] [instance: 427b793c-ae47-451c-bbc5-589d6ce1d2bf] Took 16.67 seconds to detach 1 volumes for instance.
Oct 16 11:15:58 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1b9145e1-577e-4aec-a236-83d58da7dc40 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:15:58 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1b9145e1-577e-4aec-a236-83d58da7dc40 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:15:58 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:15:58 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:15:58 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-a139d9c2-9c6d-4a92-8fb3-341588da1b7a tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.434s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:15:58 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a139d9c2-9c6d-4a92-8fb3-341588da1b7a tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] <== connect_volume: return (1435ms) {'type': 'block', 'scsi_wwn': '26236643438323532', 'path': '/dev/sde'} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:15:58 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a139d9c2-9c6d-4a92-8fb3-341588da1b7a tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236643438323532', 'path': '/dev/sde'} {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 11:15:58 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-c35f2928-a8ae-4088-916e-14b1a48401d6 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.430s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:15:58 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-c35f2928-a8ae-4088-916e-14b1a48401d6 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:15:58 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-c35f2928-a8ae-4088-916e-14b1a48401d6 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:15:58 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-c35f2928-a8ae-4088-916e-14b1a48401d6 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:15:58 user nova-compute[74683]: INFO os_brick.initiator.connectors.iscsi [None req-c35f2928-a8ae-4088-916e-14b1a48401d6 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 11:15:58 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f -p 172.16.0.220:3260 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:58 user nova-compute[74683]: DEBUG nova.objects.instance [None req-a139d9c2-9c6d-4a92-8fb3-341588da1b7a tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lazy-loading 'flavor' on Instance uuid bd60be9c-0ff3-40a5-aaab-f31fa88a67f1 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:15:58 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:58 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[70136125-a234-4a3d-b4b4-1f2ce388c62c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:58 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-c35f2928-a8ae-4088-916e-14b1a48401d6 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 11:15:58 user nova-compute[74683]:  {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:15:58 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f -p 172.16.0.220:3260 --interface default --op new {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:58 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-a139d9c2-9c6d-4a92-8fb3-341588da1b7a tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 11:15:58 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:15:58 user nova-compute[74683]:   <source dev="/dev/sde"/>
Oct 16 11:15:58 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:15:58 user nova-compute[74683]:   <serial>77512c13-eaac-4b26-8c71-57564bfca020</serial>
Oct 16 11:15:58 user nova-compute[74683]: </disk>
Oct 16 11:15:58 user nova-compute[74683]:  {{(pid=74683) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 11:15:58 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:58 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7379c6b-b896-445b-ae8e-f773011a8ec8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f] added\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:58 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-c35f2928-a8ae-4088-916e-14b1a48401d6 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f] added
Oct 16 11:15:58 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:15:58 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:59 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-1b9145e1-577e-4aec-a236-83d58da7dc40 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:15:59 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-1b9145e1-577e-4aec-a236-83d58da7dc40 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:15:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:59 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d6922e-c014-44ce-98e0-9fd7d51abcef]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:59 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-c35f2928-a8ae-4088-916e-14b1a48401d6 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:15:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:59 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8eda15-1765-4e72-93a4-8163e460ebde]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:59 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-c35f2928-a8ae-4088-916e-14b1a48401d6 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:15:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fLruHFKd {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:59 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1b9145e1-577e-4aec-a236-83d58da7dc40 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.422s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:15:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fLruHFKd" returned: 0 in 0.024s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:59 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b76415e-74b4-412b-ae38-9256768839d6]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:59 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-c35f2928-a8ae-4088-916e-14b1a48401d6 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fLruHFKd'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:15:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:59 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[600fef3b-4dc6-46bb-81ab-9d0a2e0b5e9b]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:59 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-c35f2928-a8ae-4088-916e-14b1a48401d6 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:15:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:59 user nova-compute[74683]: INFO nova.scheduler.client.report [None req-1b9145e1-577e-4aec-a236-83d58da7dc40 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Deleted allocations for instance 427b793c-ae47-451c-bbc5-589d6ce1d2bf
Oct 16 11:15:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:59 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[97296d44-6881-4812-9ea1-5f74e5a34b9b]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:59 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-c35f2928-a8ae-4088-916e-14b1a48401d6 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)
Oct 16 11:15:59 user nova-compute[74683]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)
Oct 16 11:15:59 user nova-compute[74683]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)
Oct 16 11:15:59 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:15:59 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:15:59 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-c35f2928-a8ae-4088-916e-14b1a48401d6 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)
Oct 16 11:15:59 user nova-compute[74683]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)
Oct 16 11:15:59 user nova-compute[74683]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)
Oct 16 11:15:59 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:15:59 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:15:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f -p 172.16.0.220:3260 --login {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:59 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff5aea9-36df-41a6-b873-9fbaa3fe6724]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:59 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-c35f2928-a8ae-4088-916e-14b1a48401d6 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f, portal: 172.16.0.220,3260]
Oct 16 11:15:59 user nova-compute[74683]: Login to [iface: default, target: iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f, portal: 172.16.0.220,3260] successful.
Oct 16 11:15:59 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:15:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:59 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87f156d-a7c6-41c0-86a7-d7a584c094c3]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:59 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-c35f2928-a8ae-4088-916e-14b1a48401d6 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:15:59 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1b9145e1-577e-4aec-a236-83d58da7dc40 tempest-DeleteServersTestJSON-2005547870 tempest-DeleteServersTestJSON-2005547870-project-member] Lock "427b793c-ae47-451c-bbc5-589d6ce1d2bf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 20.457s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:15:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:59 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[856fd5f6-86ad-4dbd-a80f-58779b0615ab]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:59 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-c35f2928-a8ae-4088-916e-14b1a48401d6 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)
Oct 16 11:15:59 user nova-compute[74683]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)
Oct 16 11:15:59 user nova-compute[74683]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)
Oct 16 11:15:59 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:15:59 user nova-compute[74683]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f (non-flash)
Oct 16 11:15:59 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:15:59 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-c35f2928-a8ae-4088-916e-14b1a48401d6 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)
Oct 16 11:15:59 user nova-compute[74683]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)
Oct 16 11:15:59 user nova-compute[74683]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)
Oct 16 11:15:59 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:15:59 user nova-compute[74683]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f (non-flash)
Oct 16 11:15:59 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:15:59 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-c35f2928-a8ae-4088-916e-14b1a48401d6 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.371s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:15:59 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-c35f2928-a8ae-4088-916e-14b1a48401d6 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Connected to 172.16.0.220:3260 {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 11:15:59 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-c35f2928-a8ae-4088-916e-14b1a48401d6 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=74683) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 11:15:59 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-c35f2928-a8ae-4088-916e-14b1a48401d6 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74683) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 11:15:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:15:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:15:59 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[da010662-60b5-439b-86d9-5bcce8003214]: (4, ('- - 0', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:15:59 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-c35f2928-a8ae-4088-916e-14b1a48401d6 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:15:59 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-c35f2928-a8ae-4088-916e-14b1a48401d6 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fLruHFKd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 11:15:59 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-a139d9c2-9c6d-4a92-8fb3-341588da1b7a tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:15:59 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-a139d9c2-9c6d-4a92-8fb3-341588da1b7a tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:15:59 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-a139d9c2-9c6d-4a92-8fb3-341588da1b7a tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] No VIF found with MAC fa:16:3e:dd:07:47, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:15:59 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:16:00 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-c35f2928-a8ae-4088-916e-14b1a48401d6 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.411s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:16:00 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-c35f2928-a8ae-4088-916e-14b1a48401d6 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] <== connect_volume: return (2841ms) {'type': 'block', 'scsi_wwn': '23232386161626436', 'path': '/dev/sdf'} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:16:00 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c35f2928-a8ae-4088-916e-14b1a48401d6 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23232386161626436', 'path': '/dev/sdf'} {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 11:16:00 user nova-compute[74683]: DEBUG nova.objects.instance [None req-c35f2928-a8ae-4088-916e-14b1a48401d6 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Lazy-loading 'flavor' on Instance uuid fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:16:00 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-c35f2928-a8ae-4088-916e-14b1a48401d6 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 11:16:00 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:16:00 user nova-compute[74683]:   <source dev="/dev/sdf"/>
Oct 16 11:16:00 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:16:00 user nova-compute[74683]:   <serial>0aa00a0e-fa1e-4032-91f6-af020f1e986f</serial>
Oct 16 11:16:00 user nova-compute[74683]: </disk>
Oct 16 11:16:00 user nova-compute[74683]:  {{(pid=74683) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 11:16:00 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:16:00 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Starting heal instance info cache {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 11:16:00 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:00 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-c35f2928-a8ae-4088-916e-14b1a48401d6 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:16:00 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-c35f2928-a8ae-4088-916e-14b1a48401d6 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:16:00 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-c35f2928-a8ae-4088-916e-14b1a48401d6 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] No VIF found with MAC fa:16:3e:5a:7a:f8, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:16:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "refresh_cache-bd60be9c-0ff3-40a5-aaab-f31fa88a67f1" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:16:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquired lock "refresh_cache-bd60be9c-0ff3-40a5-aaab-f31fa88a67f1" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:16:00 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Forcefully refreshing network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 11:16:01 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Updating instance_info_cache with network_info: [{"id": "05cf5b29-bd7b-498d-b3d0-b7de22551793", "address": "fa:16:3e:dd:07:47", "network": {"id": "f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-137528169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c66aa774134aa6a873eabffc28ec07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05cf5b29-bd", "ovs_interfaceid": "05cf5b29-bd7b-498d-b3d0-b7de22551793", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:16:01 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Releasing lock "refresh_cache-bd60be9c-0ff3-40a5-aaab-f31fa88a67f1" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:16:01 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Updated the network info_cache for instance {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 11:16:01 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:16:01 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:16:01 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74683) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 11:16:02 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:16:03 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:03 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:16:03 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:16:03 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:16:03 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:16:03 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:16:03 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Auditing locally available compute resources for user (node: user) {{(pid=74683) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 11:16:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json" returned: 0 in 0.349s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1db5e2-0b25-4d61-9dd3-038811b4eda1/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1db5e2-0b25-4d61-9dd3-038811b4eda1/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1db5e2-0b25-4d61-9dd3-038811b4eda1/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1db5e2-0b25-4d61-9dd3-038811b4eda1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53bce625-6aa9-42df-9cb4-c08958c18a47/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53bce625-6aa9-42df-9cb4-c08958c18a47/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53bce625-6aa9-42df-9cb4-c08958c18a47/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53bce625-6aa9-42df-9cb4-c08958c18a47/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd60be9c-0ff3-40a5-aaab-f31fa88a67f1/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd60be9c-0ff3-40a5-aaab-f31fa88a67f1/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd60be9c-0ff3-40a5-aaab-f31fa88a67f1/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd60be9c-0ff3-40a5-aaab-f31fa88a67f1/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:06 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:16:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d3f594-1f38-41d3-90aa-3dfba95ce077/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d3f594-1f38-41d3-90aa-3dfba95ce077/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d3f594-1f38-41d3-90aa-3dfba95ce077/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d3f594-1f38-41d3-90aa-3dfba95ce077/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81290b55-8c05-4925-b445-d121b1bff1a2/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81290b55-8c05-4925-b445-d121b1bff1a2/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81290b55-8c05-4925-b445-d121b1bff1a2/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:07 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81290b55-8c05-4925-b445-d121b1bff1a2/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:07 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:07 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:07 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:07 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:07 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:16:07 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:16:07 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:16:07 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:16:08 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:16:08 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:16:08 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Hypervisor/Node resource view: name=user free_ram=7729MB free_disk=25.470233917236328GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74683) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 11:16:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:16:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:16:08 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:08 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 18a77385-fab9-4ea0-8aa6-666cf7e798a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:16:08 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance bd60be9c-0ff3-40a5-aaab-f31fa88a67f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:16:08 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance f192d1ec-311d-4a30-9766-361b27a8dae8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:16:08 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 2f1db5e2-0b25-4d61-9dd3-038811b4eda1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:16:08 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:16:08 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 81290b55-8c05-4925-b445-d121b1bff1a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:16:08 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance c8d3f594-1f38-41d3-90aa-3dfba95ce077 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:16:08 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 9df7866f-28e9-46d0-9f35-24484adfffd7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:16:08 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 53bce625-6aa9-42df-9cb4-c08958c18a47 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:16:08 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance d944f646-4c4d-4712-8dfe-9b1f0ff60683 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:16:08 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 11:16:08 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 11:16:08 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:16:08 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:16:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Acquiring lock "d5e55361-d9ed-4d07-91b0-ec4d08b2e817" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:16:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "d5e55361-d9ed-4d07-91b0-ec4d08b2e817" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:16:08 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Compute_service record updated for user:user {{(pid=74683) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 11:16:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.533s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:16:08 user nova-compute[74683]: DEBUG nova.compute.manager [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Starting instance... {{(pid=74683) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 11:16:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:16:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:16:08 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74683) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 11:16:08 user nova-compute[74683]: INFO nova.compute.claims [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Claim successful on node user
Oct 16 11:16:09 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:16:09 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:16:09 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.475s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:16:09 user nova-compute[74683]: DEBUG nova.compute.manager [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Start building networks asynchronously for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 11:16:09 user nova-compute[74683]: DEBUG nova.compute.manager [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Allocating IP information in the background. {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 11:16:09 user nova-compute[74683]: DEBUG nova.network.neutron [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] allocate_for_instance() {{(pid=74683) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 11:16:09 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 11:16:09 user nova-compute[74683]: DEBUG nova.compute.manager [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Start building block device mappings for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 11:16:09 user nova-compute[74683]: INFO nova.virt.block_device [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Booting with blank volume at /dev/vda
Oct 16 11:16:09 user nova-compute[74683]: DEBUG nova.policy [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '76a41804541e4a259771702727d9993e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6e0046017b4bba85caf2a39d1c67b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74683) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 11:16:10 user nova-compute[74683]: DEBUG nova.network.neutron [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Successfully created port: ade44b63-49bb-4dbc-b0f9-95156f4fd6db {{(pid=74683) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 11:16:10 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:10 user nova-compute[74683]: DEBUG nova.network.neutron [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Successfully updated port: ade44b63-49bb-4dbc-b0f9-95156f4fd6db {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:16:10 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Acquiring lock "refresh_cache-d5e55361-d9ed-4d07-91b0-ec4d08b2e817" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:16:10 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Acquired lock "refresh_cache-d5e55361-d9ed-4d07-91b0-ec4d08b2e817" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:16:10 user nova-compute[74683]: DEBUG nova.network.neutron [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:16:10 user nova-compute[74683]: DEBUG nova.compute.manager [req-06a90f8a-2b9f-4727-be60-fee4ad50bde6 req-337b4c38-f62b-41ee-8765-8d72c10d0bbd service nova] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Received event network-changed-ade44b63-49bb-4dbc-b0f9-95156f4fd6db {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:16:10 user nova-compute[74683]: DEBUG nova.compute.manager [req-06a90f8a-2b9f-4727-be60-fee4ad50bde6 req-337b4c38-f62b-41ee-8765-8d72c10d0bbd service nova] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Refreshing instance network info cache due to event network-changed-ade44b63-49bb-4dbc-b0f9-95156f4fd6db. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:16:10 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-06a90f8a-2b9f-4727-be60-fee4ad50bde6 req-337b4c38-f62b-41ee-8765-8d72c10d0bbd service nova] Acquiring lock "refresh_cache-d5e55361-d9ed-4d07-91b0-ec4d08b2e817" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:16:10 user nova-compute[74683]: DEBUG nova.network.neutron [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:16:11 user nova-compute[74683]: DEBUG nova.network.neutron [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Updating instance_info_cache with network_info: [{"id": "ade44b63-49bb-4dbc-b0f9-95156f4fd6db", "address": "fa:16:3e:ad:0a:5c", "network": {"id": "4d43cc12-d2cd-4552-90a4-884a0ff3dc66", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-825513246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6e0046017b4bba85caf2a39d1c67b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade44b63-49", "ovs_interfaceid": "ade44b63-49bb-4dbc-b0f9-95156f4fd6db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:16:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Releasing lock "refresh_cache-d5e55361-d9ed-4d07-91b0-ec4d08b2e817" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:16:11 user nova-compute[74683]: DEBUG nova.compute.manager [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Instance network_info: |[{"id": "ade44b63-49bb-4dbc-b0f9-95156f4fd6db", "address": "fa:16:3e:ad:0a:5c", "network": {"id": "4d43cc12-d2cd-4552-90a4-884a0ff3dc66", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-825513246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6e0046017b4bba85caf2a39d1c67b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade44b63-49", "ovs_interfaceid": "ade44b63-49bb-4dbc-b0f9-95156f4fd6db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 11:16:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-06a90f8a-2b9f-4727-be60-fee4ad50bde6 req-337b4c38-f62b-41ee-8765-8d72c10d0bbd service nova] Acquired lock "refresh_cache-d5e55361-d9ed-4d07-91b0-ec4d08b2e817" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:16:11 user nova-compute[74683]: DEBUG nova.network.neutron [req-06a90f8a-2b9f-4727-be60-fee4ad50bde6 req-337b4c38-f62b-41ee-8765-8d72c10d0bbd service nova] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Refreshing network info cache for port ade44b63-49bb-4dbc-b0f9-95156f4fd6db {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:16:11 user nova-compute[74683]: DEBUG nova.network.neutron [req-06a90f8a-2b9f-4727-be60-fee4ad50bde6 req-337b4c38-f62b-41ee-8765-8d72c10d0bbd service nova] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Updated VIF entry in instance network info cache for port ade44b63-49bb-4dbc-b0f9-95156f4fd6db. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:16:11 user nova-compute[74683]: DEBUG nova.network.neutron [req-06a90f8a-2b9f-4727-be60-fee4ad50bde6 req-337b4c38-f62b-41ee-8765-8d72c10d0bbd service nova] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Updating instance_info_cache with network_info: [{"id": "ade44b63-49bb-4dbc-b0f9-95156f4fd6db", "address": "fa:16:3e:ad:0a:5c", "network": {"id": "4d43cc12-d2cd-4552-90a4-884a0ff3dc66", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-825513246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6e0046017b4bba85caf2a39d1c67b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade44b63-49", "ovs_interfaceid": "ade44b63-49bb-4dbc-b0f9-95156f4fd6db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:16:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-06a90f8a-2b9f-4727-be60-fee4ad50bde6 req-337b4c38-f62b-41ee-8765-8d72c10d0bbd service nova] Releasing lock "refresh_cache-d5e55361-d9ed-4d07-91b0-ec4d08b2e817" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:16:13 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:15 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:17 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89d409b3-f428-462e-8698-0d52fbfa0c5e tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Calling os-brick to attach iSCSI Volume {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 11:16:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d409b3-f428-462e-8698-0d52fbfa0c5e tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sWufdTqP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:16:17 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-89d409b3-f428-462e-8698-0d52fbfa0c5e tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:16:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-89d409b3-f428-462e-8698-0d52fbfa0c5e tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:16:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-89d409b3-f428-462e-8698-0d52fbfa0c5e tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:16:17 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-89d409b3-f428-462e-8698-0d52fbfa0c5e tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:16:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-89d409b3-f428-462e-8698-0d52fbfa0c5e tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:16:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-89d409b3-f428-462e-8698-0d52fbfa0c5e tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:16:17 user nova-compute[74683]: INFO os_brick.initiator.connectors.iscsi [None req-89d409b3-f428-462e-8698-0d52fbfa0c5e tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 11:16:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6 -p 172.16.0.220:3260 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:17 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb8a6e6-9b86-47d1-b9c3-79b9ecb66be3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d409b3-f428-462e-8698-0d52fbfa0c5e tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 11:16:17 user nova-compute[74683]:  {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:16:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:17 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9e0a17-744b-4edb-a9b5-ef1fe0c999b7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6] added\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d409b3-f428-462e-8698-0d52fbfa0c5e tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6] added
Oct 16 11:16:17 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:16:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:17 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3acf3b3-d0c7-49ea-8aba-9cb55f799de2]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d409b3-f428-462e-8698-0d52fbfa0c5e tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:16:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:17 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef8845e-10ab-427e-9304-17f6e68cdd53]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d409b3-f428-462e-8698-0d52fbfa0c5e tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:16:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sWufdTqP {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sWufdTqP" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:17 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff6d12b-5a94-4b2d-8ad3-fd6ae77134f7]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d409b3-f428-462e-8698-0d52fbfa0c5e tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sWufdTqP'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:16:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:17 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[2981b706-1813-4683-9238-52375f10d912]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d409b3-f428-462e-8698-0d52fbfa0c5e tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:16:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:17 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb2e045-4b8b-4304-a628-10b3ce47703a]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d409b3-f428-462e-8698-0d52fbfa0c5e tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)
Oct 16 11:16:17 user nova-compute[74683]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)
Oct 16 11:16:17 user nova-compute[74683]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)
Oct 16 11:16:17 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:16:17 user nova-compute[74683]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f (non-flash)
Oct 16 11:16:17 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:16:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d409b3-f428-462e-8698-0d52fbfa0c5e tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)
Oct 16 11:16:17 user nova-compute[74683]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)
Oct 16 11:16:17 user nova-compute[74683]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)
Oct 16 11:16:17 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:16:17 user nova-compute[74683]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f (non-flash)
Oct 16 11:16:17 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:16:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6 -p 172.16.0.220:3260 --login {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:17 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3cd536-0cb1-4544-92a4-a205277e1553]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d409b3-f428-462e-8698-0d52fbfa0c5e tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6, portal: 172.16.0.220,3260]
Oct 16 11:16:17 user nova-compute[74683]: Login to [iface: default, target: iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6, portal: 172.16.0.220,3260] successful.
Oct 16 11:16:17 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:16:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.091s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:17 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[57bd687f-6637-4a30-8f0d-0b426fc2dadb]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d409b3-f428-462e-8698-0d52fbfa0c5e tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:16:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:17 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2a3505-15ea-4793-85a9-64d0256eb4e1]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d409b3-f428-462e-8698-0d52fbfa0c5e tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)
Oct 16 11:16:17 user nova-compute[74683]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)
Oct 16 11:16:17 user nova-compute[74683]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)
Oct 16 11:16:17 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:16:17 user nova-compute[74683]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f (non-flash)
Oct 16 11:16:17 user nova-compute[74683]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6 (non-flash)
Oct 16 11:16:17 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:16:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d409b3-f428-462e-8698-0d52fbfa0c5e tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)
Oct 16 11:16:17 user nova-compute[74683]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)
Oct 16 11:16:17 user nova-compute[74683]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)
Oct 16 11:16:17 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:16:17 user nova-compute[74683]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f (non-flash)
Oct 16 11:16:17 user nova-compute[74683]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6 (non-flash)
Oct 16 11:16:17 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:16:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-89d409b3-f428-462e-8698-0d52fbfa0c5e tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.383s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:16:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d409b3-f428-462e-8698-0d52fbfa0c5e tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] Connected to 172.16.0.220:3260 {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 11:16:17 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-89d409b3-f428-462e-8698-0d52fbfa0c5e tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=74683) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 11:16:17 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-89d409b3-f428-462e-8698-0d52fbfa0c5e tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] Scanning host 38 c: -, t: -, l: 0) {{(pid=74683) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 11:16:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.025s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:17 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[51263a3b-3982-4519-be96-7a282af49f52]: (4, ('- - 0', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:17 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-89d409b3-f428-462e-8698-0d52fbfa0c5e tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:16:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d409b3-f428-462e-8698-0d52fbfa0c5e tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sWufdTqP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 11:16:17 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-a139d9c2-9c6d-4a92-8fb3-341588da1b7a tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "bd60be9c-0ff3-40a5-aaab-f31fa88a67f1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 57.615s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:16:17 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-c35f2928-a8ae-4088-916e-14b1a48401d6 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Lock "fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 39.841s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:16:18 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:18 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-126ab16a-2480-4126-a74f-68166e9a632a tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Calling os-brick to attach iSCSI Volume {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 11:16:18 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-126ab16a-2480-4126-a74f-68166e9a632a tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oZsHXTpk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:16:18 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-126ab16a-2480-4126-a74f-68166e9a632a tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:16:18 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-126ab16a-2480-4126-a74f-68166e9a632a tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:16:18 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:18 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-89d409b3-f428-462e-8698-0d52fbfa0c5e tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.428s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:16:18 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d409b3-f428-462e-8698-0d52fbfa0c5e tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] <== connect_volume: return (1430ms) {'type': 'block', 'scsi_wwn': '23966613864346661', 'path': '/dev/sdg'} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:16:18 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89d409b3-f428-462e-8698-0d52fbfa0c5e tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966613864346661', 'path': '/dev/sdg'} {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 11:16:18 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-126ab16a-2480-4126-a74f-68166e9a632a tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.550s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:16:18 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-126ab16a-2480-4126-a74f-68166e9a632a tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:16:18 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-126ab16a-2480-4126-a74f-68166e9a632a tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:16:18 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-126ab16a-2480-4126-a74f-68166e9a632a tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:16:18 user nova-compute[74683]: INFO os_brick.initiator.connectors.iscsi [None req-126ab16a-2480-4126-a74f-68166e9a632a tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 11:16:18 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b -p 172.16.0.220:3260 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:18 user nova-compute[74683]: DEBUG nova.objects.instance [None req-89d409b3-f428-462e-8698-0d52fbfa0c5e tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] Lazy-loading 'flavor' on Instance uuid c8d3f594-1f38-41d3-90aa-3dfba95ce077 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:16:18 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:18 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc5df74-9bf8-4ed4-875b-1e68b0fe3324]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:18 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-126ab16a-2480-4126-a74f-68166e9a632a tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 11:16:18 user nova-compute[74683]:  {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:16:18 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-89d409b3-f428-462e-8698-0d52fbfa0c5e tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] attach device xml: <disk type="block" device="disk">
Oct 16 11:16:18 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:16:18 user nova-compute[74683]:   <source dev="/dev/sdg"/>
Oct 16 11:16:18 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:16:18 user nova-compute[74683]:   <serial>03f18968-f0d6-4c71-8294-125c0bdcc9b6</serial>
Oct 16 11:16:18 user nova-compute[74683]: </disk>
Oct 16 11:16:18 user nova-compute[74683]:  {{(pid=74683) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 11:16:18 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b -p 172.16.0.220:3260 --interface default --op new {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:18 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:18 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f3d6fb-abad-407d-a27d-d41da9bd0b91]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b] added\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:18 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-126ab16a-2480-4126-a74f-68166e9a632a tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b] added
Oct 16 11:16:18 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:16:18 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.040s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:19 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3618908-6952-4e68-90b8-2d4f2a1dc5d1]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:19 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-126ab16a-2480-4126-a74f-68166e9a632a tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:16:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:19 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf8e7a6-190f-427a-8160-d60fcd45fbeb]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:19 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-126ab16a-2480-4126-a74f-68166e9a632a tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:16:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oZsHXTpk {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oZsHXTpk" returned: 0 in 0.025s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:19 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa1e86b-93d5-4561-8bd9-4b4b1539ed35]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:19 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-126ab16a-2480-4126-a74f-68166e9a632a tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oZsHXTpk'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:16:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:19 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[156e65b1-41e8-4151-81e8-5c92fbd0402a]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:19 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-126ab16a-2480-4126-a74f-68166e9a632a tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:16:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:19 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a839787c-7574-4983-aefe-17e70a2dcf47]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:19 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-126ab16a-2480-4126-a74f-68166e9a632a tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)
Oct 16 11:16:19 user nova-compute[74683]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)
Oct 16 11:16:19 user nova-compute[74683]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)
Oct 16 11:16:19 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:16:19 user nova-compute[74683]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f (non-flash)
Oct 16 11:16:19 user nova-compute[74683]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6 (non-flash)
Oct 16 11:16:19 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:16:19 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-126ab16a-2480-4126-a74f-68166e9a632a tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)
Oct 16 11:16:19 user nova-compute[74683]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)
Oct 16 11:16:19 user nova-compute[74683]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)
Oct 16 11:16:19 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:16:19 user nova-compute[74683]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f (non-flash)
Oct 16 11:16:19 user nova-compute[74683]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6 (non-flash)
Oct 16 11:16:19 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:16:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b -p 172.16.0.220:3260 --login {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:19 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[b815de82-2ecf-49f3-bc71-5e7fe994839c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:19 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-126ab16a-2480-4126-a74f-68166e9a632a tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b, portal: 172.16.0.220,3260]
Oct 16 11:16:19 user nova-compute[74683]: Login to [iface: default, target: iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b, portal: 172.16.0.220,3260] successful.
Oct 16 11:16:19 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:16:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:19 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a1c925-653c-49f7-814c-8e1fca9f7838]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:19 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-126ab16a-2480-4126-a74f-68166e9a632a tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:16:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:19 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f582af2b-3413-4d2b-9f8e-9efefdb98e1c]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:19 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-126ab16a-2480-4126-a74f-68166e9a632a tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)
Oct 16 11:16:19 user nova-compute[74683]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)
Oct 16 11:16:19 user nova-compute[74683]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)
Oct 16 11:16:19 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:16:19 user nova-compute[74683]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f (non-flash)
Oct 16 11:16:19 user nova-compute[74683]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6 (non-flash)
Oct 16 11:16:19 user nova-compute[74683]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b (non-flash)
Oct 16 11:16:19 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:16:19 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-126ab16a-2480-4126-a74f-68166e9a632a tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)
Oct 16 11:16:19 user nova-compute[74683]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)
Oct 16 11:16:19 user nova-compute[74683]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)
Oct 16 11:16:19 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:16:19 user nova-compute[74683]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f (non-flash)
Oct 16 11:16:19 user nova-compute[74683]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6 (non-flash)
Oct 16 11:16:19 user nova-compute[74683]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b (non-flash)
Oct 16 11:16:19 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:16:19 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-126ab16a-2480-4126-a74f-68166e9a632a tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.419s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:16:19 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-126ab16a-2480-4126-a74f-68166e9a632a tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Connected to 172.16.0.220:3260 {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 11:16:19 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-126ab16a-2480-4126-a74f-68166e9a632a tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=74683) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 11:16:19 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-126ab16a-2480-4126-a74f-68166e9a632a tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74683) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 11:16:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:19 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[231162e5-5943-41ce-85dc-58093a59248e]: (4, ('- - 0', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:19 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-126ab16a-2480-4126-a74f-68166e9a632a tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:16:19 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-126ab16a-2480-4126-a74f-68166e9a632a tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oZsHXTpk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 11:16:19 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-89d409b3-f428-462e-8698-0d52fbfa0c5e tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:16:19 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-89d409b3-f428-462e-8698-0d52fbfa0c5e tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:16:19 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-89d409b3-f428-462e-8698-0d52fbfa0c5e tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] No VIF found with MAC fa:16:3e:bf:fd:e3, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:16:19 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-89d409b3-f428-462e-8698-0d52fbfa0c5e tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] Lock "c8d3f594-1f38-41d3-90aa-3dfba95ce077" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.711s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:16:19 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1dc04ab5-59fb-4d1e-b28d-8e3048a75621 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Acquiring lock "fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:16:19 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1dc04ab5-59fb-4d1e-b28d-8e3048a75621 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Lock "fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:16:19 user nova-compute[74683]: INFO nova.compute.manager [None req-1dc04ab5-59fb-4d1e-b28d-8e3048a75621 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Detaching volume 0aa00a0e-fa1e-4032-91f6-af020f1e986f
Oct 16 11:16:19 user nova-compute[74683]: INFO nova.virt.block_device [None req-1dc04ab5-59fb-4d1e-b28d-8e3048a75621 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Attempting to driver detach volume 0aa00a0e-fa1e-4032-91f6-af020f1e986f from mountpoint /dev/vdb
Oct 16 11:16:19 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-1dc04ab5-59fb-4d1e-b28d-8e3048a75621 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Attempting to detach device vdb from instance fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7 from the persistent domain config. {{(pid=74683) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 11:16:19 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-1dc04ab5-59fb-4d1e-b28d-8e3048a75621 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 11:16:19 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:16:19 user nova-compute[74683]:   <source dev="/dev/sdf"/>
Oct 16 11:16:19 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:16:19 user nova-compute[74683]:   <serial>0aa00a0e-fa1e-4032-91f6-af020f1e986f</serial>
Oct 16 11:16:19 user nova-compute[74683]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 11:16:19 user nova-compute[74683]: </disk>
Oct 16 11:16:19 user nova-compute[74683]:  {{(pid=74683) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 11:16:19 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-1dc04ab5-59fb-4d1e-b28d-8e3048a75621 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Successfully detached device vdb from instance fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7 from the persistent domain config.
Oct 16 11:16:19 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-1dc04ab5-59fb-4d1e-b28d-8e3048a75621 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7 from the live domain config. {{(pid=74683) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 11:16:19 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-1dc04ab5-59fb-4d1e-b28d-8e3048a75621 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 11:16:19 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:16:19 user nova-compute[74683]:   <source dev="/dev/sdf"/>
Oct 16 11:16:19 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:16:19 user nova-compute[74683]:   <serial>0aa00a0e-fa1e-4032-91f6-af020f1e986f</serial>
Oct 16 11:16:19 user nova-compute[74683]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 11:16:19 user nova-compute[74683]: </disk>
Oct 16 11:16:19 user nova-compute[74683]:  {{(pid=74683) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 11:16:20 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-1dc04ab5-59fb-4d1e-b28d-8e3048a75621 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7 {{(pid=74683) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 11:16:20 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-809fdfe2-6960-4ed1-bd8b-ab2158ac7ebc tempest-VolumesAssistedSnapshotsTest-1005996370 tempest-VolumesAssistedSnapshotsTest-1005996370-project] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] volume_snapshot_create: create_info: {'snapshot_id': 'ac27788a-380e-4822-8166-da4e9d87b9cc', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74683) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Oct 16 11:16:20 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-809fdfe2-6960-4ed1-bd8b-ab2158ac7ebc tempest-VolumesAssistedSnapshotsTest-1005996370 tempest-VolumesAssistedSnapshotsTest-1005996370-project] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] snap xml: <domainsnapshot>
Oct 16 11:16:20 user nova-compute[74683]:   <disks>
Oct 16 11:16:20 user nova-compute[74683]:     <disk name="/dev/sdg" snapshot="external" type="file">
Oct 16 11:16:20 user nova-compute[74683]:       <source file="/dev/new_file"/>
Oct 16 11:16:20 user nova-compute[74683]:     </disk>
Oct 16 11:16:20 user nova-compute[74683]:     <disk name="vda" snapshot="no"/>
Oct 16 11:16:20 user nova-compute[74683]:   </disks>
Oct 16 11:16:20 user nova-compute[74683]: </domainsnapshot>
Oct 16 11:16:20 user nova-compute[74683]:  {{(pid=74683) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Oct 16 11:16:20 user nova-compute[74683]: DEBUG nova.objects.instance [None req-809fdfe2-6960-4ed1-bd8b-ab2158ac7ebc tempest-VolumesAssistedSnapshotsTest-1005996370 tempest-VolumesAssistedSnapshotsTest-1005996370-project] Lazy-loading 'system_metadata' on Instance uuid c8d3f594-1f38-41d3-90aa-3dfba95ce077 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:16:20 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-126ab16a-2480-4126-a74f-68166e9a632a tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.471s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:16:20 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-126ab16a-2480-4126-a74f-68166e9a632a tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] <== connect_volume: return (2022ms) {'type': 'block', 'scsi_wwn': '23934636239373663', 'path': '/dev/sdh'} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:16:20 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-126ab16a-2480-4126-a74f-68166e9a632a tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934636239373663', 'path': '/dev/sdh'} {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 11:16:20 user nova-compute[74683]: DEBUG nova.objects.instance [None req-126ab16a-2480-4126-a74f-68166e9a632a tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Lazy-loading 'flavor' on Instance uuid 81290b55-8c05-4925-b445-d121b1bff1a2 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:16:20 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-126ab16a-2480-4126-a74f-68166e9a632a tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 11:16:20 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:16:20 user nova-compute[74683]:   <source dev="/dev/sdh"/>
Oct 16 11:16:20 user nova-compute[74683]:   <target dev="sdc" bus="scsi"/>
Oct 16 11:16:20 user nova-compute[74683]:   <serial>7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b</serial>
Oct 16 11:16:20 user nova-compute[74683]:   <address type="drive" controller="0" unit="2"/>
Oct 16 11:16:20 user nova-compute[74683]: </disk>
Oct 16 11:16:20 user nova-compute[74683]:  {{(pid=74683) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 11:16:20 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-809fdfe2-6960-4ed1-bd8b-ab2158ac7ebc tempest-VolumesAssistedSnapshotsTest-1005996370 tempest-VolumesAssistedSnapshotsTest-1005996370-project] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 16 11:16:20 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-3b8a4a53-de6d-44c7-9e6e-0bc104cea40c tempest-VolumesAssistedSnapshotsTest-1005996370 tempest-VolumesAssistedSnapshotsTest-1005996370-project] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] volume_snapshot_delete: delete_info: {'volume_id': '03f18968-f0d6-4c71-8294-125c0bdcc9b6'} {{(pid=74683) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver [None req-3b8a4a53-de6d-44c7-9e6e-0bc104cea40c tempest-VolumesAssistedSnapshotsTest-1005996370 tempest-VolumesAssistedSnapshotsTest-1005996370-project] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Traceback (most recent call last):
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077]     self._volume_snapshot_delete(context, instance, volume_id,
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077]     if delete_info['type'] != 'qcow2':
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] KeyError: 'type'
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] 
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver [None req-809fdfe2-6960-4ed1-bd8b-ab2158ac7ebc tempest-VolumesAssistedSnapshotsTest-1005996370 tempest-VolumesAssistedSnapshotsTest-1005996370-project] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Traceback (most recent call last):
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077]     rv = execute(f, *args, **kwargs)
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077]     six.reraise(c, e, tb)
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077]     raise value
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077]     rv = meth(*args, **kwargs)
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] 
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver [None req-809fdfe2-6960-4ed1-bd8b-ab2158ac7ebc tempest-VolumesAssistedSnapshotsTest-1005996370 tempest-VolumesAssistedSnapshotsTest-1005996370-project] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Traceback (most recent call last):
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077]     self._volume_snapshot_create(context, instance, guest,
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077]     rv = execute(f, *args, **kwargs)
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077]     six.reraise(c, e, tb)
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077]     raise value
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077]     rv = meth(*args, **kwargs)
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] 
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver [None req-3b8a4a53-de6d-44c7-9e6e-0bc104cea40c tempest-VolumesAssistedSnapshotsTest-1005996370 tempest-VolumesAssistedSnapshotsTest-1005996370-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver 
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver 
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-b1b2fe8b-30bc-4301-8647-231e2cb4bc92)
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver 
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver 
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver 
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver [None req-809fdfe2-6960-4ed1-bd8b-ab2158ac7ebc tempest-VolumesAssistedSnapshotsTest-1005996370 tempest-VolumesAssistedSnapshotsTest-1005996370-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot ac27788a-380e-4822-8166-da4e9d87b9cc could not be found.
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver     raise value
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver 
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver 
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot ac27788a-380e-4822-8166-da4e9d87b9cc could not be found. (HTTP 404) (Request-ID: req-a5e36686-b53a-45a4-83d7-2ca26ca6e8af)
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver 
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver 
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot ac27788a-380e-4822-8166-da4e9d87b9cc could not be found.
Oct 16 11:16:20 user nova-compute[74683]: ERROR nova.virt.libvirt.driver 
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server [None req-3b8a4a53-de6d-44c7-9e6e-0bc104cea40c tempest-VolumesAssistedSnapshotsTest-1005996370 tempest-VolumesAssistedSnapshotsTest-1005996370-project] Exception during message handling: KeyError: 'type'
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4516, in volume_snapshot_delete
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server 
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server [None req-809fdfe2-6960-4ed1-bd8b-ab2158ac7ebc tempest-VolumesAssistedSnapshotsTest-1005996370 tempest-VolumesAssistedSnapshotsTest-1005996370-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4504, in volume_snapshot_create
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     raise value
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 16 11:16:20 user nova-compute[74683]: ERROR oslo_messaging.rpc.server 
Oct 16 11:16:20 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:20 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-50a07209-c46d-40e5-a0ae-2b656b1ab165 tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] Acquiring lock "c8d3f594-1f38-41d3-90aa-3dfba95ce077" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:16:20 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-50a07209-c46d-40e5-a0ae-2b656b1ab165 tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] Lock "c8d3f594-1f38-41d3-90aa-3dfba95ce077" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:16:20 user nova-compute[74683]: INFO nova.compute.manager [None req-50a07209-c46d-40e5-a0ae-2b656b1ab165 tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Detaching volume 03f18968-f0d6-4c71-8294-125c0bdcc9b6
Oct 16 11:16:20 user nova-compute[74683]: INFO nova.virt.block_device [None req-50a07209-c46d-40e5-a0ae-2b656b1ab165 tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Attempting to driver detach volume 03f18968-f0d6-4c71-8294-125c0bdcc9b6 from mountpoint /dev/vdb
Oct 16 11:16:20 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-126ab16a-2480-4126-a74f-68166e9a632a tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] No BDM found with device name sda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:16:20 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-126ab16a-2480-4126-a74f-68166e9a632a tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:16:20 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-126ab16a-2480-4126-a74f-68166e9a632a tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:16:20 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-126ab16a-2480-4126-a74f-68166e9a632a tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] No VIF found with MAC fa:16:3e:f3:60:b8, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:16:20 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-50a07209-c46d-40e5-a0ae-2b656b1ab165 tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] Attempting to detach device vdb from instance c8d3f594-1f38-41d3-90aa-3dfba95ce077 from the persistent domain config. {{(pid=74683) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 11:16:20 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-50a07209-c46d-40e5-a0ae-2b656b1ab165 tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] detach device xml: <disk type="block" device="disk">
Oct 16 11:16:20 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:16:20 user nova-compute[74683]:   <source dev="/dev/sdg"/>
Oct 16 11:16:20 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:16:20 user nova-compute[74683]:   <serial>03f18968-f0d6-4c71-8294-125c0bdcc9b6</serial>
Oct 16 11:16:20 user nova-compute[74683]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 11:16:20 user nova-compute[74683]: </disk>
Oct 16 11:16:20 user nova-compute[74683]:  {{(pid=74683) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 11:16:20 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-50a07209-c46d-40e5-a0ae-2b656b1ab165 tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] Successfully detached device vdb from instance c8d3f594-1f38-41d3-90aa-3dfba95ce077 from the persistent domain config.
Oct 16 11:16:20 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-50a07209-c46d-40e5-a0ae-2b656b1ab165 tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c8d3f594-1f38-41d3-90aa-3dfba95ce077 from the live domain config. {{(pid=74683) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 11:16:20 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-50a07209-c46d-40e5-a0ae-2b656b1ab165 tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] detach device xml: <disk type="block" device="disk">
Oct 16 11:16:20 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:16:20 user nova-compute[74683]:   <source dev="/dev/sdg"/>
Oct 16 11:16:20 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:16:20 user nova-compute[74683]:   <serial>03f18968-f0d6-4c71-8294-125c0bdcc9b6</serial>
Oct 16 11:16:20 user nova-compute[74683]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 11:16:20 user nova-compute[74683]: </disk>
Oct 16 11:16:20 user nova-compute[74683]:  {{(pid=74683) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 11:16:21 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-126ab16a-2480-4126-a74f-68166e9a632a tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Lock "81290b55-8c05-4925-b445-d121b1bff1a2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.150s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:16:21 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-50a07209-c46d-40e5-a0ae-2b656b1ab165 tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c8d3f594-1f38-41d3-90aa-3dfba95ce077 {{(pid=74683) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 11:16:21 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Acquiring lock "5951e708-5667-4ff0-871b-34845bb20f7c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:16:21 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "5951e708-5667-4ff0-871b-34845bb20f7c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:16:21 user nova-compute[74683]: DEBUG nova.compute.manager [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] Starting instance... {{(pid=74683) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 11:16:21 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:16:21 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:16:21 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74683) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 11:16:21 user nova-compute[74683]: INFO nova.compute.claims [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] Claim successful on node user
Oct 16 11:16:22 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:16:22 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:16:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.473s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:16:22 user nova-compute[74683]: DEBUG nova.compute.manager [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] Start building networks asynchronously for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 11:16:22 user nova-compute[74683]: DEBUG nova.compute.manager [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] Allocating IP information in the background. {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 11:16:22 user nova-compute[74683]: DEBUG nova.network.neutron [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] allocate_for_instance() {{(pid=74683) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 11:16:22 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 11:16:22 user nova-compute[74683]: DEBUG nova.compute.manager [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] Start building block device mappings for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 11:16:22 user nova-compute[74683]: DEBUG nova.policy [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cdc203c025d84efe86e25cfdf75107b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c66aa774134aa6a873eabffc28ec07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74683) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 11:16:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-c5b1bc67-596e-44ff-b2f4-7b13ce9a5d73 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Acquiring lock "81290b55-8c05-4925-b445-d121b1bff1a2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:16:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-c5b1bc67-596e-44ff-b2f4-7b13ce9a5d73 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Lock "81290b55-8c05-4925-b445-d121b1bff1a2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:16:22 user nova-compute[74683]: INFO nova.compute.manager [None req-c5b1bc67-596e-44ff-b2f4-7b13ce9a5d73 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Detaching volume 7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b
Oct 16 11:16:22 user nova-compute[74683]: DEBUG nova.compute.manager [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] Start spawning the instance on the hypervisor. {{(pid=74683) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 11:16:22 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] Creating instance directory {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 11:16:22 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] Creating image(s)
Oct 16 11:16:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Acquiring lock "/opt/stack/data/nova/instances/5951e708-5667-4ff0-871b-34845bb20f7c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:16:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "/opt/stack/data/nova/instances/5951e708-5667-4ff0-871b-34845bb20f7c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:16:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "/opt/stack/data/nova/instances/5951e708-5667-4ff0-871b-34845bb20f7c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:16:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:22 user nova-compute[74683]: INFO nova.virt.block_device [None req-c5b1bc67-596e-44ff-b2f4-7b13ce9a5d73 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Attempting to driver detach volume 7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b from mountpoint /dev/sdc
Oct 16 11:16:22 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-c5b1bc67-596e-44ff-b2f4-7b13ce9a5d73 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Attempting to detach device sdc from instance 81290b55-8c05-4925-b445-d121b1bff1a2 from the persistent domain config. {{(pid=74683) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 11:16:22 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-c5b1bc67-596e-44ff-b2f4-7b13ce9a5d73 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 11:16:22 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:16:22 user nova-compute[74683]:   <source dev="/dev/sdh"/>
Oct 16 11:16:22 user nova-compute[74683]:   <target dev="sdc" bus="scsi"/>
Oct 16 11:16:22 user nova-compute[74683]:   <serial>7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b</serial>
Oct 16 11:16:22 user nova-compute[74683]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 16 11:16:22 user nova-compute[74683]: </disk>
Oct 16 11:16:22 user nova-compute[74683]:  {{(pid=74683) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 11:16:22 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-c5b1bc67-596e-44ff-b2f4-7b13ce9a5d73 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Successfully detached device sdc from instance 81290b55-8c05-4925-b445-d121b1bff1a2 from the persistent domain config.
Oct 16 11:16:22 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-c5b1bc67-596e-44ff-b2f4-7b13ce9a5d73 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 81290b55-8c05-4925-b445-d121b1bff1a2 from the live domain config. {{(pid=74683) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 11:16:22 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-c5b1bc67-596e-44ff-b2f4-7b13ce9a5d73 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 11:16:22 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:16:22 user nova-compute[74683]:   <source dev="/dev/sdh"/>
Oct 16 11:16:22 user nova-compute[74683]:   <target dev="sdc" bus="scsi"/>
Oct 16 11:16:22 user nova-compute[74683]:   <serial>7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b</serial>
Oct 16 11:16:22 user nova-compute[74683]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 16 11:16:22 user nova-compute[74683]: </disk>
Oct 16 11:16:22 user nova-compute[74683]:  {{(pid=74683) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 11:16:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.206s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Acquiring lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:16:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:16:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.193s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/5951e708-5667-4ff0-871b-34845bb20f7c/disk 1073741824 {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/5951e708-5667-4ff0-871b-34845bb20f7c/disk 1073741824" returned: 0 in 0.047s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:23 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:16:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:23 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-c5b1bc67-596e-44ff-b2f4-7b13ce9a5d73 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 81290b55-8c05-4925-b445-d121b1bff1a2 {{(pid=74683) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 11:16:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:23 user nova-compute[74683]: DEBUG nova.network.neutron [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] Successfully created port: 52b6ce44-5078-43ef-aa7d-a0a0bfa1184e {{(pid=74683) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 11:16:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.189s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:23 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5951e708-5667-4ff0-871b-34845bb20f7c/disk. size=1073741824 {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 11:16:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5951e708-5667-4ff0-871b-34845bb20f7c/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5951e708-5667-4ff0-871b-34845bb20f7c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:23 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Cannot resize image /opt/stack/data/nova/instances/5951e708-5667-4ff0-871b-34845bb20f7c/disk to a smaller size. {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 11:16:23 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] Created local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 11:16:23 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] Ensure instance console log exists: /opt/stack/data/nova/instances/5951e708-5667-4ff0-871b-34845bb20f7c/console.log {{(pid=74683) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 11:16:23 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:16:23 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:16:23 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:16:23 user nova-compute[74683]: DEBUG os_brick.utils [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:16:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:23 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ddbb2db-3198-40f0-89c3-7f5f96b58f9d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:70b9d336ab7d\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:23 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd50b291-866d-44f6-bc06-6b44c7a8db29]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:23 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbdc683d-2dd3-4af6-96de-07ec9edd28f1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:23 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a19570-844e-4be3-981e-4cdb546e8f30]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Running cmd (subprocess): nvme version {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] 'nvme version' failed. Not Retrying. {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:16:23 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.nvmeof [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] nvme not present on system {{(pid=74683) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 11:16:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:16:23 user nova-compute[74683]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 11:16:23 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55268e4-577e-492a-a5f0-c4cd9c71769a]: (4, '') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:23 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74683) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 11:16:23 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 11:16:23 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] LIGHTOS: no hostnqn found. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 11:16:23 user nova-compute[74683]: DEBUG os_brick.utils [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:70b9d336ab7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:16:23 user nova-compute[74683]: DEBUG nova.virt.block_device [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Updating existing volume attachment record: fcfb98c2-7940-46d6-bebd-29de6b15f199 {{(pid=74683) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 11:16:23 user nova-compute[74683]: DEBUG nova.network.neutron [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] Successfully updated port: 52b6ce44-5078-43ef-aa7d-a0a0bfa1184e {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:16:23 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Acquiring lock "refresh_cache-5951e708-5667-4ff0-871b-34845bb20f7c" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:16:23 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Acquired lock "refresh_cache-5951e708-5667-4ff0-871b-34845bb20f7c" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:16:23 user nova-compute[74683]: DEBUG nova.network.neutron [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:16:23 user nova-compute[74683]: DEBUG nova.compute.manager [req-f0a5a8d3-6de0-4a15-9aab-ddccf518afa4 req-27428018-aa7c-4d02-b8c1-05587fd1f9b3 service nova] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] Received event network-changed-52b6ce44-5078-43ef-aa7d-a0a0bfa1184e {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:16:23 user nova-compute[74683]: DEBUG nova.compute.manager [req-f0a5a8d3-6de0-4a15-9aab-ddccf518afa4 req-27428018-aa7c-4d02-b8c1-05587fd1f9b3 service nova] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] Refreshing instance network info cache due to event network-changed-52b6ce44-5078-43ef-aa7d-a0a0bfa1184e. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:16:23 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f0a5a8d3-6de0-4a15-9aab-ddccf518afa4 req-27428018-aa7c-4d02-b8c1-05587fd1f9b3 service nova] Acquiring lock "refresh_cache-5951e708-5667-4ff0-871b-34845bb20f7c" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:16:23 user nova-compute[74683]: DEBUG nova.network.neutron [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:16:24 user nova-compute[74683]: DEBUG nova.network.neutron [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] Updating instance_info_cache with network_info: [{"id": "52b6ce44-5078-43ef-aa7d-a0a0bfa1184e", "address": "fa:16:3e:f9:2e:68", "network": {"id": "f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-137528169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c66aa774134aa6a873eabffc28ec07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52b6ce44-50", "ovs_interfaceid": "52b6ce44-5078-43ef-aa7d-a0a0bfa1184e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:16:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Releasing lock "refresh_cache-5951e708-5667-4ff0-871b-34845bb20f7c" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:16:24 user nova-compute[74683]: DEBUG nova.compute.manager [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] Instance network_info: |[{"id": "52b6ce44-5078-43ef-aa7d-a0a0bfa1184e", "address": "fa:16:3e:f9:2e:68", "network": {"id": "f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-137528169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c66aa774134aa6a873eabffc28ec07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52b6ce44-50", "ovs_interfaceid": "52b6ce44-5078-43ef-aa7d-a0a0bfa1184e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 11:16:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f0a5a8d3-6de0-4a15-9aab-ddccf518afa4 req-27428018-aa7c-4d02-b8c1-05587fd1f9b3 service nova] Acquired lock "refresh_cache-5951e708-5667-4ff0-871b-34845bb20f7c" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:16:24 user nova-compute[74683]: DEBUG nova.network.neutron [req-f0a5a8d3-6de0-4a15-9aab-ddccf518afa4 req-27428018-aa7c-4d02-b8c1-05587fd1f9b3 service nova] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] Refreshing network info cache for port 52b6ce44-5078-43ef-aa7d-a0a0bfa1184e {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:16:24 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] Start _get_guest_xml network_info=[{"id": "52b6ce44-5078-43ef-aa7d-a0a0bfa1184e", "address": "fa:16:3e:f9:2e:68", "network": {"id": "f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-137528169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c66aa774134aa6a873eabffc28ec07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52b6ce44-50", "ovs_interfaceid": "52b6ce44-5078-43ef-aa7d-a0a0bfa1184e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:16:24 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:16:24 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:16:24 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:16:24 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:16:24 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:16:24 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:16:24 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:16:24 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:16:24 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:16:24 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:16:24 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:16:24 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:16:24 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:16:24 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:16:24 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:16:24 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:16:24 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:16:24 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:16:24 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:16:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-482897188',display_name='tempest-AttachVolumeNegativeTest-server-482897188',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-482897188',id=13,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE5IpzQDTkkSAhXXtuYKdTWVfFeRBgR/PmHMQgn92/JFiTOZ8MLA1Dl8ctacv8NBs4JbklDxS8DYHOAB9zd+w58vIE8g1qn6joP0Xc1NJPqr5O3322NBqx5hGIuj6X7CZw==',key_name='tempest-keypair-1871302629',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72c66aa774134aa6a873eabffc28ec07',ramdisk_id='',reservation_id='r-ysdicaz0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-845934820',owner_user_name='tempest-AttachVolumeNegativeTest-845934820-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:16:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cdc203c025d84efe86e25cfdf75107b8',uuid=5951e708-5667-4ff0-871b-34845bb20f7c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52b6ce44-5078-43ef-aa7d-a0a0bfa1184e", "address": "fa:16:3e:f9:2e:68", "network": {"id": "f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-137528169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c66aa774134aa6a873eabffc28ec07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52b6ce44-50", "ovs_interfaceid": "52b6ce44-5078-43ef-aa7d-a0a0bfa1184e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:16:24 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Converting VIF {"id": "52b6ce44-5078-43ef-aa7d-a0a0bfa1184e", "address": "fa:16:3e:f9:2e:68", "network": {"id": "f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-137528169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c66aa774134aa6a873eabffc28ec07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52b6ce44-50", "ovs_interfaceid": "52b6ce44-5078-43ef-aa7d-a0a0bfa1184e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:16:24 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:2e:68,bridge_name='br-int',has_traffic_filtering=True,id=52b6ce44-5078-43ef-aa7d-a0a0bfa1184e,network=Network(f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52b6ce44-50') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:16:24 user nova-compute[74683]: DEBUG nova.objects.instance [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lazy-loading 'pci_devices' on Instance uuid 5951e708-5667-4ff0-871b-34845bb20f7c {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:16:24 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:16:24 user nova-compute[74683]:   <uuid>5951e708-5667-4ff0-871b-34845bb20f7c</uuid>
Oct 16 11:16:24 user nova-compute[74683]:   <name>instance-0000000d</name>
Oct 16 11:16:24 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:16:24 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:16:24 user nova-compute[74683]:   <metadata>
Oct 16 11:16:24 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:16:24 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:16:24 user nova-compute[74683]:       <nova:name>tempest-AttachVolumeNegativeTest-server-482897188</nova:name>
Oct 16 11:16:24 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:16:24</nova:creationTime>
Oct 16 11:16:24 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:16:24 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:16:24 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:16:24 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:16:24 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:16:24 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:16:24 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:16:24 user nova-compute[74683]:       <nova:owner>
Oct 16 11:16:24 user nova-compute[74683]:         <nova:user uuid="cdc203c025d84efe86e25cfdf75107b8">tempest-AttachVolumeNegativeTest-845934820-project-member</nova:user>
Oct 16 11:16:24 user nova-compute[74683]:         <nova:project uuid="72c66aa774134aa6a873eabffc28ec07">tempest-AttachVolumeNegativeTest-845934820</nova:project>
Oct 16 11:16:24 user nova-compute[74683]:       </nova:owner>
Oct 16 11:16:24 user nova-compute[74683]:       <nova:root type="image" uuid="0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f"/>
Oct 16 11:16:24 user nova-compute[74683]:       <nova:ports>
Oct 16 11:16:24 user nova-compute[74683]:         <nova:port uuid="52b6ce44-5078-43ef-aa7d-a0a0bfa1184e">
Oct 16 11:16:24 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 16 11:16:24 user nova-compute[74683]:         </nova:port>
Oct 16 11:16:24 user nova-compute[74683]:       </nova:ports>
Oct 16 11:16:24 user nova-compute[74683]:     </nova:instance>
Oct 16 11:16:24 user nova-compute[74683]:   </metadata>
Oct 16 11:16:24 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:16:24 user nova-compute[74683]:     <system>
Oct 16 11:16:24 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:16:24 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:16:24 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:16:24 user nova-compute[74683]:       <entry name="serial">5951e708-5667-4ff0-871b-34845bb20f7c</entry>
Oct 16 11:16:24 user nova-compute[74683]:       <entry name="uuid">5951e708-5667-4ff0-871b-34845bb20f7c</entry>
Oct 16 11:16:24 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:16:24 user nova-compute[74683]:     </system>
Oct 16 11:16:24 user nova-compute[74683]:   </sysinfo>
Oct 16 11:16:24 user nova-compute[74683]:   <os>
Oct 16 11:16:24 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:16:24 user nova-compute[74683]:     <boot dev="hd"/>
Oct 16 11:16:24 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:16:24 user nova-compute[74683]:   </os>
Oct 16 11:16:24 user nova-compute[74683]:   <features>
Oct 16 11:16:24 user nova-compute[74683]:     <acpi/>
Oct 16 11:16:24 user nova-compute[74683]:     <apic/>
Oct 16 11:16:24 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:16:24 user nova-compute[74683]:   </features>
Oct 16 11:16:24 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:16:24 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:16:24 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:16:24 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:16:24 user nova-compute[74683]:   </clock>
Oct 16 11:16:24 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:16:24 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:16:24 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:16:24 user nova-compute[74683]:   </cpu>
Oct 16 11:16:24 user nova-compute[74683]:   <devices>
Oct 16 11:16:24 user nova-compute[74683]:     <disk type="file" device="disk">
Oct 16 11:16:24 user nova-compute[74683]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 11:16:24 user nova-compute[74683]:       <source file="/opt/stack/data/nova/instances/5951e708-5667-4ff0-871b-34845bb20f7c/disk"/>
Oct 16 11:16:24 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:16:24 user nova-compute[74683]:     </disk>
Oct 16 11:16:24 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:16:24 user nova-compute[74683]:       <mac address="fa:16:3e:f9:2e:68"/>
Oct 16 11:16:24 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:16:24 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:16:24 user nova-compute[74683]:       <target dev="tap52b6ce44-50"/>
Oct 16 11:16:24 user nova-compute[74683]:     </interface>
Oct 16 11:16:24 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:16:24 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/5951e708-5667-4ff0-871b-34845bb20f7c/console.log" append="off"/>
Oct 16 11:16:24 user nova-compute[74683]:     </serial>
Oct 16 11:16:24 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:16:24 user nova-compute[74683]:     <video>
Oct 16 11:16:24 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:16:24 user nova-compute[74683]:     </video>
Oct 16 11:16:24 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:16:24 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:16:24 user nova-compute[74683]:     </rng>
Oct 16 11:16:24 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:16:24 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:16:24 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:16:24 user nova-compute[74683]:     </memballoon>
Oct 16 11:16:24 user nova-compute[74683]:   </devices>
Oct 16 11:16:24 user nova-compute[74683]: </domain>
Oct 16 11:16:24 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:16:24 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:16:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-482897188',display_name='tempest-AttachVolumeNegativeTest-server-482897188',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-482897188',id=13,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE5IpzQDTkkSAhXXtuYKdTWVfFeRBgR/PmHMQgn92/JFiTOZ8MLA1Dl8ctacv8NBs4JbklDxS8DYHOAB9zd+w58vIE8g1qn6joP0Xc1NJPqr5O3322NBqx5hGIuj6X7CZw==',key_name='tempest-keypair-1871302629',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72c66aa774134aa6a873eabffc28ec07',ramdisk_id='',reservation_id='r-ysdicaz0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-845934820',owner_user_name='tempest-AttachVolumeNegativeTest-845934820-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:16:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cdc203c025d84efe86e25cfdf75107b8',uuid=5951e708-5667-4ff0-871b-34845bb20f7c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52b6ce44-5078-43ef-aa7d-a0a0bfa1184e", "address": "fa:16:3e:f9:2e:68", "network": {"id": "f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-137528169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c66aa774134aa6a873eabffc28ec07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52b6ce44-50", "ovs_interfaceid": "52b6ce44-5078-43ef-aa7d-a0a0bfa1184e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:16:24 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Converting VIF {"id": "52b6ce44-5078-43ef-aa7d-a0a0bfa1184e", "address": "fa:16:3e:f9:2e:68", "network": {"id": "f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-137528169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c66aa774134aa6a873eabffc28ec07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52b6ce44-50", "ovs_interfaceid": "52b6ce44-5078-43ef-aa7d-a0a0bfa1184e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:16:24 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:2e:68,bridge_name='br-int',has_traffic_filtering=True,id=52b6ce44-5078-43ef-aa7d-a0a0bfa1184e,network=Network(f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52b6ce44-50') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:16:24 user nova-compute[74683]: DEBUG os_vif [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:2e:68,bridge_name='br-int',has_traffic_filtering=True,id=52b6ce44-5078-43ef-aa7d-a0a0bfa1184e,network=Network(f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52b6ce44-50') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:16:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:16:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:16:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2daa154b-b3f6-5fe8-afd3-fa6f5d8d06fa', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:16:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap52b6ce44-50, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:16:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap52b6ce44-50, col_values=(('qos', UUID('710822f3-8bf0-440a-b0bf-a071ce116629')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:16:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap52b6ce44-50, col_values=(('external_ids', {'iface-id': '52b6ce44-5078-43ef-aa7d-a0a0bfa1184e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:2e:68', 'vm-uuid': '5951e708-5667-4ff0-871b-34845bb20f7c'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:16:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:16:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:24 user nova-compute[74683]: INFO os_vif [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:2e:68,bridge_name='br-int',has_traffic_filtering=True,id=52b6ce44-5078-43ef-aa7d-a0a0bfa1184e,network=Network(f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52b6ce44-50')
Oct 16 11:16:24 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:16:24 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] No VIF found with MAC fa:16:3e:f9:2e:68, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:16:24 user nova-compute[74683]: DEBUG nova.network.neutron [req-f0a5a8d3-6de0-4a15-9aab-ddccf518afa4 req-27428018-aa7c-4d02-b8c1-05587fd1f9b3 service nova] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] Updated VIF entry in instance network info cache for port 52b6ce44-5078-43ef-aa7d-a0a0bfa1184e. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:16:24 user nova-compute[74683]: DEBUG nova.network.neutron [req-f0a5a8d3-6de0-4a15-9aab-ddccf518afa4 req-27428018-aa7c-4d02-b8c1-05587fd1f9b3 service nova] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] Updating instance_info_cache with network_info: [{"id": "52b6ce44-5078-43ef-aa7d-a0a0bfa1184e", "address": "fa:16:3e:f9:2e:68", "network": {"id": "f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-137528169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c66aa774134aa6a873eabffc28ec07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52b6ce44-50", "ovs_interfaceid": "52b6ce44-5078-43ef-aa7d-a0a0bfa1184e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:16:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f0a5a8d3-6de0-4a15-9aab-ddccf518afa4 req-27428018-aa7c-4d02-b8c1-05587fd1f9b3 service nova] Releasing lock "refresh_cache-5951e708-5667-4ff0-871b-34845bb20f7c" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:16:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:26 user nova-compute[74683]: DEBUG nova.compute.manager [req-c58d4f72-2770-49ca-9e4b-262f35e3fe9a req-305799d9-7866-4c5e-b5e1-cfc85b50f3ec service nova] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] Received event network-vif-plugged-52b6ce44-5078-43ef-aa7d-a0a0bfa1184e {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:16:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c58d4f72-2770-49ca-9e4b-262f35e3fe9a req-305799d9-7866-4c5e-b5e1-cfc85b50f3ec service nova] Acquiring lock "5951e708-5667-4ff0-871b-34845bb20f7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:16:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c58d4f72-2770-49ca-9e4b-262f35e3fe9a req-305799d9-7866-4c5e-b5e1-cfc85b50f3ec service nova] Lock "5951e708-5667-4ff0-871b-34845bb20f7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:16:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c58d4f72-2770-49ca-9e4b-262f35e3fe9a req-305799d9-7866-4c5e-b5e1-cfc85b50f3ec service nova] Lock "5951e708-5667-4ff0-871b-34845bb20f7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:16:26 user nova-compute[74683]: DEBUG nova.compute.manager [req-c58d4f72-2770-49ca-9e4b-262f35e3fe9a req-305799d9-7866-4c5e-b5e1-cfc85b50f3ec service nova] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] No waiting events found dispatching network-vif-plugged-52b6ce44-5078-43ef-aa7d-a0a0bfa1184e {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:16:26 user nova-compute[74683]: WARNING nova.compute.manager [req-c58d4f72-2770-49ca-9e4b-262f35e3fe9a req-305799d9-7866-4c5e-b5e1-cfc85b50f3ec service nova] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] Received unexpected event network-vif-plugged-52b6ce44-5078-43ef-aa7d-a0a0bfa1184e for instance with vm_state building and task_state spawning.
Oct 16 11:16:27 user nova-compute[74683]: DEBUG nova.compute.manager [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Start spawning the instance on the hypervisor. {{(pid=74683) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Creating instance directory {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 11:16:27 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Creating image(s)
Oct 16 11:16:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Did not create local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Ensure instance console log exists: /opt/stack/data/nova/instances/d944f646-4c4d-4712-8dfe-9b1f0ff60683/console.log {{(pid=74683) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Start _get_guest_xml network_info=[{"id": "e57a2375-e447-4210-bbcf-41b3e5fc247c", "address": "fa:16:3e:20:c8:bf", "network": {"id": "540c0f36-606c-4006-8d84-50054c6727fa", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-308363250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape57a2375-e4", "ovs_interfaceid": "e57a2375-e447-4210-bbcf-41b3e5fc247c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ce7eb587-a6b4-4512-b0e2-80a4da1dbfb4", "address": "fa:16:3e:63:d7:c6", "network": {"id": "c1575c96-f936-4f92-9b3c-6355d69d0f52", "bridge": "br-int", "label": "tempest-device-tagging-net1-1179473676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce7eb587-a6", "ovs_interfaceid": "ce7eb587-a6b4-4512-b0e2-80a4da1dbfb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a6b7eb88-42a3-46b9-8cd2-5b5b06d8849a", "address": "fa:16:3e:9b:41:93", "network": {"id": "c1575c96-f936-4f92-9b3c-6355d69d0f52", "bridge": "br-int", "label": "tempest-device-tagging-net1-1179473676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6b7eb88-42", "ovs_interfaceid": "a6b7eb88-42a3-46b9-8cd2-5b5b06d8849a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9cb93e0f-104e-4f2b-9b61-6d89781b34ca", "address": "fa:16:3e:cd:71:b8", "network": {"id": "c1575c96-f936-4f92-9b3c-6355d69d0f52", "bridge": "br-int", "label": "tempest-device-tagging-net1-1179473676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cb93e0f-10", "ovs_interfaceid": "9cb93e0f-104e-4f2b-9b61-6d89781b34ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "890aa3e7-41ea-4c2a-bcef-7f412d80f1ac", "address": "fa:16:3e:75:e3:67", "network": {"id": "c1575c96-f936-4f92-9b3c-6355d69d0f52", "bridge": "br-int", "label": "tempest-device-tagging-net1-1179473676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap890aa3e7-41", "ovs_interfaceid": "890aa3e7-41ea-4c2a-bcef-7f412d80f1ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f447e989-eb77-4618-9ce5-271b79c2441f", "address": "fa:16:3e:d8:a4:a5", "network": {"id": "92db7fdf-c810-43ef-883b-69a04a04e5e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-66216092", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf447e989-eb", "ovs_interfaceid": "f447e989-eb77-4618-9ce5-271b79c2441f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4a78f612-a4ed-431d-b6c6-b62a23d83a95", "address": "fa:16:3e:13:b8:ac", "network": {"id": "92db7fdf-c810-43ef-883b-69a04a04e5e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-66216092", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a78f612-a4", "ovs_interfaceid": "4a78f612-a4ed-431d-b6c6-b62a23d83a95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hZAjBwSM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd944f646-4c4d-4712-8dfe-9b1f0ff60683', 'attached_at': '', 'detached_at': '', 'volume_id': '2d1cac00-6344-49fe-9d7a-1c6fe160414e', 'serial': '2d1cac00-6344-49fe-9d7a-1c6fe160414e'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': '6f135fb0-7644-4089-ae3a-fcf0562a8102', 'volume_type': None}, {'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cNXhSmaE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd944f646-4c4d-4712-8dfe-9b1f0ff60683', 'attached_at': '', 'detached_at': '', 'volume_id': 'c1e2d623-19a9-4b4c-9fe1-18e656aef0f3', 'serial': 'c1e2d623-19a9-4b4c-9fe1-18e656aef0f3'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 1, 'delete_on_termination': False, 'attachment_id': 'e2d25ade-8919-4346-a207-1c68f1180eea', 'volume_type': None}, {'guest_format': None, 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AEDJnfZU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd944f646-4c4d-4712-8dfe-9b1f0ff60683', 'attached_at': '', 'detached_at': '', 'volume_id': '80b502e7-5d0d-489c-8f84-29551a9e5e0e', 'serial': '80b502e7-5d0d-489c-8f84-29551a9e5e0e'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 2, 'delete_on_termination': False, 'attachment_id': 'ca229502-f51a-4201-83f8-5cb227085e94', 'volume_type': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:16:27 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:16:27 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:16:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Calling os-brick to attach iSCSI Volume {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hZAjBwSM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:16:27 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:16:27 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:16:27 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:16:27 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:16:27 user nova-compute[74683]: INFO os_brick.initiator.connectors.iscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 11:16:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e -p 172.16.0.220:3260 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0000ef0-4339-4852-bb6a-372dd251ad86]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 11:16:27 user nova-compute[74683]:  {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e -p 172.16.0.220:3260 --interface default --op new {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e424c918-5c14-4460-9522-0a15b38f4f75]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e] added\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e] added
Oct 16 11:16:27 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e266c7e-b0c7-40ca-b04e-76fe34f3f826]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[7239747b-d269-46a3-b4d9-6baf6dafea64]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hZAjBwSM {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hZAjBwSM" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba8de99-4cb2-4c12-9694-7beb95b23a46]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hZAjBwSM'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[91bf28f9-c8bd-4350-b143-2c8192ff4048]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5ad7fe-32df-4a3e-a6cd-e05bb8436d7a]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)
Oct 16 11:16:27 user nova-compute[74683]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)
Oct 16 11:16:27 user nova-compute[74683]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)
Oct 16 11:16:27 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:16:27 user nova-compute[74683]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f (non-flash)
Oct 16 11:16:27 user nova-compute[74683]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6 (non-flash)
Oct 16 11:16:27 user nova-compute[74683]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b (non-flash)
Oct 16 11:16:27 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)
Oct 16 11:16:27 user nova-compute[74683]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)
Oct 16 11:16:27 user nova-compute[74683]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)
Oct 16 11:16:27 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:16:27 user nova-compute[74683]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f (non-flash)
Oct 16 11:16:27 user nova-compute[74683]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6 (non-flash)
Oct 16 11:16:27 user nova-compute[74683]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b (non-flash)
Oct 16 11:16:27 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e -p 172.16.0.220:3260 --login {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[11cff14a-9359-42a6-9c02-26f6e69ea1c0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e, portal: 172.16.0.220,3260]
Oct 16 11:16:27 user nova-compute[74683]: Login to [iface: default, target: iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e, portal: 172.16.0.220,3260] successful.
Oct 16 11:16:27 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[4524cb4f-2a56-41d0-9ead-90e278e4c7bd]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ba67f0-821a-4687-ba1b-cf0fcf698071]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)
Oct 16 11:16:27 user nova-compute[74683]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)
Oct 16 11:16:27 user nova-compute[74683]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)
Oct 16 11:16:27 user nova-compute[74683]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)
Oct 16 11:16:27 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:16:27 user nova-compute[74683]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f (non-flash)
Oct 16 11:16:27 user nova-compute[74683]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6 (non-flash)
Oct 16 11:16:27 user nova-compute[74683]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b (non-flash)
Oct 16 11:16:27 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)
Oct 16 11:16:27 user nova-compute[74683]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)
Oct 16 11:16:27 user nova-compute[74683]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)
Oct 16 11:16:27 user nova-compute[74683]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)
Oct 16 11:16:27 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:16:27 user nova-compute[74683]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f (non-flash)
Oct 16 11:16:27 user nova-compute[74683]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6 (non-flash)
Oct 16 11:16:27 user nova-compute[74683]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b (non-flash)
Oct 16 11:16:27 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Connected to 172.16.0.220:3260 {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=74683) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=74683) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.016s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb07d35f-53f3-4117-913b-012ad921f7c8]: (4, ('- - 0', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:16:27 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hZAjBwSM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 11:16:28 user nova-compute[74683]: DEBUG nova.compute.manager [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] Instance event wait completed in 0 seconds for  {{(pid=74683) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 11:16:28 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] Guest created on hypervisor {{(pid=74683) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 11:16:28 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] Instance spawned successfully.
Oct 16 11:16:28 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 11:16:28 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] Found default for hw_cdrom_bus of ide {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:16:28 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] Found default for hw_disk_bus of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:16:28 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] Found default for hw_input_bus of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:16:28 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] Found default for hw_pointer_model of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:16:28 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] Found default for hw_video_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:16:28 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] Found default for hw_vif_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:16:28 user nova-compute[74683]: INFO nova.compute.manager [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] Took 5.65 seconds to spawn the instance on the hypervisor.
Oct 16 11:16:28 user nova-compute[74683]: DEBUG nova.compute.manager [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:16:28 user nova-compute[74683]: DEBUG nova.compute.manager [req-5574bd9d-1c06-4b07-95d2-13adcbc51327 req-ec1f96fd-4d4b-48ce-93f3-91f192676992 service nova] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] Received event network-vif-plugged-52b6ce44-5078-43ef-aa7d-a0a0bfa1184e {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:16:28 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-5574bd9d-1c06-4b07-95d2-13adcbc51327 req-ec1f96fd-4d4b-48ce-93f3-91f192676992 service nova] Acquiring lock "5951e708-5667-4ff0-871b-34845bb20f7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:16:28 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-5574bd9d-1c06-4b07-95d2-13adcbc51327 req-ec1f96fd-4d4b-48ce-93f3-91f192676992 service nova] Lock "5951e708-5667-4ff0-871b-34845bb20f7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:16:28 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-5574bd9d-1c06-4b07-95d2-13adcbc51327 req-ec1f96fd-4d4b-48ce-93f3-91f192676992 service nova] Lock "5951e708-5667-4ff0-871b-34845bb20f7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:16:28 user nova-compute[74683]: DEBUG nova.compute.manager [req-5574bd9d-1c06-4b07-95d2-13adcbc51327 req-ec1f96fd-4d4b-48ce-93f3-91f192676992 service nova] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] No waiting events found dispatching network-vif-plugged-52b6ce44-5078-43ef-aa7d-a0a0bfa1184e {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:16:28 user nova-compute[74683]: WARNING nova.compute.manager [req-5574bd9d-1c06-4b07-95d2-13adcbc51327 req-ec1f96fd-4d4b-48ce-93f3-91f192676992 service nova] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] Received unexpected event network-vif-plugged-52b6ce44-5078-43ef-aa7d-a0a0bfa1184e for instance with vm_state building and task_state spawning.
Oct 16 11:16:28 user nova-compute[74683]: INFO nova.compute.manager [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] Took 6.55 seconds to build instance.
Oct 16 11:16:28 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-bdad97f5-2226-426f-bfa4-0b8c61972459 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "5951e708-5667-4ff0-871b-34845bb20f7c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.656s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:16:28 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:16:28 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] <== connect_volume: return (1379ms) {'type': 'block', 'scsi_wwn': '23938643566366166', 'path': '/dev/sdi'} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:16:28 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23938643566366166', 'path': '/dev/sdi'} {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 11:16:28 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Calling os-brick to attach iSCSI Volume {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 11:16:28 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cNXhSmaE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:16:28 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:16:28 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:16:28 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:16:28 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:16:28 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:16:28 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:16:28 user nova-compute[74683]: INFO os_brick.initiator.connectors.iscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 11:16:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 -p 172.16.0.220:3260 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:28 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4e9d30-68e8-4f7c-89a0-74812535f115]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:28 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 11:16:28 user nova-compute[74683]:  {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:16:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:28 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[139a9bdb-37a4-4f3d-9f89-88d784978d2f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3] added\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:28 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3] added
Oct 16 11:16:28 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:16:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:28 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5bab7f0-1a88-46f3-a667-65457cc02a89]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:28 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:16:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:28 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[81aeecca-c2d4-41cb-926c-7170c455d28c]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:28 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:16:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cNXhSmaE {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cNXhSmaE" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:28 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ead10fe-d6b0-4294-83bd-519ec8bc1290]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:28 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cNXhSmaE'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:16:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:28 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a0ba74-0735-48d5-bc48-d8a3d162d4da]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:28 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:16:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:28 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[853aeb5c-a17f-4ecc-a745-117573a23e50]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:28 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)
Oct 16 11:16:28 user nova-compute[74683]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)
Oct 16 11:16:28 user nova-compute[74683]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)
Oct 16 11:16:28 user nova-compute[74683]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)
Oct 16 11:16:28 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:16:28 user nova-compute[74683]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f (non-flash)
Oct 16 11:16:28 user nova-compute[74683]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6 (non-flash)
Oct 16 11:16:28 user nova-compute[74683]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b (non-flash)
Oct 16 11:16:28 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:16:28 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)
Oct 16 11:16:28 user nova-compute[74683]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)
Oct 16 11:16:28 user nova-compute[74683]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)
Oct 16 11:16:28 user nova-compute[74683]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)
Oct 16 11:16:28 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:16:28 user nova-compute[74683]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f (non-flash)
Oct 16 11:16:28 user nova-compute[74683]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6 (non-flash)
Oct 16 11:16:28 user nova-compute[74683]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b (non-flash)
Oct 16 11:16:28 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:16:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 -p 172.16.0.220:3260 --login {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 -p 172.16.0.220:3260 --login" returned: 0 in 0.101s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:29 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[905b8c69-f1fb-4fac-bddb-49118b0f771e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:29 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3, portal: 172.16.0.220,3260]
Oct 16 11:16:29 user nova-compute[74683]: Login to [iface: default, target: iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3, portal: 172.16.0.220,3260] successful.
Oct 16 11:16:29 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:16:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:29 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[4661f165-71d7-4a1e-acae-6410e4e89d1e]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:29 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:16:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:29 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2888394-63b8-4e13-913a-ee8d42442395]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:29 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)
Oct 16 11:16:29 user nova-compute[74683]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)
Oct 16 11:16:29 user nova-compute[74683]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)
Oct 16 11:16:29 user nova-compute[74683]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)
Oct 16 11:16:29 user nova-compute[74683]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)
Oct 16 11:16:29 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:16:29 user nova-compute[74683]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f (non-flash)
Oct 16 11:16:29 user nova-compute[74683]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6 (non-flash)
Oct 16 11:16:29 user nova-compute[74683]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b (non-flash)
Oct 16 11:16:29 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:16:29 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)
Oct 16 11:16:29 user nova-compute[74683]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)
Oct 16 11:16:29 user nova-compute[74683]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)
Oct 16 11:16:29 user nova-compute[74683]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)
Oct 16 11:16:29 user nova-compute[74683]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)
Oct 16 11:16:29 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:16:29 user nova-compute[74683]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f (non-flash)
Oct 16 11:16:29 user nova-compute[74683]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6 (non-flash)
Oct 16 11:16:29 user nova-compute[74683]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b (non-flash)
Oct 16 11:16:29 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:16:29 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.357s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:16:29 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Connected to 172.16.0.220:3260 {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 11:16:29 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=74683) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 11:16:29 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=74683) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 11:16:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:29 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9a9900-9336-497a-a4f2-74e03a431892]: (4, ('- - 0', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:29 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: None {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:16:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:30 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:16:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cNXhSmaE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 11:16:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.394s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:16:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] <== connect_volume: return (1395ms) {'type': 'block', 'scsi_wwn': '23630376263663037', 'path': '/dev/sdj'} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:16:30 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630376263663037', 'path': '/dev/sdj'} {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 11:16:30 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Calling os-brick to attach iSCSI Volume {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 11:16:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AEDJnfZU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:16:30 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:16:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:16:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:16:30 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:16:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:16:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:16:30 user nova-compute[74683]: INFO os_brick.initiator.connectors.iscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 11:16:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e -p 172.16.0.220:3260 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc09fd32-95da-4c33-88c8-50b47310a98d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 11:16:30 user nova-compute[74683]:  {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:16:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e -p 172.16.0.220:3260 --interface default --op new {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cda7ffe-a914-4206-9c0a-a14f3789ed15]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e] added\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e] added
Oct 16 11:16:30 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:16:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.049s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e422e6-e0bb-436d-8199-fd372a98932c]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:16:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0cad44-9fbd-4401-8227-c56c7c434568]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:16:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AEDJnfZU {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AEDJnfZU" returned: 0 in 0.023s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d8aa7a-c50e-46f5-a246-282eebdcce04]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AEDJnfZU'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:16:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[1292b8a6-b110-4508-917f-d93b1d8e5c3a]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:16:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[7531b956-b6dd-4c09-b973-4f0871a235ef]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)
Oct 16 11:16:30 user nova-compute[74683]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)
Oct 16 11:16:30 user nova-compute[74683]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)
Oct 16 11:16:30 user nova-compute[74683]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)
Oct 16 11:16:30 user nova-compute[74683]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)
Oct 16 11:16:30 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:16:30 user nova-compute[74683]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f (non-flash)
Oct 16 11:16:30 user nova-compute[74683]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6 (non-flash)
Oct 16 11:16:30 user nova-compute[74683]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b (non-flash)
Oct 16 11:16:30 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:16:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)
Oct 16 11:16:30 user nova-compute[74683]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)
Oct 16 11:16:30 user nova-compute[74683]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)
Oct 16 11:16:30 user nova-compute[74683]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)
Oct 16 11:16:30 user nova-compute[74683]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)
Oct 16 11:16:30 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:16:30 user nova-compute[74683]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f (non-flash)
Oct 16 11:16:30 user nova-compute[74683]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6 (non-flash)
Oct 16 11:16:30 user nova-compute[74683]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b (non-flash)
Oct 16 11:16:30 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:16:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e -p 172.16.0.220:3260 --login {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e -p 172.16.0.220:3260 --login" returned: 0 in 0.104s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e22aed2-bf93-4059-b877-5a2bc7de2d0e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e, portal: 172.16.0.220,3260]
Oct 16 11:16:30 user nova-compute[74683]: Login to [iface: default, target: iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e, portal: 172.16.0.220,3260] successful.
Oct 16 11:16:30 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:16:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[49127500-0895-453f-8175-6c4fd357fd9b]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:16:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[89755597-be80-4bd2-8ce2-b545637243ca]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)
Oct 16 11:16:30 user nova-compute[74683]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)
Oct 16 11:16:30 user nova-compute[74683]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e (non-flash)
Oct 16 11:16:30 user nova-compute[74683]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)
Oct 16 11:16:30 user nova-compute[74683]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)
Oct 16 11:16:30 user nova-compute[74683]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)
Oct 16 11:16:30 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:16:30 user nova-compute[74683]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f (non-flash)
Oct 16 11:16:30 user nova-compute[74683]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6 (non-flash)
Oct 16 11:16:30 user nova-compute[74683]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b (non-flash)
Oct 16 11:16:30 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:16:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)
Oct 16 11:16:30 user nova-compute[74683]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)
Oct 16 11:16:30 user nova-compute[74683]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e (non-flash)
Oct 16 11:16:30 user nova-compute[74683]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)
Oct 16 11:16:30 user nova-compute[74683]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)
Oct 16 11:16:30 user nova-compute[74683]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)
Oct 16 11:16:30 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:16:30 user nova-compute[74683]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f (non-flash)
Oct 16 11:16:30 user nova-compute[74683]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6 (non-flash)
Oct 16 11:16:30 user nova-compute[74683]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b (non-flash)
Oct 16 11:16:30 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:16:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.419s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:16:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Connected to 172.16.0.220:3260 {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 11:16:30 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] HCTL ('42', '-', '-', 0) found on session 12 with lun 0 {{(pid=74683) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 11:16:30 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=74683) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 11:16:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.024s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d2a3f0-deb8-4c4f-92e9-fdcaad775d86]: (4, ('- - 0', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:30 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Searching for a device in session 12 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:16:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AEDJnfZU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 11:16:30 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.474s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] <== connect_volume: return (1476ms) {'type': 'block', 'scsi_wwn': '26138363338336334', 'path': '/dev/sdk'} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138363338336334', 'path': '/dev/sdk'} {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T11:14:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-153004525',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-153004525',id=11,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPT0wFGepT2AbMdp1rAx79xDZxHu2H/2AkbfKha2i6dolhWnV2tQPzUnhpCRMrAf5PLBt6Ls2nh9OlA5dn90oD2J+97H6rdIu1Yx2AsfyI0saOnNSsTFksp9Zunxk73fQ==',key_name='tempest-keypair-273034633',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ac0a84f26f244dcb698429bb447feff',ramdisk_id='',reservation_id='r-ev6lcphm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2030851280',owner_user_name='tempest-TaggedBootDevicesTest_v242-2030851280-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:14:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='08a96cdfeb5746cea70a478c307e5998',uuid=d944f646-4c4d-4712-8dfe-9b1f0ff60683,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e57a2375-e447-4210-bbcf-41b3e5fc247c", "address": "fa:16:3e:20:c8:bf", "network": {"id": "540c0f36-606c-4006-8d84-50054c6727fa", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-308363250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape57a2375-e4", "ovs_interfaceid": "e57a2375-e447-4210-bbcf-41b3e5fc247c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Converting VIF {"id": "e57a2375-e447-4210-bbcf-41b3e5fc247c", "address": "fa:16:3e:20:c8:bf", "network": {"id": "540c0f36-606c-4006-8d84-50054c6727fa", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-308363250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape57a2375-e4", "ovs_interfaceid": "e57a2375-e447-4210-bbcf-41b3e5fc247c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:c8:bf,bridge_name='br-int',has_traffic_filtering=True,id=e57a2375-e447-4210-bbcf-41b3e5fc247c,network=Network(540c0f36-606c-4006-8d84-50054c6727fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape57a2375-e4') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T11:14:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-153004525',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-153004525',id=11,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPT0wFGepT2AbMdp1rAx79xDZxHu2H/2AkbfKha2i6dolhWnV2tQPzUnhpCRMrAf5PLBt6Ls2nh9OlA5dn90oD2J+97H6rdIu1Yx2AsfyI0saOnNSsTFksp9Zunxk73fQ==',key_name='tempest-keypair-273034633',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ac0a84f26f244dcb698429bb447feff',ramdisk_id='',reservation_id='r-ev6lcphm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2030851280',owner_user_name='tempest-TaggedBootDevicesTest_v242-2030851280-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:14:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='08a96cdfeb5746cea70a478c307e5998',uuid=d944f646-4c4d-4712-8dfe-9b1f0ff60683,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce7eb587-a6b4-4512-b0e2-80a4da1dbfb4", "address": "fa:16:3e:63:d7:c6", "network": {"id": "c1575c96-f936-4f92-9b3c-6355d69d0f52", "bridge": "br-int", "label": "tempest-device-tagging-net1-1179473676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce7eb587-a6", "ovs_interfaceid": "ce7eb587-a6b4-4512-b0e2-80a4da1dbfb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Converting VIF {"id": "ce7eb587-a6b4-4512-b0e2-80a4da1dbfb4", "address": "fa:16:3e:63:d7:c6", "network": {"id": "c1575c96-f936-4f92-9b3c-6355d69d0f52", "bridge": "br-int", "label": "tempest-device-tagging-net1-1179473676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce7eb587-a6", "ovs_interfaceid": "ce7eb587-a6b4-4512-b0e2-80a4da1dbfb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:d7:c6,bridge_name='br-int',has_traffic_filtering=True,id=ce7eb587-a6b4-4512-b0e2-80a4da1dbfb4,network=Network(c1575c96-f936-4f92-9b3c-6355d69d0f52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapce7eb587-a6') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T11:14:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-153004525',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-153004525',id=11,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPT0wFGepT2AbMdp1rAx79xDZxHu2H/2AkbfKha2i6dolhWnV2tQPzUnhpCRMrAf5PLBt6Ls2nh9OlA5dn90oD2J+97H6rdIu1Yx2AsfyI0saOnNSsTFksp9Zunxk73fQ==',key_name='tempest-keypair-273034633',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ac0a84f26f244dcb698429bb447feff',ramdisk_id='',reservation_id='r-ev6lcphm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2030851280',owner_user_name='tempest-TaggedBootDevicesTest_v242-2030851280-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:14:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='08a96cdfeb5746cea70a478c307e5998',uuid=d944f646-4c4d-4712-8dfe-9b1f0ff60683,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6b7eb88-42a3-46b9-8cd2-5b5b06d8849a", "address": "fa:16:3e:9b:41:93", "network": {"id": "c1575c96-f936-4f92-9b3c-6355d69d0f52", "bridge": "br-int", "label": "tempest-device-tagging-net1-1179473676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6b7eb88-42", "ovs_interfaceid": "a6b7eb88-42a3-46b9-8cd2-5b5b06d8849a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Converting VIF {"id": "a6b7eb88-42a3-46b9-8cd2-5b5b06d8849a", "address": "fa:16:3e:9b:41:93", "network": {"id": "c1575c96-f936-4f92-9b3c-6355d69d0f52", "bridge": "br-int", "label": "tempest-device-tagging-net1-1179473676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6b7eb88-42", "ovs_interfaceid": "a6b7eb88-42a3-46b9-8cd2-5b5b06d8849a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:41:93,bridge_name='br-int',has_traffic_filtering=True,id=a6b7eb88-42a3-46b9-8cd2-5b5b06d8849a,network=Network(c1575c96-f936-4f92-9b3c-6355d69d0f52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa6b7eb88-42') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T11:14:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-153004525',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-153004525',id=11,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPT0wFGepT2AbMdp1rAx79xDZxHu2H/2AkbfKha2i6dolhWnV2tQPzUnhpCRMrAf5PLBt6Ls2nh9OlA5dn90oD2J+97H6rdIu1Yx2AsfyI0saOnNSsTFksp9Zunxk73fQ==',key_name='tempest-keypair-273034633',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ac0a84f26f244dcb698429bb447feff',ramdisk_id='',reservation_id='r-ev6lcphm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2030851280',owner_user_name='tempest-TaggedBootDevicesTest_v242-2030851280-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:14:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='08a96cdfeb5746cea70a478c307e5998',uuid=d944f646-4c4d-4712-8dfe-9b1f0ff60683,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9cb93e0f-104e-4f2b-9b61-6d89781b34ca", "address": "fa:16:3e:cd:71:b8", "network": {"id": "c1575c96-f936-4f92-9b3c-6355d69d0f52", "bridge": "br-int", "label": "tempest-device-tagging-net1-1179473676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cb93e0f-10", "ovs_interfaceid": "9cb93e0f-104e-4f2b-9b61-6d89781b34ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Converting VIF {"id": "9cb93e0f-104e-4f2b-9b61-6d89781b34ca", "address": "fa:16:3e:cd:71:b8", "network": {"id": "c1575c96-f936-4f92-9b3c-6355d69d0f52", "bridge": "br-int", "label": "tempest-device-tagging-net1-1179473676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cb93e0f-10", "ovs_interfaceid": "9cb93e0f-104e-4f2b-9b61-6d89781b34ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:71:b8,bridge_name='br-int',has_traffic_filtering=True,id=9cb93e0f-104e-4f2b-9b61-6d89781b34ca,network=Network(c1575c96-f936-4f92-9b3c-6355d69d0f52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cb93e0f-10') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T11:14:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-153004525',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-153004525',id=11,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPT0wFGepT2AbMdp1rAx79xDZxHu2H/2AkbfKha2i6dolhWnV2tQPzUnhpCRMrAf5PLBt6Ls2nh9OlA5dn90oD2J+97H6rdIu1Yx2AsfyI0saOnNSsTFksp9Zunxk73fQ==',key_name='tempest-keypair-273034633',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ac0a84f26f244dcb698429bb447feff',ramdisk_id='',reservation_id='r-ev6lcphm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2030851280',owner_user_name='tempest-TaggedBootDevicesTest_v242-2030851280-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:14:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='08a96cdfeb5746cea70a478c307e5998',uuid=d944f646-4c4d-4712-8dfe-9b1f0ff60683,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "890aa3e7-41ea-4c2a-bcef-7f412d80f1ac", "address": "fa:16:3e:75:e3:67", "network": {"id": "c1575c96-f936-4f92-9b3c-6355d69d0f52", "bridge": "br-int", "label": "tempest-device-tagging-net1-1179473676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap890aa3e7-41", "ovs_interfaceid": "890aa3e7-41ea-4c2a-bcef-7f412d80f1ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Converting VIF {"id": "890aa3e7-41ea-4c2a-bcef-7f412d80f1ac", "address": "fa:16:3e:75:e3:67", "network": {"id": "c1575c96-f936-4f92-9b3c-6355d69d0f52", "bridge": "br-int", "label": "tempest-device-tagging-net1-1179473676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap890aa3e7-41", "ovs_interfaceid": "890aa3e7-41ea-4c2a-bcef-7f412d80f1ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:e3:67,bridge_name='br-int',has_traffic_filtering=True,id=890aa3e7-41ea-4c2a-bcef-7f412d80f1ac,network=Network(c1575c96-f936-4f92-9b3c-6355d69d0f52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap890aa3e7-41') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T11:14:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-153004525',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-153004525',id=11,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPT0wFGepT2AbMdp1rAx79xDZxHu2H/2AkbfKha2i6dolhWnV2tQPzUnhpCRMrAf5PLBt6Ls2nh9OlA5dn90oD2J+97H6rdIu1Yx2AsfyI0saOnNSsTFksp9Zunxk73fQ==',key_name='tempest-keypair-273034633',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ac0a84f26f244dcb698429bb447feff',ramdisk_id='',reservation_id='r-ev6lcphm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2030851280',owner_user_name='tempest-TaggedBootDevicesTest_v242-2030851280-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:14:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='08a96cdfeb5746cea70a478c307e5998',uuid=d944f646-4c4d-4712-8dfe-9b1f0ff60683,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f447e989-eb77-4618-9ce5-271b79c2441f", "address": "fa:16:3e:d8:a4:a5", "network": {"id": "92db7fdf-c810-43ef-883b-69a04a04e5e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-66216092", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf447e989-eb", "ovs_interfaceid": "f447e989-eb77-4618-9ce5-271b79c2441f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Converting VIF {"id": "f447e989-eb77-4618-9ce5-271b79c2441f", "address": "fa:16:3e:d8:a4:a5", "network": {"id": "92db7fdf-c810-43ef-883b-69a04a04e5e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-66216092", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf447e989-eb", "ovs_interfaceid": "f447e989-eb77-4618-9ce5-271b79c2441f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:a4:a5,bridge_name='br-int',has_traffic_filtering=True,id=f447e989-eb77-4618-9ce5-271b79c2441f,network=Network(92db7fdf-c810-43ef-883b-69a04a04e5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf447e989-eb') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T11:14:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-153004525',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-153004525',id=11,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPT0wFGepT2AbMdp1rAx79xDZxHu2H/2AkbfKha2i6dolhWnV2tQPzUnhpCRMrAf5PLBt6Ls2nh9OlA5dn90oD2J+97H6rdIu1Yx2AsfyI0saOnNSsTFksp9Zunxk73fQ==',key_name='tempest-keypair-273034633',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ac0a84f26f244dcb698429bb447feff',ramdisk_id='',reservation_id='r-ev6lcphm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2030851280',owner_user_name='tempest-TaggedBootDevicesTest_v242-2030851280-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:14:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='08a96cdfeb5746cea70a478c307e5998',uuid=d944f646-4c4d-4712-8dfe-9b1f0ff60683,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a78f612-a4ed-431d-b6c6-b62a23d83a95", "address": "fa:16:3e:13:b8:ac", "network": {"id": "92db7fdf-c810-43ef-883b-69a04a04e5e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-66216092", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a78f612-a4", "ovs_interfaceid": "4a78f612-a4ed-431d-b6c6-b62a23d83a95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Converting VIF {"id": "4a78f612-a4ed-431d-b6c6-b62a23d83a95", "address": "fa:16:3e:13:b8:ac", "network": {"id": "92db7fdf-c810-43ef-883b-69a04a04e5e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-66216092", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a78f612-a4", "ovs_interfaceid": "4a78f612-a4ed-431d-b6c6-b62a23d83a95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:b8:ac,bridge_name='br-int',has_traffic_filtering=True,id=4a78f612-a4ed-431d-b6c6-b62a23d83a95,network=Network(92db7fdf-c810-43ef-883b-69a04a04e5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a78f612-a4') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG nova.objects.instance [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Lazy-loading 'pci_devices' on Instance uuid d944f646-4c4d-4712-8dfe-9b1f0ff60683 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:16:31 user nova-compute[74683]:   <uuid>d944f646-4c4d-4712-8dfe-9b1f0ff60683</uuid>
Oct 16 11:16:31 user nova-compute[74683]:   <name>instance-0000000b</name>
Oct 16 11:16:31 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:16:31 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:16:31 user nova-compute[74683]:   <metadata>
Oct 16 11:16:31 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:16:31 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:16:31 user nova-compute[74683]:       <nova:name>tempest-device-tagging-server-153004525</nova:name>
Oct 16 11:16:31 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:16:27</nova:creationTime>
Oct 16 11:16:31 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:16:31 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:16:31 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:16:31 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:16:31 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:16:31 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:16:31 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:16:31 user nova-compute[74683]:       <nova:owner>
Oct 16 11:16:31 user nova-compute[74683]:         <nova:user uuid="08a96cdfeb5746cea70a478c307e5998">tempest-TaggedBootDevicesTest_v242-2030851280-project-member</nova:user>
Oct 16 11:16:31 user nova-compute[74683]:         <nova:project uuid="2ac0a84f26f244dcb698429bb447feff">tempest-TaggedBootDevicesTest_v242-2030851280</nova:project>
Oct 16 11:16:31 user nova-compute[74683]:       </nova:owner>
Oct 16 11:16:31 user nova-compute[74683]:       <nova:root type="image" uuid="0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f"/>
Oct 16 11:16:31 user nova-compute[74683]:       <nova:ports>
Oct 16 11:16:31 user nova-compute[74683]:         <nova:port uuid="e57a2375-e447-4210-bbcf-41b3e5fc247c">
Oct 16 11:16:31 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 16 11:16:31 user nova-compute[74683]:         </nova:port>
Oct 16 11:16:31 user nova-compute[74683]:         <nova:port uuid="ce7eb587-a6b4-4512-b0e2-80a4da1dbfb4">
Oct 16 11:16:31 user nova-compute[74683]:           <nova:ip type="fixed" address="10.1.1.174" ipVersion="4"/>
Oct 16 11:16:31 user nova-compute[74683]:         </nova:port>
Oct 16 11:16:31 user nova-compute[74683]:         <nova:port uuid="a6b7eb88-42a3-46b9-8cd2-5b5b06d8849a">
Oct 16 11:16:31 user nova-compute[74683]:           <nova:ip type="fixed" address="10.1.1.56" ipVersion="4"/>
Oct 16 11:16:31 user nova-compute[74683]:         </nova:port>
Oct 16 11:16:31 user nova-compute[74683]:         <nova:port uuid="9cb93e0f-104e-4f2b-9b61-6d89781b34ca">
Oct 16 11:16:31 user nova-compute[74683]:           <nova:ip type="fixed" address="10.1.1.188" ipVersion="4"/>
Oct 16 11:16:31 user nova-compute[74683]:         </nova:port>
Oct 16 11:16:31 user nova-compute[74683]:         <nova:port uuid="890aa3e7-41ea-4c2a-bcef-7f412d80f1ac">
Oct 16 11:16:31 user nova-compute[74683]:           <nova:ip type="fixed" address="10.1.1.225" ipVersion="4"/>
Oct 16 11:16:31 user nova-compute[74683]:         </nova:port>
Oct 16 11:16:31 user nova-compute[74683]:         <nova:port uuid="f447e989-eb77-4618-9ce5-271b79c2441f">
Oct 16 11:16:31 user nova-compute[74683]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Oct 16 11:16:31 user nova-compute[74683]:         </nova:port>
Oct 16 11:16:31 user nova-compute[74683]:         <nova:port uuid="4a78f612-a4ed-431d-b6c6-b62a23d83a95">
Oct 16 11:16:31 user nova-compute[74683]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Oct 16 11:16:31 user nova-compute[74683]:         </nova:port>
Oct 16 11:16:31 user nova-compute[74683]:       </nova:ports>
Oct 16 11:16:31 user nova-compute[74683]:     </nova:instance>
Oct 16 11:16:31 user nova-compute[74683]:   </metadata>
Oct 16 11:16:31 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:16:31 user nova-compute[74683]:     <system>
Oct 16 11:16:31 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:16:31 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:16:31 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:16:31 user nova-compute[74683]:       <entry name="serial">d944f646-4c4d-4712-8dfe-9b1f0ff60683</entry>
Oct 16 11:16:31 user nova-compute[74683]:       <entry name="uuid">d944f646-4c4d-4712-8dfe-9b1f0ff60683</entry>
Oct 16 11:16:31 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:16:31 user nova-compute[74683]:     </system>
Oct 16 11:16:31 user nova-compute[74683]:   </sysinfo>
Oct 16 11:16:31 user nova-compute[74683]:   <os>
Oct 16 11:16:31 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:16:31 user nova-compute[74683]:     <boot dev="hd"/>
Oct 16 11:16:31 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:16:31 user nova-compute[74683]:   </os>
Oct 16 11:16:31 user nova-compute[74683]:   <features>
Oct 16 11:16:31 user nova-compute[74683]:     <acpi/>
Oct 16 11:16:31 user nova-compute[74683]:     <apic/>
Oct 16 11:16:31 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:16:31 user nova-compute[74683]:   </features>
Oct 16 11:16:31 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:16:31 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:16:31 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:16:31 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:16:31 user nova-compute[74683]:   </clock>
Oct 16 11:16:31 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:16:31 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:16:31 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:16:31 user nova-compute[74683]:   </cpu>
Oct 16 11:16:31 user nova-compute[74683]:   <devices>
Oct 16 11:16:31 user nova-compute[74683]:     <disk type="file" device="cdrom">
Oct 16 11:16:31 user nova-compute[74683]:       <driver name="qemu" type="raw" cache="none"/>
Oct 16 11:16:31 user nova-compute[74683]:       <source file="/opt/stack/data/nova/instances/d944f646-4c4d-4712-8dfe-9b1f0ff60683/disk.config"/>
Oct 16 11:16:31 user nova-compute[74683]:       <target dev="hda" bus="ide"/>
Oct 16 11:16:31 user nova-compute[74683]:     </disk>
Oct 16 11:16:31 user nova-compute[74683]:     <disk type="block" device="disk">
Oct 16 11:16:31 user nova-compute[74683]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:16:31 user nova-compute[74683]:       <source dev="/dev/sdi"/>
Oct 16 11:16:31 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:16:31 user nova-compute[74683]:       <serial>2d1cac00-6344-49fe-9d7a-1c6fe160414e</serial>
Oct 16 11:16:31 user nova-compute[74683]:     </disk>
Oct 16 11:16:31 user nova-compute[74683]:     <disk type="block" device="disk">
Oct 16 11:16:31 user nova-compute[74683]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:16:31 user nova-compute[74683]:       <source dev="/dev/sdj"/>
Oct 16 11:16:31 user nova-compute[74683]:       <target dev="vdb" bus="virtio"/>
Oct 16 11:16:31 user nova-compute[74683]:       <serial>c1e2d623-19a9-4b4c-9fe1-18e656aef0f3</serial>
Oct 16 11:16:31 user nova-compute[74683]:     </disk>
Oct 16 11:16:31 user nova-compute[74683]:     <disk type="block" device="disk">
Oct 16 11:16:31 user nova-compute[74683]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:16:31 user nova-compute[74683]:       <source dev="/dev/sdk"/>
Oct 16 11:16:31 user nova-compute[74683]:       <target dev="vdc" bus="virtio"/>
Oct 16 11:16:31 user nova-compute[74683]:       <serial>80b502e7-5d0d-489c-8f84-29551a9e5e0e</serial>
Oct 16 11:16:31 user nova-compute[74683]:     </disk>
Oct 16 11:16:31 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:16:31 user nova-compute[74683]:       <mac address="fa:16:3e:20:c8:bf"/>
Oct 16 11:16:31 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:16:31 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:16:31 user nova-compute[74683]:       <target dev="tape57a2375-e4"/>
Oct 16 11:16:31 user nova-compute[74683]:     </interface>
Oct 16 11:16:31 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:16:31 user nova-compute[74683]:       <mac address="fa:16:3e:63:d7:c6"/>
Oct 16 11:16:31 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:16:31 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:16:31 user nova-compute[74683]:       <target dev="tapce7eb587-a6"/>
Oct 16 11:16:31 user nova-compute[74683]:     </interface>
Oct 16 11:16:31 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:16:31 user nova-compute[74683]:       <mac address="fa:16:3e:9b:41:93"/>
Oct 16 11:16:31 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:16:31 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:16:31 user nova-compute[74683]:       <target dev="tapa6b7eb88-42"/>
Oct 16 11:16:31 user nova-compute[74683]:     </interface>
Oct 16 11:16:31 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:16:31 user nova-compute[74683]:       <mac address="fa:16:3e:cd:71:b8"/>
Oct 16 11:16:31 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:16:31 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:16:31 user nova-compute[74683]:       <target dev="tap9cb93e0f-10"/>
Oct 16 11:16:31 user nova-compute[74683]:     </interface>
Oct 16 11:16:31 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:16:31 user nova-compute[74683]:       <mac address="fa:16:3e:75:e3:67"/>
Oct 16 11:16:31 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:16:31 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:16:31 user nova-compute[74683]:       <target dev="tap890aa3e7-41"/>
Oct 16 11:16:31 user nova-compute[74683]:     </interface>
Oct 16 11:16:31 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:16:31 user nova-compute[74683]:       <mac address="fa:16:3e:d8:a4:a5"/>
Oct 16 11:16:31 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:16:31 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:16:31 user nova-compute[74683]:       <target dev="tapf447e989-eb"/>
Oct 16 11:16:31 user nova-compute[74683]:     </interface>
Oct 16 11:16:31 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:16:31 user nova-compute[74683]:       <mac address="fa:16:3e:13:b8:ac"/>
Oct 16 11:16:31 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:16:31 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:16:31 user nova-compute[74683]:       <target dev="tap4a78f612-a4"/>
Oct 16 11:16:31 user nova-compute[74683]:     </interface>
Oct 16 11:16:31 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:16:31 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/d944f646-4c4d-4712-8dfe-9b1f0ff60683/console.log" append="off"/>
Oct 16 11:16:31 user nova-compute[74683]:     </serial>
Oct 16 11:16:31 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:16:31 user nova-compute[74683]:     <video>
Oct 16 11:16:31 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:16:31 user nova-compute[74683]:     </video>
Oct 16 11:16:31 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:16:31 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:16:31 user nova-compute[74683]:     </rng>
Oct 16 11:16:31 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:16:31 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:16:31 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:16:31 user nova-compute[74683]:     </memballoon>
Oct 16 11:16:31 user nova-compute[74683]:   </devices>
Oct 16 11:16:31 user nova-compute[74683]: </domain>
Oct 16 11:16:31 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T11:14:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-153004525',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-153004525',id=11,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPT0wFGepT2AbMdp1rAx79xDZxHu2H/2AkbfKha2i6dolhWnV2tQPzUnhpCRMrAf5PLBt6Ls2nh9OlA5dn90oD2J+97H6rdIu1Yx2AsfyI0saOnNSsTFksp9Zunxk73fQ==',key_name='tempest-keypair-273034633',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ac0a84f26f244dcb698429bb447feff',ramdisk_id='',reservation_id='r-ev6lcphm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2030851280',owner_user_name='tempest-TaggedBootDevicesTest_v242-2030851280-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:14:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='08a96cdfeb5746cea70a478c307e5998',uuid=d944f646-4c4d-4712-8dfe-9b1f0ff60683,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e57a2375-e447-4210-bbcf-41b3e5fc247c", "address": "fa:16:3e:20:c8:bf", "network": {"id": "540c0f36-606c-4006-8d84-50054c6727fa", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-308363250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape57a2375-e4", "ovs_interfaceid": "e57a2375-e447-4210-bbcf-41b3e5fc247c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Converting VIF {"id": "e57a2375-e447-4210-bbcf-41b3e5fc247c", "address": "fa:16:3e:20:c8:bf", "network": {"id": "540c0f36-606c-4006-8d84-50054c6727fa", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-308363250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape57a2375-e4", "ovs_interfaceid": "e57a2375-e447-4210-bbcf-41b3e5fc247c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:c8:bf,bridge_name='br-int',has_traffic_filtering=True,id=e57a2375-e447-4210-bbcf-41b3e5fc247c,network=Network(540c0f36-606c-4006-8d84-50054c6727fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape57a2375-e4') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG os_vif [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:c8:bf,bridge_name='br-int',has_traffic_filtering=True,id=e57a2375-e447-4210-bbcf-41b3e5fc247c,network=Network(540c0f36-606c-4006-8d84-50054c6727fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape57a2375-e4') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3bc88914-f449-56e1-bb3e-71b06dd43cd5', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape57a2375-e4, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape57a2375-e4, col_values=(('qos', UUID('ca8ac82e-15d4-484b-a8d4-df54590f30e0')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape57a2375-e4, col_values=(('external_ids', {'iface-id': 'e57a2375-e447-4210-bbcf-41b3e5fc247c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:c8:bf', 'vm-uuid': 'd944f646-4c4d-4712-8dfe-9b1f0ff60683'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:31 user nova-compute[74683]: INFO os_vif [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:c8:bf,bridge_name='br-int',has_traffic_filtering=True,id=e57a2375-e447-4210-bbcf-41b3e5fc247c,network=Network(540c0f36-606c-4006-8d84-50054c6727fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape57a2375-e4')
Oct 16 11:16:31 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T11:14:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-153004525',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-153004525',id=11,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPT0wFGepT2AbMdp1rAx79xDZxHu2H/2AkbfKha2i6dolhWnV2tQPzUnhpCRMrAf5PLBt6Ls2nh9OlA5dn90oD2J+97H6rdIu1Yx2AsfyI0saOnNSsTFksp9Zunxk73fQ==',key_name='tempest-keypair-273034633',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ac0a84f26f244dcb698429bb447feff',ramdisk_id='',reservation_id='r-ev6lcphm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2030851280',owner_user_name='tempest-TaggedBootDevicesTest_v242-2030851280-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:14:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='08a96cdfeb5746cea70a478c307e5998',uuid=d944f646-4c4d-4712-8dfe-9b1f0ff60683,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce7eb587-a6b4-4512-b0e2-80a4da1dbfb4", "address": "fa:16:3e:63:d7:c6", "network": {"id": "c1575c96-f936-4f92-9b3c-6355d69d0f52", "bridge": "br-int", "label": "tempest-device-tagging-net1-1179473676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce7eb587-a6", "ovs_interfaceid": "ce7eb587-a6b4-4512-b0e2-80a4da1dbfb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Converting VIF {"id": "ce7eb587-a6b4-4512-b0e2-80a4da1dbfb4", "address": "fa:16:3e:63:d7:c6", "network": {"id": "c1575c96-f936-4f92-9b3c-6355d69d0f52", "bridge": "br-int", "label": "tempest-device-tagging-net1-1179473676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce7eb587-a6", "ovs_interfaceid": "ce7eb587-a6b4-4512-b0e2-80a4da1dbfb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:d7:c6,bridge_name='br-int',has_traffic_filtering=True,id=ce7eb587-a6b4-4512-b0e2-80a4da1dbfb4,network=Network(c1575c96-f936-4f92-9b3c-6355d69d0f52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapce7eb587-a6') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG os_vif [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:d7:c6,bridge_name='br-int',has_traffic_filtering=True,id=ce7eb587-a6b4-4512-b0e2-80a4da1dbfb4,network=Network(c1575c96-f936-4f92-9b3c-6355d69d0f52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapce7eb587-a6') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ffad4118-41cf-5483-86dc-e28c0cff40d7', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapce7eb587-a6, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapce7eb587-a6, col_values=(('qos', UUID('5e37a2be-5dd7-4df4-ba4c-361174148a22')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapce7eb587-a6, col_values=(('external_ids', {'iface-id': 'ce7eb587-a6b4-4512-b0e2-80a4da1dbfb4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:d7:c6', 'vm-uuid': 'd944f646-4c4d-4712-8dfe-9b1f0ff60683'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:31 user nova-compute[74683]: INFO os_vif [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:d7:c6,bridge_name='br-int',has_traffic_filtering=True,id=ce7eb587-a6b4-4512-b0e2-80a4da1dbfb4,network=Network(c1575c96-f936-4f92-9b3c-6355d69d0f52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapce7eb587-a6')
Oct 16 11:16:31 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T11:14:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-153004525',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-153004525',id=11,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPT0wFGepT2AbMdp1rAx79xDZxHu2H/2AkbfKha2i6dolhWnV2tQPzUnhpCRMrAf5PLBt6Ls2nh9OlA5dn90oD2J+97H6rdIu1Yx2AsfyI0saOnNSsTFksp9Zunxk73fQ==',key_name='tempest-keypair-273034633',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ac0a84f26f244dcb698429bb447feff',ramdisk_id='',reservation_id='r-ev6lcphm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2030851280',owner_user_name='tempest-TaggedBootDevicesTest_v242-2030851280-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:14:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='08a96cdfeb5746cea70a478c307e5998',uuid=d944f646-4c4d-4712-8dfe-9b1f0ff60683,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6b7eb88-42a3-46b9-8cd2-5b5b06d8849a", "address": "fa:16:3e:9b:41:93", "network": {"id": "c1575c96-f936-4f92-9b3c-6355d69d0f52", "bridge": "br-int", "label": "tempest-device-tagging-net1-1179473676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6b7eb88-42", "ovs_interfaceid": "a6b7eb88-42a3-46b9-8cd2-5b5b06d8849a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Converting VIF {"id": "a6b7eb88-42a3-46b9-8cd2-5b5b06d8849a", "address": "fa:16:3e:9b:41:93", "network": {"id": "c1575c96-f936-4f92-9b3c-6355d69d0f52", "bridge": "br-int", "label": "tempest-device-tagging-net1-1179473676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6b7eb88-42", "ovs_interfaceid": "a6b7eb88-42a3-46b9-8cd2-5b5b06d8849a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:41:93,bridge_name='br-int',has_traffic_filtering=True,id=a6b7eb88-42a3-46b9-8cd2-5b5b06d8849a,network=Network(c1575c96-f936-4f92-9b3c-6355d69d0f52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa6b7eb88-42') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG os_vif [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:41:93,bridge_name='br-int',has_traffic_filtering=True,id=a6b7eb88-42a3-46b9-8cd2-5b5b06d8849a,network=Network(c1575c96-f936-4f92-9b3c-6355d69d0f52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa6b7eb88-42') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '88a843cc-9592-57e8-aa89-a686dda86773', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa6b7eb88-42, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa6b7eb88-42, col_values=(('qos', UUID('c80f6a54-12f1-46cf-9232-e21a77402c83')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa6b7eb88-42, col_values=(('external_ids', {'iface-id': 'a6b7eb88-42a3-46b9-8cd2-5b5b06d8849a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:41:93', 'vm-uuid': 'd944f646-4c4d-4712-8dfe-9b1f0ff60683'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:31 user nova-compute[74683]: INFO os_vif [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:41:93,bridge_name='br-int',has_traffic_filtering=True,id=a6b7eb88-42a3-46b9-8cd2-5b5b06d8849a,network=Network(c1575c96-f936-4f92-9b3c-6355d69d0f52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa6b7eb88-42')
Oct 16 11:16:31 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T11:14:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-153004525',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-153004525',id=11,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPT0wFGepT2AbMdp1rAx79xDZxHu2H/2AkbfKha2i6dolhWnV2tQPzUnhpCRMrAf5PLBt6Ls2nh9OlA5dn90oD2J+97H6rdIu1Yx2AsfyI0saOnNSsTFksp9Zunxk73fQ==',key_name='tempest-keypair-273034633',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ac0a84f26f244dcb698429bb447feff',ramdisk_id='',reservation_id='r-ev6lcphm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2030851280',owner_user_name='tempest-TaggedBootDevicesTest_v242-2030851280-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:14:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='08a96cdfeb5746cea70a478c307e5998',uuid=d944f646-4c4d-4712-8dfe-9b1f0ff60683,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9cb93e0f-104e-4f2b-9b61-6d89781b34ca", "address": "fa:16:3e:cd:71:b8", "network": {"id": "c1575c96-f936-4f92-9b3c-6355d69d0f52", "bridge": "br-int", "label": "tempest-device-tagging-net1-1179473676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cb93e0f-10", "ovs_interfaceid": "9cb93e0f-104e-4f2b-9b61-6d89781b34ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Converting VIF {"id": "9cb93e0f-104e-4f2b-9b61-6d89781b34ca", "address": "fa:16:3e:cd:71:b8", "network": {"id": "c1575c96-f936-4f92-9b3c-6355d69d0f52", "bridge": "br-int", "label": "tempest-device-tagging-net1-1179473676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cb93e0f-10", "ovs_interfaceid": "9cb93e0f-104e-4f2b-9b61-6d89781b34ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:71:b8,bridge_name='br-int',has_traffic_filtering=True,id=9cb93e0f-104e-4f2b-9b61-6d89781b34ca,network=Network(c1575c96-f936-4f92-9b3c-6355d69d0f52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cb93e0f-10') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG os_vif [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:71:b8,bridge_name='br-int',has_traffic_filtering=True,id=9cb93e0f-104e-4f2b-9b61-6d89781b34ca,network=Network(c1575c96-f936-4f92-9b3c-6355d69d0f52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cb93e0f-10') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e8a0d90c-9913-5ea4-a455-2293627fa221', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9cb93e0f-10, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9cb93e0f-10, col_values=(('qos', UUID('b469f1b6-6a44-4251-8e4a-dd5196dda8d5')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9cb93e0f-10, col_values=(('external_ids', {'iface-id': '9cb93e0f-104e-4f2b-9b61-6d89781b34ca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:71:b8', 'vm-uuid': 'd944f646-4c4d-4712-8dfe-9b1f0ff60683'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:31 user nova-compute[74683]: INFO os_vif [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:71:b8,bridge_name='br-int',has_traffic_filtering=True,id=9cb93e0f-104e-4f2b-9b61-6d89781b34ca,network=Network(c1575c96-f936-4f92-9b3c-6355d69d0f52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cb93e0f-10')
Oct 16 11:16:31 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T11:14:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-153004525',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-153004525',id=11,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPT0wFGepT2AbMdp1rAx79xDZxHu2H/2AkbfKha2i6dolhWnV2tQPzUnhpCRMrAf5PLBt6Ls2nh9OlA5dn90oD2J+97H6rdIu1Yx2AsfyI0saOnNSsTFksp9Zunxk73fQ==',key_name='tempest-keypair-273034633',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ac0a84f26f244dcb698429bb447feff',ramdisk_id='',reservation_id='r-ev6lcphm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2030851280',owner_user_name='tempest-TaggedBootDevicesTest_v242-2030851280-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:14:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='08a96cdfeb5746cea70a478c307e5998',uuid=d944f646-4c4d-4712-8dfe-9b1f0ff60683,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "890aa3e7-41ea-4c2a-bcef-7f412d80f1ac", "address": "fa:16:3e:75:e3:67", "network": {"id": "c1575c96-f936-4f92-9b3c-6355d69d0f52", "bridge": "br-int", "label": "tempest-device-tagging-net1-1179473676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap890aa3e7-41", "ovs_interfaceid": "890aa3e7-41ea-4c2a-bcef-7f412d80f1ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Converting VIF {"id": "890aa3e7-41ea-4c2a-bcef-7f412d80f1ac", "address": "fa:16:3e:75:e3:67", "network": {"id": "c1575c96-f936-4f92-9b3c-6355d69d0f52", "bridge": "br-int", "label": "tempest-device-tagging-net1-1179473676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap890aa3e7-41", "ovs_interfaceid": "890aa3e7-41ea-4c2a-bcef-7f412d80f1ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:e3:67,bridge_name='br-int',has_traffic_filtering=True,id=890aa3e7-41ea-4c2a-bcef-7f412d80f1ac,network=Network(c1575c96-f936-4f92-9b3c-6355d69d0f52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap890aa3e7-41') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG os_vif [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:e3:67,bridge_name='br-int',has_traffic_filtering=True,id=890aa3e7-41ea-4c2a-bcef-7f412d80f1ac,network=Network(c1575c96-f936-4f92-9b3c-6355d69d0f52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap890aa3e7-41') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6321f9cb-0171-5325-87b1-188d63761ef0', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:16:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap890aa3e7-41, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:16:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap890aa3e7-41, col_values=(('qos', UUID('e7760ed5-4c36-464d-ae18-31169740d14c')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:16:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap890aa3e7-41, col_values=(('external_ids', {'iface-id': '890aa3e7-41ea-4c2a-bcef-7f412d80f1ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:e3:67', 'vm-uuid': 'd944f646-4c4d-4712-8dfe-9b1f0ff60683'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:16:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:16:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:32 user nova-compute[74683]: INFO os_vif [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:e3:67,bridge_name='br-int',has_traffic_filtering=True,id=890aa3e7-41ea-4c2a-bcef-7f412d80f1ac,network=Network(c1575c96-f936-4f92-9b3c-6355d69d0f52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap890aa3e7-41')
Oct 16 11:16:32 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T11:14:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-153004525',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-153004525',id=11,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPT0wFGepT2AbMdp1rAx79xDZxHu2H/2AkbfKha2i6dolhWnV2tQPzUnhpCRMrAf5PLBt6Ls2nh9OlA5dn90oD2J+97H6rdIu1Yx2AsfyI0saOnNSsTFksp9Zunxk73fQ==',key_name='tempest-keypair-273034633',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ac0a84f26f244dcb698429bb447feff',ramdisk_id='',reservation_id='r-ev6lcphm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2030851280',owner_user_name='tempest-TaggedBootDevicesTest_v242-2030851280-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:14:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='08a96cdfeb5746cea70a478c307e5998',uuid=d944f646-4c4d-4712-8dfe-9b1f0ff60683,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f447e989-eb77-4618-9ce5-271b79c2441f", "address": "fa:16:3e:d8:a4:a5", "network": {"id": "92db7fdf-c810-43ef-883b-69a04a04e5e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-66216092", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf447e989-eb", "ovs_interfaceid": "f447e989-eb77-4618-9ce5-271b79c2441f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:16:32 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Converting VIF {"id": "f447e989-eb77-4618-9ce5-271b79c2441f", "address": "fa:16:3e:d8:a4:a5", "network": {"id": "92db7fdf-c810-43ef-883b-69a04a04e5e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-66216092", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf447e989-eb", "ovs_interfaceid": "f447e989-eb77-4618-9ce5-271b79c2441f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:16:32 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:a4:a5,bridge_name='br-int',has_traffic_filtering=True,id=f447e989-eb77-4618-9ce5-271b79c2441f,network=Network(92db7fdf-c810-43ef-883b-69a04a04e5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf447e989-eb') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:16:32 user nova-compute[74683]: DEBUG os_vif [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:a4:a5,bridge_name='br-int',has_traffic_filtering=True,id=f447e989-eb77-4618-9ce5-271b79c2441f,network=Network(92db7fdf-c810-43ef-883b-69a04a04e5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf447e989-eb') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:16:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:16:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:16:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4794cfa6-98ab-5592-bbff-5b6e97361a2a', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:16:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:16:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf447e989-eb, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:16:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf447e989-eb, col_values=(('qos', UUID('1e3e3c42-698d-438b-83c4-199b55b7870e')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:16:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf447e989-eb, col_values=(('external_ids', {'iface-id': 'f447e989-eb77-4618-9ce5-271b79c2441f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:a4:a5', 'vm-uuid': 'd944f646-4c4d-4712-8dfe-9b1f0ff60683'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:16:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:16:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:32 user nova-compute[74683]: INFO os_vif [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:a4:a5,bridge_name='br-int',has_traffic_filtering=True,id=f447e989-eb77-4618-9ce5-271b79c2441f,network=Network(92db7fdf-c810-43ef-883b-69a04a04e5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf447e989-eb')
Oct 16 11:16:32 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T11:14:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-153004525',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-153004525',id=11,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPT0wFGepT2AbMdp1rAx79xDZxHu2H/2AkbfKha2i6dolhWnV2tQPzUnhpCRMrAf5PLBt6Ls2nh9OlA5dn90oD2J+97H6rdIu1Yx2AsfyI0saOnNSsTFksp9Zunxk73fQ==',key_name='tempest-keypair-273034633',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ac0a84f26f244dcb698429bb447feff',ramdisk_id='',reservation_id='r-ev6lcphm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2030851280',owner_user_name='tempest-TaggedBootDevicesTest_v242-2030851280-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:14:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='08a96cdfeb5746cea70a478c307e5998',uuid=d944f646-4c4d-4712-8dfe-9b1f0ff60683,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a78f612-a4ed-431d-b6c6-b62a23d83a95", "address": "fa:16:3e:13:b8:ac", "network": {"id": "92db7fdf-c810-43ef-883b-69a04a04e5e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-66216092", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a78f612-a4", "ovs_interfaceid": "4a78f612-a4ed-431d-b6c6-b62a23d83a95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:16:32 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Converting VIF {"id": "4a78f612-a4ed-431d-b6c6-b62a23d83a95", "address": "fa:16:3e:13:b8:ac", "network": {"id": "92db7fdf-c810-43ef-883b-69a04a04e5e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-66216092", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a78f612-a4", "ovs_interfaceid": "4a78f612-a4ed-431d-b6c6-b62a23d83a95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:16:32 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:b8:ac,bridge_name='br-int',has_traffic_filtering=True,id=4a78f612-a4ed-431d-b6c6-b62a23d83a95,network=Network(92db7fdf-c810-43ef-883b-69a04a04e5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a78f612-a4') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:16:32 user nova-compute[74683]: DEBUG os_vif [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:b8:ac,bridge_name='br-int',has_traffic_filtering=True,id=4a78f612-a4ed-431d-b6c6-b62a23d83a95,network=Network(92db7fdf-c810-43ef-883b-69a04a04e5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a78f612-a4') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:16:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:16:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:16:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f03aa138-f9a5-56bd-b137-d5db081a3323', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:16:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:16:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4a78f612-a4, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:16:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4a78f612-a4, col_values=(('qos', UUID('aeb05028-3660-40d4-9a5f-db1dca0ba8d0')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:16:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4a78f612-a4, col_values=(('external_ids', {'iface-id': '4a78f612-a4ed-431d-b6c6-b62a23d83a95', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:b8:ac', 'vm-uuid': 'd944f646-4c4d-4712-8dfe-9b1f0ff60683'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:16:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:16:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:32 user nova-compute[74683]: INFO os_vif [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:b8:ac,bridge_name='br-int',has_traffic_filtering=True,id=4a78f612-a4ed-431d-b6c6-b62a23d83a95,network=Network(92db7fdf-c810-43ef-883b-69a04a04e5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a78f612-a4')
Oct 16 11:16:32 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] No BDM found with device name hda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:16:32 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:16:32 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] No VIF found with MAC fa:16:3e:20:c8:bf, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:16:32 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] No VIF found with MAC fa:16:3e:75:e3:67, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:16:32 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Using config drive
Oct 16 11:16:32 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Creating config drive at /opt/stack/data/nova/instances/d944f646-4c4d-4712-8dfe-9b1f0ff60683/disk.config
Oct 16 11:16:32 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d944f646-4c4d-4712-8dfe-9b1f0ff60683/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmph2c7y4kv {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:32 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d944f646-4c4d-4712-8dfe-9b1f0ff60683/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmph2c7y4kv" returned: 0 in 0.069s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-0d05d71a-bb84-4653-9fb0-e2c5d66fd52e tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Acquiring lock "53bce625-6aa9-42df-9cb4-c08958c18a47" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:16:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-0d05d71a-bb84-4653-9fb0-e2c5d66fd52e tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Lock "53bce625-6aa9-42df-9cb4-c08958c18a47" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:16:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-0d05d71a-bb84-4653-9fb0-e2c5d66fd52e tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Acquiring lock "53bce625-6aa9-42df-9cb4-c08958c18a47-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:16:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-0d05d71a-bb84-4653-9fb0-e2c5d66fd52e tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Lock "53bce625-6aa9-42df-9cb4-c08958c18a47-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:16:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-0d05d71a-bb84-4653-9fb0-e2c5d66fd52e tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Lock "53bce625-6aa9-42df-9cb4-c08958c18a47-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:16:33 user nova-compute[74683]: INFO nova.compute.manager [None req-0d05d71a-bb84-4653-9fb0-e2c5d66fd52e tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] [instance: 53bce625-6aa9-42df-9cb4-c08958c18a47] Terminating instance
Oct 16 11:16:33 user nova-compute[74683]: DEBUG nova.compute.manager [None req-0d05d71a-bb84-4653-9fb0-e2c5d66fd52e tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] [instance: 53bce625-6aa9-42df-9cb4-c08958c18a47] Start destroying the instance on the hypervisor. {{(pid=74683) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 11:16:34 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:34 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:34 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:34 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:34 user nova-compute[74683]: DEBUG nova.compute.manager [req-b941d6fe-6a0b-436c-855d-a61c7a9c5f73 req-97417406-9e2d-4ab1-bbaf-52dfed190941 service nova] [instance: 53bce625-6aa9-42df-9cb4-c08958c18a47] Received event network-vif-unplugged-758c0bbb-32ee-46bc-8731-37d03568a858 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:16:34 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b941d6fe-6a0b-436c-855d-a61c7a9c5f73 req-97417406-9e2d-4ab1-bbaf-52dfed190941 service nova] Acquiring lock "53bce625-6aa9-42df-9cb4-c08958c18a47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:16:34 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b941d6fe-6a0b-436c-855d-a61c7a9c5f73 req-97417406-9e2d-4ab1-bbaf-52dfed190941 service nova] Lock "53bce625-6aa9-42df-9cb4-c08958c18a47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:16:34 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b941d6fe-6a0b-436c-855d-a61c7a9c5f73 req-97417406-9e2d-4ab1-bbaf-52dfed190941 service nova] Lock "53bce625-6aa9-42df-9cb4-c08958c18a47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:16:34 user nova-compute[74683]: DEBUG nova.compute.manager [req-b941d6fe-6a0b-436c-855d-a61c7a9c5f73 req-97417406-9e2d-4ab1-bbaf-52dfed190941 service nova] [instance: 53bce625-6aa9-42df-9cb4-c08958c18a47] No waiting events found dispatching network-vif-unplugged-758c0bbb-32ee-46bc-8731-37d03568a858 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:16:34 user nova-compute[74683]: DEBUG nova.compute.manager [req-b941d6fe-6a0b-436c-855d-a61c7a9c5f73 req-97417406-9e2d-4ab1-bbaf-52dfed190941 service nova] [instance: 53bce625-6aa9-42df-9cb4-c08958c18a47] Received event network-vif-unplugged-758c0bbb-32ee-46bc-8731-37d03568a858 for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 11:16:34 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:34 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:34 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:35 user nova-compute[74683]: DEBUG nova.compute.manager [req-2946303d-9111-458c-b119-63105c020bb3 req-379cdd25-7498-44e4-8e02-679495e72ea3 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received event network-vif-plugged-e57a2375-e447-4210-bbcf-41b3e5fc247c {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:16:35 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-2946303d-9111-458c-b119-63105c020bb3 req-379cdd25-7498-44e4-8e02-679495e72ea3 service nova] Acquiring lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:16:35 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-2946303d-9111-458c-b119-63105c020bb3 req-379cdd25-7498-44e4-8e02-679495e72ea3 service nova] Lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:16:35 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-2946303d-9111-458c-b119-63105c020bb3 req-379cdd25-7498-44e4-8e02-679495e72ea3 service nova] Lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:16:35 user nova-compute[74683]: DEBUG nova.compute.manager [req-2946303d-9111-458c-b119-63105c020bb3 req-379cdd25-7498-44e4-8e02-679495e72ea3 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] No waiting events found dispatching network-vif-plugged-e57a2375-e447-4210-bbcf-41b3e5fc247c {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:16:35 user nova-compute[74683]: WARNING nova.compute.manager [req-2946303d-9111-458c-b119-63105c020bb3 req-379cdd25-7498-44e4-8e02-679495e72ea3 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received unexpected event network-vif-plugged-e57a2375-e447-4210-bbcf-41b3e5fc247c for instance with vm_state building and task_state spawning.
Oct 16 11:16:35 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 53bce625-6aa9-42df-9cb4-c08958c18a47] Instance destroyed successfully.
Oct 16 11:16:35 user nova-compute[74683]: DEBUG nova.objects.instance [None req-0d05d71a-bb84-4653-9fb0-e2c5d66fd52e tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Lazy-loading 'resources' on Instance uuid 53bce625-6aa9-42df-9cb4-c08958c18a47 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:16:35 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-0d05d71a-bb84-4653-9fb0-e2c5d66fd52e tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:14:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-64854216',display_name='tempest-VolumesNegativeTest-instance-64854216',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-64854216',id=10,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:14:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0cdc52ddb386435fa34000baf394c578',ramdisk_id='',reservation_id='r-sfc0k5xt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-173141477',owner_user_name='tempest-VolumesNegativeTest-173141477-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:14:52Z,user_data=None,user_id='1b891ebf84554097b0111e5cfa52431b',uuid=53bce625-6aa9-42df-9cb4-c08958c18a47,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "758c0bbb-32ee-46bc-8731-37d03568a858", "address": "fa:16:3e:70:7c:00", "network": {"id": "459c55ed-5b55-4a59-9b66-ec757f05d8c6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bb523d6f2b3446f8a5e869f72a4f150b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758c0bbb-32", "ovs_interfaceid": "758c0bbb-32ee-46bc-8731-37d03568a858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:16:35 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-0d05d71a-bb84-4653-9fb0-e2c5d66fd52e tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Converting VIF {"id": "758c0bbb-32ee-46bc-8731-37d03568a858", "address": "fa:16:3e:70:7c:00", "network": {"id": "459c55ed-5b55-4a59-9b66-ec757f05d8c6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bb523d6f2b3446f8a5e869f72a4f150b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758c0bbb-32", "ovs_interfaceid": "758c0bbb-32ee-46bc-8731-37d03568a858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:16:35 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-0d05d71a-bb84-4653-9fb0-e2c5d66fd52e tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:7c:00,bridge_name='br-int',has_traffic_filtering=True,id=758c0bbb-32ee-46bc-8731-37d03568a858,network=Network(459c55ed-5b55-4a59-9b66-ec757f05d8c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap758c0bbb-32') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:16:35 user nova-compute[74683]: DEBUG os_vif [None req-0d05d71a-bb84-4653-9fb0-e2c5d66fd52e tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:7c:00,bridge_name='br-int',has_traffic_filtering=True,id=758c0bbb-32ee-46bc-8731-37d03568a858,network=Network(459c55ed-5b55-4a59-9b66-ec757f05d8c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap758c0bbb-32') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:16:35 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:35 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap758c0bbb-32, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:16:35 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:35 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:35 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:35 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:35 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:35 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:35 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=775d527c-a723-4e2b-8e03-a58f7edbc8d9) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:16:35 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:35 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:16:35 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:35 user nova-compute[74683]: INFO os_vif [None req-0d05d71a-bb84-4653-9fb0-e2c5d66fd52e tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:7c:00,bridge_name='br-int',has_traffic_filtering=True,id=758c0bbb-32ee-46bc-8731-37d03568a858,network=Network(459c55ed-5b55-4a59-9b66-ec757f05d8c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap758c0bbb-32')
Oct 16 11:16:35 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-0d05d71a-bb84-4653-9fb0-e2c5d66fd52e tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] [instance: 53bce625-6aa9-42df-9cb4-c08958c18a47] Deleting instance files /opt/stack/data/nova/instances/53bce625-6aa9-42df-9cb4-c08958c18a47_del
Oct 16 11:16:35 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-0d05d71a-bb84-4653-9fb0-e2c5d66fd52e tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] [instance: 53bce625-6aa9-42df-9cb4-c08958c18a47] Deletion of /opt/stack/data/nova/instances/53bce625-6aa9-42df-9cb4-c08958c18a47_del complete
Oct 16 11:16:35 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:35 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:35 user nova-compute[74683]: INFO nova.compute.manager [None req-0d05d71a-bb84-4653-9fb0-e2c5d66fd52e tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] [instance: 53bce625-6aa9-42df-9cb4-c08958c18a47] Took 1.89 seconds to destroy the instance on the hypervisor.
Oct 16 11:16:35 user nova-compute[74683]: DEBUG oslo.service.loopingcall [None req-0d05d71a-bb84-4653-9fb0-e2c5d66fd52e tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74683) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 11:16:35 user nova-compute[74683]: DEBUG nova.compute.manager [-] [instance: 53bce625-6aa9-42df-9cb4-c08958c18a47] Deallocating network for instance {{(pid=74683) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 11:16:35 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: 53bce625-6aa9-42df-9cb4-c08958c18a47] deallocate_for_instance() {{(pid=74683) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 11:16:35 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:35 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:36 user nova-compute[74683]: DEBUG nova.compute.manager [req-f0c468b6-0fe9-408a-a9f8-e8b9c9cee188 req-03f7668d-417e-4a0a-8759-d956afd9fca1 service nova] [instance: 53bce625-6aa9-42df-9cb4-c08958c18a47] Received event network-vif-plugged-758c0bbb-32ee-46bc-8731-37d03568a858 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:16:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f0c468b6-0fe9-408a-a9f8-e8b9c9cee188 req-03f7668d-417e-4a0a-8759-d956afd9fca1 service nova] Acquiring lock "53bce625-6aa9-42df-9cb4-c08958c18a47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:16:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f0c468b6-0fe9-408a-a9f8-e8b9c9cee188 req-03f7668d-417e-4a0a-8759-d956afd9fca1 service nova] Lock "53bce625-6aa9-42df-9cb4-c08958c18a47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:16:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f0c468b6-0fe9-408a-a9f8-e8b9c9cee188 req-03f7668d-417e-4a0a-8759-d956afd9fca1 service nova] Lock "53bce625-6aa9-42df-9cb4-c08958c18a47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:16:36 user nova-compute[74683]: DEBUG nova.compute.manager [req-f0c468b6-0fe9-408a-a9f8-e8b9c9cee188 req-03f7668d-417e-4a0a-8759-d956afd9fca1 service nova] [instance: 53bce625-6aa9-42df-9cb4-c08958c18a47] No waiting events found dispatching network-vif-plugged-758c0bbb-32ee-46bc-8731-37d03568a858 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:16:36 user nova-compute[74683]: WARNING nova.compute.manager [req-f0c468b6-0fe9-408a-a9f8-e8b9c9cee188 req-03f7668d-417e-4a0a-8759-d956afd9fca1 service nova] [instance: 53bce625-6aa9-42df-9cb4-c08958c18a47] Received unexpected event network-vif-plugged-758c0bbb-32ee-46bc-8731-37d03568a858 for instance with vm_state active and task_state deleting.
Oct 16 11:16:36 user nova-compute[74683]: DEBUG nova.compute.manager [req-f0c468b6-0fe9-408a-a9f8-e8b9c9cee188 req-03f7668d-417e-4a0a-8759-d956afd9fca1 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received event network-vif-plugged-ce7eb587-a6b4-4512-b0e2-80a4da1dbfb4 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:16:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f0c468b6-0fe9-408a-a9f8-e8b9c9cee188 req-03f7668d-417e-4a0a-8759-d956afd9fca1 service nova] Acquiring lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:16:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f0c468b6-0fe9-408a-a9f8-e8b9c9cee188 req-03f7668d-417e-4a0a-8759-d956afd9fca1 service nova] Lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:16:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f0c468b6-0fe9-408a-a9f8-e8b9c9cee188 req-03f7668d-417e-4a0a-8759-d956afd9fca1 service nova] Lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:16:36 user nova-compute[74683]: DEBUG nova.compute.manager [req-f0c468b6-0fe9-408a-a9f8-e8b9c9cee188 req-03f7668d-417e-4a0a-8759-d956afd9fca1 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] No waiting events found dispatching network-vif-plugged-ce7eb587-a6b4-4512-b0e2-80a4da1dbfb4 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:16:36 user nova-compute[74683]: WARNING nova.compute.manager [req-f0c468b6-0fe9-408a-a9f8-e8b9c9cee188 req-03f7668d-417e-4a0a-8759-d956afd9fca1 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received unexpected event network-vif-plugged-ce7eb587-a6b4-4512-b0e2-80a4da1dbfb4 for instance with vm_state building and task_state spawning.
Oct 16 11:16:36 user nova-compute[74683]: DEBUG nova.compute.manager [req-f0c468b6-0fe9-408a-a9f8-e8b9c9cee188 req-03f7668d-417e-4a0a-8759-d956afd9fca1 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received event network-vif-plugged-ce7eb587-a6b4-4512-b0e2-80a4da1dbfb4 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:16:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f0c468b6-0fe9-408a-a9f8-e8b9c9cee188 req-03f7668d-417e-4a0a-8759-d956afd9fca1 service nova] Acquiring lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:16:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f0c468b6-0fe9-408a-a9f8-e8b9c9cee188 req-03f7668d-417e-4a0a-8759-d956afd9fca1 service nova] Lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:16:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f0c468b6-0fe9-408a-a9f8-e8b9c9cee188 req-03f7668d-417e-4a0a-8759-d956afd9fca1 service nova] Lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:16:36 user nova-compute[74683]: DEBUG nova.compute.manager [req-f0c468b6-0fe9-408a-a9f8-e8b9c9cee188 req-03f7668d-417e-4a0a-8759-d956afd9fca1 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] No waiting events found dispatching network-vif-plugged-ce7eb587-a6b4-4512-b0e2-80a4da1dbfb4 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:16:36 user nova-compute[74683]: WARNING nova.compute.manager [req-f0c468b6-0fe9-408a-a9f8-e8b9c9cee188 req-03f7668d-417e-4a0a-8759-d956afd9fca1 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received unexpected event network-vif-plugged-ce7eb587-a6b4-4512-b0e2-80a4da1dbfb4 for instance with vm_state building and task_state spawning.
Oct 16 11:16:36 user nova-compute[74683]: DEBUG nova.compute.manager [req-f0c468b6-0fe9-408a-a9f8-e8b9c9cee188 req-03f7668d-417e-4a0a-8759-d956afd9fca1 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received event network-vif-plugged-a6b7eb88-42a3-46b9-8cd2-5b5b06d8849a {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:16:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f0c468b6-0fe9-408a-a9f8-e8b9c9cee188 req-03f7668d-417e-4a0a-8759-d956afd9fca1 service nova] Acquiring lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:16:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f0c468b6-0fe9-408a-a9f8-e8b9c9cee188 req-03f7668d-417e-4a0a-8759-d956afd9fca1 service nova] Lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:16:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f0c468b6-0fe9-408a-a9f8-e8b9c9cee188 req-03f7668d-417e-4a0a-8759-d956afd9fca1 service nova] Lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:16:36 user nova-compute[74683]: DEBUG nova.compute.manager [req-f0c468b6-0fe9-408a-a9f8-e8b9c9cee188 req-03f7668d-417e-4a0a-8759-d956afd9fca1 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] No waiting events found dispatching network-vif-plugged-a6b7eb88-42a3-46b9-8cd2-5b5b06d8849a {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:16:36 user nova-compute[74683]: WARNING nova.compute.manager [req-f0c468b6-0fe9-408a-a9f8-e8b9c9cee188 req-03f7668d-417e-4a0a-8759-d956afd9fca1 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received unexpected event network-vif-plugged-a6b7eb88-42a3-46b9-8cd2-5b5b06d8849a for instance with vm_state building and task_state spawning.
Oct 16 11:16:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:36 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: 53bce625-6aa9-42df-9cb4-c08958c18a47] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:16:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:36 user nova-compute[74683]: DEBUG nova.compute.manager [req-e3d82000-8c2a-4f36-9073-9a2650d159af req-ec5a738b-b5fe-4061-90e8-c438ec3e38ed service nova] [instance: 53bce625-6aa9-42df-9cb4-c08958c18a47] Received event network-vif-deleted-758c0bbb-32ee-46bc-8731-37d03568a858 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:16:36 user nova-compute[74683]: INFO nova.compute.manager [req-e3d82000-8c2a-4f36-9073-9a2650d159af req-ec5a738b-b5fe-4061-90e8-c438ec3e38ed service nova] [instance: 53bce625-6aa9-42df-9cb4-c08958c18a47] Neutron deleted interface 758c0bbb-32ee-46bc-8731-37d03568a858; detaching it from the instance and deleting it from the info cache
Oct 16 11:16:36 user nova-compute[74683]: DEBUG nova.network.neutron [req-e3d82000-8c2a-4f36-9073-9a2650d159af req-ec5a738b-b5fe-4061-90e8-c438ec3e38ed service nova] [instance: 53bce625-6aa9-42df-9cb4-c08958c18a47] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:16:36 user nova-compute[74683]: INFO nova.compute.manager [-] [instance: 53bce625-6aa9-42df-9cb4-c08958c18a47] Took 0.70 seconds to deallocate network for instance.
Oct 16 11:16:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:36 user nova-compute[74683]: DEBUG nova.compute.manager [req-e3d82000-8c2a-4f36-9073-9a2650d159af req-ec5a738b-b5fe-4061-90e8-c438ec3e38ed service nova] [instance: 53bce625-6aa9-42df-9cb4-c08958c18a47] Detach interface failed, port_id=758c0bbb-32ee-46bc-8731-37d03568a858, reason: Instance 53bce625-6aa9-42df-9cb4-c08958c18a47 could not be found. {{(pid=74683) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 16 11:16:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-0d05d71a-bb84-4653-9fb0-e2c5d66fd52e tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:16:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-0d05d71a-bb84-4653-9fb0-e2c5d66fd52e tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:16:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:37 user nova-compute[74683]: DEBUG nova.compute.manager [req-a1601370-f0c3-437f-a0b8-edc9d87aa6c6 req-b103abb6-e7a2-4425-84de-48ffb0d7e661 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received event network-vif-plugged-e57a2375-e447-4210-bbcf-41b3e5fc247c {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:16:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a1601370-f0c3-437f-a0b8-edc9d87aa6c6 req-b103abb6-e7a2-4425-84de-48ffb0d7e661 service nova] Acquiring lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:16:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a1601370-f0c3-437f-a0b8-edc9d87aa6c6 req-b103abb6-e7a2-4425-84de-48ffb0d7e661 service nova] Lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:16:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a1601370-f0c3-437f-a0b8-edc9d87aa6c6 req-b103abb6-e7a2-4425-84de-48ffb0d7e661 service nova] Lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:16:37 user nova-compute[74683]: DEBUG nova.compute.manager [req-a1601370-f0c3-437f-a0b8-edc9d87aa6c6 req-b103abb6-e7a2-4425-84de-48ffb0d7e661 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] No waiting events found dispatching network-vif-plugged-e57a2375-e447-4210-bbcf-41b3e5fc247c {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:16:37 user nova-compute[74683]: WARNING nova.compute.manager [req-a1601370-f0c3-437f-a0b8-edc9d87aa6c6 req-b103abb6-e7a2-4425-84de-48ffb0d7e661 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received unexpected event network-vif-plugged-e57a2375-e447-4210-bbcf-41b3e5fc247c for instance with vm_state building and task_state spawning.
Oct 16 11:16:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:37 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-0d05d71a-bb84-4653-9fb0-e2c5d66fd52e tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:16:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:37 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-0d05d71a-bb84-4653-9fb0-e2c5d66fd52e tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:16:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-0d05d71a-bb84-4653-9fb0-e2c5d66fd52e tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.615s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:16:37 user nova-compute[74683]: INFO nova.scheduler.client.report [None req-0d05d71a-bb84-4653-9fb0-e2c5d66fd52e tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Deleted allocations for instance 53bce625-6aa9-42df-9cb4-c08958c18a47
Oct 16 11:16:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-0d05d71a-bb84-4653-9fb0-e2c5d66fd52e tempest-VolumesNegativeTest-173141477 tempest-VolumesNegativeTest-173141477-project-member] Lock "53bce625-6aa9-42df-9cb4-c08958c18a47" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.528s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:16:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:38 user nova-compute[74683]: DEBUG nova.compute.manager [req-88b276cb-0ac4-44a0-a4ab-fc3047d30026 req-e4f35cea-244c-49c9-9b56-a9e7db580404 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received event network-vif-plugged-a6b7eb88-42a3-46b9-8cd2-5b5b06d8849a {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:16:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-88b276cb-0ac4-44a0-a4ab-fc3047d30026 req-e4f35cea-244c-49c9-9b56-a9e7db580404 service nova] Acquiring lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:16:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-88b276cb-0ac4-44a0-a4ab-fc3047d30026 req-e4f35cea-244c-49c9-9b56-a9e7db580404 service nova] Lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:16:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-88b276cb-0ac4-44a0-a4ab-fc3047d30026 req-e4f35cea-244c-49c9-9b56-a9e7db580404 service nova] Lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:16:38 user nova-compute[74683]: DEBUG nova.compute.manager [req-88b276cb-0ac4-44a0-a4ab-fc3047d30026 req-e4f35cea-244c-49c9-9b56-a9e7db580404 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] No waiting events found dispatching network-vif-plugged-a6b7eb88-42a3-46b9-8cd2-5b5b06d8849a {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:16:38 user nova-compute[74683]: WARNING nova.compute.manager [req-88b276cb-0ac4-44a0-a4ab-fc3047d30026 req-e4f35cea-244c-49c9-9b56-a9e7db580404 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received unexpected event network-vif-plugged-a6b7eb88-42a3-46b9-8cd2-5b5b06d8849a for instance with vm_state building and task_state spawning.
Oct 16 11:16:38 user nova-compute[74683]: DEBUG nova.compute.manager [req-88b276cb-0ac4-44a0-a4ab-fc3047d30026 req-e4f35cea-244c-49c9-9b56-a9e7db580404 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received event network-vif-plugged-9cb93e0f-104e-4f2b-9b61-6d89781b34ca {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:16:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-88b276cb-0ac4-44a0-a4ab-fc3047d30026 req-e4f35cea-244c-49c9-9b56-a9e7db580404 service nova] Acquiring lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:16:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-88b276cb-0ac4-44a0-a4ab-fc3047d30026 req-e4f35cea-244c-49c9-9b56-a9e7db580404 service nova] Lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:16:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-88b276cb-0ac4-44a0-a4ab-fc3047d30026 req-e4f35cea-244c-49c9-9b56-a9e7db580404 service nova] Lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:16:38 user nova-compute[74683]: DEBUG nova.compute.manager [req-88b276cb-0ac4-44a0-a4ab-fc3047d30026 req-e4f35cea-244c-49c9-9b56-a9e7db580404 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] No waiting events found dispatching network-vif-plugged-9cb93e0f-104e-4f2b-9b61-6d89781b34ca {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:16:38 user nova-compute[74683]: WARNING nova.compute.manager [req-88b276cb-0ac4-44a0-a4ab-fc3047d30026 req-e4f35cea-244c-49c9-9b56-a9e7db580404 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received unexpected event network-vif-plugged-9cb93e0f-104e-4f2b-9b61-6d89781b34ca for instance with vm_state building and task_state spawning.
Oct 16 11:16:38 user nova-compute[74683]: DEBUG nova.compute.manager [req-88b276cb-0ac4-44a0-a4ab-fc3047d30026 req-e4f35cea-244c-49c9-9b56-a9e7db580404 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received event network-vif-plugged-9cb93e0f-104e-4f2b-9b61-6d89781b34ca {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:16:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-88b276cb-0ac4-44a0-a4ab-fc3047d30026 req-e4f35cea-244c-49c9-9b56-a9e7db580404 service nova] Acquiring lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:16:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-88b276cb-0ac4-44a0-a4ab-fc3047d30026 req-e4f35cea-244c-49c9-9b56-a9e7db580404 service nova] Lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:16:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-88b276cb-0ac4-44a0-a4ab-fc3047d30026 req-e4f35cea-244c-49c9-9b56-a9e7db580404 service nova] Lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:16:38 user nova-compute[74683]: DEBUG nova.compute.manager [req-88b276cb-0ac4-44a0-a4ab-fc3047d30026 req-e4f35cea-244c-49c9-9b56-a9e7db580404 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] No waiting events found dispatching network-vif-plugged-9cb93e0f-104e-4f2b-9b61-6d89781b34ca {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:16:38 user nova-compute[74683]: WARNING nova.compute.manager [req-88b276cb-0ac4-44a0-a4ab-fc3047d30026 req-e4f35cea-244c-49c9-9b56-a9e7db580404 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received unexpected event network-vif-plugged-9cb93e0f-104e-4f2b-9b61-6d89781b34ca for instance with vm_state building and task_state spawning.
Oct 16 11:16:38 user nova-compute[74683]: DEBUG nova.compute.manager [req-88b276cb-0ac4-44a0-a4ab-fc3047d30026 req-e4f35cea-244c-49c9-9b56-a9e7db580404 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received event network-vif-plugged-890aa3e7-41ea-4c2a-bcef-7f412d80f1ac {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:16:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-88b276cb-0ac4-44a0-a4ab-fc3047d30026 req-e4f35cea-244c-49c9-9b56-a9e7db580404 service nova] Acquiring lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:16:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-88b276cb-0ac4-44a0-a4ab-fc3047d30026 req-e4f35cea-244c-49c9-9b56-a9e7db580404 service nova] Lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:16:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-88b276cb-0ac4-44a0-a4ab-fc3047d30026 req-e4f35cea-244c-49c9-9b56-a9e7db580404 service nova] Lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:16:38 user nova-compute[74683]: DEBUG nova.compute.manager [req-88b276cb-0ac4-44a0-a4ab-fc3047d30026 req-e4f35cea-244c-49c9-9b56-a9e7db580404 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] No waiting events found dispatching network-vif-plugged-890aa3e7-41ea-4c2a-bcef-7f412d80f1ac {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:16:38 user nova-compute[74683]: WARNING nova.compute.manager [req-88b276cb-0ac4-44a0-a4ab-fc3047d30026 req-e4f35cea-244c-49c9-9b56-a9e7db580404 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received unexpected event network-vif-plugged-890aa3e7-41ea-4c2a-bcef-7f412d80f1ac for instance with vm_state building and task_state spawning.
Oct 16 11:16:38 user nova-compute[74683]: DEBUG nova.compute.manager [req-88b276cb-0ac4-44a0-a4ab-fc3047d30026 req-e4f35cea-244c-49c9-9b56-a9e7db580404 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received event network-vif-plugged-890aa3e7-41ea-4c2a-bcef-7f412d80f1ac {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:16:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-88b276cb-0ac4-44a0-a4ab-fc3047d30026 req-e4f35cea-244c-49c9-9b56-a9e7db580404 service nova] Acquiring lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:16:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-88b276cb-0ac4-44a0-a4ab-fc3047d30026 req-e4f35cea-244c-49c9-9b56-a9e7db580404 service nova] Lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:16:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-88b276cb-0ac4-44a0-a4ab-fc3047d30026 req-e4f35cea-244c-49c9-9b56-a9e7db580404 service nova] Lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:16:38 user nova-compute[74683]: DEBUG nova.compute.manager [req-88b276cb-0ac4-44a0-a4ab-fc3047d30026 req-e4f35cea-244c-49c9-9b56-a9e7db580404 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] No waiting events found dispatching network-vif-plugged-890aa3e7-41ea-4c2a-bcef-7f412d80f1ac {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:16:38 user nova-compute[74683]: WARNING nova.compute.manager [req-88b276cb-0ac4-44a0-a4ab-fc3047d30026 req-e4f35cea-244c-49c9-9b56-a9e7db580404 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received unexpected event network-vif-plugged-890aa3e7-41ea-4c2a-bcef-7f412d80f1ac for instance with vm_state building and task_state spawning.
Oct 16 11:16:38 user nova-compute[74683]: DEBUG nova.compute.manager [req-88b276cb-0ac4-44a0-a4ab-fc3047d30026 req-e4f35cea-244c-49c9-9b56-a9e7db580404 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received event network-vif-plugged-f447e989-eb77-4618-9ce5-271b79c2441f {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:16:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-88b276cb-0ac4-44a0-a4ab-fc3047d30026 req-e4f35cea-244c-49c9-9b56-a9e7db580404 service nova] Acquiring lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:16:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-88b276cb-0ac4-44a0-a4ab-fc3047d30026 req-e4f35cea-244c-49c9-9b56-a9e7db580404 service nova] Lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:16:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-88b276cb-0ac4-44a0-a4ab-fc3047d30026 req-e4f35cea-244c-49c9-9b56-a9e7db580404 service nova] Lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:16:38 user nova-compute[74683]: DEBUG nova.compute.manager [req-88b276cb-0ac4-44a0-a4ab-fc3047d30026 req-e4f35cea-244c-49c9-9b56-a9e7db580404 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] No waiting events found dispatching network-vif-plugged-f447e989-eb77-4618-9ce5-271b79c2441f {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:16:38 user nova-compute[74683]: WARNING nova.compute.manager [req-88b276cb-0ac4-44a0-a4ab-fc3047d30026 req-e4f35cea-244c-49c9-9b56-a9e7db580404 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received unexpected event network-vif-plugged-f447e989-eb77-4618-9ce5-271b79c2441f for instance with vm_state building and task_state spawning.
Oct 16 11:16:38 user nova-compute[74683]: DEBUG nova.compute.manager [req-88b276cb-0ac4-44a0-a4ab-fc3047d30026 req-e4f35cea-244c-49c9-9b56-a9e7db580404 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received event network-vif-plugged-f447e989-eb77-4618-9ce5-271b79c2441f {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:16:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-88b276cb-0ac4-44a0-a4ab-fc3047d30026 req-e4f35cea-244c-49c9-9b56-a9e7db580404 service nova] Acquiring lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:16:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-88b276cb-0ac4-44a0-a4ab-fc3047d30026 req-e4f35cea-244c-49c9-9b56-a9e7db580404 service nova] Lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:16:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-88b276cb-0ac4-44a0-a4ab-fc3047d30026 req-e4f35cea-244c-49c9-9b56-a9e7db580404 service nova] Lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:16:38 user nova-compute[74683]: DEBUG nova.compute.manager [req-88b276cb-0ac4-44a0-a4ab-fc3047d30026 req-e4f35cea-244c-49c9-9b56-a9e7db580404 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] No waiting events found dispatching network-vif-plugged-f447e989-eb77-4618-9ce5-271b79c2441f {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:16:38 user nova-compute[74683]: WARNING nova.compute.manager [req-88b276cb-0ac4-44a0-a4ab-fc3047d30026 req-e4f35cea-244c-49c9-9b56-a9e7db580404 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received unexpected event network-vif-plugged-f447e989-eb77-4618-9ce5-271b79c2441f for instance with vm_state building and task_state spawning.
Oct 16 11:16:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:38 user nova-compute[74683]: DEBUG nova.compute.manager [req-f3f16312-f901-44a6-8095-4745b69f3db3 req-482ca38c-b925-41da-9ae2-8971e6f1c202 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received event network-vif-plugged-4a78f612-a4ed-431d-b6c6-b62a23d83a95 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:16:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f3f16312-f901-44a6-8095-4745b69f3db3 req-482ca38c-b925-41da-9ae2-8971e6f1c202 service nova] Acquiring lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:16:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f3f16312-f901-44a6-8095-4745b69f3db3 req-482ca38c-b925-41da-9ae2-8971e6f1c202 service nova] Lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:16:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f3f16312-f901-44a6-8095-4745b69f3db3 req-482ca38c-b925-41da-9ae2-8971e6f1c202 service nova] Lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:16:38 user nova-compute[74683]: DEBUG nova.compute.manager [req-f3f16312-f901-44a6-8095-4745b69f3db3 req-482ca38c-b925-41da-9ae2-8971e6f1c202 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] No waiting events found dispatching network-vif-plugged-4a78f612-a4ed-431d-b6c6-b62a23d83a95 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:16:38 user nova-compute[74683]: WARNING nova.compute.manager [req-f3f16312-f901-44a6-8095-4745b69f3db3 req-482ca38c-b925-41da-9ae2-8971e6f1c202 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received unexpected event network-vif-plugged-4a78f612-a4ed-431d-b6c6-b62a23d83a95 for instance with vm_state building and task_state spawning.
Oct 16 11:16:38 user nova-compute[74683]: DEBUG nova.compute.manager [req-f3f16312-f901-44a6-8095-4745b69f3db3 req-482ca38c-b925-41da-9ae2-8971e6f1c202 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received event network-vif-plugged-4a78f612-a4ed-431d-b6c6-b62a23d83a95 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:16:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f3f16312-f901-44a6-8095-4745b69f3db3 req-482ca38c-b925-41da-9ae2-8971e6f1c202 service nova] Acquiring lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:16:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f3f16312-f901-44a6-8095-4745b69f3db3 req-482ca38c-b925-41da-9ae2-8971e6f1c202 service nova] Lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:16:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f3f16312-f901-44a6-8095-4745b69f3db3 req-482ca38c-b925-41da-9ae2-8971e6f1c202 service nova] Lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:16:38 user nova-compute[74683]: DEBUG nova.compute.manager [req-f3f16312-f901-44a6-8095-4745b69f3db3 req-482ca38c-b925-41da-9ae2-8971e6f1c202 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] No waiting events found dispatching network-vif-plugged-4a78f612-a4ed-431d-b6c6-b62a23d83a95 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:16:38 user nova-compute[74683]: WARNING nova.compute.manager [req-f3f16312-f901-44a6-8095-4745b69f3db3 req-482ca38c-b925-41da-9ae2-8971e6f1c202 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received unexpected event network-vif-plugged-4a78f612-a4ed-431d-b6c6-b62a23d83a95 for instance with vm_state building and task_state spawning.
Oct 16 11:16:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:39 user nova-compute[74683]: DEBUG nova.compute.manager [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Instance event wait completed in 0 seconds for  {{(pid=74683) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 11:16:39 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Guest created on hypervisor {{(pid=74683) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 11:16:39 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Instance spawned successfully.
Oct 16 11:16:39 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 11:16:39 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Found default for hw_cdrom_bus of ide {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:16:39 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Found default for hw_disk_bus of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:16:39 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Found default for hw_input_bus of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:16:39 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Found default for hw_pointer_model of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:16:39 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Found default for hw_video_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:16:39 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Found default for hw_vif_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:16:39 user nova-compute[74683]: INFO nova.compute.manager [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Took 12.58 seconds to spawn the instance on the hypervisor.
Oct 16 11:16:39 user nova-compute[74683]: DEBUG nova.compute.manager [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:16:39 user nova-compute[74683]: INFO nova.compute.manager [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Took 109.04 seconds to build instance.
Oct 16 11:16:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-e081c442-706d-43da-ae6a-6aebfe20f405 tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 109.147s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:16:40 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-1dc04ab5-59fb-4d1e-b28d-8e3048a75621 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7 is timed out.
Oct 16 11:16:40 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-1dc04ab5-59fb-4d1e-b28d-8e3048a75621 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Successfully detached device vdb from instance fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7 from the live domain config.
Oct 16 11:16:40 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1dc04ab5-59fb-4d1e-b28d-8e3048a75621 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] calling os-brick to detach iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 11:16:40 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dc04ab5-59fb-4d1e-b28d-8e3048a75621 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, {'target_iqn': 'iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fLruHFKd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:16:40 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-1dc04ab5-59fb-4d1e-b28d-8e3048a75621 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:16:40 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-1dc04ab5-59fb-4d1e-b28d-8e3048a75621 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:16:40 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-1dc04ab5-59fb-4d1e-b28d-8e3048a75621 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:16:40 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:40 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:40 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ee84d2-f51d-485c-98e9-efa337c06ca0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:40 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dc04ab5-59fb-4d1e-b28d-8e3048a75621 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 11:16:40 user nova-compute[74683]: No targets found.
Oct 16 11:16:40 user nova-compute[74683]: iSNS:
Oct 16 11:16:40 user nova-compute[74683]: No targets found.
Oct 16 11:16:40 user nova-compute[74683]: STATIC:
Oct 16 11:16:40 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e
Oct 16 11:16:40 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:16:40 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:16:40 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2
Oct 16 11:16:40 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:16:40 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:16:40 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b
Oct 16 11:16:40 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:16:40 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:16:40 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d
Oct 16 11:16:40 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:16:40 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:16:40 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e
Oct 16 11:16:40 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:16:40 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:16:40 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b
Oct 16 11:16:40 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:16:40 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:16:40 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f
Oct 16 11:16:40 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:16:40 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:16:40 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3
Oct 16 11:16:40 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:16:40 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:16:40 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6
Oct 16 11:16:40 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:16:40 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:16:40 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020
Oct 16 11:16:40 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:16:40 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:16:40 user nova-compute[74683]: FIRMWARE:
Oct 16 11:16:40 user nova-compute[74683]: No targets found.
Oct 16 11:16:40 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:16:40 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dc04ab5-59fb-4d1e-b28d-8e3048a75621 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 11:16:40 user nova-compute[74683]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 11:16:40 user nova-compute[74683]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74683) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 11:16:40 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dc04ab5-59fb-4d1e-b28d-8e3048a75621 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f', 0)] {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 11:16:40 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:40 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:40 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a6284d-bdd2-4383-b87e-6137358328e2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:40 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:40 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.048s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:40 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1103808-7368-4e12-aef8-edf462898713]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:40 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dc04ab5-59fb-4d1e-b28d-8e3048a75621 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)
Oct 16 11:16:40 user nova-compute[74683]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)
Oct 16 11:16:40 user nova-compute[74683]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e (non-flash)
Oct 16 11:16:40 user nova-compute[74683]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)
Oct 16 11:16:40 user nova-compute[74683]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)
Oct 16 11:16:40 user nova-compute[74683]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)
Oct 16 11:16:40 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:16:40 user nova-compute[74683]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f (non-flash)
Oct 16 11:16:40 user nova-compute[74683]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6 (non-flash)
Oct 16 11:16:40 user nova-compute[74683]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b (non-flash)
Oct 16 11:16:40 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:16:40 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dc04ab5-59fb-4d1e-b28d-8e3048a75621 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)
Oct 16 11:16:40 user nova-compute[74683]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)
Oct 16 11:16:40 user nova-compute[74683]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e (non-flash)
Oct 16 11:16:40 user nova-compute[74683]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)
Oct 16 11:16:40 user nova-compute[74683]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)
Oct 16 11:16:40 user nova-compute[74683]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)
Oct 16 11:16:40 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:16:40 user nova-compute[74683]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f (non-flash)
Oct 16 11:16:40 user nova-compute[74683]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6 (non-flash)
Oct 16 11:16:40 user nova-compute[74683]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b (non-flash)
Oct 16 11:16:40 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:16:40 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dc04ab5-59fb-4d1e-b28d-8e3048a75621 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda4c7609d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f'): ({'sdf'}, set())}) {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 11:16:40 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-1dc04ab5-59fb-4d1e-b28d-8e3048a75621 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Removing single pathed devices sdf {{(pid=74683) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 11:16:40 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:40 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:40 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed5586e-2b73-4b59-bed8-876fcdda7cd0]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:40 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:40 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.027s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:40 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30b6a8c-d861-4e6c-8b01-ac29a6ef80fd]: (4, ('ok\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:40 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-1dc04ab5-59fb-4d1e-b28d-8e3048a75621 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Flushing IO for device /dev/sdf {{(pid=74683) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 11:16:40 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:40 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:40 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[b787f0fa-0df5-4783-b4b6-f52dde49694b]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:40 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-1dc04ab5-59fb-4d1e-b28d-8e3048a75621 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74683) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 11:16:40 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:40 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:40 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:40 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79ece8b-3cc9-4594-986c-bbd2e2da3279]: (4, ('1', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:40 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-1dc04ab5-59fb-4d1e-b28d-8e3048a75621 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 11:16:40 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-1dc04ab5-59fb-4d1e-b28d-8e3048a75621 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] SCSI volumes sdf have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 11:16:40 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dc04ab5-59fb-4d1e-b28d-8e3048a75621 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f')] {{(pid=74683) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 11:16:40 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:40 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:40 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0063fc-f279-4855-80ad-c72163961f37]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:40 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dc04ab5-59fb-4d1e-b28d-8e3048a75621 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:16:40 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f -p 172.16.0.220:3260 --logout {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:40 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f -p 172.16.0.220:3260 --logout" returned: 0 in 0.088s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:40 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[28785ed7-4bf3-4ca1-83b7-a48fc59efb5f]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:40 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dc04ab5-59fb-4d1e-b28d-8e3048a75621 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f, portal: 172.16.0.220,3260]
Oct 16 11:16:40 user nova-compute[74683]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f, portal: 172.16.0.220,3260] successful.
Oct 16 11:16:40 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:16:40 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f -p 172.16.0.220:3260 --op delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:40 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0aa00a0e-fa1e-4032-91f6-af020f1e986f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:40 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa58cb74-733e-456b-914f-75eef3299e01]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:40 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dc04ab5-59fb-4d1e-b28d-8e3048a75621 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:16:40 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-1dc04ab5-59fb-4d1e-b28d-8e3048a75621 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.415s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:16:40 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dc04ab5-59fb-4d1e-b28d-8e3048a75621 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] <== disconnect_volume: return (417ms) None {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:16:40 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1dc04ab5-59fb-4d1e-b28d-8e3048a75621 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Disconnected iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 11:16:40 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:41 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-50a07209-c46d-40e5-a0ae-2b656b1ab165 tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c8d3f594-1f38-41d3-90aa-3dfba95ce077 is timed out.
Oct 16 11:16:41 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-50a07209-c46d-40e5-a0ae-2b656b1ab165 tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] Successfully detached device vdb from instance c8d3f594-1f38-41d3-90aa-3dfba95ce077 from the live domain config.
Oct 16 11:16:41 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50a07209-c46d-40e5-a0ae-2b656b1ab165 tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] calling os-brick to detach iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 11:16:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a07209-c46d-40e5-a0ae-2b656b1ab165 tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, {'target_iqn': 'iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sWufdTqP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:16:41 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-50a07209-c46d-40e5-a0ae-2b656b1ab165 tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:16:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-50a07209-c46d-40e5-a0ae-2b656b1ab165 tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:16:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-50a07209-c46d-40e5-a0ae-2b656b1ab165 tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:16:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:41 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af23e7b-3e6f-4a39-979f-42db27b01a2c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a07209-c46d-40e5-a0ae-2b656b1ab165 tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 11:16:41 user nova-compute[74683]: No targets found.
Oct 16 11:16:41 user nova-compute[74683]: iSNS:
Oct 16 11:16:41 user nova-compute[74683]: No targets found.
Oct 16 11:16:41 user nova-compute[74683]: STATIC:
Oct 16 11:16:41 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e
Oct 16 11:16:41 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:16:41 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:16:41 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2
Oct 16 11:16:41 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:16:41 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:16:41 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b
Oct 16 11:16:41 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:16:41 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:16:41 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d
Oct 16 11:16:41 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:16:41 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:16:41 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e
Oct 16 11:16:41 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:16:41 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:16:41 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b
Oct 16 11:16:41 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:16:41 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:16:41 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3
Oct 16 11:16:41 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:16:41 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:16:41 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6
Oct 16 11:16:41 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:16:41 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:16:41 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020
Oct 16 11:16:41 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:16:41 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:16:41 user nova-compute[74683]: FIRMWARE:
Oct 16 11:16:41 user nova-compute[74683]: No targets found.
Oct 16 11:16:41 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:16:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a07209-c46d-40e5-a0ae-2b656b1ab165 tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 11:16:41 user nova-compute[74683]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 11:16:41 user nova-compute[74683]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74683) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 11:16:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a07209-c46d-40e5-a0ae-2b656b1ab165 tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6', 0)] {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 11:16:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:41 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[525cb1d8-38a6-4994-9fce-4e64baa299d6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:41 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[33afbda9-e09c-4151-903d-345969209cc1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a07209-c46d-40e5-a0ae-2b656b1ab165 tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)
Oct 16 11:16:41 user nova-compute[74683]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)
Oct 16 11:16:41 user nova-compute[74683]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e (non-flash)
Oct 16 11:16:41 user nova-compute[74683]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)
Oct 16 11:16:41 user nova-compute[74683]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)
Oct 16 11:16:41 user nova-compute[74683]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)
Oct 16 11:16:41 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:16:41 user nova-compute[74683]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6 (non-flash)
Oct 16 11:16:41 user nova-compute[74683]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b (non-flash)
Oct 16 11:16:41 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:16:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a07209-c46d-40e5-a0ae-2b656b1ab165 tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)
Oct 16 11:16:41 user nova-compute[74683]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)
Oct 16 11:16:41 user nova-compute[74683]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e (non-flash)
Oct 16 11:16:41 user nova-compute[74683]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)
Oct 16 11:16:41 user nova-compute[74683]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)
Oct 16 11:16:41 user nova-compute[74683]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)
Oct 16 11:16:41 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:16:41 user nova-compute[74683]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6 (non-flash)
Oct 16 11:16:41 user nova-compute[74683]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b (non-flash)
Oct 16 11:16:41 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:16:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a07209-c46d-40e5-a0ae-2b656b1ab165 tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda4c786440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6'): ({'sdg'}, set())}) {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 11:16:41 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-50a07209-c46d-40e5-a0ae-2b656b1ab165 tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] Removing single pathed devices sdg {{(pid=74683) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 11:16:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:41 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b1c8ef-6424-4337-9671-d7142654cd6c]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:41 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d137a219-36b3-42e7-a8e8-3d27395c3ca2]: (4, ('ok\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:41 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-50a07209-c46d-40e5-a0ae-2b656b1ab165 tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] Flushing IO for device /dev/sdg {{(pid=74683) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 11:16:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:41 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d3c3f6-677f-4269-a9de-76ac0f4648d0]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:41 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-50a07209-c46d-40e5-a0ae-2b656b1ab165 tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74683) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 11:16:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:41 user nova-compute[74683]: DEBUG nova.objects.instance [None req-1dc04ab5-59fb-4d1e-b28d-8e3048a75621 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Lazy-loading 'flavor' on Instance uuid fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:16:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.036s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:41 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[424619d8-094c-4356-b806-64f23dbe63f5]: (4, ('1', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:41 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-50a07209-c46d-40e5-a0ae-2b656b1ab165 tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 11:16:41 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-50a07209-c46d-40e5-a0ae-2b656b1ab165 tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] SCSI volumes sdg have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 11:16:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a07209-c46d-40e5-a0ae-2b656b1ab165 tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6')] {{(pid=74683) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 11:16:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1dc04ab5-59fb-4d1e-b28d-8e3048a75621 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Lock "fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.030s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:16:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:41 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7c8ec9-eba7-45bf-bfe9-4c05b6541f05]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a07209-c46d-40e5-a0ae-2b656b1ab165 tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:16:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6 -p 172.16.0.220:3260 --logout {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:41 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c36285-2286-4aed-92fa-8ea4e43e7aaa]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a07209-c46d-40e5-a0ae-2b656b1ab165 tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6, portal: 172.16.0.220,3260]
Oct 16 11:16:41 user nova-compute[74683]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6, portal: 172.16.0.220,3260] successful.
Oct 16 11:16:41 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:16:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6 -p 172.16.0.220:3260 --op delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03f18968-f0d6-4c71-8294-125c0bdcc9b6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:41 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ee9d8a-cf78-467c-acaf-bfa3499c6f70]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a07209-c46d-40e5-a0ae-2b656b1ab165 tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:16:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-50a07209-c46d-40e5-a0ae-2b656b1ab165 tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:16:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a07209-c46d-40e5-a0ae-2b656b1ab165 tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] <== disconnect_volume: return (374ms) None {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:16:41 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50a07209-c46d-40e5-a0ae-2b656b1ab165 tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Disconnected iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 11:16:42 user nova-compute[74683]: DEBUG nova.objects.instance [None req-50a07209-c46d-40e5-a0ae-2b656b1ab165 tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] Lazy-loading 'flavor' on Instance uuid c8d3f594-1f38-41d3-90aa-3dfba95ce077 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:16:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-50a07209-c46d-40e5-a0ae-2b656b1ab165 tempest-VolumesAssistedSnapshotsTest-1288240785 tempest-VolumesAssistedSnapshotsTest-1288240785-project-admin] Lock "c8d3f594-1f38-41d3-90aa-3dfba95ce077" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.198s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:16:43 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-c5b1bc67-596e-44ff-b2f4-7b13ce9a5d73 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 81290b55-8c05-4925-b445-d121b1bff1a2 is timed out.
Oct 16 11:16:43 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-c5b1bc67-596e-44ff-b2f4-7b13ce9a5d73 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Successfully detached device sdc from instance 81290b55-8c05-4925-b445-d121b1bff1a2 from the live domain config.
Oct 16 11:16:43 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5b1bc67-596e-44ff-b2f4-7b13ce9a5d73 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] calling os-brick to detach iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 11:16:43 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b1bc67-596e-44ff-b2f4-7b13ce9a5d73 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, {'target_iqn': 'iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oZsHXTpk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:16:43 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-c5b1bc67-596e-44ff-b2f4-7b13ce9a5d73 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:16:43 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-c5b1bc67-596e-44ff-b2f4-7b13ce9a5d73 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:16:43 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-c5b1bc67-596e-44ff-b2f4-7b13ce9a5d73 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:16:43 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:43 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:43 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2e4d17-0126-4fa9-a995-4cc41e0ab208]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:43 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b1bc67-596e-44ff-b2f4-7b13ce9a5d73 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 11:16:43 user nova-compute[74683]: No targets found.
Oct 16 11:16:43 user nova-compute[74683]: iSNS:
Oct 16 11:16:43 user nova-compute[74683]: No targets found.
Oct 16 11:16:43 user nova-compute[74683]: STATIC:
Oct 16 11:16:43 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e
Oct 16 11:16:43 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:16:43 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:16:43 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2
Oct 16 11:16:43 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:16:43 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:16:43 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b
Oct 16 11:16:43 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:16:43 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:16:43 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d
Oct 16 11:16:43 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:16:43 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:16:43 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e
Oct 16 11:16:43 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:16:43 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:16:43 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b
Oct 16 11:16:43 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:16:43 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:16:43 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3
Oct 16 11:16:43 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:16:43 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:16:43 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020
Oct 16 11:16:43 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:16:43 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:16:43 user nova-compute[74683]: FIRMWARE:
Oct 16 11:16:43 user nova-compute[74683]: No targets found.
Oct 16 11:16:43 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:16:43 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b1bc67-596e-44ff-b2f4-7b13ce9a5d73 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 11:16:43 user nova-compute[74683]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 11:16:43 user nova-compute[74683]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74683) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 11:16:43 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b1bc67-596e-44ff-b2f4-7b13ce9a5d73 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b', 0)] {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 11:16:43 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:43 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:43 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[669ab79e-fcc9-4ff7-86e3-2b5cc5a2d0ef]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:43 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:43 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:43 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf6ea0f-5acf-4426-80a7-69d29972bcd0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:43 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b1bc67-596e-44ff-b2f4-7b13ce9a5d73 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)
Oct 16 11:16:43 user nova-compute[74683]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)
Oct 16 11:16:43 user nova-compute[74683]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e (non-flash)
Oct 16 11:16:43 user nova-compute[74683]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)
Oct 16 11:16:43 user nova-compute[74683]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)
Oct 16 11:16:43 user nova-compute[74683]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)
Oct 16 11:16:43 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:16:43 user nova-compute[74683]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b (non-flash)
Oct 16 11:16:43 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:16:43 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b1bc67-596e-44ff-b2f4-7b13ce9a5d73 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)
Oct 16 11:16:43 user nova-compute[74683]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)
Oct 16 11:16:43 user nova-compute[74683]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e (non-flash)
Oct 16 11:16:43 user nova-compute[74683]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)
Oct 16 11:16:43 user nova-compute[74683]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)
Oct 16 11:16:43 user nova-compute[74683]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)
Oct 16 11:16:43 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:16:43 user nova-compute[74683]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b (non-flash)
Oct 16 11:16:43 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:16:43 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b1bc67-596e-44ff-b2f4-7b13ce9a5d73 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda4c77e710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b'): ({'sdh'}, set())}) {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 11:16:43 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-c5b1bc67-596e-44ff-b2f4-7b13ce9a5d73 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Removing single pathed devices sdh {{(pid=74683) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 11:16:43 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:43 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:43 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[758b76ec-d075-4be0-be76-895358ec6e81]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:43 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:43 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:43 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[601d0032-b20c-4f5f-aeb3-91d6c1220e5c]: (4, ('ok\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:43 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-c5b1bc67-596e-44ff-b2f4-7b13ce9a5d73 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Flushing IO for device /dev/sdh {{(pid=74683) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 11:16:43 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:43 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:43 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[81dd28c4-b14d-4212-aa11-a05c2116c450]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:43 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-c5b1bc67-596e-44ff-b2f4-7b13ce9a5d73 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74683) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 11:16:43 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:43 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.042s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:43 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3df1cef-6fe9-4152-8d71-5db97cb9d135]: (4, ('1', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:43 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-c5b1bc67-596e-44ff-b2f4-7b13ce9a5d73 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 11:16:43 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-c5b1bc67-596e-44ff-b2f4-7b13ce9a5d73 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] SCSI volumes sdh have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 11:16:43 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b1bc67-596e-44ff-b2f4-7b13ce9a5d73 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b')] {{(pid=74683) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 11:16:43 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:43 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:43 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08a0dc7-2813-4530-8dd5-15e6545df72f]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:43 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b1bc67-596e-44ff-b2f4-7b13ce9a5d73 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:16:43 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b -p 172.16.0.220:3260 --logout {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:43 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:43 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[754a4ac2-f465-43da-9239-bf3207bd6a9b]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:43 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b1bc67-596e-44ff-b2f4-7b13ce9a5d73 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b, portal: 172.16.0.220,3260]
Oct 16 11:16:43 user nova-compute[74683]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b, portal: 172.16.0.220,3260] successful.
Oct 16 11:16:43 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:16:43 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b -p 172.16.0.220:3260 --op delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:43 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dbc96ae-59a3-4c86-90bd-ef7c6af5d58b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:43 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e97fad-b677-451d-9c02-961f2bdba388]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:43 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b1bc67-596e-44ff-b2f4-7b13ce9a5d73 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:16:43 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-c5b1bc67-596e-44ff-b2f4-7b13ce9a5d73 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:16:43 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b1bc67-596e-44ff-b2f4-7b13ce9a5d73 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] <== disconnect_volume: return (369ms) None {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:16:43 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5b1bc67-596e-44ff-b2f4-7b13ce9a5d73 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Disconnected iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 11:16:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:44 user nova-compute[74683]: DEBUG nova.objects.instance [None req-c5b1bc67-596e-44ff-b2f4-7b13ce9a5d73 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Lazy-loading 'flavor' on Instance uuid 81290b55-8c05-4925-b445-d121b1bff1a2 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:16:44 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-c5b1bc67-596e-44ff-b2f4-7b13ce9a5d73 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Lock "81290b55-8c05-4925-b445-d121b1bff1a2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.833s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:16:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-34508193-b74f-4fa5-9a3d-77bddd4ecbf0 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Acquiring lock "81290b55-8c05-4925-b445-d121b1bff1a2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:16:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-34508193-b74f-4fa5-9a3d-77bddd4ecbf0 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Lock "81290b55-8c05-4925-b445-d121b1bff1a2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:16:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-34508193-b74f-4fa5-9a3d-77bddd4ecbf0 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Acquiring lock "81290b55-8c05-4925-b445-d121b1bff1a2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:16:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-34508193-b74f-4fa5-9a3d-77bddd4ecbf0 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Lock "81290b55-8c05-4925-b445-d121b1bff1a2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:16:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-34508193-b74f-4fa5-9a3d-77bddd4ecbf0 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Lock "81290b55-8c05-4925-b445-d121b1bff1a2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:16:45 user nova-compute[74683]: INFO nova.compute.manager [None req-34508193-b74f-4fa5-9a3d-77bddd4ecbf0 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Terminating instance
Oct 16 11:16:45 user nova-compute[74683]: DEBUG nova.compute.manager [None req-34508193-b74f-4fa5-9a3d-77bddd4ecbf0 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Start destroying the instance on the hypervisor. {{(pid=74683) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 11:16:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:45 user nova-compute[74683]: DEBUG nova.compute.manager [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Start spawning the instance on the hypervisor. {{(pid=74683) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 11:16:45 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Creating instance directory {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 11:16:45 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Creating image(s)
Oct 16 11:16:45 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Did not create local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 16 11:16:45 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Ensure instance console log exists: /opt/stack/data/nova/instances/d5e55361-d9ed-4d07-91b0-ec4d08b2e817/console.log {{(pid=74683) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 11:16:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:16:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:16:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:16:45 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Start _get_guest_xml network_info=[{"id": "ade44b63-49bb-4dbc-b0f9-95156f4fd6db", "address": "fa:16:3e:ad:0a:5c", "network": {"id": "4d43cc12-d2cd-4552-90a4-884a0ff3dc66", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-825513246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6e0046017b4bba85caf2a39d1c67b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade44b63-49", "ovs_interfaceid": "ade44b63-49bb-4dbc-b0f9-95156f4fd6db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yuvqsfmL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd5e55361-d9ed-4d07-91b0-ec4d08b2e817', 'attached_at': '', 'detached_at': '', 'volume_id': 'c6adf91a-024f-493b-9a81-eef3c4ca39fb', 'serial': 'c6adf91a-024f-493b-9a81-eef3c4ca39fb'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': 'fcfb98c2-7940-46d6-bebd-29de6b15f199', 'volume_type': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:16:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:45 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:16:45 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:16:45 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:16:45 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:16:45 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:16:45 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:16:45 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:16:45 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:16:45 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:16:45 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:16:45 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:16:45 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:16:45 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:16:45 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:16:45 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:16:45 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:16:45 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:16:45 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Calling os-brick to attach iSCSI Volume {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yuvqsfmL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:16:46 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:16:46 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:16:46 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:16:46 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:16:46 user nova-compute[74683]: INFO os_brick.initiator.connectors.iscsi [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 11:16:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb -p 172.16.0.220:3260 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb -p 172.16.0.220:3260" returned: 21 in 0.038s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[772dbaa1-e4a0-4de6-a50c-f36019dfc2cf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 11:16:46 user nova-compute[74683]:  {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb -p 172.16.0.220:3260 --interface default --op new {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30acf4d-e8d7-48df-8bf8-3c287ad20f22]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb] added\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb] added
Oct 16 11:16:46 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[97756f7b-6cf7-4d26-9c72-154c8ebcaea7]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca6421f-65e8-4f06-b143-5227554425a2]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yuvqsfmL {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yuvqsfmL" returned: 0 in 0.024s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[125c7824-7999-45b6-b304-d41047e44956]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yuvqsfmL'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG nova.compute.manager [req-590cf530-574c-4586-b037-1ff8a188e039 req-e25016b9-588c-412a-bb5b-96dd01e28e56 service nova] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Received event network-vif-unplugged-8b5f6bec-c96c-4b1d-bdf6-4012cc0a3fae {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-590cf530-574c-4586-b037-1ff8a188e039 req-e25016b9-588c-412a-bb5b-96dd01e28e56 service nova] Acquiring lock "81290b55-8c05-4925-b445-d121b1bff1a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-590cf530-574c-4586-b037-1ff8a188e039 req-e25016b9-588c-412a-bb5b-96dd01e28e56 service nova] Lock "81290b55-8c05-4925-b445-d121b1bff1a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-590cf530-574c-4586-b037-1ff8a188e039 req-e25016b9-588c-412a-bb5b-96dd01e28e56 service nova] Lock "81290b55-8c05-4925-b445-d121b1bff1a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG nova.compute.manager [req-590cf530-574c-4586-b037-1ff8a188e039 req-e25016b9-588c-412a-bb5b-96dd01e28e56 service nova] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] No waiting events found dispatching network-vif-unplugged-8b5f6bec-c96c-4b1d-bdf6-4012cc0a3fae {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG nova.compute.manager [req-590cf530-574c-4586-b037-1ff8a188e039 req-e25016b9-588c-412a-bb5b-96dd01e28e56 service nova] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Received event network-vif-unplugged-8b5f6bec-c96c-4b1d-bdf6-4012cc0a3fae for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[63841d03-05f8-4af1-9ec8-2fdb3a45b0be]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f0acb4-9505-4cc9-b758-7ccd0b21063d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)
Oct 16 11:16:46 user nova-compute[74683]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)
Oct 16 11:16:46 user nova-compute[74683]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e (non-flash)
Oct 16 11:16:46 user nova-compute[74683]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)
Oct 16 11:16:46 user nova-compute[74683]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)
Oct 16 11:16:46 user nova-compute[74683]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)
Oct 16 11:16:46 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:16:46 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)
Oct 16 11:16:46 user nova-compute[74683]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)
Oct 16 11:16:46 user nova-compute[74683]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e (non-flash)
Oct 16 11:16:46 user nova-compute[74683]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)
Oct 16 11:16:46 user nova-compute[74683]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)
Oct 16 11:16:46 user nova-compute[74683]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)
Oct 16 11:16:46 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:16:46 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb -p 172.16.0.220:3260 --login {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3db763-4297-4c52-868e-346a44a5c4a3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb, portal: 172.16.0.220,3260]
Oct 16 11:16:46 user nova-compute[74683]: Login to [iface: default, target: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb, portal: 172.16.0.220,3260] successful.
Oct 16 11:16:46 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e09c3e2-0332-4645-b9d7-1ddf36224b9c]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8605efe-9c50-45ab-b11e-5ecfc71891d5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)
Oct 16 11:16:46 user nova-compute[74683]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)
Oct 16 11:16:46 user nova-compute[74683]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e (non-flash)
Oct 16 11:16:46 user nova-compute[74683]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:16:46 user nova-compute[74683]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)
Oct 16 11:16:46 user nova-compute[74683]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)
Oct 16 11:16:46 user nova-compute[74683]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)
Oct 16 11:16:46 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:16:46 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)
Oct 16 11:16:46 user nova-compute[74683]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)
Oct 16 11:16:46 user nova-compute[74683]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e (non-flash)
Oct 16 11:16:46 user nova-compute[74683]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:16:46 user nova-compute[74683]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)
Oct 16 11:16:46 user nova-compute[74683]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)
Oct 16 11:16:46 user nova-compute[74683]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)
Oct 16 11:16:46 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:16:46 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.401s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Connected to 172.16.0.220:3260 {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] HCTL ('37', '-', '-', 0) found on session 13 with lun 0 {{(pid=74683) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74683) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.027s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae15e681-d2c0-427c-96e4-a7b35e2fd1e7]: (4, ('- - 0', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Searching for a device in session 13 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yuvqsfmL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 11:16:46 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Instance destroyed successfully.
Oct 16 11:16:46 user nova-compute[74683]: DEBUG nova.objects.instance [None req-34508193-b74f-4fa5-9a3d-77bddd4ecbf0 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Lazy-loading 'resources' on Instance uuid 81290b55-8c05-4925-b445-d121b1bff1a2 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-34508193-b74f-4fa5-9a3d-77bddd4ecbf0 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T11:13:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-784751833',display_name='tempest-AttachSCSIVolumeTestJSON-server-784751833',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-784751833',id=7,image_ref='f92565e5-7521-42b8-88f7-0e17710e3812',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0LFfgJd4tSBgM40sYw9NrNKYaqU3rN2f4N0VA2hNl1mB8B233GpPKbn5K/WUy40PW7fQ2Ve9UUhStJqOkeAoIcWOyTUqHTK/Shq09jRNNAdDkRV13L1bvaK/Oh8nlk+Q==',key_name='tempest-keypair-821741181',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:13:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='85c6b7c7954f42638e1075cc9d0afbd2',ramdisk_id='',reservation_id='r-4edzk5tk',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f92565e5-7521-42b8-88f7-0e17710e3812',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-620263426',owner_user_name='tempest-AttachSCSIVolumeTestJSON-620263426-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:13:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cc93ef469234e5e832edef72e1efb9c',uuid=81290b55-8c05-4925-b445-d121b1bff1a2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b5f6bec-c96c-4b1d-bdf6-4012cc0a3fae", "address": "fa:16:3e:f3:60:b8", "network": {"id": "55de7975-487e-4317-ac3e-9619e78b087c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-563245692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c6b7c7954f42638e1075cc9d0afbd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b5f6bec-c9", "ovs_interfaceid": "8b5f6bec-c96c-4b1d-bdf6-4012cc0a3fae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-34508193-b74f-4fa5-9a3d-77bddd4ecbf0 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Converting VIF {"id": "8b5f6bec-c96c-4b1d-bdf6-4012cc0a3fae", "address": "fa:16:3e:f3:60:b8", "network": {"id": "55de7975-487e-4317-ac3e-9619e78b087c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-563245692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c6b7c7954f42638e1075cc9d0afbd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b5f6bec-c9", "ovs_interfaceid": "8b5f6bec-c96c-4b1d-bdf6-4012cc0a3fae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-34508193-b74f-4fa5-9a3d-77bddd4ecbf0 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:60:b8,bridge_name='br-int',has_traffic_filtering=True,id=8b5f6bec-c96c-4b1d-bdf6-4012cc0a3fae,network=Network(55de7975-487e-4317-ac3e-9619e78b087c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b5f6bec-c9') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG os_vif [None req-34508193-b74f-4fa5-9a3d-77bddd4ecbf0 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:60:b8,bridge_name='br-int',has_traffic_filtering=True,id=8b5f6bec-c96c-4b1d-bdf6-4012cc0a3fae,network=Network(55de7975-487e-4317-ac3e-9619e78b087c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b5f6bec-c9') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b5f6bec-c9, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fea5ae54-e363-4302-98ce-cd33c6de9003) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:16:46 user nova-compute[74683]: INFO os_vif [None req-34508193-b74f-4fa5-9a3d-77bddd4ecbf0 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:60:b8,bridge_name='br-int',has_traffic_filtering=True,id=8b5f6bec-c96c-4b1d-bdf6-4012cc0a3fae,network=Network(55de7975-487e-4317-ac3e-9619e78b087c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b5f6bec-c9')
Oct 16 11:16:46 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-34508193-b74f-4fa5-9a3d-77bddd4ecbf0 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Deleting instance files /opt/stack/data/nova/instances/81290b55-8c05-4925-b445-d121b1bff1a2_del
Oct 16 11:16:46 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-34508193-b74f-4fa5-9a3d-77bddd4ecbf0 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Deletion of /opt/stack/data/nova/instances/81290b55-8c05-4925-b445-d121b1bff1a2_del complete
Oct 16 11:16:46 user nova-compute[74683]: INFO nova.compute.manager [None req-34508193-b74f-4fa5-9a3d-77bddd4ecbf0 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Took 0.98 seconds to destroy the instance on the hypervisor.
Oct 16 11:16:46 user nova-compute[74683]: DEBUG oslo.service.loopingcall [None req-34508193-b74f-4fa5-9a3d-77bddd4ecbf0 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74683) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG nova.compute.manager [-] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Deallocating network for instance {{(pid=74683) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 11:16:46 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] deallocate_for_instance() {{(pid=74683) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 11:16:47 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.450s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:16:47 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] <== connect_volume: return (1451ms) {'type': 'block', 'scsi_wwn': '26164646534383662', 'path': '/dev/sdf'} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:16:47 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26164646534383662', 'path': '/dev/sdf'} {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 11:16:47 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:16:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1230353272',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1230353272',id=12,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d6e0046017b4bba85caf2a39d1c67b3',ramdisk_id='',reservation_id='r-ve22na1w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1787816377',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:16:09Z,user_data=None,user_id='76a41804541e4a259771702727d9993e',uuid=d5e55361-d9ed-4d07-91b0-ec4d08b2e817,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ade44b63-49bb-4dbc-b0f9-95156f4fd6db", "address": "fa:16:3e:ad:0a:5c", "network": {"id": "4d43cc12-d2cd-4552-90a4-884a0ff3dc66", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-825513246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6e0046017b4bba85caf2a39d1c67b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade44b63-49", "ovs_interfaceid": "ade44b63-49bb-4dbc-b0f9-95156f4fd6db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:16:47 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Converting VIF {"id": "ade44b63-49bb-4dbc-b0f9-95156f4fd6db", "address": "fa:16:3e:ad:0a:5c", "network": {"id": "4d43cc12-d2cd-4552-90a4-884a0ff3dc66", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-825513246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6e0046017b4bba85caf2a39d1c67b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade44b63-49", "ovs_interfaceid": "ade44b63-49bb-4dbc-b0f9-95156f4fd6db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:16:47 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:0a:5c,bridge_name='br-int',has_traffic_filtering=True,id=ade44b63-49bb-4dbc-b0f9-95156f4fd6db,network=Network(4d43cc12-d2cd-4552-90a4-884a0ff3dc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapade44b63-49') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:16:47 user nova-compute[74683]: DEBUG nova.objects.instance [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lazy-loading 'pci_devices' on Instance uuid d5e55361-d9ed-4d07-91b0-ec4d08b2e817 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:16:47 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:16:47 user nova-compute[74683]:   <uuid>d5e55361-d9ed-4d07-91b0-ec4d08b2e817</uuid>
Oct 16 11:16:47 user nova-compute[74683]:   <name>instance-0000000c</name>
Oct 16 11:16:47 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:16:47 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:16:47 user nova-compute[74683]:   <metadata>
Oct 16 11:16:47 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:16:47 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:16:47 user nova-compute[74683]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1230353272</nova:name>
Oct 16 11:16:47 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:16:45</nova:creationTime>
Oct 16 11:16:47 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:16:47 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:16:47 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:16:47 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:16:47 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:16:47 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:16:47 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:16:47 user nova-compute[74683]:       <nova:owner>
Oct 16 11:16:47 user nova-compute[74683]:         <nova:user uuid="76a41804541e4a259771702727d9993e">tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member</nova:user>
Oct 16 11:16:47 user nova-compute[74683]:         <nova:project uuid="4d6e0046017b4bba85caf2a39d1c67b3">tempest-ServerBootFromVolumeStableRescueTest-1787816377</nova:project>
Oct 16 11:16:47 user nova-compute[74683]:       </nova:owner>
Oct 16 11:16:47 user nova-compute[74683]:       <nova:root type="image" uuid="0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f"/>
Oct 16 11:16:47 user nova-compute[74683]:       <nova:ports>
Oct 16 11:16:47 user nova-compute[74683]:         <nova:port uuid="ade44b63-49bb-4dbc-b0f9-95156f4fd6db">
Oct 16 11:16:47 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 16 11:16:47 user nova-compute[74683]:         </nova:port>
Oct 16 11:16:47 user nova-compute[74683]:       </nova:ports>
Oct 16 11:16:47 user nova-compute[74683]:     </nova:instance>
Oct 16 11:16:47 user nova-compute[74683]:   </metadata>
Oct 16 11:16:47 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:16:47 user nova-compute[74683]:     <system>
Oct 16 11:16:47 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:16:47 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:16:47 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:16:47 user nova-compute[74683]:       <entry name="serial">d5e55361-d9ed-4d07-91b0-ec4d08b2e817</entry>
Oct 16 11:16:47 user nova-compute[74683]:       <entry name="uuid">d5e55361-d9ed-4d07-91b0-ec4d08b2e817</entry>
Oct 16 11:16:47 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:16:47 user nova-compute[74683]:     </system>
Oct 16 11:16:47 user nova-compute[74683]:   </sysinfo>
Oct 16 11:16:47 user nova-compute[74683]:   <os>
Oct 16 11:16:47 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:16:47 user nova-compute[74683]:     <boot dev="hd"/>
Oct 16 11:16:47 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:16:47 user nova-compute[74683]:   </os>
Oct 16 11:16:47 user nova-compute[74683]:   <features>
Oct 16 11:16:47 user nova-compute[74683]:     <acpi/>
Oct 16 11:16:47 user nova-compute[74683]:     <apic/>
Oct 16 11:16:47 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:16:47 user nova-compute[74683]:   </features>
Oct 16 11:16:47 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:16:47 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:16:47 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:16:47 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:16:47 user nova-compute[74683]:   </clock>
Oct 16 11:16:47 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:16:47 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:16:47 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:16:47 user nova-compute[74683]:   </cpu>
Oct 16 11:16:47 user nova-compute[74683]:   <devices>
Oct 16 11:16:47 user nova-compute[74683]:     <disk type="block" device="disk">
Oct 16 11:16:47 user nova-compute[74683]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:16:47 user nova-compute[74683]:       <source dev="/dev/sdf"/>
Oct 16 11:16:47 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:16:47 user nova-compute[74683]:       <serial>c6adf91a-024f-493b-9a81-eef3c4ca39fb</serial>
Oct 16 11:16:47 user nova-compute[74683]:     </disk>
Oct 16 11:16:47 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:16:47 user nova-compute[74683]:       <mac address="fa:16:3e:ad:0a:5c"/>
Oct 16 11:16:47 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:16:47 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:16:47 user nova-compute[74683]:       <target dev="tapade44b63-49"/>
Oct 16 11:16:47 user nova-compute[74683]:     </interface>
Oct 16 11:16:47 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:16:47 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/d5e55361-d9ed-4d07-91b0-ec4d08b2e817/console.log" append="off"/>
Oct 16 11:16:47 user nova-compute[74683]:     </serial>
Oct 16 11:16:47 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:16:47 user nova-compute[74683]:     <video>
Oct 16 11:16:47 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:16:47 user nova-compute[74683]:     </video>
Oct 16 11:16:47 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:16:47 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:16:47 user nova-compute[74683]:     </rng>
Oct 16 11:16:47 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:16:47 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:16:47 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:16:47 user nova-compute[74683]:     </memballoon>
Oct 16 11:16:47 user nova-compute[74683]:   </devices>
Oct 16 11:16:47 user nova-compute[74683]: </domain>
Oct 16 11:16:47 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:16:47 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:16:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1230353272',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1230353272',id=12,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d6e0046017b4bba85caf2a39d1c67b3',ramdisk_id='',reservation_id='r-ve22na1w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1787816377',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:16:09Z,user_data=None,user_id='76a41804541e4a259771702727d9993e',uuid=d5e55361-d9ed-4d07-91b0-ec4d08b2e817,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ade44b63-49bb-4dbc-b0f9-95156f4fd6db", "address": "fa:16:3e:ad:0a:5c", "network": {"id": "4d43cc12-d2cd-4552-90a4-884a0ff3dc66", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-825513246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6e0046017b4bba85caf2a39d1c67b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade44b63-49", "ovs_interfaceid": "ade44b63-49bb-4dbc-b0f9-95156f4fd6db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:16:47 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Converting VIF {"id": "ade44b63-49bb-4dbc-b0f9-95156f4fd6db", "address": "fa:16:3e:ad:0a:5c", "network": {"id": "4d43cc12-d2cd-4552-90a4-884a0ff3dc66", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-825513246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6e0046017b4bba85caf2a39d1c67b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade44b63-49", "ovs_interfaceid": "ade44b63-49bb-4dbc-b0f9-95156f4fd6db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:16:47 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:0a:5c,bridge_name='br-int',has_traffic_filtering=True,id=ade44b63-49bb-4dbc-b0f9-95156f4fd6db,network=Network(4d43cc12-d2cd-4552-90a4-884a0ff3dc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapade44b63-49') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:16:47 user nova-compute[74683]: DEBUG os_vif [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:0a:5c,bridge_name='br-int',has_traffic_filtering=True,id=ade44b63-49bb-4dbc-b0f9-95156f4fd6db,network=Network(4d43cc12-d2cd-4552-90a4-884a0ff3dc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapade44b63-49') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:16:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:16:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:16:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3a66ce58-8caa-557b-8793-f9b685645046', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:16:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:16:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapade44b63-49, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:16:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapade44b63-49, col_values=(('qos', UUID('dd88bc0d-d92e-41be-9321-a289735be46b')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:16:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapade44b63-49, col_values=(('external_ids', {'iface-id': 'ade44b63-49bb-4dbc-b0f9-95156f4fd6db', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:0a:5c', 'vm-uuid': 'd5e55361-d9ed-4d07-91b0-ec4d08b2e817'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:16:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:16:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:47 user nova-compute[74683]: INFO os_vif [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:0a:5c,bridge_name='br-int',has_traffic_filtering=True,id=ade44b63-49bb-4dbc-b0f9-95156f4fd6db,network=Network(4d43cc12-d2cd-4552-90a4-884a0ff3dc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapade44b63-49')
Oct 16 11:16:47 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:16:47 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] No VIF found with MAC fa:16:3e:ad:0a:5c, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:16:48 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:16:48 user nova-compute[74683]: INFO nova.compute.manager [-] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Took 1.36 seconds to deallocate network for instance.
Oct 16 11:16:48 user nova-compute[74683]: DEBUG nova.compute.manager [req-badfee69-0899-4f70-9def-ec95d4cc75e7 req-c655d81f-7d93-46ff-ac36-bc752573630e service nova] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Received event network-vif-deleted-8b5f6bec-c96c-4b1d-bdf6-4012cc0a3fae {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:16:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-34508193-b74f-4fa5-9a3d-77bddd4ecbf0 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:16:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-34508193-b74f-4fa5-9a3d-77bddd4ecbf0 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:16:48 user nova-compute[74683]: DEBUG nova.compute.manager [req-bedb2b4d-a4c0-43a8-8ff5-7817070ec250 req-9afb07c2-0f76-42a1-9a99-306977dc0103 service nova] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Received event network-vif-plugged-8b5f6bec-c96c-4b1d-bdf6-4012cc0a3fae {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:16:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-bedb2b4d-a4c0-43a8-8ff5-7817070ec250 req-9afb07c2-0f76-42a1-9a99-306977dc0103 service nova] Acquiring lock "81290b55-8c05-4925-b445-d121b1bff1a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:16:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-bedb2b4d-a4c0-43a8-8ff5-7817070ec250 req-9afb07c2-0f76-42a1-9a99-306977dc0103 service nova] Lock "81290b55-8c05-4925-b445-d121b1bff1a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:16:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-bedb2b4d-a4c0-43a8-8ff5-7817070ec250 req-9afb07c2-0f76-42a1-9a99-306977dc0103 service nova] Lock "81290b55-8c05-4925-b445-d121b1bff1a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:16:48 user nova-compute[74683]: DEBUG nova.compute.manager [req-bedb2b4d-a4c0-43a8-8ff5-7817070ec250 req-9afb07c2-0f76-42a1-9a99-306977dc0103 service nova] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] No waiting events found dispatching network-vif-plugged-8b5f6bec-c96c-4b1d-bdf6-4012cc0a3fae {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:16:48 user nova-compute[74683]: WARNING nova.compute.manager [req-bedb2b4d-a4c0-43a8-8ff5-7817070ec250 req-9afb07c2-0f76-42a1-9a99-306977dc0103 service nova] [instance: 81290b55-8c05-4925-b445-d121b1bff1a2] Received unexpected event network-vif-plugged-8b5f6bec-c96c-4b1d-bdf6-4012cc0a3fae for instance with vm_state deleted and task_state None.
Oct 16 11:16:48 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-34508193-b74f-4fa5-9a3d-77bddd4ecbf0 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:16:48 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-34508193-b74f-4fa5-9a3d-77bddd4ecbf0 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:16:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-34508193-b74f-4fa5-9a3d-77bddd4ecbf0 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.366s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:16:48 user nova-compute[74683]: INFO nova.scheduler.client.report [None req-34508193-b74f-4fa5-9a3d-77bddd4ecbf0 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Deleted allocations for instance 81290b55-8c05-4925-b445-d121b1bff1a2
Oct 16 11:16:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-34508193-b74f-4fa5-9a3d-77bddd4ecbf0 tempest-AttachSCSIVolumeTestJSON-620263426 tempest-AttachSCSIVolumeTestJSON-620263426-project-member] Lock "81290b55-8c05-4925-b445-d121b1bff1a2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.920s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:16:48 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:48 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:48 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:49 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:49 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:49 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:50 user nova-compute[74683]: DEBUG nova.compute.manager [req-6df3159e-098a-4ffd-80a2-e8048641fbb3 req-8ca7f36b-ebb5-4123-b843-c66b60e24e6a service nova] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Received event network-vif-plugged-ade44b63-49bb-4dbc-b0f9-95156f4fd6db {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:16:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-6df3159e-098a-4ffd-80a2-e8048641fbb3 req-8ca7f36b-ebb5-4123-b843-c66b60e24e6a service nova] Acquiring lock "d5e55361-d9ed-4d07-91b0-ec4d08b2e817-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:16:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-6df3159e-098a-4ffd-80a2-e8048641fbb3 req-8ca7f36b-ebb5-4123-b843-c66b60e24e6a service nova] Lock "d5e55361-d9ed-4d07-91b0-ec4d08b2e817-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:16:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-6df3159e-098a-4ffd-80a2-e8048641fbb3 req-8ca7f36b-ebb5-4123-b843-c66b60e24e6a service nova] Lock "d5e55361-d9ed-4d07-91b0-ec4d08b2e817-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:16:50 user nova-compute[74683]: DEBUG nova.compute.manager [req-6df3159e-098a-4ffd-80a2-e8048641fbb3 req-8ca7f36b-ebb5-4123-b843-c66b60e24e6a service nova] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] No waiting events found dispatching network-vif-plugged-ade44b63-49bb-4dbc-b0f9-95156f4fd6db {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:16:50 user nova-compute[74683]: WARNING nova.compute.manager [req-6df3159e-098a-4ffd-80a2-e8048641fbb3 req-8ca7f36b-ebb5-4123-b843-c66b60e24e6a service nova] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Received unexpected event network-vif-plugged-ade44b63-49bb-4dbc-b0f9-95156f4fd6db for instance with vm_state building and task_state spawning.
Oct 16 11:16:50 user nova-compute[74683]: DEBUG nova.compute.manager [req-6df3159e-098a-4ffd-80a2-e8048641fbb3 req-8ca7f36b-ebb5-4123-b843-c66b60e24e6a service nova] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Received event network-vif-plugged-ade44b63-49bb-4dbc-b0f9-95156f4fd6db {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:16:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-6df3159e-098a-4ffd-80a2-e8048641fbb3 req-8ca7f36b-ebb5-4123-b843-c66b60e24e6a service nova] Acquiring lock "d5e55361-d9ed-4d07-91b0-ec4d08b2e817-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:16:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-6df3159e-098a-4ffd-80a2-e8048641fbb3 req-8ca7f36b-ebb5-4123-b843-c66b60e24e6a service nova] Lock "d5e55361-d9ed-4d07-91b0-ec4d08b2e817-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:16:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-6df3159e-098a-4ffd-80a2-e8048641fbb3 req-8ca7f36b-ebb5-4123-b843-c66b60e24e6a service nova] Lock "d5e55361-d9ed-4d07-91b0-ec4d08b2e817-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:16:50 user nova-compute[74683]: DEBUG nova.compute.manager [req-6df3159e-098a-4ffd-80a2-e8048641fbb3 req-8ca7f36b-ebb5-4123-b843-c66b60e24e6a service nova] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] No waiting events found dispatching network-vif-plugged-ade44b63-49bb-4dbc-b0f9-95156f4fd6db {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:16:50 user nova-compute[74683]: WARNING nova.compute.manager [req-6df3159e-098a-4ffd-80a2-e8048641fbb3 req-8ca7f36b-ebb5-4123-b843-c66b60e24e6a service nova] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Received unexpected event network-vif-plugged-ade44b63-49bb-4dbc-b0f9-95156f4fd6db for instance with vm_state building and task_state spawning.
Oct 16 11:16:50 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:51 user nova-compute[74683]: DEBUG nova.compute.manager [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Instance event wait completed in 0 seconds for  {{(pid=74683) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 11:16:51 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Guest created on hypervisor {{(pid=74683) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 11:16:51 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Instance spawned successfully.
Oct 16 11:16:51 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 11:16:51 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Found default for hw_cdrom_bus of ide {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:16:51 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Found default for hw_disk_bus of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:16:51 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Found default for hw_input_bus of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:16:51 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Found default for hw_pointer_model of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:16:51 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Found default for hw_video_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:16:51 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Found default for hw_vif_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:16:51 user nova-compute[74683]: INFO nova.compute.manager [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Took 5.28 seconds to spawn the instance on the hypervisor.
Oct 16 11:16:51 user nova-compute[74683]: DEBUG nova.compute.manager [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:16:51 user nova-compute[74683]: INFO nova.compute.manager [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Took 42.64 seconds to build instance.
Oct 16 11:16:51 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-76a5e8a0-fc54-4ce9-867c-ecb59170f5d5 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "d5e55361-d9ed-4d07-91b0-ec4d08b2e817" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 42.795s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:16:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:55 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:55 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:16:58 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-03b83769-20d2-4ad0-bc66-f4dd50c3b5fc tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Acquiring lock "2f1db5e2-0b25-4d61-9dd3-038811b4eda1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:17:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-03b83769-20d2-4ad0-bc66-f4dd50c3b5fc tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Lock "2f1db5e2-0b25-4d61-9dd3-038811b4eda1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:17:00 user nova-compute[74683]: DEBUG nova.objects.instance [None req-03b83769-20d2-4ad0-bc66-f4dd50c3b5fc tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Lazy-loading 'flavor' on Instance uuid 2f1db5e2-0b25-4d61-9dd3-038811b4eda1 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:17:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-03b83769-20d2-4ad0-bc66-f4dd50c3b5fc tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Lock "2f1db5e2-0b25-4d61-9dd3-038811b4eda1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:17:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-03b83769-20d2-4ad0-bc66-f4dd50c3b5fc tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Acquiring lock "2f1db5e2-0b25-4d61-9dd3-038811b4eda1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:17:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-03b83769-20d2-4ad0-bc66-f4dd50c3b5fc tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Lock "2f1db5e2-0b25-4d61-9dd3-038811b4eda1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:17:00 user nova-compute[74683]: INFO nova.compute.manager [None req-03b83769-20d2-4ad0-bc66-f4dd50c3b5fc tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Attaching volume a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 to /dev/vdb
Oct 16 11:17:00 user nova-compute[74683]: DEBUG os_brick.utils [None req-03b83769-20d2-4ad0-bc66-f4dd50c3b5fc tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:17:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:00 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f48e655-a13f-41fd-901a-5b417c6841af]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:70b9d336ab7d\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:00 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0427b3-f6c8-443e-8bcb-5cd703e73f68]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:00 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7e411a-b50c-4a89-8a35-30df5b725105]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:00 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[7811c157-eba9-449b-93f3-40e42e673852]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-03b83769-20d2-4ad0-bc66-f4dd50c3b5fc tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Running cmd (subprocess): nvme version {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-03b83769-20d2-4ad0-bc66-f4dd50c3b5fc tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] 'nvme version' failed. Not Retrying. {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:17:00 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.nvmeof [None req-03b83769-20d2-4ad0-bc66-f4dd50c3b5fc tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] nvme not present on system {{(pid=74683) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 11:17:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:00 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:17:00 user nova-compute[74683]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 11:17:00 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f59003f-b175-4ece-8121-647340e9d542]: (4, '') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:00 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-03b83769-20d2-4ad0-bc66-f4dd50c3b5fc tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74683) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 11:17:00 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-03b83769-20d2-4ad0-bc66-f4dd50c3b5fc tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 11:17:00 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-03b83769-20d2-4ad0-bc66-f4dd50c3b5fc tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] LIGHTOS: no hostnqn found. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 11:17:00 user nova-compute[74683]: DEBUG os_brick.utils [None req-03b83769-20d2-4ad0-bc66-f4dd50c3b5fc tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:70b9d336ab7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:17:00 user nova-compute[74683]: DEBUG nova.virt.block_device [None req-03b83769-20d2-4ad0-bc66-f4dd50c3b5fc tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Updating existing volume attachment record: 4fc306ac-a61a-492c-ae1b-7ad8452a0e03 {{(pid=74683) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 11:17:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:03 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:17:03 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Starting heal instance info cache {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 11:17:03 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "refresh_cache-f192d1ec-311d-4a30-9766-361b27a8dae8" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:17:03 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquired lock "refresh_cache-f192d1ec-311d-4a30-9766-361b27a8dae8" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:17:03 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Forcefully refreshing network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 11:17:03 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-5e6f4575-c24f-4763-bcde-f875dbfbea43 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Acquiring lock "f192d1ec-311d-4a30-9766-361b27a8dae8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:17:03 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-5e6f4575-c24f-4763-bcde-f875dbfbea43 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Lock "f192d1ec-311d-4a30-9766-361b27a8dae8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:17:03 user nova-compute[74683]: DEBUG nova.objects.instance [None req-5e6f4575-c24f-4763-bcde-f875dbfbea43 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Lazy-loading 'flavor' on Instance uuid f192d1ec-311d-4a30-9766-361b27a8dae8 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:17:03 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-5e6f4575-c24f-4763-bcde-f875dbfbea43 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Lock "f192d1ec-311d-4a30-9766-361b27a8dae8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:17:04 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-5e6f4575-c24f-4763-bcde-f875dbfbea43 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Acquiring lock "f192d1ec-311d-4a30-9766-361b27a8dae8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:17:04 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-5e6f4575-c24f-4763-bcde-f875dbfbea43 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Lock "f192d1ec-311d-4a30-9766-361b27a8dae8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:17:04 user nova-compute[74683]: INFO nova.compute.manager [None req-5e6f4575-c24f-4763-bcde-f875dbfbea43 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Attaching volume e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b to /dev/vdb
Oct 16 11:17:04 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Updating instance_info_cache with network_info: [{"id": "dbbeadad-745e-4d28-a242-577b3197b079", "address": "fa:16:3e:2b:14:bf", "network": {"id": "33f5edce-0901-42ea-b07a-47da2819b133", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-117849665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d7573bebfe47e3989f8eedd90dee6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbbeadad-74", "ovs_interfaceid": "dbbeadad-745e-4d28-a242-577b3197b079", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:17:04 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Releasing lock "refresh_cache-f192d1ec-311d-4a30-9766-361b27a8dae8" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:17:04 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Updated the network info_cache for instance {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 11:17:04 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:17:04 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:17:04 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:17:04 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:17:04 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:17:04 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74683) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 11:17:04 user nova-compute[74683]: DEBUG os_brick.utils [None req-5e6f4575-c24f-4763-bcde-f875dbfbea43 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:17:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b45b029-c092-4c2d-8b89-898e170da4eb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:70b9d336ab7d\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f4f0bb-9078-4234-826a-0e795ab7971b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[6442cd6c-dacf-4140-95b4-b4d5c7b53177]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[30badcc4-fbf0-4484-aa92-8c55ce55a95c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-5e6f4575-c24f-4763-bcde-f875dbfbea43 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Running cmd (subprocess): nvme version {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:04 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:17:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-5e6f4575-c24f-4763-bcde-f875dbfbea43 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] 'nvme version' failed. Not Retrying. {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:17:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5e6f4575-c24f-4763-bcde-f875dbfbea43 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] nvme not present on system {{(pid=74683) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 11:17:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:17:04 user nova-compute[74683]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 11:17:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e15944d-f562-4251-b4c3-e0ef09a90792]: (4, '') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-5e6f4575-c24f-4763-bcde-f875dbfbea43 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74683) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 11:17:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-5e6f4575-c24f-4763-bcde-f875dbfbea43 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 11:17:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-5e6f4575-c24f-4763-bcde-f875dbfbea43 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] LIGHTOS: no hostnqn found. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 11:17:04 user nova-compute[74683]: DEBUG os_brick.utils [None req-5e6f4575-c24f-4763-bcde-f875dbfbea43 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:70b9d336ab7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:17:04 user nova-compute[74683]: DEBUG nova.virt.block_device [None req-5e6f4575-c24f-4763-bcde-f875dbfbea43 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Updating existing volume attachment record: 70863a85-1059-44c1-b46b-91e7bffda2fc {{(pid=74683) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 11:17:04 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:17:04 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:17:04 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:17:04 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:17:04 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:17:04 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:17:04 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Auditing locally available compute resources for user (node: user) {{(pid=74683) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 11:17:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1db5e2-0b25-4d61-9dd3-038811b4eda1/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1db5e2-0b25-4d61-9dd3-038811b4eda1/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1db5e2-0b25-4d61-9dd3-038811b4eda1/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1db5e2-0b25-4d61-9dd3-038811b4eda1/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5951e708-5667-4ff0-871b-34845bb20f7c/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5951e708-5667-4ff0-871b-34845bb20f7c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5951e708-5667-4ff0-871b-34845bb20f7c/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5951e708-5667-4ff0-871b-34845bb20f7c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:06 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:17:06 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:17:06 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdk (vdc) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:17:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd60be9c-0ff3-40a5-aaab-f31fa88a67f1/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd60be9c-0ff3-40a5-aaab-f31fa88a67f1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd60be9c-0ff3-40a5-aaab-f31fa88a67f1/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd60be9c-0ff3-40a5-aaab-f31fa88a67f1/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:06 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:17:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d3f594-1f38-41d3-90aa-3dfba95ce077/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d3f594-1f38-41d3-90aa-3dfba95ce077/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d3f594-1f38-41d3-90aa-3dfba95ce077/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:07 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d3f594-1f38-41d3-90aa-3dfba95ce077/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:07 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:17:07 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:07 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:07 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:07 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:07 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:17:07 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:17:07 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:17:08 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:17:08 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:17:08 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Hypervisor/Node resource view: name=user free_ram=7541MB free_disk=25.466590881347656GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74683) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 11:17:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:17:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:17:08 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 18a77385-fab9-4ea0-8aa6-666cf7e798a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:17:08 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance bd60be9c-0ff3-40a5-aaab-f31fa88a67f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:17:08 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance f192d1ec-311d-4a30-9766-361b27a8dae8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:17:08 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 2f1db5e2-0b25-4d61-9dd3-038811b4eda1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:17:08 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:17:08 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance c8d3f594-1f38-41d3-90aa-3dfba95ce077 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:17:08 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 9df7866f-28e9-46d0-9f35-24484adfffd7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:17:08 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance d944f646-4c4d-4712-8dfe-9b1f0ff60683 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:17:08 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance d5e55361-d9ed-4d07-91b0-ec4d08b2e817 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:17:08 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 5951e708-5667-4ff0-871b-34845bb20f7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:17:08 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 11:17:08 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 11:17:08 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:17:08 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:17:08 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Compute_service record updated for user:user {{(pid=74683) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 11:17:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.518s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:17:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Acquiring lock "9ae15ce7-996c-460f-a901-1570a2012af1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:17:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Lock "9ae15ce7-996c-460f-a901-1570a2012af1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:17:08 user nova-compute[74683]: DEBUG nova.compute.manager [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Starting instance... {{(pid=74683) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 11:17:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:17:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:17:08 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74683) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 11:17:08 user nova-compute[74683]: INFO nova.compute.claims [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Claim successful on node user
Oct 16 11:17:09 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:17:09 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:17:09 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.479s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:17:09 user nova-compute[74683]: DEBUG nova.compute.manager [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Start building networks asynchronously for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 11:17:09 user nova-compute[74683]: DEBUG nova.compute.manager [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Allocating IP information in the background. {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 11:17:09 user nova-compute[74683]: DEBUG nova.network.neutron [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] allocate_for_instance() {{(pid=74683) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 11:17:09 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 11:17:09 user nova-compute[74683]: DEBUG nova.compute.manager [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Start building block device mappings for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 11:17:09 user nova-compute[74683]: DEBUG nova.policy [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ceb56d9dc1b04324adfd4f8d0b1a9766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5042cdda42b74341b6c592437b6bbdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74683) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 11:17:09 user nova-compute[74683]: DEBUG nova.compute.manager [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Start spawning the instance on the hypervisor. {{(pid=74683) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 11:17:09 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Creating instance directory {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 11:17:09 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Creating image(s)
Oct 16 11:17:09 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Acquiring lock "/opt/stack/data/nova/instances/9ae15ce7-996c-460f-a901-1570a2012af1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:17:09 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Lock "/opt/stack/data/nova/instances/9ae15ce7-996c-460f-a901-1570a2012af1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:17:09 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Lock "/opt/stack/data/nova/instances/9ae15ce7-996c-460f-a901-1570a2012af1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:17:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.173s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:09 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Acquiring lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:17:09 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:17:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.195s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/9ae15ce7-996c-460f-a901-1570a2012af1/disk 1073741824 {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/9ae15ce7-996c-460f-a901-1570a2012af1/disk 1073741824" returned: 0 in 0.066s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:09 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:17:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:10 user nova-compute[74683]: DEBUG nova.network.neutron [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Successfully created port: 84d9dc84-2273-4e6b-a8fe-9a94bddd198c {{(pid=74683) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 11:17:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.215s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:10 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9ae15ce7-996c-460f-a901-1570a2012af1/disk. size=1073741824 {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 11:17:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae15ce7-996c-460f-a901-1570a2012af1/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae15ce7-996c-460f-a901-1570a2012af1/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:10 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Cannot resize image /opt/stack/data/nova/instances/9ae15ce7-996c-460f-a901-1570a2012af1/disk to a smaller size. {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 11:17:10 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Created local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 11:17:10 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Ensure instance console log exists: /opt/stack/data/nova/instances/9ae15ce7-996c-460f-a901-1570a2012af1/console.log {{(pid=74683) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 11:17:10 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:17:10 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:17:10 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:17:10 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:10 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:11 user nova-compute[74683]: DEBUG nova.network.neutron [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Successfully updated port: 84d9dc84-2273-4e6b-a8fe-9a94bddd198c {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:17:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Acquiring lock "refresh_cache-9ae15ce7-996c-460f-a901-1570a2012af1" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:17:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Acquired lock "refresh_cache-9ae15ce7-996c-460f-a901-1570a2012af1" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:17:11 user nova-compute[74683]: DEBUG nova.network.neutron [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:17:11 user nova-compute[74683]: DEBUG nova.compute.manager [req-2509665e-5bb2-413c-8bb9-986183b135be req-93d3d2cb-88fc-4880-b739-a7a871d8d5fa service nova] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Received event network-changed-84d9dc84-2273-4e6b-a8fe-9a94bddd198c {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:17:11 user nova-compute[74683]: DEBUG nova.compute.manager [req-2509665e-5bb2-413c-8bb9-986183b135be req-93d3d2cb-88fc-4880-b739-a7a871d8d5fa service nova] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Refreshing instance network info cache due to event network-changed-84d9dc84-2273-4e6b-a8fe-9a94bddd198c. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:17:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-2509665e-5bb2-413c-8bb9-986183b135be req-93d3d2cb-88fc-4880-b739-a7a871d8d5fa service nova] Acquiring lock "refresh_cache-9ae15ce7-996c-460f-a901-1570a2012af1" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:17:11 user nova-compute[74683]: DEBUG nova.network.neutron [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:17:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Acquiring lock "c15b7e00-a608-4796-8e6e-1304785a9af5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:17:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Lock "c15b7e00-a608-4796-8e6e-1304785a9af5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:17:11 user nova-compute[74683]: DEBUG nova.compute.manager [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: c15b7e00-a608-4796-8e6e-1304785a9af5] Starting instance... {{(pid=74683) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 11:17:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:17:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:17:11 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74683) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 11:17:11 user nova-compute[74683]: INFO nova.compute.claims [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: c15b7e00-a608-4796-8e6e-1304785a9af5] Claim successful on node user
Oct 16 11:17:11 user nova-compute[74683]: DEBUG nova.network.neutron [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Updating instance_info_cache with network_info: [{"id": "84d9dc84-2273-4e6b-a8fe-9a94bddd198c", "address": "fa:16:3e:07:96:fd", "network": {"id": "33b6ba99-0d95-497e-a744-1ae84c9d63e1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-240536039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5042cdda42b74341b6c592437b6bbdbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d9dc84-22", "ovs_interfaceid": "84d9dc84-2273-4e6b-a8fe-9a94bddd198c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:17:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Releasing lock "refresh_cache-9ae15ce7-996c-460f-a901-1570a2012af1" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:17:11 user nova-compute[74683]: DEBUG nova.compute.manager [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Instance network_info: |[{"id": "84d9dc84-2273-4e6b-a8fe-9a94bddd198c", "address": "fa:16:3e:07:96:fd", "network": {"id": "33b6ba99-0d95-497e-a744-1ae84c9d63e1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-240536039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5042cdda42b74341b6c592437b6bbdbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d9dc84-22", "ovs_interfaceid": "84d9dc84-2273-4e6b-a8fe-9a94bddd198c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 11:17:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-2509665e-5bb2-413c-8bb9-986183b135be req-93d3d2cb-88fc-4880-b739-a7a871d8d5fa service nova] Acquired lock "refresh_cache-9ae15ce7-996c-460f-a901-1570a2012af1" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:17:11 user nova-compute[74683]: DEBUG nova.network.neutron [req-2509665e-5bb2-413c-8bb9-986183b135be req-93d3d2cb-88fc-4880-b739-a7a871d8d5fa service nova] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Refreshing network info cache for port 84d9dc84-2273-4e6b-a8fe-9a94bddd198c {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:17:11 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Start _get_guest_xml network_info=[{"id": "84d9dc84-2273-4e6b-a8fe-9a94bddd198c", "address": "fa:16:3e:07:96:fd", "network": {"id": "33b6ba99-0d95-497e-a744-1ae84c9d63e1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-240536039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5042cdda42b74341b6c592437b6bbdbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d9dc84-22", "ovs_interfaceid": "84d9dc84-2273-4e6b-a8fe-9a94bddd198c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:17:11 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:17:11 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:17:11 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:17:11 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:17:11 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:17:11 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:17:11 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:17:11 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:17:11 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:17:11 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:17:11 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:17:11 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:17:11 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:17:11 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:17:11 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:17:11 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:17:11 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:17:11 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:17:11 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T11:17:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-717081521',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-717081521',id=14,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8efJVroKVuigryD4GSp1jU2h74/46LP7zUTBq1YNdoS9sGz/cMTsYXKQK2+Lj6yR1spH3hPAhB6Y4h51NvH2BYFIARH1zI9goHYvZdEeIkuG1XUEV0yYBKVJjNs/qPig==',key_name='tempest-keypair-1457686750',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5042cdda42b74341b6c592437b6bbdbf',ramdisk_id='',reservation_id='r-ezaz9z78',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-2119065928',owner_user_name='tempest-TaggedAttachmentsTest-2119065928-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:17:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ceb56d9dc1b04324adfd4f8d0b1a9766',uuid=9ae15ce7-996c-460f-a901-1570a2012af1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84d9dc84-2273-4e6b-a8fe-9a94bddd198c", "address": "fa:16:3e:07:96:fd", "network": {"id": "33b6ba99-0d95-497e-a744-1ae84c9d63e1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-240536039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5042cdda42b74341b6c592437b6bbdbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d9dc84-22", "ovs_interfaceid": "84d9dc84-2273-4e6b-a8fe-9a94bddd198c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:17:11 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Converting VIF {"id": "84d9dc84-2273-4e6b-a8fe-9a94bddd198c", "address": "fa:16:3e:07:96:fd", "network": {"id": "33b6ba99-0d95-497e-a744-1ae84c9d63e1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-240536039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5042cdda42b74341b6c592437b6bbdbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d9dc84-22", "ovs_interfaceid": "84d9dc84-2273-4e6b-a8fe-9a94bddd198c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:17:11 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:96:fd,bridge_name='br-int',has_traffic_filtering=True,id=84d9dc84-2273-4e6b-a8fe-9a94bddd198c,network=Network(33b6ba99-0d95-497e-a744-1ae84c9d63e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d9dc84-22') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:17:11 user nova-compute[74683]: DEBUG nova.objects.instance [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ae15ce7-996c-460f-a901-1570a2012af1 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:17:11 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:17:11 user nova-compute[74683]:   <uuid>9ae15ce7-996c-460f-a901-1570a2012af1</uuid>
Oct 16 11:17:11 user nova-compute[74683]:   <name>instance-0000000e</name>
Oct 16 11:17:11 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:17:11 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:17:11 user nova-compute[74683]:   <metadata>
Oct 16 11:17:11 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:17:11 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:17:11 user nova-compute[74683]:       <nova:name>tempest-device-tagging-server-717081521</nova:name>
Oct 16 11:17:11 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:17:11</nova:creationTime>
Oct 16 11:17:11 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:17:11 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:17:11 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:17:11 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:17:11 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:17:11 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:17:11 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:17:11 user nova-compute[74683]:       <nova:owner>
Oct 16 11:17:11 user nova-compute[74683]:         <nova:user uuid="ceb56d9dc1b04324adfd4f8d0b1a9766">tempest-TaggedAttachmentsTest-2119065928-project-member</nova:user>
Oct 16 11:17:11 user nova-compute[74683]:         <nova:project uuid="5042cdda42b74341b6c592437b6bbdbf">tempest-TaggedAttachmentsTest-2119065928</nova:project>
Oct 16 11:17:11 user nova-compute[74683]:       </nova:owner>
Oct 16 11:17:11 user nova-compute[74683]:       <nova:root type="image" uuid="0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f"/>
Oct 16 11:17:11 user nova-compute[74683]:       <nova:ports>
Oct 16 11:17:11 user nova-compute[74683]:         <nova:port uuid="84d9dc84-2273-4e6b-a8fe-9a94bddd198c">
Oct 16 11:17:11 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 16 11:17:11 user nova-compute[74683]:         </nova:port>
Oct 16 11:17:11 user nova-compute[74683]:       </nova:ports>
Oct 16 11:17:11 user nova-compute[74683]:     </nova:instance>
Oct 16 11:17:11 user nova-compute[74683]:   </metadata>
Oct 16 11:17:11 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:17:11 user nova-compute[74683]:     <system>
Oct 16 11:17:11 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:17:11 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:17:11 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:17:11 user nova-compute[74683]:       <entry name="serial">9ae15ce7-996c-460f-a901-1570a2012af1</entry>
Oct 16 11:17:11 user nova-compute[74683]:       <entry name="uuid">9ae15ce7-996c-460f-a901-1570a2012af1</entry>
Oct 16 11:17:11 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:17:11 user nova-compute[74683]:     </system>
Oct 16 11:17:11 user nova-compute[74683]:   </sysinfo>
Oct 16 11:17:11 user nova-compute[74683]:   <os>
Oct 16 11:17:11 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:17:11 user nova-compute[74683]:     <boot dev="hd"/>
Oct 16 11:17:11 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:17:11 user nova-compute[74683]:   </os>
Oct 16 11:17:11 user nova-compute[74683]:   <features>
Oct 16 11:17:11 user nova-compute[74683]:     <acpi/>
Oct 16 11:17:11 user nova-compute[74683]:     <apic/>
Oct 16 11:17:11 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:17:11 user nova-compute[74683]:   </features>
Oct 16 11:17:11 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:17:11 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:17:11 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:17:11 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:17:11 user nova-compute[74683]:   </clock>
Oct 16 11:17:11 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:17:11 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:17:11 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:17:11 user nova-compute[74683]:   </cpu>
Oct 16 11:17:11 user nova-compute[74683]:   <devices>
Oct 16 11:17:11 user nova-compute[74683]:     <disk type="file" device="disk">
Oct 16 11:17:11 user nova-compute[74683]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 11:17:11 user nova-compute[74683]:       <source file="/opt/stack/data/nova/instances/9ae15ce7-996c-460f-a901-1570a2012af1/disk"/>
Oct 16 11:17:11 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:17:11 user nova-compute[74683]:     </disk>
Oct 16 11:17:11 user nova-compute[74683]:     <disk type="file" device="cdrom">
Oct 16 11:17:11 user nova-compute[74683]:       <driver name="qemu" type="raw" cache="none"/>
Oct 16 11:17:11 user nova-compute[74683]:       <source file="/opt/stack/data/nova/instances/9ae15ce7-996c-460f-a901-1570a2012af1/disk.config"/>
Oct 16 11:17:11 user nova-compute[74683]:       <target dev="hda" bus="ide"/>
Oct 16 11:17:11 user nova-compute[74683]:     </disk>
Oct 16 11:17:11 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:17:11 user nova-compute[74683]:       <mac address="fa:16:3e:07:96:fd"/>
Oct 16 11:17:11 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:17:11 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:17:11 user nova-compute[74683]:       <target dev="tap84d9dc84-22"/>
Oct 16 11:17:11 user nova-compute[74683]:     </interface>
Oct 16 11:17:11 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:17:11 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/9ae15ce7-996c-460f-a901-1570a2012af1/console.log" append="off"/>
Oct 16 11:17:11 user nova-compute[74683]:     </serial>
Oct 16 11:17:11 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:17:11 user nova-compute[74683]:     <video>
Oct 16 11:17:11 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:17:11 user nova-compute[74683]:     </video>
Oct 16 11:17:11 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:17:11 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:17:11 user nova-compute[74683]:     </rng>
Oct 16 11:17:11 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:17:11 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:17:11 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:17:11 user nova-compute[74683]:     </memballoon>
Oct 16 11:17:11 user nova-compute[74683]:   </devices>
Oct 16 11:17:11 user nova-compute[74683]: </domain>
Oct 16 11:17:11 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:17:11 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T11:17:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-717081521',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-717081521',id=14,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8efJVroKVuigryD4GSp1jU2h74/46LP7zUTBq1YNdoS9sGz/cMTsYXKQK2+Lj6yR1spH3hPAhB6Y4h51NvH2BYFIARH1zI9goHYvZdEeIkuG1XUEV0yYBKVJjNs/qPig==',key_name='tempest-keypair-1457686750',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5042cdda42b74341b6c592437b6bbdbf',ramdisk_id='',reservation_id='r-ezaz9z78',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-2119065928',owner_user_name='tempest-TaggedAttachmentsTest-2119065928-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:17:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ceb56d9dc1b04324adfd4f8d0b1a9766',uuid=9ae15ce7-996c-460f-a901-1570a2012af1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84d9dc84-2273-4e6b-a8fe-9a94bddd198c", "address": "fa:16:3e:07:96:fd", "network": {"id": "33b6ba99-0d95-497e-a744-1ae84c9d63e1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-240536039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5042cdda42b74341b6c592437b6bbdbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d9dc84-22", "ovs_interfaceid": "84d9dc84-2273-4e6b-a8fe-9a94bddd198c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:17:11 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Converting VIF {"id": "84d9dc84-2273-4e6b-a8fe-9a94bddd198c", "address": "fa:16:3e:07:96:fd", "network": {"id": "33b6ba99-0d95-497e-a744-1ae84c9d63e1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-240536039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5042cdda42b74341b6c592437b6bbdbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d9dc84-22", "ovs_interfaceid": "84d9dc84-2273-4e6b-a8fe-9a94bddd198c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:17:11 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:96:fd,bridge_name='br-int',has_traffic_filtering=True,id=84d9dc84-2273-4e6b-a8fe-9a94bddd198c,network=Network(33b6ba99-0d95-497e-a744-1ae84c9d63e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d9dc84-22') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:17:11 user nova-compute[74683]: DEBUG os_vif [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:96:fd,bridge_name='br-int',has_traffic_filtering=True,id=84d9dc84-2273-4e6b-a8fe-9a94bddd198c,network=Network(33b6ba99-0d95-497e-a744-1ae84c9d63e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d9dc84-22') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:17:11 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:11 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:17:11 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:17:11 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:11 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c5312c3b-7906-5788-b2a3-23a96d726202', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:17:11 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:11 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:11 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:11 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84d9dc84-22, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:17:11 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap84d9dc84-22, col_values=(('qos', UUID('0e407abb-8bb6-454a-b980-eeb680679090')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:17:11 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap84d9dc84-22, col_values=(('external_ids', {'iface-id': '84d9dc84-2273-4e6b-a8fe-9a94bddd198c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:96:fd', 'vm-uuid': '9ae15ce7-996c-460f-a901-1570a2012af1'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:17:11 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:11 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:17:11 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:11 user nova-compute[74683]: INFO os_vif [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:96:fd,bridge_name='br-int',has_traffic_filtering=True,id=84d9dc84-2273-4e6b-a8fe-9a94bddd198c,network=Network(33b6ba99-0d95-497e-a744-1ae84c9d63e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d9dc84-22')
Oct 16 11:17:11 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:17:11 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] No BDM found with device name hda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:17:11 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] No VIF found with MAC fa:16:3e:07:96:fd, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:17:11 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Using config drive
Oct 16 11:17:11 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Creating config drive at /opt/stack/data/nova/instances/9ae15ce7-996c-460f-a901-1570a2012af1/disk.config
Oct 16 11:17:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9ae15ce7-996c-460f-a901-1570a2012af1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpzb_tjo9n {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9ae15ce7-996c-460f-a901-1570a2012af1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpzb_tjo9n" returned: 0 in 0.059s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:12 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:17:12 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:17:12 user nova-compute[74683]: DEBUG nova.network.neutron [req-2509665e-5bb2-413c-8bb9-986183b135be req-93d3d2cb-88fc-4880-b739-a7a871d8d5fa service nova] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Updated VIF entry in instance network info cache for port 84d9dc84-2273-4e6b-a8fe-9a94bddd198c. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:17:12 user nova-compute[74683]: DEBUG nova.network.neutron [req-2509665e-5bb2-413c-8bb9-986183b135be req-93d3d2cb-88fc-4880-b739-a7a871d8d5fa service nova] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Updating instance_info_cache with network_info: [{"id": "84d9dc84-2273-4e6b-a8fe-9a94bddd198c", "address": "fa:16:3e:07:96:fd", "network": {"id": "33b6ba99-0d95-497e-a744-1ae84c9d63e1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-240536039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5042cdda42b74341b6c592437b6bbdbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d9dc84-22", "ovs_interfaceid": "84d9dc84-2273-4e6b-a8fe-9a94bddd198c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:17:12 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.652s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:17:12 user nova-compute[74683]: DEBUG nova.compute.manager [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: c15b7e00-a608-4796-8e6e-1304785a9af5] Start building networks asynchronously for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 11:17:12 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-2509665e-5bb2-413c-8bb9-986183b135be req-93d3d2cb-88fc-4880-b739-a7a871d8d5fa service nova] Releasing lock "refresh_cache-9ae15ce7-996c-460f-a901-1570a2012af1" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:17:12 user nova-compute[74683]: DEBUG nova.compute.manager [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: c15b7e00-a608-4796-8e6e-1304785a9af5] Allocating IP information in the background. {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 11:17:12 user nova-compute[74683]: DEBUG nova.network.neutron [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: c15b7e00-a608-4796-8e6e-1304785a9af5] allocate_for_instance() {{(pid=74683) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 11:17:12 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: c15b7e00-a608-4796-8e6e-1304785a9af5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 11:17:12 user nova-compute[74683]: DEBUG nova.compute.manager [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: c15b7e00-a608-4796-8e6e-1304785a9af5] Start building block device mappings for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 11:17:12 user nova-compute[74683]: DEBUG nova.policy [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '77caa7602ea343f4a0932cc033e1fc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e03b7938f054e1fadb9f650ac8db1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74683) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 11:17:12 user nova-compute[74683]: DEBUG nova.compute.manager [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: c15b7e00-a608-4796-8e6e-1304785a9af5] Start spawning the instance on the hypervisor. {{(pid=74683) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 11:17:12 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: c15b7e00-a608-4796-8e6e-1304785a9af5] Creating instance directory {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 11:17:12 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: c15b7e00-a608-4796-8e6e-1304785a9af5] Creating image(s)
Oct 16 11:17:12 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Acquiring lock "/opt/stack/data/nova/instances/c15b7e00-a608-4796-8e6e-1304785a9af5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:17:12 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Lock "/opt/stack/data/nova/instances/c15b7e00-a608-4796-8e6e-1304785a9af5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:17:12 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Lock "/opt/stack/data/nova/instances/c15b7e00-a608-4796-8e6e-1304785a9af5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:17:12 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:12 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.215s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:12 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Acquiring lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:17:12 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:17:12 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:12 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.221s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:12 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/c15b7e00-a608-4796-8e6e-1304785a9af5/disk 1073741824 {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:12 user nova-compute[74683]: DEBUG nova.network.neutron [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: c15b7e00-a608-4796-8e6e-1304785a9af5] Successfully created port: f319be8e-d271-46e3-b31c-6271d47baaf1 {{(pid=74683) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 11:17:12 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/c15b7e00-a608-4796-8e6e-1304785a9af5/disk 1073741824" returned: 0 in 0.058s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:12 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:17:12 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:13 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.193s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:13 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c15b7e00-a608-4796-8e6e-1304785a9af5/disk. size=1073741824 {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 11:17:13 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15b7e00-a608-4796-8e6e-1304785a9af5/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:13 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15b7e00-a608-4796-8e6e-1304785a9af5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:13 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Cannot resize image /opt/stack/data/nova/instances/c15b7e00-a608-4796-8e6e-1304785a9af5/disk to a smaller size. {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 11:17:13 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: c15b7e00-a608-4796-8e6e-1304785a9af5] Created local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 11:17:13 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: c15b7e00-a608-4796-8e6e-1304785a9af5] Ensure instance console log exists: /opt/stack/data/nova/instances/c15b7e00-a608-4796-8e6e-1304785a9af5/console.log {{(pid=74683) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 11:17:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:17:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:17:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:17:13 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:13 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:13 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:13 user nova-compute[74683]: DEBUG nova.network.neutron [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: c15b7e00-a608-4796-8e6e-1304785a9af5] Successfully updated port: f319be8e-d271-46e3-b31c-6271d47baaf1 {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:17:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Acquiring lock "refresh_cache-c15b7e00-a608-4796-8e6e-1304785a9af5" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:17:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Acquired lock "refresh_cache-c15b7e00-a608-4796-8e6e-1304785a9af5" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:17:13 user nova-compute[74683]: DEBUG nova.network.neutron [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: c15b7e00-a608-4796-8e6e-1304785a9af5] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:17:13 user nova-compute[74683]: DEBUG nova.compute.manager [req-2c338276-e057-4401-96ca-d720e82b6bc1 req-e9a5eace-e4a2-4df1-a655-cc0b70a7fe8d service nova] [instance: c15b7e00-a608-4796-8e6e-1304785a9af5] Received event network-changed-f319be8e-d271-46e3-b31c-6271d47baaf1 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:17:13 user nova-compute[74683]: DEBUG nova.compute.manager [req-2c338276-e057-4401-96ca-d720e82b6bc1 req-e9a5eace-e4a2-4df1-a655-cc0b70a7fe8d service nova] [instance: c15b7e00-a608-4796-8e6e-1304785a9af5] Refreshing instance network info cache due to event network-changed-f319be8e-d271-46e3-b31c-6271d47baaf1. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:17:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-2c338276-e057-4401-96ca-d720e82b6bc1 req-e9a5eace-e4a2-4df1-a655-cc0b70a7fe8d service nova] Acquiring lock "refresh_cache-c15b7e00-a608-4796-8e6e-1304785a9af5" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:17:13 user nova-compute[74683]: DEBUG nova.network.neutron [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: c15b7e00-a608-4796-8e6e-1304785a9af5] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:17:13 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:13 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:14 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:14 user nova-compute[74683]: DEBUG nova.network.neutron [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: c15b7e00-a608-4796-8e6e-1304785a9af5] Updating instance_info_cache with network_info: [{"id": "f319be8e-d271-46e3-b31c-6271d47baaf1", "address": "fa:16:3e:94:3d:dc", "network": {"id": "2bf14a39-69ea-4656-956a-f1578bb1836d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1838676509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e03b7938f054e1fadb9f650ac8db1c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf319be8e-d2", "ovs_interfaceid": "f319be8e-d271-46e3-b31c-6271d47baaf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:17:14 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Releasing lock "refresh_cache-c15b7e00-a608-4796-8e6e-1304785a9af5" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:17:14 user nova-compute[74683]: DEBUG nova.compute.manager [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: c15b7e00-a608-4796-8e6e-1304785a9af5] Instance network_info: |[{"id": "f319be8e-d271-46e3-b31c-6271d47baaf1", "address": "fa:16:3e:94:3d:dc", "network": {"id": "2bf14a39-69ea-4656-956a-f1578bb1836d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1838676509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e03b7938f054e1fadb9f650ac8db1c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf319be8e-d2", "ovs_interfaceid": "f319be8e-d271-46e3-b31c-6271d47baaf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 11:17:14 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-2c338276-e057-4401-96ca-d720e82b6bc1 req-e9a5eace-e4a2-4df1-a655-cc0b70a7fe8d service nova] Acquired lock "refresh_cache-c15b7e00-a608-4796-8e6e-1304785a9af5" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:17:14 user nova-compute[74683]: DEBUG nova.network.neutron [req-2c338276-e057-4401-96ca-d720e82b6bc1 req-e9a5eace-e4a2-4df1-a655-cc0b70a7fe8d service nova] [instance: c15b7e00-a608-4796-8e6e-1304785a9af5] Refreshing network info cache for port f319be8e-d271-46e3-b31c-6271d47baaf1 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:17:14 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: c15b7e00-a608-4796-8e6e-1304785a9af5] Start _get_guest_xml network_info=[{"id": "f319be8e-d271-46e3-b31c-6271d47baaf1", "address": "fa:16:3e:94:3d:dc", "network": {"id": "2bf14a39-69ea-4656-956a-f1578bb1836d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1838676509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e03b7938f054e1fadb9f650ac8db1c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf319be8e-d2", "ovs_interfaceid": "f319be8e-d271-46e3-b31c-6271d47baaf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:17:14 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:17:14 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:17:14 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:17:14 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:17:14 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:17:14 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:17:14 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:17:14 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:17:14 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:17:14 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:17:14 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:17:14 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:17:14 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:17:14 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:17:14 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:17:14 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:17:14 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:17:14 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:17:14 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:17:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-906045810',display_name='tempest-VolumesAdminNegativeTest-server-906045810',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-906045810',id=15,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e03b7938f054e1fadb9f650ac8db1c9',ramdisk_id='',reservation_id='r-i603i6lm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-191985547',owner_user_name='tempest-VolumesAdminNegativeTest-191985547-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:17:12Z,user_data=None,user_id='77caa7602ea343f4a0932cc033e1fc82',uuid=c15b7e00-a608-4796-8e6e-1304785a9af5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f319be8e-d271-46e3-b31c-6271d47baaf1", "address": "fa:16:3e:94:3d:dc", "network": {"id": "2bf14a39-69ea-4656-956a-f1578bb1836d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1838676509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e03b7938f054e1fadb9f650ac8db1c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf319be8e-d2", "ovs_interfaceid": "f319be8e-d271-46e3-b31c-6271d47baaf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:17:14 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Converting VIF {"id": "f319be8e-d271-46e3-b31c-6271d47baaf1", "address": "fa:16:3e:94:3d:dc", "network": {"id": "2bf14a39-69ea-4656-956a-f1578bb1836d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1838676509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e03b7938f054e1fadb9f650ac8db1c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf319be8e-d2", "ovs_interfaceid": "f319be8e-d271-46e3-b31c-6271d47baaf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:17:14 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:3d:dc,bridge_name='br-int',has_traffic_filtering=True,id=f319be8e-d271-46e3-b31c-6271d47baaf1,network=Network(2bf14a39-69ea-4656-956a-f1578bb1836d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf319be8e-d2') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:17:14 user nova-compute[74683]: DEBUG nova.objects.instance [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Lazy-loading 'pci_devices' on Instance uuid c15b7e00-a608-4796-8e6e-1304785a9af5 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:17:14 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: c15b7e00-a608-4796-8e6e-1304785a9af5] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:17:14 user nova-compute[74683]:   <uuid>c15b7e00-a608-4796-8e6e-1304785a9af5</uuid>
Oct 16 11:17:14 user nova-compute[74683]:   <name>instance-0000000f</name>
Oct 16 11:17:14 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:17:14 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:17:14 user nova-compute[74683]:   <metadata>
Oct 16 11:17:14 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:17:14 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:17:14 user nova-compute[74683]:       <nova:name>tempest-VolumesAdminNegativeTest-server-906045810</nova:name>
Oct 16 11:17:14 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:17:14</nova:creationTime>
Oct 16 11:17:14 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:17:14 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:17:14 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:17:14 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:17:14 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:17:14 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:17:14 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:17:14 user nova-compute[74683]:       <nova:owner>
Oct 16 11:17:14 user nova-compute[74683]:         <nova:user uuid="77caa7602ea343f4a0932cc033e1fc82">tempest-VolumesAdminNegativeTest-191985547-project-member</nova:user>
Oct 16 11:17:14 user nova-compute[74683]:         <nova:project uuid="2e03b7938f054e1fadb9f650ac8db1c9">tempest-VolumesAdminNegativeTest-191985547</nova:project>
Oct 16 11:17:14 user nova-compute[74683]:       </nova:owner>
Oct 16 11:17:14 user nova-compute[74683]:       <nova:root type="image" uuid="0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f"/>
Oct 16 11:17:14 user nova-compute[74683]:       <nova:ports>
Oct 16 11:17:14 user nova-compute[74683]:         <nova:port uuid="f319be8e-d271-46e3-b31c-6271d47baaf1">
Oct 16 11:17:14 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 16 11:17:14 user nova-compute[74683]:         </nova:port>
Oct 16 11:17:14 user nova-compute[74683]:       </nova:ports>
Oct 16 11:17:14 user nova-compute[74683]:     </nova:instance>
Oct 16 11:17:14 user nova-compute[74683]:   </metadata>
Oct 16 11:17:14 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:17:14 user nova-compute[74683]:     <system>
Oct 16 11:17:14 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:17:14 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:17:14 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:17:14 user nova-compute[74683]:       <entry name="serial">c15b7e00-a608-4796-8e6e-1304785a9af5</entry>
Oct 16 11:17:14 user nova-compute[74683]:       <entry name="uuid">c15b7e00-a608-4796-8e6e-1304785a9af5</entry>
Oct 16 11:17:14 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:17:14 user nova-compute[74683]:     </system>
Oct 16 11:17:14 user nova-compute[74683]:   </sysinfo>
Oct 16 11:17:14 user nova-compute[74683]:   <os>
Oct 16 11:17:14 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:17:14 user nova-compute[74683]:     <boot dev="hd"/>
Oct 16 11:17:14 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:17:14 user nova-compute[74683]:   </os>
Oct 16 11:17:14 user nova-compute[74683]:   <features>
Oct 16 11:17:14 user nova-compute[74683]:     <acpi/>
Oct 16 11:17:14 user nova-compute[74683]:     <apic/>
Oct 16 11:17:14 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:17:14 user nova-compute[74683]:   </features>
Oct 16 11:17:14 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:17:14 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:17:14 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:17:14 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:17:14 user nova-compute[74683]:   </clock>
Oct 16 11:17:14 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:17:14 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:17:14 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:17:14 user nova-compute[74683]:   </cpu>
Oct 16 11:17:14 user nova-compute[74683]:   <devices>
Oct 16 11:17:14 user nova-compute[74683]:     <disk type="file" device="disk">
Oct 16 11:17:14 user nova-compute[74683]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 11:17:14 user nova-compute[74683]:       <source file="/opt/stack/data/nova/instances/c15b7e00-a608-4796-8e6e-1304785a9af5/disk"/>
Oct 16 11:17:14 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:17:14 user nova-compute[74683]:     </disk>
Oct 16 11:17:14 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:17:14 user nova-compute[74683]:       <mac address="fa:16:3e:94:3d:dc"/>
Oct 16 11:17:14 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:17:14 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:17:14 user nova-compute[74683]:       <target dev="tapf319be8e-d2"/>
Oct 16 11:17:14 user nova-compute[74683]:     </interface>
Oct 16 11:17:14 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:17:14 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/c15b7e00-a608-4796-8e6e-1304785a9af5/console.log" append="off"/>
Oct 16 11:17:14 user nova-compute[74683]:     </serial>
Oct 16 11:17:14 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:17:14 user nova-compute[74683]:     <video>
Oct 16 11:17:14 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:17:14 user nova-compute[74683]:     </video>
Oct 16 11:17:14 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:17:14 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:17:14 user nova-compute[74683]:     </rng>
Oct 16 11:17:14 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:17:14 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:17:14 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:17:14 user nova-compute[74683]:     </memballoon>
Oct 16 11:17:14 user nova-compute[74683]:   </devices>
Oct 16 11:17:14 user nova-compute[74683]: </domain>
Oct 16 11:17:14 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:17:14 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:17:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-906045810',display_name='tempest-VolumesAdminNegativeTest-server-906045810',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-906045810',id=15,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e03b7938f054e1fadb9f650ac8db1c9',ramdisk_id='',reservation_id='r-i603i6lm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-191985547',owner_user_name='tempest-VolumesAdminNegativeTest-191985547-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:17:12Z,user_data=None,user_id='77caa7602ea343f4a0932cc033e1fc82',uuid=c15b7e00-a608-4796-8e6e-1304785a9af5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f319be8e-d271-46e3-b31c-6271d47baaf1", "address": "fa:16:3e:94:3d:dc", "network": {"id": "2bf14a39-69ea-4656-956a-f1578bb1836d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1838676509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e03b7938f054e1fadb9f650ac8db1c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf319be8e-d2", "ovs_interfaceid": "f319be8e-d271-46e3-b31c-6271d47baaf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:17:14 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Converting VIF {"id": "f319be8e-d271-46e3-b31c-6271d47baaf1", "address": "fa:16:3e:94:3d:dc", "network": {"id": "2bf14a39-69ea-4656-956a-f1578bb1836d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1838676509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e03b7938f054e1fadb9f650ac8db1c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf319be8e-d2", "ovs_interfaceid": "f319be8e-d271-46e3-b31c-6271d47baaf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:17:14 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:3d:dc,bridge_name='br-int',has_traffic_filtering=True,id=f319be8e-d271-46e3-b31c-6271d47baaf1,network=Network(2bf14a39-69ea-4656-956a-f1578bb1836d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf319be8e-d2') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:17:14 user nova-compute[74683]: DEBUG os_vif [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:3d:dc,bridge_name='br-int',has_traffic_filtering=True,id=f319be8e-d271-46e3-b31c-6271d47baaf1,network=Network(2bf14a39-69ea-4656-956a-f1578bb1836d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf319be8e-d2') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:17:14 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:14 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:17:14 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:17:14 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:14 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2d25bd1f-de41-54fd-b141-249f52fcb9ce', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:17:14 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:14 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:17:14 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:14 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf319be8e-d2, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:17:14 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf319be8e-d2, col_values=(('qos', UUID('d841ccf7-31a5-48bc-ae59-b158acdbb9c5')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:17:14 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf319be8e-d2, col_values=(('external_ids', {'iface-id': 'f319be8e-d271-46e3-b31c-6271d47baaf1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:3d:dc', 'vm-uuid': 'c15b7e00-a608-4796-8e6e-1304785a9af5'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:17:14 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:14 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:17:14 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:14 user nova-compute[74683]: INFO os_vif [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:3d:dc,bridge_name='br-int',has_traffic_filtering=True,id=f319be8e-d271-46e3-b31c-6271d47baaf1,network=Network(2bf14a39-69ea-4656-956a-f1578bb1836d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf319be8e-d2')
Oct 16 11:17:14 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:17:14 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] No VIF found with MAC fa:16:3e:94:3d:dc, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:17:14 user nova-compute[74683]: DEBUG nova.network.neutron [req-2c338276-e057-4401-96ca-d720e82b6bc1 req-e9a5eace-e4a2-4df1-a655-cc0b70a7fe8d service nova] [instance: c15b7e00-a608-4796-8e6e-1304785a9af5] Updated VIF entry in instance network info cache for port f319be8e-d271-46e3-b31c-6271d47baaf1. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:17:14 user nova-compute[74683]: DEBUG nova.network.neutron [req-2c338276-e057-4401-96ca-d720e82b6bc1 req-e9a5eace-e4a2-4df1-a655-cc0b70a7fe8d service nova] [instance: c15b7e00-a608-4796-8e6e-1304785a9af5] Updating instance_info_cache with network_info: [{"id": "f319be8e-d271-46e3-b31c-6271d47baaf1", "address": "fa:16:3e:94:3d:dc", "network": {"id": "2bf14a39-69ea-4656-956a-f1578bb1836d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1838676509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e03b7938f054e1fadb9f650ac8db1c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf319be8e-d2", "ovs_interfaceid": "f319be8e-d271-46e3-b31c-6271d47baaf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:17:14 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-2c338276-e057-4401-96ca-d720e82b6bc1 req-e9a5eace-e4a2-4df1-a655-cc0b70a7fe8d service nova] Releasing lock "refresh_cache-c15b7e00-a608-4796-8e6e-1304785a9af5" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:17:15 user nova-compute[74683]: DEBUG nova.compute.manager [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Instance event wait completed in 0 seconds for  {{(pid=74683) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 11:17:15 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Guest created on hypervisor {{(pid=74683) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 11:17:15 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Instance spawned successfully.
Oct 16 11:17:15 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 11:17:15 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Found default for hw_cdrom_bus of ide {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:17:15 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Found default for hw_disk_bus of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:17:15 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Found default for hw_input_bus of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:17:15 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Found default for hw_pointer_model of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:17:15 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Found default for hw_video_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:17:15 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Found default for hw_vif_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:17:15 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:15 user nova-compute[74683]: DEBUG nova.compute.manager [req-7a7f5f3f-4bec-4ac1-bc6c-f09d0c8bff35 req-c53b93e6-c453-47b0-aa23-44a069386481 service nova] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Received event network-vif-plugged-84d9dc84-2273-4e6b-a8fe-9a94bddd198c {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:17:15 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-7a7f5f3f-4bec-4ac1-bc6c-f09d0c8bff35 req-c53b93e6-c453-47b0-aa23-44a069386481 service nova] Acquiring lock "9ae15ce7-996c-460f-a901-1570a2012af1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:17:15 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-7a7f5f3f-4bec-4ac1-bc6c-f09d0c8bff35 req-c53b93e6-c453-47b0-aa23-44a069386481 service nova] Lock "9ae15ce7-996c-460f-a901-1570a2012af1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:17:15 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-7a7f5f3f-4bec-4ac1-bc6c-f09d0c8bff35 req-c53b93e6-c453-47b0-aa23-44a069386481 service nova] Lock "9ae15ce7-996c-460f-a901-1570a2012af1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:17:15 user nova-compute[74683]: DEBUG nova.compute.manager [req-7a7f5f3f-4bec-4ac1-bc6c-f09d0c8bff35 req-c53b93e6-c453-47b0-aa23-44a069386481 service nova] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] No waiting events found dispatching network-vif-plugged-84d9dc84-2273-4e6b-a8fe-9a94bddd198c {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:17:15 user nova-compute[74683]: WARNING nova.compute.manager [req-7a7f5f3f-4bec-4ac1-bc6c-f09d0c8bff35 req-c53b93e6-c453-47b0-aa23-44a069386481 service nova] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Received unexpected event network-vif-plugged-84d9dc84-2273-4e6b-a8fe-9a94bddd198c for instance with vm_state building and task_state spawning.
Oct 16 11:17:15 user nova-compute[74683]: DEBUG nova.compute.manager [req-7a7f5f3f-4bec-4ac1-bc6c-f09d0c8bff35 req-c53b93e6-c453-47b0-aa23-44a069386481 service nova] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Received event network-vif-plugged-84d9dc84-2273-4e6b-a8fe-9a94bddd198c {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:17:15 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-7a7f5f3f-4bec-4ac1-bc6c-f09d0c8bff35 req-c53b93e6-c453-47b0-aa23-44a069386481 service nova] Acquiring lock "9ae15ce7-996c-460f-a901-1570a2012af1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:17:15 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-7a7f5f3f-4bec-4ac1-bc6c-f09d0c8bff35 req-c53b93e6-c453-47b0-aa23-44a069386481 service nova] Lock "9ae15ce7-996c-460f-a901-1570a2012af1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:17:15 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-7a7f5f3f-4bec-4ac1-bc6c-f09d0c8bff35 req-c53b93e6-c453-47b0-aa23-44a069386481 service nova] Lock "9ae15ce7-996c-460f-a901-1570a2012af1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:17:15 user nova-compute[74683]: DEBUG nova.compute.manager [req-7a7f5f3f-4bec-4ac1-bc6c-f09d0c8bff35 req-c53b93e6-c453-47b0-aa23-44a069386481 service nova] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] No waiting events found dispatching network-vif-plugged-84d9dc84-2273-4e6b-a8fe-9a94bddd198c {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:17:15 user nova-compute[74683]: WARNING nova.compute.manager [req-7a7f5f3f-4bec-4ac1-bc6c-f09d0c8bff35 req-c53b93e6-c453-47b0-aa23-44a069386481 service nova] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Received unexpected event network-vif-plugged-84d9dc84-2273-4e6b-a8fe-9a94bddd198c for instance with vm_state building and task_state spawning.
Oct 16 11:17:15 user nova-compute[74683]: INFO nova.compute.manager [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Took 6.28 seconds to spawn the instance on the hypervisor.
Oct 16 11:17:15 user nova-compute[74683]: DEBUG nova.compute.manager [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:17:15 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:15 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:15 user nova-compute[74683]: INFO nova.compute.manager [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Took 7.11 seconds to build instance.
Oct 16 11:17:15 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:15 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f9796589-a811-47f1-b777-a09dd8acbe32 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Lock "9ae15ce7-996c-460f-a901-1570a2012af1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.213s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:17:16 user nova-compute[74683]: DEBUG nova.compute.manager [req-e4cce7ba-113f-4cba-8475-0b9ab0630087 req-d1eed1e8-6ad9-4291-9fcb-286ec4f61000 service nova] [instance: c15b7e00-a608-4796-8e6e-1304785a9af5] Received event network-vif-plugged-f319be8e-d271-46e3-b31c-6271d47baaf1 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:17:16 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e4cce7ba-113f-4cba-8475-0b9ab0630087 req-d1eed1e8-6ad9-4291-9fcb-286ec4f61000 service nova] Acquiring lock "c15b7e00-a608-4796-8e6e-1304785a9af5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:17:16 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e4cce7ba-113f-4cba-8475-0b9ab0630087 req-d1eed1e8-6ad9-4291-9fcb-286ec4f61000 service nova] Lock "c15b7e00-a608-4796-8e6e-1304785a9af5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:17:16 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e4cce7ba-113f-4cba-8475-0b9ab0630087 req-d1eed1e8-6ad9-4291-9fcb-286ec4f61000 service nova] Lock "c15b7e00-a608-4796-8e6e-1304785a9af5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:17:16 user nova-compute[74683]: DEBUG nova.compute.manager [req-e4cce7ba-113f-4cba-8475-0b9ab0630087 req-d1eed1e8-6ad9-4291-9fcb-286ec4f61000 service nova] [instance: c15b7e00-a608-4796-8e6e-1304785a9af5] No waiting events found dispatching network-vif-plugged-f319be8e-d271-46e3-b31c-6271d47baaf1 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:17:16 user nova-compute[74683]: WARNING nova.compute.manager [req-e4cce7ba-113f-4cba-8475-0b9ab0630087 req-d1eed1e8-6ad9-4291-9fcb-286ec4f61000 service nova] [instance: c15b7e00-a608-4796-8e6e-1304785a9af5] Received unexpected event network-vif-plugged-f319be8e-d271-46e3-b31c-6271d47baaf1 for instance with vm_state building and task_state spawning.
Oct 16 11:17:16 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:16 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:18 user nova-compute[74683]: DEBUG nova.compute.manager [req-409ce769-a86f-4cfc-b31c-dbf7e23b1d10 req-afd552dc-768e-4829-b29c-2133af2ae22f service nova] [instance: c15b7e00-a608-4796-8e6e-1304785a9af5] Received event network-vif-plugged-f319be8e-d271-46e3-b31c-6271d47baaf1 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:17:18 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-409ce769-a86f-4cfc-b31c-dbf7e23b1d10 req-afd552dc-768e-4829-b29c-2133af2ae22f service nova] Acquiring lock "c15b7e00-a608-4796-8e6e-1304785a9af5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:17:18 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-409ce769-a86f-4cfc-b31c-dbf7e23b1d10 req-afd552dc-768e-4829-b29c-2133af2ae22f service nova] Lock "c15b7e00-a608-4796-8e6e-1304785a9af5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:17:18 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-409ce769-a86f-4cfc-b31c-dbf7e23b1d10 req-afd552dc-768e-4829-b29c-2133af2ae22f service nova] Lock "c15b7e00-a608-4796-8e6e-1304785a9af5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:17:18 user nova-compute[74683]: DEBUG nova.compute.manager [req-409ce769-a86f-4cfc-b31c-dbf7e23b1d10 req-afd552dc-768e-4829-b29c-2133af2ae22f service nova] [instance: c15b7e00-a608-4796-8e6e-1304785a9af5] No waiting events found dispatching network-vif-plugged-f319be8e-d271-46e3-b31c-6271d47baaf1 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:17:18 user nova-compute[74683]: WARNING nova.compute.manager [req-409ce769-a86f-4cfc-b31c-dbf7e23b1d10 req-afd552dc-768e-4829-b29c-2133af2ae22f service nova] [instance: c15b7e00-a608-4796-8e6e-1304785a9af5] Received unexpected event network-vif-plugged-f319be8e-d271-46e3-b31c-6271d47baaf1 for instance with vm_state building and task_state spawning.
Oct 16 11:17:18 user nova-compute[74683]: DEBUG nova.compute.manager [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: c15b7e00-a608-4796-8e6e-1304785a9af5] Instance event wait completed in 0 seconds for  {{(pid=74683) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 11:17:18 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: c15b7e00-a608-4796-8e6e-1304785a9af5] Guest created on hypervisor {{(pid=74683) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 11:17:18 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: c15b7e00-a608-4796-8e6e-1304785a9af5] Instance spawned successfully.
Oct 16 11:17:18 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: c15b7e00-a608-4796-8e6e-1304785a9af5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 11:17:18 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: c15b7e00-a608-4796-8e6e-1304785a9af5] Found default for hw_cdrom_bus of ide {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:17:18 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: c15b7e00-a608-4796-8e6e-1304785a9af5] Found default for hw_disk_bus of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:17:18 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: c15b7e00-a608-4796-8e6e-1304785a9af5] Found default for hw_input_bus of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:17:18 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: c15b7e00-a608-4796-8e6e-1304785a9af5] Found default for hw_pointer_model of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:17:18 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: c15b7e00-a608-4796-8e6e-1304785a9af5] Found default for hw_video_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:17:18 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: c15b7e00-a608-4796-8e6e-1304785a9af5] Found default for hw_vif_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:17:18 user nova-compute[74683]: INFO nova.compute.manager [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: c15b7e00-a608-4796-8e6e-1304785a9af5] Took 5.96 seconds to spawn the instance on the hypervisor.
Oct 16 11:17:18 user nova-compute[74683]: DEBUG nova.compute.manager [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: c15b7e00-a608-4796-8e6e-1304785a9af5] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:17:18 user nova-compute[74683]: INFO nova.compute.manager [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: c15b7e00-a608-4796-8e6e-1304785a9af5] Took 7.01 seconds to build instance.
Oct 16 11:17:18 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-30a07786-e17e-42ab-8274-0740dd1b4f81 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Lock "c15b7e00-a608-4796-8e6e-1304785a9af5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.135s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:17:19 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:20 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:21 user nova-compute[74683]: DEBUG nova.compute.manager [req-5f3e4dd1-0296-4e38-8071-35de95be0642 req-3f6b9e9a-d92d-4f2a-a94a-8d86a53ce780 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received event network-changed-1509ff6e-10c0-4f96-95ae-660dfc1402cc {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:17:21 user nova-compute[74683]: DEBUG nova.compute.manager [req-5f3e4dd1-0296-4e38-8071-35de95be0642 req-3f6b9e9a-d92d-4f2a-a94a-8d86a53ce780 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Refreshing instance network info cache due to event network-changed-1509ff6e-10c0-4f96-95ae-660dfc1402cc. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:17:21 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-5f3e4dd1-0296-4e38-8071-35de95be0642 req-3f6b9e9a-d92d-4f2a-a94a-8d86a53ce780 service nova] Acquiring lock "refresh_cache-9df7866f-28e9-46d0-9f35-24484adfffd7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:17:21 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-5f3e4dd1-0296-4e38-8071-35de95be0642 req-3f6b9e9a-d92d-4f2a-a94a-8d86a53ce780 service nova] Acquired lock "refresh_cache-9df7866f-28e9-46d0-9f35-24484adfffd7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:17:21 user nova-compute[74683]: DEBUG nova.network.neutron [req-5f3e4dd1-0296-4e38-8071-35de95be0642 req-3f6b9e9a-d92d-4f2a-a94a-8d86a53ce780 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Refreshing network info cache for port 1509ff6e-10c0-4f96-95ae-660dfc1402cc {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:17:21 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03b83769-20d2-4ad0-bc66-f4dd50c3b5fc tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Calling os-brick to attach iSCSI Volume {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 11:17:21 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b83769-20d2-4ad0-bc66-f4dd50c3b5fc tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fKNejHlu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:17:21 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-03b83769-20d2-4ad0-bc66-f4dd50c3b5fc tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:17:21 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-03b83769-20d2-4ad0-bc66-f4dd50c3b5fc tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:17:21 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-03b83769-20d2-4ad0-bc66-f4dd50c3b5fc tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:17:21 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-03b83769-20d2-4ad0-bc66-f4dd50c3b5fc tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:17:21 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-03b83769-20d2-4ad0-bc66-f4dd50c3b5fc tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:17:21 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-03b83769-20d2-4ad0-bc66-f4dd50c3b5fc tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:17:21 user nova-compute[74683]: INFO os_brick.initiator.connectors.iscsi [None req-03b83769-20d2-4ad0-bc66-f4dd50c3b5fc tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 11:17:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 -p 172.16.0.220:3260 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:21 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9444bbf-0834-4838-863b-412c37197082]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:21 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b83769-20d2-4ad0-bc66-f4dd50c3b5fc tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 11:17:21 user nova-compute[74683]:  {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:17:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:21 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53185e1-b917-4859-8e01-f0475c8b3cc1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5] added\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:21 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b83769-20d2-4ad0-bc66-f4dd50c3b5fc tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5] added
Oct 16 11:17:21 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:17:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:21 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[30dc6119-76dc-4b7f-825f-c3dceca3d579]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:21 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b83769-20d2-4ad0-bc66-f4dd50c3b5fc tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:17:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:21 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95b4ae1-b443-4cb6-8a4e-aaa24a164a2a]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:21 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b83769-20d2-4ad0-bc66-f4dd50c3b5fc tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:17:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fKNejHlu {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fKNejHlu" returned: 0 in 0.030s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:21 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6a8efb-4841-473f-b7d7-b1687cb92701]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:21 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b83769-20d2-4ad0-bc66-f4dd50c3b5fc tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fKNejHlu'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:17:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:22 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[092f4b1b-8a74-4dd7-a270-3836c5508fb5]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:22 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b83769-20d2-4ad0-bc66-f4dd50c3b5fc tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:17:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:22 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc32869-4da1-468e-a2fd-266d85974bf8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:22 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b83769-20d2-4ad0-bc66-f4dd50c3b5fc tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)
Oct 16 11:17:22 user nova-compute[74683]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)
Oct 16 11:17:22 user nova-compute[74683]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e (non-flash)
Oct 16 11:17:22 user nova-compute[74683]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:17:22 user nova-compute[74683]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)
Oct 16 11:17:22 user nova-compute[74683]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)
Oct 16 11:17:22 user nova-compute[74683]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)
Oct 16 11:17:22 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:17:22 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:17:22 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b83769-20d2-4ad0-bc66-f4dd50c3b5fc tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)
Oct 16 11:17:22 user nova-compute[74683]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)
Oct 16 11:17:22 user nova-compute[74683]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e (non-flash)
Oct 16 11:17:22 user nova-compute[74683]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:17:22 user nova-compute[74683]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)
Oct 16 11:17:22 user nova-compute[74683]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)
Oct 16 11:17:22 user nova-compute[74683]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)
Oct 16 11:17:22 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:17:22 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:17:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 -p 172.16.0.220:3260 --login {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 -p 172.16.0.220:3260 --login" returned: 0 in 0.102s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:22 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[610ffb05-dabd-4b59-9914-d19110126b18]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:22 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b83769-20d2-4ad0-bc66-f4dd50c3b5fc tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5, portal: 172.16.0.220,3260]
Oct 16 11:17:22 user nova-compute[74683]: Login to [iface: default, target: iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5, portal: 172.16.0.220,3260] successful.
Oct 16 11:17:22 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:17:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:22 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be4410e-f6fd-4697-9fa2-bfbd4e57c32d]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:22 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b83769-20d2-4ad0-bc66-f4dd50c3b5fc tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:17:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:22 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5f2ef3-8c8d-48bc-8f29-682e059337c5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:22 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b83769-20d2-4ad0-bc66-f4dd50c3b5fc tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)
Oct 16 11:17:22 user nova-compute[74683]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)
Oct 16 11:17:22 user nova-compute[74683]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e (non-flash)
Oct 16 11:17:22 user nova-compute[74683]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:17:22 user nova-compute[74683]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)
Oct 16 11:17:22 user nova-compute[74683]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)
Oct 16 11:17:22 user nova-compute[74683]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)
Oct 16 11:17:22 user nova-compute[74683]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)
Oct 16 11:17:22 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:17:22 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:17:22 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b83769-20d2-4ad0-bc66-f4dd50c3b5fc tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)
Oct 16 11:17:22 user nova-compute[74683]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)
Oct 16 11:17:22 user nova-compute[74683]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e (non-flash)
Oct 16 11:17:22 user nova-compute[74683]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:17:22 user nova-compute[74683]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)
Oct 16 11:17:22 user nova-compute[74683]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)
Oct 16 11:17:22 user nova-compute[74683]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)
Oct 16 11:17:22 user nova-compute[74683]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)
Oct 16 11:17:22 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:17:22 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:17:22 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-03b83769-20d2-4ad0-bc66-f4dd50c3b5fc tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.408s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:17:22 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b83769-20d2-4ad0-bc66-f4dd50c3b5fc tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Connected to 172.16.0.220:3260 {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 11:17:22 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-03b83769-20d2-4ad0-bc66-f4dd50c3b5fc tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] HCTL ('38', '-', '-', 0) found on session 14 with lun 0 {{(pid=74683) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 11:17:22 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-03b83769-20d2-4ad0-bc66-f4dd50c3b5fc tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74683) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 11:17:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:22 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[0890e9b4-65db-4b4f-ac24-43d78bfe420e]: (4, ('- - 0', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:22 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-03b83769-20d2-4ad0-bc66-f4dd50c3b5fc tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Searching for a device in session 14 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:17:22 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b83769-20d2-4ad0-bc66-f4dd50c3b5fc tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fKNejHlu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 11:17:22 user nova-compute[74683]: DEBUG nova.network.neutron [req-5f3e4dd1-0296-4e38-8071-35de95be0642 req-3f6b9e9a-d92d-4f2a-a94a-8d86a53ce780 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Updated VIF entry in instance network info cache for port 1509ff6e-10c0-4f96-95ae-660dfc1402cc. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:17:22 user nova-compute[74683]: DEBUG nova.network.neutron [req-5f3e4dd1-0296-4e38-8071-35de95be0642 req-3f6b9e9a-d92d-4f2a-a94a-8d86a53ce780 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Updating instance_info_cache with network_info: [{"id": "1509ff6e-10c0-4f96-95ae-660dfc1402cc", "address": "fa:16:3e:7e:c7:90", "network": {"id": "6e171460-714f-45db-a77d-ba03b50b892e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-531792258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1509ff6e-10", "ovs_interfaceid": "1509ff6e-10c0-4f96-95ae-660dfc1402cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7cfcd210-0e45-4f0e-b04b-1e933ec87734", "address": "fa:16:3e:d6:13:bf", "network": {"id": "0ab5f993-73f7-4963-9a4a-768145c101ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1056805143", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cfcd210-0e", "ovs_interfaceid": "7cfcd210-0e45-4f0e-b04b-1e933ec87734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bfe231c8-ff2a-46fd-9af6-9982a54d7846", "address": "fa:16:3e:52:f5:40", "network": {"id": "0ab5f993-73f7-4963-9a4a-768145c101ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1056805143", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe231c8-ff", "ovs_interfaceid": "bfe231c8-ff2a-46fd-9af6-9982a54d7846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8c0a030c-cf2d-4d14-b5c3-6d0563b346b9", "address": "fa:16:3e:b2:3c:35", "network": {"id": "0ab5f993-73f7-4963-9a4a-768145c101ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1056805143", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c0a030c-cf", "ovs_interfaceid": "8c0a030c-cf2d-4d14-b5c3-6d0563b346b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "82f47635-6e3f-492d-9819-4d77ae46fb29", "address": "fa:16:3e:24:20:65", "network": {"id": "0ab5f993-73f7-4963-9a4a-768145c101ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1056805143", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82f47635-6e", "ovs_interfaceid": "82f47635-6e3f-492d-9819-4d77ae46fb29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8a9e59f4-7708-438f-8411-499c6e38ec1b", "address": "fa:16:3e:42:50:56", "network": {"id": "e2c37b04-3414-40bf-a284-f1f9123d0ccb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1623055457", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a9e59f4-77", "ovs_interfaceid": "8a9e59f4-7708-438f-8411-499c6e38ec1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "698c4ef8-286a-4bc1-a789-3276dc6defea", "address": "fa:16:3e:f8:2c:0c", "network": {"id": "e2c37b04-3414-40bf-a284-f1f9123d0ccb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1623055457", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap698c4ef8-28", "ovs_interfaceid": "698c4ef8-286a-4bc1-a789-3276dc6defea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:17:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-5f3e4dd1-0296-4e38-8071-35de95be0642 req-3f6b9e9a-d92d-4f2a-a94a-8d86a53ce780 service nova] Releasing lock "refresh_cache-9df7866f-28e9-46d0-9f35-24484adfffd7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:17:23 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-03b83769-20d2-4ad0-bc66-f4dd50c3b5fc tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.453s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:17:23 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b83769-20d2-4ad0-bc66-f4dd50c3b5fc tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] <== connect_volume: return (1455ms) {'type': 'block', 'scsi_wwn': '26362376539366530', 'path': '/dev/sdg'} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:17:23 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03b83769-20d2-4ad0-bc66-f4dd50c3b5fc tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362376539366530', 'path': '/dev/sdg'} {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 11:17:23 user nova-compute[74683]: DEBUG nova.objects.instance [None req-03b83769-20d2-4ad0-bc66-f4dd50c3b5fc tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Lazy-loading 'flavor' on Instance uuid 2f1db5e2-0b25-4d61-9dd3-038811b4eda1 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:17:23 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-03b83769-20d2-4ad0-bc66-f4dd50c3b5fc tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 11:17:23 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:17:23 user nova-compute[74683]:   <source dev="/dev/sdg"/>
Oct 16 11:17:23 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:17:23 user nova-compute[74683]:   <serial>a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5</serial>
Oct 16 11:17:23 user nova-compute[74683]: </disk>
Oct 16 11:17:23 user nova-compute[74683]:  {{(pid=74683) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 11:17:23 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-03b83769-20d2-4ad0-bc66-f4dd50c3b5fc tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:17:23 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-03b83769-20d2-4ad0-bc66-f4dd50c3b5fc tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:17:23 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-03b83769-20d2-4ad0-bc66-f4dd50c3b5fc tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] No VIF found with MAC fa:16:3e:18:cc:d6, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:17:23 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-03b83769-20d2-4ad0-bc66-f4dd50c3b5fc tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Lock "2f1db5e2-0b25-4d61-9dd3-038811b4eda1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.236s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:17:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Acquiring lock "9df7866f-28e9-46d0-9f35-24484adfffd7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:17:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Lock "9df7866f-28e9-46d0-9f35-24484adfffd7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:17:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Acquiring lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:17:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:17:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:17:24 user nova-compute[74683]: INFO nova.compute.manager [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Terminating instance
Oct 16 11:17:24 user nova-compute[74683]: DEBUG nova.compute.manager [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Start destroying the instance on the hypervisor. {{(pid=74683) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 11:17:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:24 user nova-compute[74683]: DEBUG nova.compute.manager [req-82dfcd4d-6a58-41bf-8f05-fd0547efddad req-6a699384-f495-4a87-82bf-65e870b6a52f service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received event network-vif-unplugged-1509ff6e-10c0-4f96-95ae-660dfc1402cc {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:17:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-82dfcd4d-6a58-41bf-8f05-fd0547efddad req-6a699384-f495-4a87-82bf-65e870b6a52f service nova] Acquiring lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:17:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-82dfcd4d-6a58-41bf-8f05-fd0547efddad req-6a699384-f495-4a87-82bf-65e870b6a52f service nova] Lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:17:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-82dfcd4d-6a58-41bf-8f05-fd0547efddad req-6a699384-f495-4a87-82bf-65e870b6a52f service nova] Lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:17:24 user nova-compute[74683]: DEBUG nova.compute.manager [req-82dfcd4d-6a58-41bf-8f05-fd0547efddad req-6a699384-f495-4a87-82bf-65e870b6a52f service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] No waiting events found dispatching network-vif-unplugged-1509ff6e-10c0-4f96-95ae-660dfc1402cc {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:17:24 user nova-compute[74683]: DEBUG nova.compute.manager [req-82dfcd4d-6a58-41bf-8f05-fd0547efddad req-6a699384-f495-4a87-82bf-65e870b6a52f service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received event network-vif-unplugged-1509ff6e-10c0-4f96-95ae-660dfc1402cc for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 11:17:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:24 user nova-compute[74683]: DEBUG nova.compute.manager [req-7a69851c-ec55-48c3-82a6-4253bc4d197a req-9c317256-81a0-4c70-a0fe-b5b183f60071 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received event network-vif-unplugged-7cfcd210-0e45-4f0e-b04b-1e933ec87734 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:17:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-7a69851c-ec55-48c3-82a6-4253bc4d197a req-9c317256-81a0-4c70-a0fe-b5b183f60071 service nova] Acquiring lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:17:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-7a69851c-ec55-48c3-82a6-4253bc4d197a req-9c317256-81a0-4c70-a0fe-b5b183f60071 service nova] Lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:17:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-7a69851c-ec55-48c3-82a6-4253bc4d197a req-9c317256-81a0-4c70-a0fe-b5b183f60071 service nova] Lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:17:24 user nova-compute[74683]: DEBUG nova.compute.manager [req-7a69851c-ec55-48c3-82a6-4253bc4d197a req-9c317256-81a0-4c70-a0fe-b5b183f60071 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] No waiting events found dispatching network-vif-unplugged-7cfcd210-0e45-4f0e-b04b-1e933ec87734 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:17:24 user nova-compute[74683]: DEBUG nova.compute.manager [req-7a69851c-ec55-48c3-82a6-4253bc4d197a req-9c317256-81a0-4c70-a0fe-b5b183f60071 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received event network-vif-unplugged-7cfcd210-0e45-4f0e-b04b-1e933ec87734 for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 11:17:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:25 user nova-compute[74683]: INFO nova.compute.manager [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Rescuing
Oct 16 11:17:25 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Acquiring lock "refresh_cache-2f1db5e2-0b25-4d61-9dd3-038811b4eda1" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:17:25 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Acquired lock "refresh_cache-2f1db5e2-0b25-4d61-9dd3-038811b4eda1" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:17:25 user nova-compute[74683]: DEBUG nova.network.neutron [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:17:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:26 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Instance destroyed successfully.
Oct 16 11:17:26 user nova-compute[74683]: DEBUG nova.objects.instance [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Lazy-loading 'resources' on Instance uuid 9df7866f-28e9-46d0-9f35-24484adfffd7 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T11:14:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-70304386',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-70304386',id=9,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMaNfqPfIvkH/+eTEOkzkwyEVHeMqBbroH4XHs/VsM+32arQrPWLULM+KkAha5uKcIYXUQvzuK/i2uKi7/k+3+r15xjXIht8P92ImSNq2UpDCIQUhnRpXUQIyECbXNOdkg==',key_name='tempest-keypair-1984050809',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:15:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f4876261cd344bf91c3263bf1a20ae9',ramdisk_id='',reservation_id='r-im2wrlm4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-652208384',owner_user_name='tempest-TaggedBootDevicesTest-652208384-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:15:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5ad8d732f364377bca4aac914efec8f',uuid=9df7866f-28e9-46d0-9f35-24484adfffd7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1509ff6e-10c0-4f96-95ae-660dfc1402cc", "address": "fa:16:3e:7e:c7:90", "network": {"id": "6e171460-714f-45db-a77d-ba03b50b892e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-531792258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1509ff6e-10", "ovs_interfaceid": "1509ff6e-10c0-4f96-95ae-660dfc1402cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Converting VIF {"id": "1509ff6e-10c0-4f96-95ae-660dfc1402cc", "address": "fa:16:3e:7e:c7:90", "network": {"id": "6e171460-714f-45db-a77d-ba03b50b892e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-531792258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1509ff6e-10", "ovs_interfaceid": "1509ff6e-10c0-4f96-95ae-660dfc1402cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7e:c7:90,bridge_name='br-int',has_traffic_filtering=True,id=1509ff6e-10c0-4f96-95ae-660dfc1402cc,network=Network(6e171460-714f-45db-a77d-ba03b50b892e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1509ff6e-10') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG os_vif [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:c7:90,bridge_name='br-int',has_traffic_filtering=True,id=1509ff6e-10c0-4f96-95ae-660dfc1402cc,network=Network(6e171460-714f-45db-a77d-ba03b50b892e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1509ff6e-10') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1509ff6e-10, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=585ef633-09c5-4509-9027-0aa31ee3cb2b) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:26 user nova-compute[74683]: INFO os_vif [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:c7:90,bridge_name='br-int',has_traffic_filtering=True,id=1509ff6e-10c0-4f96-95ae-660dfc1402cc,network=Network(6e171460-714f-45db-a77d-ba03b50b892e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1509ff6e-10')
Oct 16 11:17:26 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T11:14:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-70304386',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-70304386',id=9,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMaNfqPfIvkH/+eTEOkzkwyEVHeMqBbroH4XHs/VsM+32arQrPWLULM+KkAha5uKcIYXUQvzuK/i2uKi7/k+3+r15xjXIht8P92ImSNq2UpDCIQUhnRpXUQIyECbXNOdkg==',key_name='tempest-keypair-1984050809',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:15:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f4876261cd344bf91c3263bf1a20ae9',ramdisk_id='',reservation_id='r-im2wrlm4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-652208384',owner_user_name='tempest-TaggedBootDevicesTest-652208384-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:15:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5ad8d732f364377bca4aac914efec8f',uuid=9df7866f-28e9-46d0-9f35-24484adfffd7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7cfcd210-0e45-4f0e-b04b-1e933ec87734", "address": "fa:16:3e:d6:13:bf", "network": {"id": "0ab5f993-73f7-4963-9a4a-768145c101ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1056805143", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cfcd210-0e", "ovs_interfaceid": "7cfcd210-0e45-4f0e-b04b-1e933ec87734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Converting VIF {"id": "7cfcd210-0e45-4f0e-b04b-1e933ec87734", "address": "fa:16:3e:d6:13:bf", "network": {"id": "0ab5f993-73f7-4963-9a4a-768145c101ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1056805143", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cfcd210-0e", "ovs_interfaceid": "7cfcd210-0e45-4f0e-b04b-1e933ec87734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:13:bf,bridge_name='br-int',has_traffic_filtering=True,id=7cfcd210-0e45-4f0e-b04b-1e933ec87734,network=Network(0ab5f993-73f7-4963-9a4a-768145c101ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7cfcd210-0e') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG os_vif [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:13:bf,bridge_name='br-int',has_traffic_filtering=True,id=7cfcd210-0e45-4f0e-b04b-1e933ec87734,network=Network(0ab5f993-73f7-4963-9a4a-768145c101ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7cfcd210-0e') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7cfcd210-0e, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1877fc68-1135-44eb-8786-f562c44d3a25) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG nova.network.neutron [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Updating instance_info_cache with network_info: [{"id": "9476563e-0758-43d9-b920-87f412881869", "address": "fa:16:3e:18:cc:d6", "network": {"id": "5a04a566-92ef-4300-976b-5c34656ec9c7", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-706076145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "207a79fe27c042d8b081272246b98245", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9476563e-07", "ovs_interfaceid": "9476563e-0758-43d9-b920-87f412881869", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Releasing lock "refresh_cache-2f1db5e2-0b25-4d61-9dd3-038811b4eda1" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:26 user nova-compute[74683]: INFO os_vif [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:13:bf,bridge_name='br-int',has_traffic_filtering=True,id=7cfcd210-0e45-4f0e-b04b-1e933ec87734,network=Network(0ab5f993-73f7-4963-9a4a-768145c101ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7cfcd210-0e')
Oct 16 11:17:26 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T11:14:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-70304386',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-70304386',id=9,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMaNfqPfIvkH/+eTEOkzkwyEVHeMqBbroH4XHs/VsM+32arQrPWLULM+KkAha5uKcIYXUQvzuK/i2uKi7/k+3+r15xjXIht8P92ImSNq2UpDCIQUhnRpXUQIyECbXNOdkg==',key_name='tempest-keypair-1984050809',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:15:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f4876261cd344bf91c3263bf1a20ae9',ramdisk_id='',reservation_id='r-im2wrlm4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-652208384',owner_user_name='tempest-TaggedBootDevicesTest-652208384-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:15:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5ad8d732f364377bca4aac914efec8f',uuid=9df7866f-28e9-46d0-9f35-24484adfffd7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bfe231c8-ff2a-46fd-9af6-9982a54d7846", "address": "fa:16:3e:52:f5:40", "network": {"id": "0ab5f993-73f7-4963-9a4a-768145c101ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1056805143", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe231c8-ff", "ovs_interfaceid": "bfe231c8-ff2a-46fd-9af6-9982a54d7846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Converting VIF {"id": "bfe231c8-ff2a-46fd-9af6-9982a54d7846", "address": "fa:16:3e:52:f5:40", "network": {"id": "0ab5f993-73f7-4963-9a4a-768145c101ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1056805143", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe231c8-ff", "ovs_interfaceid": "bfe231c8-ff2a-46fd-9af6-9982a54d7846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:f5:40,bridge_name='br-int',has_traffic_filtering=True,id=bfe231c8-ff2a-46fd-9af6-9982a54d7846,network=Network(0ab5f993-73f7-4963-9a4a-768145c101ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbfe231c8-ff') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG os_vif [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:f5:40,bridge_name='br-int',has_traffic_filtering=True,id=bfe231c8-ff2a-46fd-9af6-9982a54d7846,network=Network(0ab5f993-73f7-4963-9a4a-768145c101ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbfe231c8-ff') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbfe231c8-ff, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=665de395-1f56-4a7b-9d6c-59bc236b3063) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG nova.compute.manager [req-e284a160-44a0-4097-8dbb-56288b6ece2c req-3538258b-5842-4d62-81d5-99be679a502a service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received event network-vif-plugged-1509ff6e-10c0-4f96-95ae-660dfc1402cc {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e284a160-44a0-4097-8dbb-56288b6ece2c req-3538258b-5842-4d62-81d5-99be679a502a service nova] Acquiring lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e284a160-44a0-4097-8dbb-56288b6ece2c req-3538258b-5842-4d62-81d5-99be679a502a service nova] Lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e284a160-44a0-4097-8dbb-56288b6ece2c req-3538258b-5842-4d62-81d5-99be679a502a service nova] Lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG nova.compute.manager [req-e284a160-44a0-4097-8dbb-56288b6ece2c req-3538258b-5842-4d62-81d5-99be679a502a service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] No waiting events found dispatching network-vif-plugged-1509ff6e-10c0-4f96-95ae-660dfc1402cc {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:17:26 user nova-compute[74683]: WARNING nova.compute.manager [req-e284a160-44a0-4097-8dbb-56288b6ece2c req-3538258b-5842-4d62-81d5-99be679a502a service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received unexpected event network-vif-plugged-1509ff6e-10c0-4f96-95ae-660dfc1402cc for instance with vm_state active and task_state deleting.
Oct 16 11:17:26 user nova-compute[74683]: DEBUG nova.compute.manager [req-e284a160-44a0-4097-8dbb-56288b6ece2c req-3538258b-5842-4d62-81d5-99be679a502a service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received event network-vif-unplugged-bfe231c8-ff2a-46fd-9af6-9982a54d7846 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e284a160-44a0-4097-8dbb-56288b6ece2c req-3538258b-5842-4d62-81d5-99be679a502a service nova] Acquiring lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e284a160-44a0-4097-8dbb-56288b6ece2c req-3538258b-5842-4d62-81d5-99be679a502a service nova] Lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e284a160-44a0-4097-8dbb-56288b6ece2c req-3538258b-5842-4d62-81d5-99be679a502a service nova] Lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG nova.compute.manager [req-e284a160-44a0-4097-8dbb-56288b6ece2c req-3538258b-5842-4d62-81d5-99be679a502a service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] No waiting events found dispatching network-vif-unplugged-bfe231c8-ff2a-46fd-9af6-9982a54d7846 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG nova.compute.manager [req-e284a160-44a0-4097-8dbb-56288b6ece2c req-3538258b-5842-4d62-81d5-99be679a502a service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received event network-vif-unplugged-bfe231c8-ff2a-46fd-9af6-9982a54d7846 for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG nova.compute.manager [req-e284a160-44a0-4097-8dbb-56288b6ece2c req-3538258b-5842-4d62-81d5-99be679a502a service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received event network-vif-plugged-bfe231c8-ff2a-46fd-9af6-9982a54d7846 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e284a160-44a0-4097-8dbb-56288b6ece2c req-3538258b-5842-4d62-81d5-99be679a502a service nova] Acquiring lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e284a160-44a0-4097-8dbb-56288b6ece2c req-3538258b-5842-4d62-81d5-99be679a502a service nova] Lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e284a160-44a0-4097-8dbb-56288b6ece2c req-3538258b-5842-4d62-81d5-99be679a502a service nova] Lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG nova.compute.manager [req-e284a160-44a0-4097-8dbb-56288b6ece2c req-3538258b-5842-4d62-81d5-99be679a502a service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] No waiting events found dispatching network-vif-plugged-bfe231c8-ff2a-46fd-9af6-9982a54d7846 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:17:26 user nova-compute[74683]: WARNING nova.compute.manager [req-e284a160-44a0-4097-8dbb-56288b6ece2c req-3538258b-5842-4d62-81d5-99be679a502a service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received unexpected event network-vif-plugged-bfe231c8-ff2a-46fd-9af6-9982a54d7846 for instance with vm_state active and task_state deleting.
Oct 16 11:17:26 user nova-compute[74683]: DEBUG nova.compute.manager [req-e284a160-44a0-4097-8dbb-56288b6ece2c req-3538258b-5842-4d62-81d5-99be679a502a service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received event network-vif-unplugged-8a9e59f4-7708-438f-8411-499c6e38ec1b {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e284a160-44a0-4097-8dbb-56288b6ece2c req-3538258b-5842-4d62-81d5-99be679a502a service nova] Acquiring lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e284a160-44a0-4097-8dbb-56288b6ece2c req-3538258b-5842-4d62-81d5-99be679a502a service nova] Lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e284a160-44a0-4097-8dbb-56288b6ece2c req-3538258b-5842-4d62-81d5-99be679a502a service nova] Lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG nova.compute.manager [req-e284a160-44a0-4097-8dbb-56288b6ece2c req-3538258b-5842-4d62-81d5-99be679a502a service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] No waiting events found dispatching network-vif-unplugged-8a9e59f4-7708-438f-8411-499c6e38ec1b {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG nova.compute.manager [req-e284a160-44a0-4097-8dbb-56288b6ece2c req-3538258b-5842-4d62-81d5-99be679a502a service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received event network-vif-unplugged-8a9e59f4-7708-438f-8411-499c6e38ec1b for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG nova.compute.manager [req-e284a160-44a0-4097-8dbb-56288b6ece2c req-3538258b-5842-4d62-81d5-99be679a502a service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received event network-vif-plugged-8a9e59f4-7708-438f-8411-499c6e38ec1b {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e284a160-44a0-4097-8dbb-56288b6ece2c req-3538258b-5842-4d62-81d5-99be679a502a service nova] Acquiring lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e284a160-44a0-4097-8dbb-56288b6ece2c req-3538258b-5842-4d62-81d5-99be679a502a service nova] Lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e284a160-44a0-4097-8dbb-56288b6ece2c req-3538258b-5842-4d62-81d5-99be679a502a service nova] Lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG nova.compute.manager [req-e284a160-44a0-4097-8dbb-56288b6ece2c req-3538258b-5842-4d62-81d5-99be679a502a service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] No waiting events found dispatching network-vif-plugged-8a9e59f4-7708-438f-8411-499c6e38ec1b {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:17:26 user nova-compute[74683]: WARNING nova.compute.manager [req-e284a160-44a0-4097-8dbb-56288b6ece2c req-3538258b-5842-4d62-81d5-99be679a502a service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received unexpected event network-vif-plugged-8a9e59f4-7708-438f-8411-499c6e38ec1b for instance with vm_state active and task_state deleting.
Oct 16 11:17:26 user nova-compute[74683]: INFO os_vif [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:f5:40,bridge_name='br-int',has_traffic_filtering=True,id=bfe231c8-ff2a-46fd-9af6-9982a54d7846,network=Network(0ab5f993-73f7-4963-9a4a-768145c101ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbfe231c8-ff')
Oct 16 11:17:26 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T11:14:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-70304386',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-70304386',id=9,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMaNfqPfIvkH/+eTEOkzkwyEVHeMqBbroH4XHs/VsM+32arQrPWLULM+KkAha5uKcIYXUQvzuK/i2uKi7/k+3+r15xjXIht8P92ImSNq2UpDCIQUhnRpXUQIyECbXNOdkg==',key_name='tempest-keypair-1984050809',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:15:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f4876261cd344bf91c3263bf1a20ae9',ramdisk_id='',reservation_id='r-im2wrlm4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-652208384',owner_user_name='tempest-TaggedBootDevicesTest-652208384-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:15:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5ad8d732f364377bca4aac914efec8f',uuid=9df7866f-28e9-46d0-9f35-24484adfffd7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c0a030c-cf2d-4d14-b5c3-6d0563b346b9", "address": "fa:16:3e:b2:3c:35", "network": {"id": "0ab5f993-73f7-4963-9a4a-768145c101ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1056805143", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c0a030c-cf", "ovs_interfaceid": "8c0a030c-cf2d-4d14-b5c3-6d0563b346b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Converting VIF {"id": "8c0a030c-cf2d-4d14-b5c3-6d0563b346b9", "address": "fa:16:3e:b2:3c:35", "network": {"id": "0ab5f993-73f7-4963-9a4a-768145c101ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1056805143", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c0a030c-cf", "ovs_interfaceid": "8c0a030c-cf2d-4d14-b5c3-6d0563b346b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:3c:35,bridge_name='br-int',has_traffic_filtering=True,id=8c0a030c-cf2d-4d14-b5c3-6d0563b346b9,network=Network(0ab5f993-73f7-4963-9a4a-768145c101ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c0a030c-cf') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG os_vif [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:3c:35,bridge_name='br-int',has_traffic_filtering=True,id=8c0a030c-cf2d-4d14-b5c3-6d0563b346b9,network=Network(0ab5f993-73f7-4963-9a4a-768145c101ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c0a030c-cf') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c0a030c-cf, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6496909c-2d75-4916-bdca-66a0e78e9fcd) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:17:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG nova.compute.manager [req-aa5f6815-197b-46f9-863a-5d58d937e297 req-1109c33b-5d35-4681-8db0-bd62f071f71f service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received event network-vif-plugged-7cfcd210-0e45-4f0e-b04b-1e933ec87734 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-aa5f6815-197b-46f9-863a-5d58d937e297 req-1109c33b-5d35-4681-8db0-bd62f071f71f service nova] Acquiring lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-aa5f6815-197b-46f9-863a-5d58d937e297 req-1109c33b-5d35-4681-8db0-bd62f071f71f service nova] Lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-aa5f6815-197b-46f9-863a-5d58d937e297 req-1109c33b-5d35-4681-8db0-bd62f071f71f service nova] Lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG nova.compute.manager [req-aa5f6815-197b-46f9-863a-5d58d937e297 req-1109c33b-5d35-4681-8db0-bd62f071f71f service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] No waiting events found dispatching network-vif-plugged-7cfcd210-0e45-4f0e-b04b-1e933ec87734 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:17:27 user nova-compute[74683]: WARNING nova.compute.manager [req-aa5f6815-197b-46f9-863a-5d58d937e297 req-1109c33b-5d35-4681-8db0-bd62f071f71f service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received unexpected event network-vif-plugged-7cfcd210-0e45-4f0e-b04b-1e933ec87734 for instance with vm_state active and task_state deleting.
Oct 16 11:17:27 user nova-compute[74683]: DEBUG nova.compute.manager [req-aa5f6815-197b-46f9-863a-5d58d937e297 req-1109c33b-5d35-4681-8db0-bd62f071f71f service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received event network-vif-unplugged-8c0a030c-cf2d-4d14-b5c3-6d0563b346b9 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-aa5f6815-197b-46f9-863a-5d58d937e297 req-1109c33b-5d35-4681-8db0-bd62f071f71f service nova] Acquiring lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-aa5f6815-197b-46f9-863a-5d58d937e297 req-1109c33b-5d35-4681-8db0-bd62f071f71f service nova] Lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-aa5f6815-197b-46f9-863a-5d58d937e297 req-1109c33b-5d35-4681-8db0-bd62f071f71f service nova] Lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG nova.compute.manager [req-aa5f6815-197b-46f9-863a-5d58d937e297 req-1109c33b-5d35-4681-8db0-bd62f071f71f service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] No waiting events found dispatching network-vif-unplugged-8c0a030c-cf2d-4d14-b5c3-6d0563b346b9 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG nova.compute.manager [req-aa5f6815-197b-46f9-863a-5d58d937e297 req-1109c33b-5d35-4681-8db0-bd62f071f71f service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received event network-vif-unplugged-8c0a030c-cf2d-4d14-b5c3-6d0563b346b9 for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG nova.compute.manager [req-aa5f6815-197b-46f9-863a-5d58d937e297 req-1109c33b-5d35-4681-8db0-bd62f071f71f service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received event network-vif-plugged-8c0a030c-cf2d-4d14-b5c3-6d0563b346b9 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-aa5f6815-197b-46f9-863a-5d58d937e297 req-1109c33b-5d35-4681-8db0-bd62f071f71f service nova] Acquiring lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-aa5f6815-197b-46f9-863a-5d58d937e297 req-1109c33b-5d35-4681-8db0-bd62f071f71f service nova] Lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-aa5f6815-197b-46f9-863a-5d58d937e297 req-1109c33b-5d35-4681-8db0-bd62f071f71f service nova] Lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG nova.compute.manager [req-aa5f6815-197b-46f9-863a-5d58d937e297 req-1109c33b-5d35-4681-8db0-bd62f071f71f service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] No waiting events found dispatching network-vif-plugged-8c0a030c-cf2d-4d14-b5c3-6d0563b346b9 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:17:27 user nova-compute[74683]: WARNING nova.compute.manager [req-aa5f6815-197b-46f9-863a-5d58d937e297 req-1109c33b-5d35-4681-8db0-bd62f071f71f service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received unexpected event network-vif-plugged-8c0a030c-cf2d-4d14-b5c3-6d0563b346b9 for instance with vm_state active and task_state deleting.
Oct 16 11:17:27 user nova-compute[74683]: DEBUG nova.compute.manager [req-aa5f6815-197b-46f9-863a-5d58d937e297 req-1109c33b-5d35-4681-8db0-bd62f071f71f service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received event network-vif-unplugged-82f47635-6e3f-492d-9819-4d77ae46fb29 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-aa5f6815-197b-46f9-863a-5d58d937e297 req-1109c33b-5d35-4681-8db0-bd62f071f71f service nova] Acquiring lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-aa5f6815-197b-46f9-863a-5d58d937e297 req-1109c33b-5d35-4681-8db0-bd62f071f71f service nova] Lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-aa5f6815-197b-46f9-863a-5d58d937e297 req-1109c33b-5d35-4681-8db0-bd62f071f71f service nova] Lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG nova.compute.manager [req-aa5f6815-197b-46f9-863a-5d58d937e297 req-1109c33b-5d35-4681-8db0-bd62f071f71f service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] No waiting events found dispatching network-vif-unplugged-82f47635-6e3f-492d-9819-4d77ae46fb29 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG nova.compute.manager [req-aa5f6815-197b-46f9-863a-5d58d937e297 req-1109c33b-5d35-4681-8db0-bd62f071f71f service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received event network-vif-unplugged-82f47635-6e3f-492d-9819-4d77ae46fb29 for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:27 user nova-compute[74683]: INFO os_vif [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:3c:35,bridge_name='br-int',has_traffic_filtering=True,id=8c0a030c-cf2d-4d14-b5c3-6d0563b346b9,network=Network(0ab5f993-73f7-4963-9a4a-768145c101ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c0a030c-cf')
Oct 16 11:17:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T11:14:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-70304386',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-70304386',id=9,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMaNfqPfIvkH/+eTEOkzkwyEVHeMqBbroH4XHs/VsM+32arQrPWLULM+KkAha5uKcIYXUQvzuK/i2uKi7/k+3+r15xjXIht8P92ImSNq2UpDCIQUhnRpXUQIyECbXNOdkg==',key_name='tempest-keypair-1984050809',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:15:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f4876261cd344bf91c3263bf1a20ae9',ramdisk_id='',reservation_id='r-im2wrlm4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-652208384',owner_user_name='tempest-TaggedBootDevicesTest-652208384-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:15:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5ad8d732f364377bca4aac914efec8f',uuid=9df7866f-28e9-46d0-9f35-24484adfffd7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "82f47635-6e3f-492d-9819-4d77ae46fb29", "address": "fa:16:3e:24:20:65", "network": {"id": "0ab5f993-73f7-4963-9a4a-768145c101ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1056805143", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82f47635-6e", "ovs_interfaceid": "82f47635-6e3f-492d-9819-4d77ae46fb29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Converting VIF {"id": "82f47635-6e3f-492d-9819-4d77ae46fb29", "address": "fa:16:3e:24:20:65", "network": {"id": "0ab5f993-73f7-4963-9a4a-768145c101ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1056805143", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82f47635-6e", "ovs_interfaceid": "82f47635-6e3f-492d-9819-4d77ae46fb29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:20:65,bridge_name='br-int',has_traffic_filtering=True,id=82f47635-6e3f-492d-9819-4d77ae46fb29,network=Network(0ab5f993-73f7-4963-9a4a-768145c101ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82f47635-6e') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG os_vif [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:20:65,bridge_name='br-int',has_traffic_filtering=True,id=82f47635-6e3f-492d-9819-4d77ae46fb29,network=Network(0ab5f993-73f7-4963-9a4a-768145c101ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82f47635-6e') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap82f47635-6e, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=18b7d2e3-e28b-4e49-b99d-a9289339de4b) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:27 user nova-compute[74683]: INFO os_vif [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:20:65,bridge_name='br-int',has_traffic_filtering=True,id=82f47635-6e3f-492d-9819-4d77ae46fb29,network=Network(0ab5f993-73f7-4963-9a4a-768145c101ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82f47635-6e')
Oct 16 11:17:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T11:14:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-70304386',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-70304386',id=9,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMaNfqPfIvkH/+eTEOkzkwyEVHeMqBbroH4XHs/VsM+32arQrPWLULM+KkAha5uKcIYXUQvzuK/i2uKi7/k+3+r15xjXIht8P92ImSNq2UpDCIQUhnRpXUQIyECbXNOdkg==',key_name='tempest-keypair-1984050809',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:15:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f4876261cd344bf91c3263bf1a20ae9',ramdisk_id='',reservation_id='r-im2wrlm4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-652208384',owner_user_name='tempest-TaggedBootDevicesTest-652208384-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:15:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5ad8d732f364377bca4aac914efec8f',uuid=9df7866f-28e9-46d0-9f35-24484adfffd7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a9e59f4-7708-438f-8411-499c6e38ec1b", "address": "fa:16:3e:42:50:56", "network": {"id": "e2c37b04-3414-40bf-a284-f1f9123d0ccb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1623055457", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a9e59f4-77", "ovs_interfaceid": "8a9e59f4-7708-438f-8411-499c6e38ec1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Converting VIF {"id": "8a9e59f4-7708-438f-8411-499c6e38ec1b", "address": "fa:16:3e:42:50:56", "network": {"id": "e2c37b04-3414-40bf-a284-f1f9123d0ccb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1623055457", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a9e59f4-77", "ovs_interfaceid": "8a9e59f4-7708-438f-8411-499c6e38ec1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:50:56,bridge_name='br-int',has_traffic_filtering=True,id=8a9e59f4-7708-438f-8411-499c6e38ec1b,network=Network(e2c37b04-3414-40bf-a284-f1f9123d0ccb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a9e59f4-77') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG os_vif [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:50:56,bridge_name='br-int',has_traffic_filtering=True,id=8a9e59f4-7708-438f-8411-499c6e38ec1b,network=Network(e2c37b04-3414-40bf-a284-f1f9123d0ccb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a9e59f4-77') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a9e59f4-77, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=894ab6eb-3319-4f60-a3b8-5a43b2a095e4) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:27 user nova-compute[74683]: INFO os_vif [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:50:56,bridge_name='br-int',has_traffic_filtering=True,id=8a9e59f4-7708-438f-8411-499c6e38ec1b,network=Network(e2c37b04-3414-40bf-a284-f1f9123d0ccb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a9e59f4-77')
Oct 16 11:17:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T11:14:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-70304386',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-70304386',id=9,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMaNfqPfIvkH/+eTEOkzkwyEVHeMqBbroH4XHs/VsM+32arQrPWLULM+KkAha5uKcIYXUQvzuK/i2uKi7/k+3+r15xjXIht8P92ImSNq2UpDCIQUhnRpXUQIyECbXNOdkg==',key_name='tempest-keypair-1984050809',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:15:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f4876261cd344bf91c3263bf1a20ae9',ramdisk_id='',reservation_id='r-im2wrlm4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-652208384',owner_user_name='tempest-TaggedBootDevicesTest-652208384-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:15:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5ad8d732f364377bca4aac914efec8f',uuid=9df7866f-28e9-46d0-9f35-24484adfffd7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "698c4ef8-286a-4bc1-a789-3276dc6defea", "address": "fa:16:3e:f8:2c:0c", "network": {"id": "e2c37b04-3414-40bf-a284-f1f9123d0ccb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1623055457", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap698c4ef8-28", "ovs_interfaceid": "698c4ef8-286a-4bc1-a789-3276dc6defea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Converting VIF {"id": "698c4ef8-286a-4bc1-a789-3276dc6defea", "address": "fa:16:3e:f8:2c:0c", "network": {"id": "e2c37b04-3414-40bf-a284-f1f9123d0ccb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1623055457", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap698c4ef8-28", "ovs_interfaceid": "698c4ef8-286a-4bc1-a789-3276dc6defea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:2c:0c,bridge_name='br-int',has_traffic_filtering=True,id=698c4ef8-286a-4bc1-a789-3276dc6defea,network=Network(e2c37b04-3414-40bf-a284-f1f9123d0ccb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap698c4ef8-28') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG os_vif [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:2c:0c,bridge_name='br-int',has_traffic_filtering=True,id=698c4ef8-286a-4bc1-a789-3276dc6defea,network=Network(e2c37b04-3414-40bf-a284-f1f9123d0ccb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap698c4ef8-28') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap698c4ef8-28, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0901b418-1490-4cf6-aaa8-f35626da3a0d) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:27 user nova-compute[74683]: INFO os_vif [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:2c:0c,bridge_name='br-int',has_traffic_filtering=True,id=698c4ef8-286a-4bc1-a789-3276dc6defea,network=Network(e2c37b04-3414-40bf-a284-f1f9123d0ccb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap698c4ef8-28')
Oct 16 11:17:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] calling os-brick to detach iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, {'target_iqn': 'iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CxQZfzcS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:17:27 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:17:27 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[803d6989-bd8e-4dc2-b616-c7916650d644]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 11:17:27 user nova-compute[74683]: No targets found.
Oct 16 11:17:27 user nova-compute[74683]: iSNS:
Oct 16 11:17:27 user nova-compute[74683]: No targets found.
Oct 16 11:17:27 user nova-compute[74683]: STATIC:
Oct 16 11:17:27 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e
Oct 16 11:17:27 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:17:27 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:17:27 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2
Oct 16 11:17:27 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:17:27 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:17:27 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b
Oct 16 11:17:27 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:17:27 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:17:27 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d
Oct 16 11:17:27 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:17:27 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:17:27 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5
Oct 16 11:17:27 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:17:27 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:17:27 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e
Oct 16 11:17:27 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:17:27 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:17:27 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb
Oct 16 11:17:27 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:17:27 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:17:27 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3
Oct 16 11:17:27 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:17:27 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:17:27 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020
Oct 16 11:17:27 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:17:27 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:17:27 user nova-compute[74683]: FIRMWARE:
Oct 16 11:17:27 user nova-compute[74683]: No targets found.
Oct 16 11:17:27 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 11:17:27 user nova-compute[74683]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 11:17:27 user nova-compute[74683]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74683) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d', 0)] {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[8adf1032-7647-41dc-81fa-03f7798e3653]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe67aab-dda4-4275-97e0-46a01c2b8e42]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)
Oct 16 11:17:27 user nova-compute[74683]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)
Oct 16 11:17:27 user nova-compute[74683]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e (non-flash)
Oct 16 11:17:27 user nova-compute[74683]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:17:27 user nova-compute[74683]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)
Oct 16 11:17:27 user nova-compute[74683]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)
Oct 16 11:17:27 user nova-compute[74683]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)
Oct 16 11:17:27 user nova-compute[74683]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)
Oct 16 11:17:27 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:17:27 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)
Oct 16 11:17:27 user nova-compute[74683]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)
Oct 16 11:17:27 user nova-compute[74683]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e (non-flash)
Oct 16 11:17:27 user nova-compute[74683]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:17:27 user nova-compute[74683]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)
Oct 16 11:17:27 user nova-compute[74683]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)
Oct 16 11:17:27 user nova-compute[74683]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)
Oct 16 11:17:27 user nova-compute[74683]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d (non-flash)
Oct 16 11:17:27 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:17:27 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda4c794e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d'): ({'sdb'}, set())}) {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Removing single pathed devices sdb {{(pid=74683) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[db412003-d50f-42bd-91f0-bb5314977129]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.028s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01ca77e-fbad-4c4f-ba3a-b53293ddd0a9]: (4, ('ok\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Flushing IO for device /dev/sdb {{(pid=74683) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[51308da6-ab1d-4712-a083-7a1b4626cf03]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74683) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:27 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Instance destroyed successfully.
Oct 16 11:17:27 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Attempting a stable device rescue
Oct 16 11:17:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.057s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e16eca3-c1ac-4578-bed3-bd7c81ea3ca5]: (4, ('1', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] SCSI volumes sdb have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d')] {{(pid=74683) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=74683) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[5186d43b-a856-471a-b876-55cb3c45d1bf]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d -p 172.16.0.220:3260 --logout {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Instance directory exists: not creating {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 16 11:17:27 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Creating image(s)
Oct 16 11:17:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Acquiring lock "/opt/stack/data/nova/instances/2f1db5e2-0b25-4d61-9dd3-038811b4eda1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Lock "/opt/stack/data/nova/instances/2f1db5e2-0b25-4d61-9dd3-038811b4eda1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Lock "/opt/stack/data/nova/instances/2f1db5e2-0b25-4d61-9dd3-038811b4eda1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG nova.objects.instance [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2f1db5e2-0b25-4d61-9dd3-038811b4eda1 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Acquiring lock "7898848eee21754e7d2b5036ba0eb2807d0bd2ff" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Lock "7898848eee21754e7d2b5036ba0eb2807d0bd2ff" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8e9be6-572a-4193-853c-cbbc0f8d342a]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d, portal: 172.16.0.220,3260]
Oct 16 11:17:27 user nova-compute[74683]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d, portal: 172.16.0.220,3260] successful.
Oct 16 11:17:27 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:17:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d -p 172.16.0.220:3260 --op delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7898848eee21754e7d2b5036ba0eb2807d0bd2ff.part --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f88fd55-edd7-479f-9c45-ac2456b4e59d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.057s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:28 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c91043a-463d-4411-9434-67c41a2c9163]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:28 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:17:28 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 1.504s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:17:28 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] <== disconnect_volume: return (1506ms) None {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:17:28 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Disconnected iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 11:17:28 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] calling os-brick to detach iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 11:17:28 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, {'target_iqn': 'iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tDvjqJkp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:17:28 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:17:28 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:17:28 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:17:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:28 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[1686ed7c-d9ce-4948-8734-8c7b74c682dc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:28 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 11:17:28 user nova-compute[74683]: No targets found.
Oct 16 11:17:28 user nova-compute[74683]: iSNS:
Oct 16 11:17:28 user nova-compute[74683]: No targets found.
Oct 16 11:17:28 user nova-compute[74683]: STATIC:
Oct 16 11:17:28 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e
Oct 16 11:17:28 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:17:28 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:17:28 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2
Oct 16 11:17:28 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:17:28 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:17:28 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b
Oct 16 11:17:28 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:17:28 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:17:28 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5
Oct 16 11:17:28 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:17:28 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:17:28 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e
Oct 16 11:17:28 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:17:28 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:17:28 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb
Oct 16 11:17:28 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:17:28 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:17:28 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3
Oct 16 11:17:28 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:17:28 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:17:28 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020
Oct 16 11:17:28 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:17:28 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:17:28 user nova-compute[74683]: FIRMWARE:
Oct 16 11:17:28 user nova-compute[74683]: No targets found.
Oct 16 11:17:28 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:17:28 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 11:17:28 user nova-compute[74683]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 11:17:28 user nova-compute[74683]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74683) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 11:17:28 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2', 0)] {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 11:17:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:28 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce7f4bf-fc8d-4926-8a0d-be5404a77928]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:28 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[30bdf3f7-46be-471a-9525-9e26f6e26bbd]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:28 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)
Oct 16 11:17:28 user nova-compute[74683]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)
Oct 16 11:17:28 user nova-compute[74683]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e (non-flash)
Oct 16 11:17:28 user nova-compute[74683]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:17:28 user nova-compute[74683]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)
Oct 16 11:17:28 user nova-compute[74683]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)
Oct 16 11:17:28 user nova-compute[74683]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)
Oct 16 11:17:28 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:17:28 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:17:28 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)
Oct 16 11:17:28 user nova-compute[74683]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)
Oct 16 11:17:28 user nova-compute[74683]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e (non-flash)
Oct 16 11:17:28 user nova-compute[74683]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:17:28 user nova-compute[74683]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)
Oct 16 11:17:28 user nova-compute[74683]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 (non-flash)
Oct 16 11:17:28 user nova-compute[74683]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)
Oct 16 11:17:28 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:17:28 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:17:28 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda4c7c4ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2'): ({'sdc'}, set())}) {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 11:17:28 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Removing single pathed devices sdc {{(pid=74683) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 11:17:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28ad0ae-81f0-4bc3-b879-2271dcc4a886]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7898848eee21754e7d2b5036ba0eb2807d0bd2ff.part --force-share --output=json" returned: 0 in 0.188s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG nova.virt.images [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] af95e2e6-d26f-45e5-a3bd-a8a0d721d203 was qcow2, converting to raw {{(pid=74683) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG nova.privsep.utils [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74683) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7898848eee21754e7d2b5036ba0eb2807d0bd2ff.part /opt/stack/data/nova/instances/_base/7898848eee21754e7d2b5036ba0eb2807d0bd2ff.converted {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.030s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0f3095-cb78-4b3a-aa9c-4978e0694669]: (4, ('ok\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Flushing IO for device /dev/sdc {{(pid=74683) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG nova.compute.manager [req-272b1256-6d69-4eec-8027-a77418a3dc46 req-05d17ebb-21e8-4b0d-af55-4bbe0b3b0ec6 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received event network-vif-plugged-82f47635-6e3f-492d-9819-4d77ae46fb29 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-272b1256-6d69-4eec-8027-a77418a3dc46 req-05d17ebb-21e8-4b0d-af55-4bbe0b3b0ec6 service nova] Acquiring lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-272b1256-6d69-4eec-8027-a77418a3dc46 req-05d17ebb-21e8-4b0d-af55-4bbe0b3b0ec6 service nova] Lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-272b1256-6d69-4eec-8027-a77418a3dc46 req-05d17ebb-21e8-4b0d-af55-4bbe0b3b0ec6 service nova] Lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG nova.compute.manager [req-272b1256-6d69-4eec-8027-a77418a3dc46 req-05d17ebb-21e8-4b0d-af55-4bbe0b3b0ec6 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] No waiting events found dispatching network-vif-plugged-82f47635-6e3f-492d-9819-4d77ae46fb29 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:17:29 user nova-compute[74683]: WARNING nova.compute.manager [req-272b1256-6d69-4eec-8027-a77418a3dc46 req-05d17ebb-21e8-4b0d-af55-4bbe0b3b0ec6 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received unexpected event network-vif-plugged-82f47635-6e3f-492d-9819-4d77ae46fb29 for instance with vm_state active and task_state deleting.
Oct 16 11:17:29 user nova-compute[74683]: DEBUG nova.compute.manager [req-272b1256-6d69-4eec-8027-a77418a3dc46 req-05d17ebb-21e8-4b0d-af55-4bbe0b3b0ec6 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received event network-vif-unplugged-698c4ef8-286a-4bc1-a789-3276dc6defea {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-272b1256-6d69-4eec-8027-a77418a3dc46 req-05d17ebb-21e8-4b0d-af55-4bbe0b3b0ec6 service nova] Acquiring lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-272b1256-6d69-4eec-8027-a77418a3dc46 req-05d17ebb-21e8-4b0d-af55-4bbe0b3b0ec6 service nova] Lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-272b1256-6d69-4eec-8027-a77418a3dc46 req-05d17ebb-21e8-4b0d-af55-4bbe0b3b0ec6 service nova] Lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG nova.compute.manager [req-272b1256-6d69-4eec-8027-a77418a3dc46 req-05d17ebb-21e8-4b0d-af55-4bbe0b3b0ec6 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] No waiting events found dispatching network-vif-unplugged-698c4ef8-286a-4bc1-a789-3276dc6defea {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG nova.compute.manager [req-272b1256-6d69-4eec-8027-a77418a3dc46 req-05d17ebb-21e8-4b0d-af55-4bbe0b3b0ec6 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received event network-vif-unplugged-698c4ef8-286a-4bc1-a789-3276dc6defea for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG nova.compute.manager [req-272b1256-6d69-4eec-8027-a77418a3dc46 req-05d17ebb-21e8-4b0d-af55-4bbe0b3b0ec6 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received event network-vif-plugged-698c4ef8-286a-4bc1-a789-3276dc6defea {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-272b1256-6d69-4eec-8027-a77418a3dc46 req-05d17ebb-21e8-4b0d-af55-4bbe0b3b0ec6 service nova] Acquiring lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-272b1256-6d69-4eec-8027-a77418a3dc46 req-05d17ebb-21e8-4b0d-af55-4bbe0b3b0ec6 service nova] Lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-272b1256-6d69-4eec-8027-a77418a3dc46 req-05d17ebb-21e8-4b0d-af55-4bbe0b3b0ec6 service nova] Lock "9df7866f-28e9-46d0-9f35-24484adfffd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG nova.compute.manager [req-272b1256-6d69-4eec-8027-a77418a3dc46 req-05d17ebb-21e8-4b0d-af55-4bbe0b3b0ec6 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] No waiting events found dispatching network-vif-plugged-698c4ef8-286a-4bc1-a789-3276dc6defea {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:17:29 user nova-compute[74683]: WARNING nova.compute.manager [req-272b1256-6d69-4eec-8027-a77418a3dc46 req-05d17ebb-21e8-4b0d-af55-4bbe0b3b0ec6 service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received unexpected event network-vif-plugged-698c4ef8-286a-4bc1-a789-3276dc6defea for instance with vm_state active and task_state deleting.
Oct 16 11:17:29 user nova-compute[74683]: DEBUG nova.compute.manager [req-272b1256-6d69-4eec-8027-a77418a3dc46 req-05d17ebb-21e8-4b0d-af55-4bbe0b3b0ec6 service nova] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Received event network-vif-unplugged-9476563e-0758-43d9-b920-87f412881869 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-272b1256-6d69-4eec-8027-a77418a3dc46 req-05d17ebb-21e8-4b0d-af55-4bbe0b3b0ec6 service nova] Acquiring lock "2f1db5e2-0b25-4d61-9dd3-038811b4eda1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-272b1256-6d69-4eec-8027-a77418a3dc46 req-05d17ebb-21e8-4b0d-af55-4bbe0b3b0ec6 service nova] Lock "2f1db5e2-0b25-4d61-9dd3-038811b4eda1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-272b1256-6d69-4eec-8027-a77418a3dc46 req-05d17ebb-21e8-4b0d-af55-4bbe0b3b0ec6 service nova] Lock "2f1db5e2-0b25-4d61-9dd3-038811b4eda1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG nova.compute.manager [req-272b1256-6d69-4eec-8027-a77418a3dc46 req-05d17ebb-21e8-4b0d-af55-4bbe0b3b0ec6 service nova] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] No waiting events found dispatching network-vif-unplugged-9476563e-0758-43d9-b920-87f412881869 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:17:29 user nova-compute[74683]: WARNING nova.compute.manager [req-272b1256-6d69-4eec-8027-a77418a3dc46 req-05d17ebb-21e8-4b0d-af55-4bbe0b3b0ec6 service nova] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Received unexpected event network-vif-unplugged-9476563e-0758-43d9-b920-87f412881869 for instance with vm_state active and task_state rescuing.
Oct 16 11:17:29 user nova-compute[74683]: DEBUG nova.compute.manager [req-272b1256-6d69-4eec-8027-a77418a3dc46 req-05d17ebb-21e8-4b0d-af55-4bbe0b3b0ec6 service nova] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Received event network-vif-plugged-9476563e-0758-43d9-b920-87f412881869 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-272b1256-6d69-4eec-8027-a77418a3dc46 req-05d17ebb-21e8-4b0d-af55-4bbe0b3b0ec6 service nova] Acquiring lock "2f1db5e2-0b25-4d61-9dd3-038811b4eda1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-272b1256-6d69-4eec-8027-a77418a3dc46 req-05d17ebb-21e8-4b0d-af55-4bbe0b3b0ec6 service nova] Lock "2f1db5e2-0b25-4d61-9dd3-038811b4eda1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-272b1256-6d69-4eec-8027-a77418a3dc46 req-05d17ebb-21e8-4b0d-af55-4bbe0b3b0ec6 service nova] Lock "2f1db5e2-0b25-4d61-9dd3-038811b4eda1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG nova.compute.manager [req-272b1256-6d69-4eec-8027-a77418a3dc46 req-05d17ebb-21e8-4b0d-af55-4bbe0b3b0ec6 service nova] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] No waiting events found dispatching network-vif-plugged-9476563e-0758-43d9-b920-87f412881869 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:17:29 user nova-compute[74683]: WARNING nova.compute.manager [req-272b1256-6d69-4eec-8027-a77418a3dc46 req-05d17ebb-21e8-4b0d-af55-4bbe0b3b0ec6 service nova] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Received unexpected event network-vif-plugged-9476563e-0758-43d9-b920-87f412881869 for instance with vm_state active and task_state rescuing.
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3fcb610-8979-4da8-8f46-4a2b37c7d9b7]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74683) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.085s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[50830b47-17fa-4576-82f4-c978d374106d]: (4, ('1', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] SCSI volumes sdc have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2')] {{(pid=74683) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.088s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b976aea-d6b3-4789-86c4-049cde7c7733]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 -p 172.16.0.220:3260 --logout {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7898848eee21754e7d2b5036ba0eb2807d0bd2ff.part /opt/stack/data/nova/instances/_base/7898848eee21754e7d2b5036ba0eb2807d0bd2ff.converted" returned: 0 in 0.331s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7898848eee21754e7d2b5036ba0eb2807d0bd2ff.converted --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c372c56-06e1-425e-9d7a-b3f8af0bd271]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2, portal: 172.16.0.220,3260]
Oct 16 11:17:29 user nova-compute[74683]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2, portal: 172.16.0.220,3260] successful.
Oct 16 11:17:29 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 -p 172.16.0.220:3260 --op delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7416aefd-313c-4b26-b1f6-06786088d9c2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3fa705c-4663-459b-bee9-26e85b6632ad]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.594s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] <== disconnect_volume: return (597ms) None {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Disconnected iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] calling os-brick to detach iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, {'target_iqn': 'iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FQGKODjE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:17:29 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:17:29 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08eb7dd-8136-4cd1-8e9a-d5f1e0dbc292]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 11:17:29 user nova-compute[74683]: No targets found.
Oct 16 11:17:29 user nova-compute[74683]: iSNS:
Oct 16 11:17:29 user nova-compute[74683]: No targets found.
Oct 16 11:17:29 user nova-compute[74683]: STATIC:
Oct 16 11:17:29 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e
Oct 16 11:17:29 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:17:29 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:17:29 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b
Oct 16 11:17:29 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:17:29 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:17:29 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5
Oct 16 11:17:29 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:17:29 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:17:29 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e
Oct 16 11:17:29 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:17:29 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:17:29 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb
Oct 16 11:17:29 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:17:29 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:17:29 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3
Oct 16 11:17:29 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:17:29 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:17:29 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020
Oct 16 11:17:29 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:17:29 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:17:29 user nova-compute[74683]: FIRMWARE:
Oct 16 11:17:29 user nova-compute[74683]: No targets found.
Oct 16 11:17:29 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 11:17:29 user nova-compute[74683]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 11:17:29 user nova-compute[74683]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74683) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b', 0)] {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c11604-c397-479c-bdbd-ba901e5f68c3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7898848eee21754e7d2b5036ba0eb2807d0bd2ff.converted --force-share --output=json" returned: 0 in 0.192s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Lock "7898848eee21754e7d2b5036ba0eb2807d0bd2ff" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.852s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Acquiring lock "7898848eee21754e7d2b5036ba0eb2807d0bd2ff" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Lock "7898848eee21754e7d2b5036ba0eb2807d0bd2ff" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7898848eee21754e7d2b5036ba0eb2807d0bd2ff --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.060s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e998cdd-fde5-4bbd-bd29-6911f719e524]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)
Oct 16 11:17:29 user nova-compute[74683]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)
Oct 16 11:17:29 user nova-compute[74683]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e (non-flash)
Oct 16 11:17:29 user nova-compute[74683]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:17:29 user nova-compute[74683]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)
Oct 16 11:17:29 user nova-compute[74683]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)
Oct 16 11:17:29 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:17:29 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)
Oct 16 11:17:29 user nova-compute[74683]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)
Oct 16 11:17:29 user nova-compute[74683]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e (non-flash)
Oct 16 11:17:29 user nova-compute[74683]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:17:29 user nova-compute[74683]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)
Oct 16 11:17:29 user nova-compute[74683]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b (non-flash)
Oct 16 11:17:29 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:17:29 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda4c7c7d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b'): ({'sdd'}, set())}) {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Removing single pathed devices sdd {{(pid=74683) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db5699b-37db-44d0-8a54-4b7e01ae9814]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[247cd028-05d2-4200-a8c2-6bfb767ab2c5]: (4, ('ok\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Flushing IO for device /dev/sdd {{(pid=74683) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a0c5d3-d796-44cd-b5a3-baa312e47f62]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74683) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[8edc558f-4409-434c-9430-f755744d06bf]: (4, ('1', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] SCSI volumes sdd have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b')] {{(pid=74683) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de2a8b4-ccf3-4604-b1e2-4d2f6f31ac0e]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b -p 172.16.0.220:3260 --logout {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7898848eee21754e7d2b5036ba0eb2807d0bd2ff --force-share --output=json" returned: 0 in 0.223s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7898848eee21754e7d2b5036ba0eb2807d0bd2ff,backing_fmt=raw /opt/stack/data/nova/instances/2f1db5e2-0b25-4d61-9dd3-038811b4eda1/disk.rescue {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7898848eee21754e7d2b5036ba0eb2807d0bd2ff,backing_fmt=raw /opt/stack/data/nova/instances/2f1db5e2-0b25-4d61-9dd3-038811b4eda1/disk.rescue" returned: 0 in 0.055s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Lock "7898848eee21754e7d2b5036ba0eb2807d0bd2ff" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG nova.objects.instance [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Lazy-loading 'migration_context' on Instance uuid 2f1db5e2-0b25-4d61-9dd3-038811b4eda1 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61fb618-a1c2-4ae6-ab13-b1e0f6333e39]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b, portal: 172.16.0.220,3260]
Oct 16 11:17:29 user nova-compute[74683]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b, portal: 172.16.0.220,3260] successful.
Oct 16 11:17:29 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b -p 172.16.0.220:3260 --op delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG nova.objects.base [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Object Instance<2f1db5e2-0b25-4d61-9dd3-038811b4eda1> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Created local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Start _get_guest_xml network_info=[{"id": "9476563e-0758-43d9-b920-87f412881869", "address": "fa:16:3e:18:cc:d6", "network": {"id": "5a04a566-92ef-4300-976b-5c34656ec9c7", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-706076145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-706076145-network", "vif_mac": "fa:16:3e:18:cc:d6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "207a79fe27c042d8b081272246b98245", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9476563e-07", "ovs_interfaceid": "9476563e-0758-43d9-b920-87f412881869", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'af95e2e6-d26f-45e5-a3bd-a8a0d721d203', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fKNejHlu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '2f1db5e2-0b25-4d61-9dd3-038811b4eda1', 'attached_at': '', 'detached_at': '', 'volume_id': 'a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5', 'serial': 'a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': None, 'delete_on_termination': False, 'attachment_id': '4fc306ac-a61a-492c-ae1b-7ad8452a0e03', 'volume_type': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG nova.objects.instance [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Lazy-loading 'resources' on Instance uuid 2f1db5e2-0b25-4d61-9dd3-038811b4eda1 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG nova.objects.base [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Object Instance<2f1db5e2-0b25-4d61-9dd3-038811b4eda1> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG nova.objects.instance [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Lazy-loading 'numa_topology' on Instance uuid 2f1db5e2-0b25-4d61-9dd3-038811b4eda1 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6c6fe01-d34b-4fd1-8939-72ecd365df7b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[890f3c92-8aaf-4bdb-821c-956a8eddcfdf]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.425s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] <== disconnect_volume: return (428ms) None {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Disconnected iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 11:17:29 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Deleting instance files /opt/stack/data/nova/instances/9df7866f-28e9-46d0-9f35-24484adfffd7_del
Oct 16 11:17:29 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Deletion of /opt/stack/data/nova/instances/9df7866f-28e9-46d0-9f35-24484adfffd7_del complete
Oct 16 11:17:29 user nova-compute[74683]: DEBUG nova.objects.base [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Object Instance<2f1db5e2-0b25-4d61-9dd3-038811b4eda1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:17:29 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:17:29 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:17:29 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG nova.objects.instance [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2f1db5e2-0b25-4d61-9dd3-038811b4eda1 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:17:29 user nova-compute[74683]: DEBUG nova.objects.base [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Object Instance<2f1db5e2-0b25-4d61-9dd3-038811b4eda1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:17:30 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Calling os-brick to attach iSCSI Volume {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 11:17:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fKNejHlu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:17:30 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:17:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:17:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:17:30 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:17:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:17:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:17:30 user nova-compute[74683]: INFO os_brick.initiator.connectors.iscsi [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 11:17:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 -p 172.16.0.220:3260 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:30 user nova-compute[74683]: INFO nova.compute.manager [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Took 5.81 seconds to destroy the instance on the hypervisor.
Oct 16 11:17:30 user nova-compute[74683]: DEBUG oslo.service.loopingcall [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74683) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 11:17:30 user nova-compute[74683]: DEBUG nova.compute.manager [-] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Deallocating network for instance {{(pid=74683) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 11:17:30 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] deallocate_for_instance() {{(pid=74683) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 11:17:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 -p 172.16.0.220:3260" returned: 0 in 0.024s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae13f63-c7cb-4771-8056-51f387ef2841]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = fKNejHlu\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 16 11:17:30 user nova-compute[74683]: node.name = iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5
Oct 16 11:17:30 user nova-compute[74683]: node.tpgt = -1
Oct 16 11:17:30 user nova-compute[74683]: node.startup = automatic
Oct 16 11:17:30 user nova-compute[74683]: node.leading_login = No
Oct 16 11:17:30 user nova-compute[74683]: iface.iscsi_ifacename = default
Oct 16 11:17:30 user nova-compute[74683]: iface.net_ifacename = <empty>
Oct 16 11:17:30 user nova-compute[74683]: iface.ipaddress = <empty>
Oct 16 11:17:30 user nova-compute[74683]: iface.prefix_len = 0
Oct 16 11:17:30 user nova-compute[74683]: iface.hwaddress = <empty>
Oct 16 11:17:30 user nova-compute[74683]: iface.transport_name = tcp
Oct 16 11:17:30 user nova-compute[74683]: iface.initiatorname = <empty>
Oct 16 11:17:30 user nova-compute[74683]: iface.state = <empty>
Oct 16 11:17:30 user nova-compute[74683]: iface.vlan_id = 0
Oct 16 11:17:30 user nova-compute[74683]: iface.vlan_priority = 0
Oct 16 11:17:30 user nova-compute[74683]: iface.vlan_state = <empty>
Oct 16 11:17:30 user nova-compute[74683]: iface.iface_num = 0
Oct 16 11:17:30 user nova-compute[74683]: iface.mtu = 0
Oct 16 11:17:30 user nova-compute[74683]: iface.port = 0
Oct 16 11:17:30 user nova-compute[74683]: iface.bootproto = <empty>
Oct 16 11:17:30 user nova-compute[74683]: iface.subnet_mask = <empty>
Oct 16 11:17:30 user nova-compute[74683]: iface.gateway = <empty>
Oct 16 11:17:30 user nova-compute[74683]: iface.dhcp_alt_client_id_state = <empty>
Oct 16 11:17:30 user nova-compute[74683]: iface.dhcp_alt_client_id = <empty>
Oct 16 11:17:30 user nova-compute[74683]: iface.dhcp_dns = <empty>
Oct 16 11:17:30 user nova-compute[74683]: iface.dhcp_learn_iqn = <empty>
Oct 16 11:17:30 user nova-compute[74683]: iface.dhcp_req_vendor_id_state = <empty>
Oct 16 11:17:30 user nova-compute[74683]: iface.dhcp_vendor_id_state = <empty>
Oct 16 11:17:30 user nova-compute[74683]: iface.dhcp_vendor_id = <empty>
Oct 16 11:17:30 user nova-compute[74683]: iface.dhcp_slp_da = <empty>
Oct 16 11:17:30 user nova-compute[74683]: iface.fragmentation = <empty>
Oct 16 11:17:30 user nova-compute[74683]: iface.gratuitous_arp = <empty>
Oct 16 11:17:30 user nova-compute[74683]: iface.incoming_forwarding = <empty>
Oct 16 11:17:30 user nova-compute[74683]: iface.tos_state = <empty>
Oct 16 11:17:30 user nova-compute[74683]: iface.tos = 0
Oct 16 11:17:30 user nova-compute[74683]: iface.ttl = 0
Oct 16 11:17:30 user nova-compute[74683]: iface.delayed_ack = <empty>
Oct 16 11:17:30 user nova-compute[74683]: iface.tcp_nagle = <empty>
Oct 16 11:17:30 user nova-compute[74683]: iface.tcp_wsf_state = <empty>
Oct 16 11:17:30 user nova-compute[74683]: iface.tcp_wsf = 0
Oct 16 11:17:30 user nova-compute[74683]: iface.tcp_timer_scale = 0
Oct 16 11:17:30 user nova-compute[74683]: iface.tcp_timestamp = <empty>
Oct 16 11:17:30 user nova-compute[74683]: iface.redirect = <empty>
Oct 16 11:17:30 user nova-compute[74683]: iface.def_task_mgmt_timeout = 0
Oct 16 11:17:30 user nova-compute[74683]: iface.header_digest = <empty>
Oct 16 11:17:30 user nova-compute[74683]: iface.data_digest = <empty>
Oct 16 11:17:30 user nova-compute[74683]: iface.immediate_data = <empty>
Oct 16 11:17:30 user nova-compute[74683]: iface.initial_r2t = <empty>
Oct 16 11:17:30 user nova-compute[74683]: iface.data_seq_inorder = <empty>
Oct 16 11:17:30 user nova-compute[74683]: iface.data_pdu_inorder = <empty>
Oct 16 11:17:30 user nova-compute[74683]: iface.erl = 0
Oct 16 11:17:30 user nova-compute[74683]: iface.max_receive_data_len = 0
Oct 16 11:17:30 user nova-compute[74683]: iface.first_burst_len = 0
Oct 16 11:17:30 user nova-compute[74683]: iface.max_outstanding_r2t = 0
Oct 16 11:17:30 user nova-compute[74683]: iface.max_burst_len = 0
Oct 16 11:17:30 user nova-compute[74683]: iface.chap_auth = <empty>
Oct 16 11:17:30 user nova-compute[74683]: iface.bidi_chap = <empty>
Oct 16 11:17:30 user nova-compute[74683]: iface.strict_login_compliance = <empty>
Oct 16 11:17:30 user nova-compute[74683]: iface.discovery_auth = <empty>
Oct 16 11:17:30 user nova-compute[74683]: iface.discovery_logout = <empty>
Oct 16 11:17:30 user nova-compute[74683]: node.discovery_address = <empty>
Oct 16 11:17:30 user nova-compute[74683]: node.discovery_port = 0
Oct 16 11:17:30 user nova-compute[74683]: node.discovery_type = static
Oct 16 11:17:30 user nova-compute[74683]: node.session.initial_cmdsn = 0
Oct 16 11:17:30 user nova-compute[74683]: node.session.initial_login_retry_max = 8
Oct 16 11:17:30 user nova-compute[74683]: node.session.xmit_thread_priority = -20
Oct 16 11:17:30 user nova-compute[74683]: node.session.cmds_max = 128
Oct 16 11:17:30 user nova-compute[74683]: node.session.queue_depth = 32
Oct 16 11:17:30 user nova-compute[74683]: node.session.nr_sessions = 1
Oct 16 11:17:30 user nova-compute[74683]: node.session.auth.authmethod = CHAP
Oct 16 11:17:30 user nova-compute[74683]: node.session.auth.username = fKNejHlu
Oct 16 11:17:30 user nova-compute[74683]: node.session.auth.password = ***
Oct 16 11:17:30 user nova-compute[74683]: node.session.auth.username_in = <empty>
Oct 16 11:17:30 user nova-compute[74683]: node.session.auth.password_in = <empty>
Oct 16 11:17:30 user nova-compute[74683]: node.session.auth.chap_algs = MD5
Oct 16 11:17:30 user nova-compute[74683]: node.session.timeo.replacement_timeout = 120
Oct 16 11:17:30 user nova-compute[74683]: node.session.err_timeo.abort_timeout = 15
Oct 16 11:17:30 user nova-compute[74683]: node.session.err_timeo.lu_reset_timeout = 30
Oct 16 11:17:30 user nova-compute[74683]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 16 11:17:30 user nova-compute[74683]: node.session.err_timeo.host_reset_timeout = 60
Oct 16 11:17:30 user nova-compute[74683]: node.session.iscsi.FastAbort = Yes
Oct 16 11:17:30 user nova-compute[74683]: node.session.iscsi.InitialR2T = No
Oct 16 11:17:30 user nova-compute[74683]: node.session.iscsi.ImmediateData = Yes
Oct 16 11:17:30 user nova-compute[74683]: node.session.iscsi.FirstBurstLength = 262144
Oct 16 11:17:30 user nova-compute[74683]: node.session.iscsi.MaxBurstLength = 16776192
Oct 16 11:17:30 user nova-compute[74683]: node.session.iscsi.DefaultTime2Retain = 0
Oct 16 11:17:30 user nova-compute[74683]: node.session.iscsi.DefaultTime2Wait = 2
Oct 16 11:17:30 user nova-compute[74683]: node.session.iscsi.MaxConnections = 1
Oct 16 11:17:30 user nova-compute[74683]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 16 11:17:30 user nova-compute[74683]: node.session.iscsi.ERL = 0
Oct 16 11:17:30 user nova-compute[74683]: node.session.scan = manual
Oct 16 11:17:30 user nova-compute[74683]: node.session.reopen_max = 0
Oct 16 11:17:30 user nova-compute[74683]: node.conn[0].address = 172.16.0.220
Oct 16 11:17:30 user nova-compute[74683]: node.conn[0].port = 3260
Oct 16 11:17:30 user nova-compute[74683]: node.conn[0].startup = manual
Oct 16 11:17:30 user nova-compute[74683]: node.conn[0].tcp.window_size = 524288
Oct 16 11:17:30 user nova-compute[74683]: node.conn[0].tcp.type_of_service = 0
Oct 16 11:17:30 user nova-compute[74683]: node.conn[0].timeo.logout_timeout = 15
Oct 16 11:17:30 user nova-compute[74683]: node.conn[0].timeo.login_timeout = 15
Oct 16 11:17:30 user nova-compute[74683]: node.conn[0].timeo.auth_timeout = 45
Oct 16 11:17:30 user nova-compute[74683]: node.conn[0].timeo.noop_out_interval = 5
Oct 16 11:17:30 user nova-compute[74683]: node.conn[0].timeo.noop_out_timeout = 5
Oct 16 11:17:30 user nova-compute[74683]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 16 11:17:30 user nova-compute[74683]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 16 11:17:30 user nova-compute[74683]: node.conn[0].iscsi.HeaderDigest = None
Oct 16 11:17:30 user nova-compute[74683]: node.conn[0].iscsi.DataDigest = None
Oct 16 11:17:30 user nova-compute[74683]: node.conn[0].iscsi.IFMarker = No
Oct 16 11:17:30 user nova-compute[74683]: node.conn[0].iscsi.OFMarker = No
Oct 16 11:17:30 user nova-compute[74683]: # END RECORD
Oct 16 11:17:30 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:17:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27b2af5-5154-4589-bd1e-7d5d71186153]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:17:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[385a48b5-30b6-448d-85f1-a53d9e6e96e6]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:17:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fKNejHlu {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fKNejHlu" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3669d5-cea5-4992-9b88-41c30bcfde84]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fKNejHlu'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:17:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e3f615-0f95-4cf7-a8a2-cc31728a3d70]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:17:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[00de3fae-a2f1-48ef-af67-e84a90582ff1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)
Oct 16 11:17:30 user nova-compute[74683]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)
Oct 16 11:17:30 user nova-compute[74683]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e (non-flash)
Oct 16 11:17:30 user nova-compute[74683]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:17:30 user nova-compute[74683]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)
Oct 16 11:17:30 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:17:30 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:17:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)
Oct 16 11:17:30 user nova-compute[74683]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)
Oct 16 11:17:30 user nova-compute[74683]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e (non-flash)
Oct 16 11:17:30 user nova-compute[74683]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:17:30 user nova-compute[74683]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)
Oct 16 11:17:30 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:17:30 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:17:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.192s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:17:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Connected to 172.16.0.220:3260 {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 11:17:30 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] HCTL ('38', '0', '0', 0) found on session 14 with lun 0 {{(pid=74683) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 11:17:30 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Scanning host 38 c: 0, t: 0, l: 0) {{(pid=74683) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 11:17:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[efca7907-6d24-4225-8dbc-233cc4f747dc]: (4, ('0 0 0', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:30 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Searching for a device in session 14 and hctl ('38', '0', '0', 0) yield: sdg {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:17:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fKNejHlu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 11:17:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.225s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:17:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] <== connect_volume: return (226ms) {'type': 'block', 'scsi_wwn': '26362376539366530', 'path': '/dev/sdg'} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:17:30 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362376539366530', 'path': '/dev/sdg'} {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 11:17:30 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:13:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-649264826',display_name='tempest-ServerStableDeviceRescueTest-server-649264826',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-649264826',id=5,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCHdErqSJAuU5ThrpuRLCA7O8N+5e9cKLBRIOiKAgCYrSh7b9cT3Hw2OzejXwPp8CDDvy7DhOF+OR4lwTCUm5XrYVkiD31OBP/Hh7mTFi6YXdpdChJO0Xma5CTcgqFL8LA==',key_name='tempest-keypair-907110681',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:13:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='207a79fe27c042d8b081272246b98245',ramdisk_id='',reservation_id='r-snd9b0xu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-2038287775',owner_user_name='tempest-ServerStableDeviceRescueTest-2038287775-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:15:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da5d2dc55a234fa5a6b09bdc3f489055',uuid=2f1db5e2-0b25-4d61-9dd3-038811b4eda1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9476563e-0758-43d9-b920-87f412881869", "address": "fa:16:3e:18:cc:d6", "network": {"id": "5a04a566-92ef-4300-976b-5c34656ec9c7", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-706076145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-706076145-network", "vif_mac": "fa:16:3e:18:cc:d6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "207a79fe27c042d8b081272246b98245", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9476563e-07", "ovs_interfaceid": "9476563e-0758-43d9-b920-87f412881869", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:17:30 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Converting VIF {"id": "9476563e-0758-43d9-b920-87f412881869", "address": "fa:16:3e:18:cc:d6", "network": {"id": "5a04a566-92ef-4300-976b-5c34656ec9c7", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-706076145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-706076145-network", "vif_mac": "fa:16:3e:18:cc:d6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "207a79fe27c042d8b081272246b98245", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9476563e-07", "ovs_interfaceid": "9476563e-0758-43d9-b920-87f412881869", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:17:30 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:18:cc:d6,bridge_name='br-int',has_traffic_filtering=True,id=9476563e-0758-43d9-b920-87f412881869,network=Network(5a04a566-92ef-4300-976b-5c34656ec9c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9476563e-07') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:17:30 user nova-compute[74683]: DEBUG nova.objects.instance [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Lazy-loading 'pci_devices' on Instance uuid 2f1db5e2-0b25-4d61-9dd3-038811b4eda1 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:17:30 user nova-compute[74683]: DEBUG nova.objects.base [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Object Instance<2f1db5e2-0b25-4d61-9dd3-038811b4eda1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:17:30 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:17:30 user nova-compute[74683]:   <uuid>2f1db5e2-0b25-4d61-9dd3-038811b4eda1</uuid>
Oct 16 11:17:30 user nova-compute[74683]:   <name>instance-00000005</name>
Oct 16 11:17:30 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:17:30 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:17:30 user nova-compute[74683]:   <metadata>
Oct 16 11:17:30 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:17:30 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:17:30 user nova-compute[74683]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-649264826</nova:name>
Oct 16 11:17:30 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:17:29</nova:creationTime>
Oct 16 11:17:30 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:17:30 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:17:30 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:17:30 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:17:30 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:17:30 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:17:30 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:17:30 user nova-compute[74683]:       <nova:owner>
Oct 16 11:17:30 user nova-compute[74683]:         <nova:user uuid="da5d2dc55a234fa5a6b09bdc3f489055">tempest-ServerStableDeviceRescueTest-2038287775-project-member</nova:user>
Oct 16 11:17:30 user nova-compute[74683]:         <nova:project uuid="207a79fe27c042d8b081272246b98245">tempest-ServerStableDeviceRescueTest-2038287775</nova:project>
Oct 16 11:17:30 user nova-compute[74683]:       </nova:owner>
Oct 16 11:17:30 user nova-compute[74683]:       <nova:root type="image" uuid="0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f"/>
Oct 16 11:17:30 user nova-compute[74683]:       <nova:ports>
Oct 16 11:17:30 user nova-compute[74683]:         <nova:port uuid="9476563e-0758-43d9-b920-87f412881869">
Oct 16 11:17:30 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 16 11:17:30 user nova-compute[74683]:         </nova:port>
Oct 16 11:17:30 user nova-compute[74683]:       </nova:ports>
Oct 16 11:17:30 user nova-compute[74683]:     </nova:instance>
Oct 16 11:17:30 user nova-compute[74683]:   </metadata>
Oct 16 11:17:30 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:17:30 user nova-compute[74683]:     <system>
Oct 16 11:17:30 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:17:30 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:17:30 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:17:30 user nova-compute[74683]:       <entry name="serial">2f1db5e2-0b25-4d61-9dd3-038811b4eda1</entry>
Oct 16 11:17:30 user nova-compute[74683]:       <entry name="uuid">2f1db5e2-0b25-4d61-9dd3-038811b4eda1</entry>
Oct 16 11:17:30 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:17:30 user nova-compute[74683]:     </system>
Oct 16 11:17:30 user nova-compute[74683]:   </sysinfo>
Oct 16 11:17:30 user nova-compute[74683]:   <os>
Oct 16 11:17:30 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:17:30 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:17:30 user nova-compute[74683]:   </os>
Oct 16 11:17:30 user nova-compute[74683]:   <features>
Oct 16 11:17:30 user nova-compute[74683]:     <acpi/>
Oct 16 11:17:30 user nova-compute[74683]:     <apic/>
Oct 16 11:17:30 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:17:30 user nova-compute[74683]:   </features>
Oct 16 11:17:30 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:17:30 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:17:30 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:17:30 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:17:30 user nova-compute[74683]:   </clock>
Oct 16 11:17:30 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:17:30 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:17:30 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:17:30 user nova-compute[74683]:   </cpu>
Oct 16 11:17:30 user nova-compute[74683]:   <devices>
Oct 16 11:17:30 user nova-compute[74683]:     <disk type="file" device="disk">
Oct 16 11:17:30 user nova-compute[74683]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 11:17:30 user nova-compute[74683]:       <source file="/opt/stack/data/nova/instances/2f1db5e2-0b25-4d61-9dd3-038811b4eda1/disk"/>
Oct 16 11:17:30 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:17:30 user nova-compute[74683]:     </disk>
Oct 16 11:17:30 user nova-compute[74683]:     <disk type="block" device="disk">
Oct 16 11:17:30 user nova-compute[74683]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:17:30 user nova-compute[74683]:       <source dev="/dev/sdg"/>
Oct 16 11:17:30 user nova-compute[74683]:       <target dev="vdb" bus="virtio"/>
Oct 16 11:17:30 user nova-compute[74683]:       <serial>a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5</serial>
Oct 16 11:17:30 user nova-compute[74683]:     </disk>
Oct 16 11:17:30 user nova-compute[74683]:     <disk type="file" device="disk">
Oct 16 11:17:30 user nova-compute[74683]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 11:17:30 user nova-compute[74683]:       <source file="/opt/stack/data/nova/instances/2f1db5e2-0b25-4d61-9dd3-038811b4eda1/disk.rescue"/>
Oct 16 11:17:30 user nova-compute[74683]:       <target dev="vdc" bus="virtio"/>
Oct 16 11:17:30 user nova-compute[74683]:       <boot order="1"/>
Oct 16 11:17:30 user nova-compute[74683]:     </disk>
Oct 16 11:17:30 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:17:30 user nova-compute[74683]:       <mac address="fa:16:3e:18:cc:d6"/>
Oct 16 11:17:30 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:17:30 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:17:30 user nova-compute[74683]:       <target dev="tap9476563e-07"/>
Oct 16 11:17:30 user nova-compute[74683]:     </interface>
Oct 16 11:17:30 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:17:30 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/2f1db5e2-0b25-4d61-9dd3-038811b4eda1/console.log" append="off"/>
Oct 16 11:17:30 user nova-compute[74683]:     </serial>
Oct 16 11:17:30 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:17:30 user nova-compute[74683]:     <video>
Oct 16 11:17:30 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:17:30 user nova-compute[74683]:     </video>
Oct 16 11:17:30 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:17:30 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:17:30 user nova-compute[74683]:     </rng>
Oct 16 11:17:30 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:17:30 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:17:30 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:17:30 user nova-compute[74683]:     </memballoon>
Oct 16 11:17:30 user nova-compute[74683]:   </devices>
Oct 16 11:17:30 user nova-compute[74683]: </domain>
Oct 16 11:17:30 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:17:30 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Instance destroyed successfully.
Oct 16 11:17:30 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:17:30 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:17:30 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:17:30 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] No VIF found with MAC fa:16:3e:18:cc:d6, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:17:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:32 user nova-compute[74683]: DEBUG nova.compute.manager [req-f3b72040-cfc2-4d06-8875-c3746b4921e9 req-208557de-f841-4acf-90d3-7b5c255e1aa7 service nova] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Received event network-vif-plugged-9476563e-0758-43d9-b920-87f412881869 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:17:32 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f3b72040-cfc2-4d06-8875-c3746b4921e9 req-208557de-f841-4acf-90d3-7b5c255e1aa7 service nova] Acquiring lock "2f1db5e2-0b25-4d61-9dd3-038811b4eda1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:17:32 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f3b72040-cfc2-4d06-8875-c3746b4921e9 req-208557de-f841-4acf-90d3-7b5c255e1aa7 service nova] Lock "2f1db5e2-0b25-4d61-9dd3-038811b4eda1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:17:32 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f3b72040-cfc2-4d06-8875-c3746b4921e9 req-208557de-f841-4acf-90d3-7b5c255e1aa7 service nova] Lock "2f1db5e2-0b25-4d61-9dd3-038811b4eda1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:17:32 user nova-compute[74683]: DEBUG nova.compute.manager [req-f3b72040-cfc2-4d06-8875-c3746b4921e9 req-208557de-f841-4acf-90d3-7b5c255e1aa7 service nova] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] No waiting events found dispatching network-vif-plugged-9476563e-0758-43d9-b920-87f412881869 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:17:32 user nova-compute[74683]: WARNING nova.compute.manager [req-f3b72040-cfc2-4d06-8875-c3746b4921e9 req-208557de-f841-4acf-90d3-7b5c255e1aa7 service nova] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Received unexpected event network-vif-plugged-9476563e-0758-43d9-b920-87f412881869 for instance with vm_state active and task_state rescuing.
Oct 16 11:17:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:34 user nova-compute[74683]: DEBUG nova.compute.manager [req-d40fae55-5c86-4122-b63e-f27c851ea5c6 req-0606f88f-3357-4f37-bf7d-8d9e1bd5a94c service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received event network-vif-deleted-698c4ef8-286a-4bc1-a789-3276dc6defea {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:17:34 user nova-compute[74683]: INFO nova.compute.manager [req-d40fae55-5c86-4122-b63e-f27c851ea5c6 req-0606f88f-3357-4f37-bf7d-8d9e1bd5a94c service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Neutron deleted interface 698c4ef8-286a-4bc1-a789-3276dc6defea; detaching it from the instance and deleting it from the info cache
Oct 16 11:17:34 user nova-compute[74683]: DEBUG nova.network.neutron [req-d40fae55-5c86-4122-b63e-f27c851ea5c6 req-0606f88f-3357-4f37-bf7d-8d9e1bd5a94c service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Updating instance_info_cache with network_info: [{"id": "1509ff6e-10c0-4f96-95ae-660dfc1402cc", "address": "fa:16:3e:7e:c7:90", "network": {"id": "6e171460-714f-45db-a77d-ba03b50b892e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-531792258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1509ff6e-10", "ovs_interfaceid": "1509ff6e-10c0-4f96-95ae-660dfc1402cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7cfcd210-0e45-4f0e-b04b-1e933ec87734", "address": "fa:16:3e:d6:13:bf", "network": {"id": "0ab5f993-73f7-4963-9a4a-768145c101ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1056805143", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cfcd210-0e", "ovs_interfaceid": "7cfcd210-0e45-4f0e-b04b-1e933ec87734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bfe231c8-ff2a-46fd-9af6-9982a54d7846", "address": "fa:16:3e:52:f5:40", "network": {"id": "0ab5f993-73f7-4963-9a4a-768145c101ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1056805143", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe231c8-ff", "ovs_interfaceid": "bfe231c8-ff2a-46fd-9af6-9982a54d7846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8c0a030c-cf2d-4d14-b5c3-6d0563b346b9", "address": "fa:16:3e:b2:3c:35", "network": {"id": "0ab5f993-73f7-4963-9a4a-768145c101ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1056805143", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c0a030c-cf", "ovs_interfaceid": "8c0a030c-cf2d-4d14-b5c3-6d0563b346b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "82f47635-6e3f-492d-9819-4d77ae46fb29", "address": "fa:16:3e:24:20:65", "network": {"id": "0ab5f993-73f7-4963-9a4a-768145c101ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1056805143", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82f47635-6e", "ovs_interfaceid": "82f47635-6e3f-492d-9819-4d77ae46fb29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8a9e59f4-7708-438f-8411-499c6e38ec1b", "address": "fa:16:3e:42:50:56", "network": {"id": "e2c37b04-3414-40bf-a284-f1f9123d0ccb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1623055457", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a9e59f4-77", "ovs_interfaceid": "8a9e59f4-7708-438f-8411-499c6e38ec1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:17:34 user nova-compute[74683]: DEBUG nova.compute.manager [req-d40fae55-5c86-4122-b63e-f27c851ea5c6 req-0606f88f-3357-4f37-bf7d-8d9e1bd5a94c service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Detach interface failed, port_id=698c4ef8-286a-4bc1-a789-3276dc6defea, reason: Instance 9df7866f-28e9-46d0-9f35-24484adfffd7 could not be found. {{(pid=74683) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 16 11:17:34 user nova-compute[74683]: DEBUG nova.compute.manager [req-d40fae55-5c86-4122-b63e-f27c851ea5c6 req-0606f88f-3357-4f37-bf7d-8d9e1bd5a94c service nova] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Received event network-vif-plugged-9476563e-0758-43d9-b920-87f412881869 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:17:34 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-d40fae55-5c86-4122-b63e-f27c851ea5c6 req-0606f88f-3357-4f37-bf7d-8d9e1bd5a94c service nova] Acquiring lock "2f1db5e2-0b25-4d61-9dd3-038811b4eda1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:17:34 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-d40fae55-5c86-4122-b63e-f27c851ea5c6 req-0606f88f-3357-4f37-bf7d-8d9e1bd5a94c service nova] Lock "2f1db5e2-0b25-4d61-9dd3-038811b4eda1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:17:34 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-d40fae55-5c86-4122-b63e-f27c851ea5c6 req-0606f88f-3357-4f37-bf7d-8d9e1bd5a94c service nova] Lock "2f1db5e2-0b25-4d61-9dd3-038811b4eda1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:17:34 user nova-compute[74683]: DEBUG nova.compute.manager [req-d40fae55-5c86-4122-b63e-f27c851ea5c6 req-0606f88f-3357-4f37-bf7d-8d9e1bd5a94c service nova] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] No waiting events found dispatching network-vif-plugged-9476563e-0758-43d9-b920-87f412881869 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:17:34 user nova-compute[74683]: WARNING nova.compute.manager [req-d40fae55-5c86-4122-b63e-f27c851ea5c6 req-0606f88f-3357-4f37-bf7d-8d9e1bd5a94c service nova] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Received unexpected event network-vif-plugged-9476563e-0758-43d9-b920-87f412881869 for instance with vm_state active and task_state rescuing.
Oct 16 11:17:34 user nova-compute[74683]: DEBUG nova.compute.manager [req-d40fae55-5c86-4122-b63e-f27c851ea5c6 req-0606f88f-3357-4f37-bf7d-8d9e1bd5a94c service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received event network-vif-deleted-8a9e59f4-7708-438f-8411-499c6e38ec1b {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:17:34 user nova-compute[74683]: INFO nova.compute.manager [req-d40fae55-5c86-4122-b63e-f27c851ea5c6 req-0606f88f-3357-4f37-bf7d-8d9e1bd5a94c service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Neutron deleted interface 8a9e59f4-7708-438f-8411-499c6e38ec1b; detaching it from the instance and deleting it from the info cache
Oct 16 11:17:34 user nova-compute[74683]: DEBUG nova.network.neutron [req-d40fae55-5c86-4122-b63e-f27c851ea5c6 req-0606f88f-3357-4f37-bf7d-8d9e1bd5a94c service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Updating instance_info_cache with network_info: [{"id": "1509ff6e-10c0-4f96-95ae-660dfc1402cc", "address": "fa:16:3e:7e:c7:90", "network": {"id": "6e171460-714f-45db-a77d-ba03b50b892e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-531792258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1509ff6e-10", "ovs_interfaceid": "1509ff6e-10c0-4f96-95ae-660dfc1402cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7cfcd210-0e45-4f0e-b04b-1e933ec87734", "address": "fa:16:3e:d6:13:bf", "network": {"id": "0ab5f993-73f7-4963-9a4a-768145c101ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1056805143", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cfcd210-0e", "ovs_interfaceid": "7cfcd210-0e45-4f0e-b04b-1e933ec87734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bfe231c8-ff2a-46fd-9af6-9982a54d7846", "address": "fa:16:3e:52:f5:40", "network": {"id": "0ab5f993-73f7-4963-9a4a-768145c101ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1056805143", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe231c8-ff", "ovs_interfaceid": "bfe231c8-ff2a-46fd-9af6-9982a54d7846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8c0a030c-cf2d-4d14-b5c3-6d0563b346b9", "address": "fa:16:3e:b2:3c:35", "network": {"id": "0ab5f993-73f7-4963-9a4a-768145c101ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1056805143", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c0a030c-cf", "ovs_interfaceid": "8c0a030c-cf2d-4d14-b5c3-6d0563b346b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "82f47635-6e3f-492d-9819-4d77ae46fb29", "address": "fa:16:3e:24:20:65", "network": {"id": "0ab5f993-73f7-4963-9a4a-768145c101ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1056805143", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82f47635-6e", "ovs_interfaceid": "82f47635-6e3f-492d-9819-4d77ae46fb29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:17:34 user nova-compute[74683]: DEBUG nova.compute.manager [None req-806ab0a9-4ae3-43a6-92e6-88032a25e788 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:17:34 user nova-compute[74683]: DEBUG nova.compute.manager [req-d40fae55-5c86-4122-b63e-f27c851ea5c6 req-0606f88f-3357-4f37-bf7d-8d9e1bd5a94c service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Detach interface failed, port_id=8a9e59f4-7708-438f-8411-499c6e38ec1b, reason: Instance 9df7866f-28e9-46d0-9f35-24484adfffd7 could not be found. {{(pid=74683) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 16 11:17:34 user nova-compute[74683]: DEBUG nova.compute.manager [req-d40fae55-5c86-4122-b63e-f27c851ea5c6 req-0606f88f-3357-4f37-bf7d-8d9e1bd5a94c service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received event network-vif-deleted-1509ff6e-10c0-4f96-95ae-660dfc1402cc {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:17:34 user nova-compute[74683]: INFO nova.compute.manager [req-d40fae55-5c86-4122-b63e-f27c851ea5c6 req-0606f88f-3357-4f37-bf7d-8d9e1bd5a94c service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Neutron deleted interface 1509ff6e-10c0-4f96-95ae-660dfc1402cc; detaching it from the instance and deleting it from the info cache
Oct 16 11:17:34 user nova-compute[74683]: DEBUG nova.network.neutron [req-d40fae55-5c86-4122-b63e-f27c851ea5c6 req-0606f88f-3357-4f37-bf7d-8d9e1bd5a94c service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Updating instance_info_cache with network_info: [{"id": "7cfcd210-0e45-4f0e-b04b-1e933ec87734", "address": "fa:16:3e:d6:13:bf", "network": {"id": "0ab5f993-73f7-4963-9a4a-768145c101ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1056805143", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cfcd210-0e", "ovs_interfaceid": "7cfcd210-0e45-4f0e-b04b-1e933ec87734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bfe231c8-ff2a-46fd-9af6-9982a54d7846", "address": "fa:16:3e:52:f5:40", "network": {"id": "0ab5f993-73f7-4963-9a4a-768145c101ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1056805143", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe231c8-ff", "ovs_interfaceid": "bfe231c8-ff2a-46fd-9af6-9982a54d7846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8c0a030c-cf2d-4d14-b5c3-6d0563b346b9", "address": "fa:16:3e:b2:3c:35", "network": {"id": "0ab5f993-73f7-4963-9a4a-768145c101ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1056805143", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c0a030c-cf", "ovs_interfaceid": "8c0a030c-cf2d-4d14-b5c3-6d0563b346b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "82f47635-6e3f-492d-9819-4d77ae46fb29", "address": "fa:16:3e:24:20:65", "network": {"id": "0ab5f993-73f7-4963-9a4a-768145c101ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1056805143", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82f47635-6e", "ovs_interfaceid": "82f47635-6e3f-492d-9819-4d77ae46fb29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:17:34 user nova-compute[74683]: DEBUG nova.compute.manager [req-d40fae55-5c86-4122-b63e-f27c851ea5c6 req-0606f88f-3357-4f37-bf7d-8d9e1bd5a94c service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Detach interface failed, port_id=1509ff6e-10c0-4f96-95ae-660dfc1402cc, reason: Instance 9df7866f-28e9-46d0-9f35-24484adfffd7 could not be found. {{(pid=74683) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 16 11:17:34 user nova-compute[74683]: DEBUG nova.compute.manager [req-d40fae55-5c86-4122-b63e-f27c851ea5c6 req-0606f88f-3357-4f37-bf7d-8d9e1bd5a94c service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received event network-vif-deleted-8c0a030c-cf2d-4d14-b5c3-6d0563b346b9 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:17:34 user nova-compute[74683]: INFO nova.compute.manager [req-d40fae55-5c86-4122-b63e-f27c851ea5c6 req-0606f88f-3357-4f37-bf7d-8d9e1bd5a94c service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Neutron deleted interface 8c0a030c-cf2d-4d14-b5c3-6d0563b346b9; detaching it from the instance and deleting it from the info cache
Oct 16 11:17:34 user nova-compute[74683]: DEBUG nova.network.neutron [req-d40fae55-5c86-4122-b63e-f27c851ea5c6 req-0606f88f-3357-4f37-bf7d-8d9e1bd5a94c service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Updating instance_info_cache with network_info: [{"id": "7cfcd210-0e45-4f0e-b04b-1e933ec87734", "address": "fa:16:3e:d6:13:bf", "network": {"id": "0ab5f993-73f7-4963-9a4a-768145c101ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1056805143", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cfcd210-0e", "ovs_interfaceid": "7cfcd210-0e45-4f0e-b04b-1e933ec87734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bfe231c8-ff2a-46fd-9af6-9982a54d7846", "address": "fa:16:3e:52:f5:40", "network": {"id": "0ab5f993-73f7-4963-9a4a-768145c101ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1056805143", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe231c8-ff", "ovs_interfaceid": "bfe231c8-ff2a-46fd-9af6-9982a54d7846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "82f47635-6e3f-492d-9819-4d77ae46fb29", "address": "fa:16:3e:24:20:65", "network": {"id": "0ab5f993-73f7-4963-9a4a-768145c101ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1056805143", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f4876261cd344bf91c3263bf1a20ae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82f47635-6e", "ovs_interfaceid": "82f47635-6e3f-492d-9819-4d77ae46fb29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:17:35 user nova-compute[74683]: DEBUG nova.compute.manager [req-d40fae55-5c86-4122-b63e-f27c851ea5c6 req-0606f88f-3357-4f37-bf7d-8d9e1bd5a94c service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Detach interface failed, port_id=8c0a030c-cf2d-4d14-b5c3-6d0563b346b9, reason: Instance 9df7866f-28e9-46d0-9f35-24484adfffd7 could not be found. {{(pid=74683) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 16 11:17:35 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:17:35 user nova-compute[74683]: INFO nova.compute.manager [-] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Took 5.06 seconds to deallocate network for instance.
Oct 16 11:17:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:36 user nova-compute[74683]: DEBUG nova.compute.manager [req-62cb7c79-2f49-4717-9d0d-9b0158e989f6 req-7d201c39-dd08-47a7-ae44-c7f597d2aebd service nova] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Received event network-vif-deleted-82f47635-6e3f-492d-9819-4d77ae46fb29 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:17:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:37 user nova-compute[74683]: INFO nova.compute.manager [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] [instance: 9df7866f-28e9-46d0-9f35-24484adfffd7] Took 2.84 seconds to detach 3 volumes for instance.
Oct 16 11:17:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:17:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:17:38 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:17:38 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:17:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.619s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:17:38 user nova-compute[74683]: INFO nova.scheduler.client.report [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Deleted allocations for instance 9df7866f-28e9-46d0-9f35-24484adfffd7
Oct 16 11:17:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-4a3bf8f9-1ff3-488f-883c-a904e206589b tempest-TaggedBootDevicesTest-652208384 tempest-TaggedBootDevicesTest-652208384-project-member] Lock "9df7866f-28e9-46d0-9f35-24484adfffd7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 14.581s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:17:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:42 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e6f4575-c24f-4763-bcde-f875dbfbea43 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Calling os-brick to attach iSCSI Volume {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 11:17:42 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6f4575-c24f-4763-bcde-f875dbfbea43 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nGRHmKco', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:17:42 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-5e6f4575-c24f-4763-bcde-f875dbfbea43 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:17:42 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-5e6f4575-c24f-4763-bcde-f875dbfbea43 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:17:42 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-5e6f4575-c24f-4763-bcde-f875dbfbea43 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:17:42 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-5e6f4575-c24f-4763-bcde-f875dbfbea43 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:17:42 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-5e6f4575-c24f-4763-bcde-f875dbfbea43 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:17:42 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-5e6f4575-c24f-4763-bcde-f875dbfbea43 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:17:42 user nova-compute[74683]: INFO os_brick.initiator.connectors.iscsi [None req-5e6f4575-c24f-4763-bcde-f875dbfbea43 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 11:17:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:42 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[3751634a-4896-4ee0-ba8f-3a31e4eec055]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:42 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6f4575-c24f-4763-bcde-f875dbfbea43 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 11:17:42 user nova-compute[74683]:  {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:17:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260 --interface default --op new {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:42 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[86caafd5-11fd-46d5-b078-42eff070e811]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b] added\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:42 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6f4575-c24f-4763-bcde-f875dbfbea43 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b] added
Oct 16 11:17:42 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:17:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:42 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c94a8ba-9bc6-4ff3-a9f3-7a477c2806b3]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:42 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6f4575-c24f-4763-bcde-f875dbfbea43 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:17:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:42 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d625dbd-47cb-4e95-a201-34534e9f8bf8]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:42 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6f4575-c24f-4763-bcde-f875dbfbea43 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:17:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nGRHmKco {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nGRHmKco" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:42 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dea94cd-0b8f-4a53-96e0-78156827efaa]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:42 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6f4575-c24f-4763-bcde-f875dbfbea43 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nGRHmKco'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:17:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:42 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0367ee-2f35-47ba-a2df-f2dfbd280687]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:42 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6f4575-c24f-4763-bcde-f875dbfbea43 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:17:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:42 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[3171a72a-3708-45a7-a91c-6c9b270d8d45]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:42 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6f4575-c24f-4763-bcde-f875dbfbea43 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)
Oct 16 11:17:42 user nova-compute[74683]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)
Oct 16 11:17:42 user nova-compute[74683]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e (non-flash)
Oct 16 11:17:42 user nova-compute[74683]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:17:42 user nova-compute[74683]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)
Oct 16 11:17:42 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:17:42 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:17:42 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6f4575-c24f-4763-bcde-f875dbfbea43 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)
Oct 16 11:17:42 user nova-compute[74683]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)
Oct 16 11:17:42 user nova-compute[74683]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e (non-flash)
Oct 16 11:17:42 user nova-compute[74683]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:17:42 user nova-compute[74683]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)
Oct 16 11:17:42 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:17:42 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:17:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260 --login {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:42 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d699ae-23f2-4251-9d42-f35242f4c6fb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:42 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6f4575-c24f-4763-bcde-f875dbfbea43 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b, portal: 172.16.0.220,3260]
Oct 16 11:17:42 user nova-compute[74683]: Login to [iface: default, target: iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b, portal: 172.16.0.220,3260] successful.
Oct 16 11:17:42 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:17:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:42 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d30d12-80da-47b6-a5c6-c503118622ba]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:42 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6f4575-c24f-4763-bcde-f875dbfbea43 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:17:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:42 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-05f535e6-6e82-4564-a699-af60343004b9 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Acquiring lock "c8d3f594-1f38-41d3-90aa-3dfba95ce077" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:17:42 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-05f535e6-6e82-4564-a699-af60343004b9 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Lock "c8d3f594-1f38-41d3-90aa-3dfba95ce077" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:17:42 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-05f535e6-6e82-4564-a699-af60343004b9 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Acquiring lock "c8d3f594-1f38-41d3-90aa-3dfba95ce077-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:17:42 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-05f535e6-6e82-4564-a699-af60343004b9 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Lock "c8d3f594-1f38-41d3-90aa-3dfba95ce077-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:17:42 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-05f535e6-6e82-4564-a699-af60343004b9 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Lock "c8d3f594-1f38-41d3-90aa-3dfba95ce077-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:17:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:42 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f660d81e-4c65-447e-b990-a17630e2bf2f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:42 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6f4575-c24f-4763-bcde-f875dbfbea43 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)
Oct 16 11:17:42 user nova-compute[74683]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)
Oct 16 11:17:42 user nova-compute[74683]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e (non-flash)
Oct 16 11:17:42 user nova-compute[74683]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:17:42 user nova-compute[74683]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)
Oct 16 11:17:42 user nova-compute[74683]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)
Oct 16 11:17:42 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:17:42 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:17:42 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6f4575-c24f-4763-bcde-f875dbfbea43 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)
Oct 16 11:17:42 user nova-compute[74683]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)
Oct 16 11:17:42 user nova-compute[74683]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e (non-flash)
Oct 16 11:17:42 user nova-compute[74683]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:17:42 user nova-compute[74683]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)
Oct 16 11:17:42 user nova-compute[74683]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)
Oct 16 11:17:42 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:17:42 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:17:42 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-5e6f4575-c24f-4763-bcde-f875dbfbea43 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.380s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:17:42 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6f4575-c24f-4763-bcde-f875dbfbea43 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Connected to 172.16.0.220:3260 {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 11:17:42 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-5e6f4575-c24f-4763-bcde-f875dbfbea43 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=74683) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 11:17:42 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-5e6f4575-c24f-4763-bcde-f875dbfbea43 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74683) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 11:17:42 user nova-compute[74683]: INFO nova.compute.manager [None req-05f535e6-6e82-4564-a699-af60343004b9 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Terminating instance
Oct 16 11:17:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:42 user nova-compute[74683]: DEBUG nova.compute.manager [None req-05f535e6-6e82-4564-a699-af60343004b9 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Start destroying the instance on the hypervisor. {{(pid=74683) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 11:17:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.030s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:42 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19cbb7b-14f5-4e41-ad93-07fb1081e440]: (4, ('- - 0', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:42 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-5e6f4575-c24f-4763-bcde-f875dbfbea43 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:17:42 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6f4575-c24f-4763-bcde-f875dbfbea43 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nGRHmKco', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 11:17:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:43 user nova-compute[74683]: DEBUG nova.compute.manager [req-88db6d29-da20-4bd0-83ee-9d66d9480747 req-512ceafe-82f2-46cf-b436-310c0218b206 service nova] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Received event network-vif-unplugged-84c66881-3b9a-4448-a984-840fab1521e4 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:17:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-88db6d29-da20-4bd0-83ee-9d66d9480747 req-512ceafe-82f2-46cf-b436-310c0218b206 service nova] Acquiring lock "c8d3f594-1f38-41d3-90aa-3dfba95ce077-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:17:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-88db6d29-da20-4bd0-83ee-9d66d9480747 req-512ceafe-82f2-46cf-b436-310c0218b206 service nova] Lock "c8d3f594-1f38-41d3-90aa-3dfba95ce077-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:17:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-88db6d29-da20-4bd0-83ee-9d66d9480747 req-512ceafe-82f2-46cf-b436-310c0218b206 service nova] Lock "c8d3f594-1f38-41d3-90aa-3dfba95ce077-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:17:43 user nova-compute[74683]: DEBUG nova.compute.manager [req-88db6d29-da20-4bd0-83ee-9d66d9480747 req-512ceafe-82f2-46cf-b436-310c0218b206 service nova] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] No waiting events found dispatching network-vif-unplugged-84c66881-3b9a-4448-a984-840fab1521e4 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:17:43 user nova-compute[74683]: DEBUG nova.compute.manager [req-88db6d29-da20-4bd0-83ee-9d66d9480747 req-512ceafe-82f2-46cf-b436-310c0218b206 service nova] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Received event network-vif-unplugged-84c66881-3b9a-4448-a984-840fab1521e4 for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 11:17:43 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Instance destroyed successfully.
Oct 16 11:17:43 user nova-compute[74683]: DEBUG nova.objects.instance [None req-05f535e6-6e82-4564-a699-af60343004b9 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Lazy-loading 'resources' on Instance uuid c8d3f594-1f38-41d3-90aa-3dfba95ce077 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:17:43 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-05f535e6-6e82-4564-a699-af60343004b9 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:13:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-2114004726',display_name='tempest-VolumesAssistedSnapshotsTest-server-2114004726',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-2114004726',id=8,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3v1E9Wc1FznpHJ1hGPoknkKO/e/T0NlyrxZYLLiRxRK/jh7vR6Ura8z8xR5Kzac1BUlwP5LtryMQhfEbYH1nwKd2wZ6lmd9xshz6idTA4dfiWTKYBovHu/zjAAutb5VA==',key_name='tempest-keypair-715136135',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:13:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='97c84099ff9940018a403eba219b0370',ramdisk_id='',reservation_id='r-gcdokve1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-998320029',owner_user_name='tempest-VolumesAssistedSnapshotsTest-998320029-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:13:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3205976849b2442b81d3e9e4be43eccb',uuid=c8d3f594-1f38-41d3-90aa-3dfba95ce077,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84c66881-3b9a-4448-a984-840fab1521e4", "address": "fa:16:3e:bf:fd:e3", "network": {"id": "8bd06e2b-a2a2-47c6-a513-9e0bdfb1964e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2134820244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97c84099ff9940018a403eba219b0370", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c66881-3b", "ovs_interfaceid": "84c66881-3b9a-4448-a984-840fab1521e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:17:43 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-05f535e6-6e82-4564-a699-af60343004b9 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Converting VIF {"id": "84c66881-3b9a-4448-a984-840fab1521e4", "address": "fa:16:3e:bf:fd:e3", "network": {"id": "8bd06e2b-a2a2-47c6-a513-9e0bdfb1964e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2134820244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97c84099ff9940018a403eba219b0370", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c66881-3b", "ovs_interfaceid": "84c66881-3b9a-4448-a984-840fab1521e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:17:43 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-05f535e6-6e82-4564-a699-af60343004b9 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bf:fd:e3,bridge_name='br-int',has_traffic_filtering=True,id=84c66881-3b9a-4448-a984-840fab1521e4,network=Network(8bd06e2b-a2a2-47c6-a513-9e0bdfb1964e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c66881-3b') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:17:43 user nova-compute[74683]: DEBUG os_vif [None req-05f535e6-6e82-4564-a699-af60343004b9 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:fd:e3,bridge_name='br-int',has_traffic_filtering=True,id=84c66881-3b9a-4448-a984-840fab1521e4,network=Network(8bd06e2b-a2a2-47c6-a513-9e0bdfb1964e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c66881-3b') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:17:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84c66881-3b, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:17:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=71051800-d7cd-4512-b075-2b257ebb8d3d) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:17:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:43 user nova-compute[74683]: INFO os_vif [None req-05f535e6-6e82-4564-a699-af60343004b9 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:fd:e3,bridge_name='br-int',has_traffic_filtering=True,id=84c66881-3b9a-4448-a984-840fab1521e4,network=Network(8bd06e2b-a2a2-47c6-a513-9e0bdfb1964e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c66881-3b')
Oct 16 11:17:43 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-05f535e6-6e82-4564-a699-af60343004b9 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Deleting instance files /opt/stack/data/nova/instances/c8d3f594-1f38-41d3-90aa-3dfba95ce077_del
Oct 16 11:17:43 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-05f535e6-6e82-4564-a699-af60343004b9 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Deletion of /opt/stack/data/nova/instances/c8d3f594-1f38-41d3-90aa-3dfba95ce077_del complete
Oct 16 11:17:43 user nova-compute[74683]: INFO nova.compute.manager [None req-05f535e6-6e82-4564-a699-af60343004b9 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Took 0.93 seconds to destroy the instance on the hypervisor.
Oct 16 11:17:43 user nova-compute[74683]: DEBUG oslo.service.loopingcall [None req-05f535e6-6e82-4564-a699-af60343004b9 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74683) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 11:17:43 user nova-compute[74683]: DEBUG nova.compute.manager [-] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Deallocating network for instance {{(pid=74683) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 11:17:43 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] deallocate_for_instance() {{(pid=74683) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 11:17:43 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-5e6f4575-c24f-4763-bcde-f875dbfbea43 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.446s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:17:43 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6f4575-c24f-4763-bcde-f875dbfbea43 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] <== connect_volume: return (1448ms) {'type': 'block', 'scsi_wwn': '23238393562653037', 'path': '/dev/sdb'} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:17:43 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e6f4575-c24f-4763-bcde-f875dbfbea43 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23238393562653037', 'path': '/dev/sdb'} {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 11:17:43 user nova-compute[74683]: DEBUG nova.objects.instance [None req-5e6f4575-c24f-4763-bcde-f875dbfbea43 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Lazy-loading 'flavor' on Instance uuid f192d1ec-311d-4a30-9766-361b27a8dae8 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:17:44 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-5e6f4575-c24f-4763-bcde-f875dbfbea43 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 11:17:44 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:17:44 user nova-compute[74683]:   <source dev="/dev/sdb"/>
Oct 16 11:17:44 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:17:44 user nova-compute[74683]:   <serial>e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b</serial>
Oct 16 11:17:44 user nova-compute[74683]: </disk>
Oct 16 11:17:44 user nova-compute[74683]:  {{(pid=74683) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 11:17:44 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-5e6f4575-c24f-4763-bcde-f875dbfbea43 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:17:44 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-5e6f4575-c24f-4763-bcde-f875dbfbea43 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:17:44 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-5e6f4575-c24f-4763-bcde-f875dbfbea43 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] No VIF found with MAC fa:16:3e:2b:14:bf, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:17:44 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-5e6f4575-c24f-4763-bcde-f875dbfbea43 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Lock "f192d1ec-311d-4a30-9766-361b27a8dae8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 40.461s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:17:44 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:17:44 user nova-compute[74683]: DEBUG nova.compute.manager [req-85773579-5ee8-4d52-9bb6-7c09f9e65011 req-ace75e9d-2f2d-43d7-9b2f-9c9a0b237697 service nova] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Received event network-vif-deleted-84c66881-3b9a-4448-a984-840fab1521e4 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:17:44 user nova-compute[74683]: INFO nova.compute.manager [req-85773579-5ee8-4d52-9bb6-7c09f9e65011 req-ace75e9d-2f2d-43d7-9b2f-9c9a0b237697 service nova] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Neutron deleted interface 84c66881-3b9a-4448-a984-840fab1521e4; detaching it from the instance and deleting it from the info cache
Oct 16 11:17:44 user nova-compute[74683]: DEBUG nova.network.neutron [req-85773579-5ee8-4d52-9bb6-7c09f9e65011 req-ace75e9d-2f2d-43d7-9b2f-9c9a0b237697 service nova] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:17:44 user nova-compute[74683]: INFO nova.compute.manager [-] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Took 0.97 seconds to deallocate network for instance.
Oct 16 11:17:44 user nova-compute[74683]: DEBUG nova.compute.manager [req-85773579-5ee8-4d52-9bb6-7c09f9e65011 req-ace75e9d-2f2d-43d7-9b2f-9c9a0b237697 service nova] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Detach interface failed, port_id=84c66881-3b9a-4448-a984-840fab1521e4, reason: Instance c8d3f594-1f38-41d3-90aa-3dfba95ce077 could not be found. {{(pid=74683) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 16 11:17:44 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-05f535e6-6e82-4564-a699-af60343004b9 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:17:44 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-05f535e6-6e82-4564-a699-af60343004b9 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:17:45 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-05f535e6-6e82-4564-a699-af60343004b9 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:17:45 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-05f535e6-6e82-4564-a699-af60343004b9 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:17:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-05f535e6-6e82-4564-a699-af60343004b9 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.381s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:17:45 user nova-compute[74683]: INFO nova.scheduler.client.report [None req-05f535e6-6e82-4564-a699-af60343004b9 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Deleted allocations for instance c8d3f594-1f38-41d3-90aa-3dfba95ce077
Oct 16 11:17:45 user nova-compute[74683]: DEBUG nova.compute.manager [req-f339adc5-904d-4920-b612-5dfd2ad1693b req-a64aaac5-a775-4d3e-99ff-dadd0835ce4d service nova] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Received event network-vif-plugged-84c66881-3b9a-4448-a984-840fab1521e4 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:17:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f339adc5-904d-4920-b612-5dfd2ad1693b req-a64aaac5-a775-4d3e-99ff-dadd0835ce4d service nova] Acquiring lock "c8d3f594-1f38-41d3-90aa-3dfba95ce077-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:17:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f339adc5-904d-4920-b612-5dfd2ad1693b req-a64aaac5-a775-4d3e-99ff-dadd0835ce4d service nova] Lock "c8d3f594-1f38-41d3-90aa-3dfba95ce077-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:17:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f339adc5-904d-4920-b612-5dfd2ad1693b req-a64aaac5-a775-4d3e-99ff-dadd0835ce4d service nova] Lock "c8d3f594-1f38-41d3-90aa-3dfba95ce077-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:17:45 user nova-compute[74683]: DEBUG nova.compute.manager [req-f339adc5-904d-4920-b612-5dfd2ad1693b req-a64aaac5-a775-4d3e-99ff-dadd0835ce4d service nova] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] No waiting events found dispatching network-vif-plugged-84c66881-3b9a-4448-a984-840fab1521e4 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:17:45 user nova-compute[74683]: WARNING nova.compute.manager [req-f339adc5-904d-4920-b612-5dfd2ad1693b req-a64aaac5-a775-4d3e-99ff-dadd0835ce4d service nova] [instance: c8d3f594-1f38-41d3-90aa-3dfba95ce077] Received unexpected event network-vif-plugged-84c66881-3b9a-4448-a984-840fab1521e4 for instance with vm_state deleted and task_state None.
Oct 16 11:17:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-05f535e6-6e82-4564-a699-af60343004b9 tempest-VolumesAssistedSnapshotsTest-998320029 tempest-VolumesAssistedSnapshotsTest-998320029-project-member] Lock "c8d3f594-1f38-41d3-90aa-3dfba95ce077" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.538s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:17:46 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:47 user nova-compute[74683]: DEBUG nova.compute.manager [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Stashing vm_state: active {{(pid=74683) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 16 11:17:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:17:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:17:47 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74683) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 11:17:47 user nova-compute[74683]: INFO nova.compute.claims [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Claim successful on node user
Oct 16 11:17:47 user nova-compute[74683]: INFO nova.compute.resource_tracker [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Updating resource usage from migration a748c33b-b037-42b4-81ba-0cc2bc8370bf
Oct 16 11:17:48 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:17:48 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:17:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.693s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:17:48 user nova-compute[74683]: INFO nova.compute.manager [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Migrating
Oct 16 11:17:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:17:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:17:48 user nova-compute[74683]: INFO nova.compute.rpcapi [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Oct 16 11:17:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:17:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Acquiring lock "refresh_cache-f192d1ec-311d-4a30-9766-361b27a8dae8" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:17:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Acquired lock "refresh_cache-f192d1ec-311d-4a30-9766-361b27a8dae8" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:17:48 user nova-compute[74683]: DEBUG nova.network.neutron [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:17:48 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:49 user nova-compute[74683]: DEBUG nova.network.neutron [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Updating instance_info_cache with network_info: [{"id": "dbbeadad-745e-4d28-a242-577b3197b079", "address": "fa:16:3e:2b:14:bf", "network": {"id": "33f5edce-0901-42ea-b07a-47da2819b133", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-117849665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d7573bebfe47e3989f8eedd90dee6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbbeadad-74", "ovs_interfaceid": "dbbeadad-745e-4d28-a242-577b3197b079", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:17:49 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Releasing lock "refresh_cache-f192d1ec-311d-4a30-9766-361b27a8dae8" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:17:49 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Starting migrate_disk_and_power_off {{(pid=74683) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 16 11:17:49 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:49 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:49 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:49 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:49 user nova-compute[74683]: DEBUG nova.compute.manager [req-d28231c9-8a17-4354-ba5a-6137c739c8d7 req-9c354ba6-53ab-4b98-9f3d-029f8a247030 service nova] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Received event network-vif-unplugged-dbbeadad-745e-4d28-a242-577b3197b079 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:17:49 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-d28231c9-8a17-4354-ba5a-6137c739c8d7 req-9c354ba6-53ab-4b98-9f3d-029f8a247030 service nova] Acquiring lock "f192d1ec-311d-4a30-9766-361b27a8dae8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:17:49 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-d28231c9-8a17-4354-ba5a-6137c739c8d7 req-9c354ba6-53ab-4b98-9f3d-029f8a247030 service nova] Lock "f192d1ec-311d-4a30-9766-361b27a8dae8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:17:49 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-d28231c9-8a17-4354-ba5a-6137c739c8d7 req-9c354ba6-53ab-4b98-9f3d-029f8a247030 service nova] Lock "f192d1ec-311d-4a30-9766-361b27a8dae8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:17:49 user nova-compute[74683]: DEBUG nova.compute.manager [req-d28231c9-8a17-4354-ba5a-6137c739c8d7 req-9c354ba6-53ab-4b98-9f3d-029f8a247030 service nova] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] No waiting events found dispatching network-vif-unplugged-dbbeadad-745e-4d28-a242-577b3197b079 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:17:49 user nova-compute[74683]: WARNING nova.compute.manager [req-d28231c9-8a17-4354-ba5a-6137c739c8d7 req-9c354ba6-53ab-4b98-9f3d-029f8a247030 service nova] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Received unexpected event network-vif-unplugged-dbbeadad-745e-4d28-a242-577b3197b079 for instance with vm_state active and task_state resize_migrating.
Oct 16 11:17:50 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Instance destroyed successfully.
Oct 16 11:17:50 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:13:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-983209770',display_name='tempest-ServerActionsTestOtherB-server-983209770',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-983209770',id=4,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9H9XkO3ueDaPVFedHBs8IBjQP+O3m5MP98XnfC/J6UPNHq/d/RZvz6o5PlZR6OTg+H3cDaV7C6HUM8WearORwrzPoJ/Wxd8/4rMuBZ4j1C0aE5FLDGnbq9yp0LqlVHBQ==',key_name='tempest-keypair-650579759',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:13:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e1d7573bebfe47e3989f8eedd90dee6c',ramdisk_id='',reservation_id='r-wwd9qybu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1241350688',owner_user_name='tempest-ServerActionsTestOtherB-1241350688-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:17:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fc0a33378424a9080c747d4f78528a5',uuid=f192d1ec-311d-4a30-9766-361b27a8dae8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dbbeadad-745e-4d28-a242-577b3197b079", "address": "fa:16:3e:2b:14:bf", "network": {"id": "33f5edce-0901-42ea-b07a-47da2819b133", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-117849665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-117849665-network", "vif_mac": "fa:16:3e:2b:14:bf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d7573bebfe47e3989f8eedd90dee6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbbeadad-74", "ovs_interfaceid": "dbbeadad-745e-4d28-a242-577b3197b079", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Converting VIF {"id": "dbbeadad-745e-4d28-a242-577b3197b079", "address": "fa:16:3e:2b:14:bf", "network": {"id": "33f5edce-0901-42ea-b07a-47da2819b133", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-117849665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-117849665-network", "vif_mac": "fa:16:3e:2b:14:bf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d7573bebfe47e3989f8eedd90dee6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbbeadad-74", "ovs_interfaceid": "dbbeadad-745e-4d28-a242-577b3197b079", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2b:14:bf,bridge_name='br-int',has_traffic_filtering=True,id=dbbeadad-745e-4d28-a242-577b3197b079,network=Network(33f5edce-0901-42ea-b07a-47da2819b133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbbeadad-74') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG os_vif [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:14:bf,bridge_name='br-int',has_traffic_filtering=True,id=dbbeadad-745e-4d28-a242-577b3197b079,network=Network(33f5edce-0901-42ea-b07a-47da2819b133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbbeadad-74') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdbbeadad-74, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dafe74bf-c9fe-4fe4-9844-f70576049656) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:50 user nova-compute[74683]: INFO os_vif [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:14:bf,bridge_name='br-int',has_traffic_filtering=True,id=dbbeadad-745e-4d28-a242-577b3197b079,network=Network(33f5edce-0901-42ea-b07a-47da2819b133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbbeadad-74')
Oct 16 11:17:50 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] calling os-brick to detach iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, {'target_iqn': 'iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nGRHmKco', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:17:50 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:17:50 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[35bf5399-10e9-4564-9a13-d5d44126db86]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 11:17:50 user nova-compute[74683]: No targets found.
Oct 16 11:17:50 user nova-compute[74683]: iSNS:
Oct 16 11:17:50 user nova-compute[74683]: No targets found.
Oct 16 11:17:50 user nova-compute[74683]: STATIC:
Oct 16 11:17:50 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e
Oct 16 11:17:50 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:17:50 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:17:50 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5
Oct 16 11:17:50 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:17:50 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:17:50 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e
Oct 16 11:17:50 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:17:50 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:17:50 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb
Oct 16 11:17:50 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:17:50 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:17:50 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3
Oct 16 11:17:50 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:17:50 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:17:50 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020
Oct 16 11:17:50 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:17:50 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:17:50 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b
Oct 16 11:17:50 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:17:50 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:17:50 user nova-compute[74683]: FIRMWARE:
Oct 16 11:17:50 user nova-compute[74683]: No targets found.
Oct 16 11:17:50 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 11:17:50 user nova-compute[74683]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 11:17:50 user nova-compute[74683]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74683) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b', 0)] {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd53f54f-04ad-420f-aabc-fd7de8298c7e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9ce923-df1b-425c-b4bf-ac9c559d856e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)
Oct 16 11:17:50 user nova-compute[74683]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)
Oct 16 11:17:50 user nova-compute[74683]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e (non-flash)
Oct 16 11:17:50 user nova-compute[74683]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:17:50 user nova-compute[74683]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)
Oct 16 11:17:50 user nova-compute[74683]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)
Oct 16 11:17:50 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:17:50 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)
Oct 16 11:17:50 user nova-compute[74683]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)
Oct 16 11:17:50 user nova-compute[74683]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e (non-flash)
Oct 16 11:17:50 user nova-compute[74683]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:17:50 user nova-compute[74683]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)
Oct 16 11:17:50 user nova-compute[74683]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)
Oct 16 11:17:50 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:17:50 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda4c7c5fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b'): ({'sdb'}, set())}) {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Removing single pathed devices sdb {{(pid=74683) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ec5731-524f-459e-81c1-ce06bf72eb08]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee6c955-69d0-4fcd-b5fd-58b6d9358e78]: (4, ('ok\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Flushing IO for device /dev/sdb {{(pid=74683) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c05b4e-ec67-47d5-acfe-83d7a138b88a]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74683) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ce1e2c-f1b9-49b8-8ff2-489435153ccd]: (4, ('1', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] SCSI volumes sdb have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b')] {{(pid=74683) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d60ae7d-335b-4fb0-8333-df04223da74d]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260 --logout {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f0872b-75ce-42bc-8eb1-212d64f70d4d]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b, portal: 172.16.0.220,3260]
Oct 16 11:17:50 user nova-compute[74683]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b, portal: 172.16.0.220,3260] successful.
Oct 16 11:17:50 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260 --op delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd30a1c-2c11-4374-8dfc-38601d163a7c]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.391s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] <== disconnect_volume: return (393ms) None {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Disconnected iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:50 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:51 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:51 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:17:51 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8_resize/disk /opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/disk {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:51 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:51 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:51 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] CMD "cp -r /opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8_resize/disk /opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/disk" returned: 0 in 0.363s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:51 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8_resize/disk.info /opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/disk.info {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:51 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] CMD "cp -r /opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8_resize/disk.info /opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/disk.info" returned: 0 in 0.033s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:52 user nova-compute[74683]: DEBUG nova.compute.manager [req-f87f508b-7ad5-4978-8244-765e6faccf9c req-69a182d4-02c9-4fc4-bd5e-4f970d07831b service nova] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Received event network-vif-plugged-dbbeadad-745e-4d28-a242-577b3197b079 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:17:52 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f87f508b-7ad5-4978-8244-765e6faccf9c req-69a182d4-02c9-4fc4-bd5e-4f970d07831b service nova] Acquiring lock "f192d1ec-311d-4a30-9766-361b27a8dae8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:17:52 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f87f508b-7ad5-4978-8244-765e6faccf9c req-69a182d4-02c9-4fc4-bd5e-4f970d07831b service nova] Lock "f192d1ec-311d-4a30-9766-361b27a8dae8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:17:52 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f87f508b-7ad5-4978-8244-765e6faccf9c req-69a182d4-02c9-4fc4-bd5e-4f970d07831b service nova] Lock "f192d1ec-311d-4a30-9766-361b27a8dae8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:17:52 user nova-compute[74683]: DEBUG nova.compute.manager [req-f87f508b-7ad5-4978-8244-765e6faccf9c req-69a182d4-02c9-4fc4-bd5e-4f970d07831b service nova] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] No waiting events found dispatching network-vif-plugged-dbbeadad-745e-4d28-a242-577b3197b079 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:17:52 user nova-compute[74683]: WARNING nova.compute.manager [req-f87f508b-7ad5-4978-8244-765e6faccf9c req-69a182d4-02c9-4fc4-bd5e-4f970d07831b service nova] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Received unexpected event network-vif-plugged-dbbeadad-745e-4d28-a242-577b3197b079 for instance with vm_state active and task_state resize_migrating.
Oct 16 11:17:53 user nova-compute[74683]: DEBUG nova.network.neutron [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Port dbbeadad-745e-4d28-a242-577b3197b079 binding to destination host user is already ACTIVE {{(pid=74683) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Oct 16 11:17:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Acquiring lock "f192d1ec-311d-4a30-9766-361b27a8dae8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:17:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Lock "f192d1ec-311d-4a30-9766-361b27a8dae8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:17:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Lock "f192d1ec-311d-4a30-9766-361b27a8dae8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:17:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Acquiring lock "refresh_cache-f192d1ec-311d-4a30-9766-361b27a8dae8" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:17:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Acquired lock "refresh_cache-f192d1ec-311d-4a30-9766-361b27a8dae8" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:17:53 user nova-compute[74683]: DEBUG nova.network.neutron [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:17:53 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:53 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:53 user nova-compute[74683]: DEBUG nova.network.neutron [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Updating instance_info_cache with network_info: [{"id": "dbbeadad-745e-4d28-a242-577b3197b079", "address": "fa:16:3e:2b:14:bf", "network": {"id": "33f5edce-0901-42ea-b07a-47da2819b133", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-117849665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d7573bebfe47e3989f8eedd90dee6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbbeadad-74", "ovs_interfaceid": "dbbeadad-745e-4d28-a242-577b3197b079", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:17:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Releasing lock "refresh_cache-f192d1ec-311d-4a30-9766-361b27a8dae8" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:17:53 user nova-compute[74683]: DEBUG os_brick.utils [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:17:53 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:53 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:53 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb206c3a-8a2e-4aca-995c-d5b61b1bd1c6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:70b9d336ab7d\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:53 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:53 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:53 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[0139572b-d0e8-4f05-b2c9-f2f40a256cb1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:53 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:53 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:17:53 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2c9bbc-cffd-4d32-8832-6fd689c839a9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:53 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d232d60-6a1f-4dc5-9f36-0acc46226bfe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:53 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Running cmd (subprocess): nvme version {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:53 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] 'nvme version' failed. Not Retrying. {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:17:53 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] nvme not present on system {{(pid=74683) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 11:17:53 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:17:53 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:17:53 user nova-compute[74683]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 11:17:53 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d88b42-c3e7-4662-a010-18f8ba9bcfaf]: (4, '') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:17:53 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74683) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 11:17:53 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 11:17:53 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] LIGHTOS: no hostnqn found. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 11:17:53 user nova-compute[74683]: DEBUG os_brick.utils [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:70b9d336ab7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:17:55 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:59 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:17:59 user nova-compute[74683]: INFO nova.compute.manager [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Rescuing
Oct 16 11:17:59 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Acquiring lock "refresh_cache-d5e55361-d9ed-4d07-91b0-ec4d08b2e817" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:17:59 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Acquired lock "refresh_cache-d5e55361-d9ed-4d07-91b0-ec4d08b2e817" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:17:59 user nova-compute[74683]: DEBUG nova.network.neutron [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:17:59 user nova-compute[74683]: DEBUG nova.network.neutron [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Updating instance_info_cache with network_info: [{"id": "ade44b63-49bb-4dbc-b0f9-95156f4fd6db", "address": "fa:16:3e:ad:0a:5c", "network": {"id": "4d43cc12-d2cd-4552-90a4-884a0ff3dc66", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-825513246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6e0046017b4bba85caf2a39d1c67b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade44b63-49", "ovs_interfaceid": "ade44b63-49bb-4dbc-b0f9-95156f4fd6db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:18:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Releasing lock "refresh_cache-d5e55361-d9ed-4d07-91b0-ec4d08b2e817" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:18:00 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:00 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:00 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:00 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:00 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:00 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Instance destroyed successfully.
Oct 16 11:18:00 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Attempting a stable device rescue
Oct 16 11:18:01 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74683) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 16 11:18:01 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Instance directory exists: not creating {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 16 11:18:01 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Creating image(s)
Oct 16 11:18:01 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Acquiring lock "/opt/stack/data/nova/instances/d5e55361-d9ed-4d07-91b0-ec4d08b2e817/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:18:01 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "/opt/stack/data/nova/instances/d5e55361-d9ed-4d07-91b0-ec4d08b2e817/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:18:01 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "/opt/stack/data/nova/instances/d5e55361-d9ed-4d07-91b0-ec4d08b2e817/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:18:01 user nova-compute[74683]: DEBUG nova.objects.instance [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lazy-loading 'trusted_certs' on Instance uuid d5e55361-d9ed-4d07-91b0-ec4d08b2e817 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:18:01 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Acquiring lock "b6761ea8a845e7d7245c24089ba0178f468f718a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:18:01 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "b6761ea8a845e7d7245c24089ba0178f468f718a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:18:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6761ea8a845e7d7245c24089ba0178f468f718a.part --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:02 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6761ea8a845e7d7245c24089ba0178f468f718a.part --force-share --output=json" returned: 0 in 0.229s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:02 user nova-compute[74683]: DEBUG nova.virt.images [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] b9e618f3-cad0-426a-9513-330870cc0a59 was qcow2, converting to raw {{(pid=74683) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 16 11:18:02 user nova-compute[74683]: DEBUG nova.privsep.utils [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74683) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 11:18:02 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b6761ea8a845e7d7245c24089ba0178f468f718a.part /opt/stack/data/nova/instances/_base/b6761ea8a845e7d7245c24089ba0178f468f718a.converted {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:02 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b6761ea8a845e7d7245c24089ba0178f468f718a.part /opt/stack/data/nova/instances/_base/b6761ea8a845e7d7245c24089ba0178f468f718a.converted" returned: 0 in 0.315s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:02 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6761ea8a845e7d7245c24089ba0178f468f718a.converted --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:02 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6761ea8a845e7d7245c24089ba0178f468f718a.converted --force-share --output=json" returned: 0 in 0.257s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "b6761ea8a845e7d7245c24089ba0178f468f718a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.766s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:18:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Acquiring lock "b6761ea8a845e7d7245c24089ba0178f468f718a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:18:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "b6761ea8a845e7d7245c24089ba0178f468f718a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:18:02 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6761ea8a845e7d7245c24089ba0178f468f718a --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6761ea8a845e7d7245c24089ba0178f468f718a --force-share --output=json" returned: 0 in 0.210s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6761ea8a845e7d7245c24089ba0178f468f718a,backing_fmt=raw /opt/stack/data/nova/instances/d5e55361-d9ed-4d07-91b0-ec4d08b2e817/disk.rescue {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6761ea8a845e7d7245c24089ba0178f468f718a,backing_fmt=raw /opt/stack/data/nova/instances/d5e55361-d9ed-4d07-91b0-ec4d08b2e817/disk.rescue" returned: 0 in 0.059s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "b6761ea8a845e7d7245c24089ba0178f468f718a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG nova.objects.instance [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lazy-loading 'migration_context' on Instance uuid d5e55361-d9ed-4d07-91b0-ec4d08b2e817 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG nova.objects.base [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Object Instance<d5e55361-d9ed-4d07-91b0-ec4d08b2e817> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Created local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Start _get_guest_xml network_info=[{"id": "ade44b63-49bb-4dbc-b0f9-95156f4fd6db", "address": "fa:16:3e:ad:0a:5c", "network": {"id": "4d43cc12-d2cd-4552-90a4-884a0ff3dc66", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-825513246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-825513246-network", "vif_mac": "fa:16:3e:ad:0a:5c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6e0046017b4bba85caf2a39d1c67b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade44b63-49", "ovs_interfaceid": "ade44b63-49bb-4dbc-b0f9-95156f4fd6db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b9e618f3-cad0-426a-9513-330870cc0a59', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yuvqsfmL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'd5e55361-d9ed-4d07-91b0-ec4d08b2e817', 'attached_at': '', 'detached_at': '', 'volume_id': 'c6adf91a-024f-493b-9a81-eef3c4ca39fb', 'serial': 'c6adf91a-024f-493b-9a81-eef3c4ca39fb'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': 'fcfb98c2-7940-46d6-bebd-29de6b15f199', 'volume_type': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG nova.objects.instance [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lazy-loading 'resources' on Instance uuid d5e55361-d9ed-4d07-91b0-ec4d08b2e817 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG nova.objects.base [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Object Instance<d5e55361-d9ed-4d07-91b0-ec4d08b2e817> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG nova.objects.instance [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lazy-loading 'numa_topology' on Instance uuid d5e55361-d9ed-4d07-91b0-ec4d08b2e817 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG nova.objects.base [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Object Instance<d5e55361-d9ed-4d07-91b0-ec4d08b2e817> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:18:03 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:18:03 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:18:03 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG nova.objects.instance [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lazy-loading 'vcpu_model' on Instance uuid d5e55361-d9ed-4d07-91b0-ec4d08b2e817 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG nova.objects.base [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Object Instance<d5e55361-d9ed-4d07-91b0-ec4d08b2e817> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Calling os-brick to attach iSCSI Volume {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yuvqsfmL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:18:03 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:18:03 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:18:03 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:18:03 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:18:03 user nova-compute[74683]: INFO os_brick.initiator.connectors.iscsi [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 11:18:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb -p 172.16.0.220:3260 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e4bc8f-7221-4d73-84f2-72cdf8f69e54]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = yuvqsfmL\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 16 11:18:03 user nova-compute[74683]: node.name = iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb
Oct 16 11:18:03 user nova-compute[74683]: node.tpgt = -1
Oct 16 11:18:03 user nova-compute[74683]: node.startup = automatic
Oct 16 11:18:03 user nova-compute[74683]: node.leading_login = No
Oct 16 11:18:03 user nova-compute[74683]: iface.iscsi_ifacename = default
Oct 16 11:18:03 user nova-compute[74683]: iface.net_ifacename = <empty>
Oct 16 11:18:03 user nova-compute[74683]: iface.ipaddress = <empty>
Oct 16 11:18:03 user nova-compute[74683]: iface.prefix_len = 0
Oct 16 11:18:03 user nova-compute[74683]: iface.hwaddress = <empty>
Oct 16 11:18:03 user nova-compute[74683]: iface.transport_name = tcp
Oct 16 11:18:03 user nova-compute[74683]: iface.initiatorname = <empty>
Oct 16 11:18:03 user nova-compute[74683]: iface.state = <empty>
Oct 16 11:18:03 user nova-compute[74683]: iface.vlan_id = 0
Oct 16 11:18:03 user nova-compute[74683]: iface.vlan_priority = 0
Oct 16 11:18:03 user nova-compute[74683]: iface.vlan_state = <empty>
Oct 16 11:18:03 user nova-compute[74683]: iface.iface_num = 0
Oct 16 11:18:03 user nova-compute[74683]: iface.mtu = 0
Oct 16 11:18:03 user nova-compute[74683]: iface.port = 0
Oct 16 11:18:03 user nova-compute[74683]: iface.bootproto = <empty>
Oct 16 11:18:03 user nova-compute[74683]: iface.subnet_mask = <empty>
Oct 16 11:18:03 user nova-compute[74683]: iface.gateway = <empty>
Oct 16 11:18:03 user nova-compute[74683]: iface.dhcp_alt_client_id_state = <empty>
Oct 16 11:18:03 user nova-compute[74683]: iface.dhcp_alt_client_id = <empty>
Oct 16 11:18:03 user nova-compute[74683]: iface.dhcp_dns = <empty>
Oct 16 11:18:03 user nova-compute[74683]: iface.dhcp_learn_iqn = <empty>
Oct 16 11:18:03 user nova-compute[74683]: iface.dhcp_req_vendor_id_state = <empty>
Oct 16 11:18:03 user nova-compute[74683]: iface.dhcp_vendor_id_state = <empty>
Oct 16 11:18:03 user nova-compute[74683]: iface.dhcp_vendor_id = <empty>
Oct 16 11:18:03 user nova-compute[74683]: iface.dhcp_slp_da = <empty>
Oct 16 11:18:03 user nova-compute[74683]: iface.fragmentation = <empty>
Oct 16 11:18:03 user nova-compute[74683]: iface.gratuitous_arp = <empty>
Oct 16 11:18:03 user nova-compute[74683]: iface.incoming_forwarding = <empty>
Oct 16 11:18:03 user nova-compute[74683]: iface.tos_state = <empty>
Oct 16 11:18:03 user nova-compute[74683]: iface.tos = 0
Oct 16 11:18:03 user nova-compute[74683]: iface.ttl = 0
Oct 16 11:18:03 user nova-compute[74683]: iface.delayed_ack = <empty>
Oct 16 11:18:03 user nova-compute[74683]: iface.tcp_nagle = <empty>
Oct 16 11:18:03 user nova-compute[74683]: iface.tcp_wsf_state = <empty>
Oct 16 11:18:03 user nova-compute[74683]: iface.tcp_wsf = 0
Oct 16 11:18:03 user nova-compute[74683]: iface.tcp_timer_scale = 0
Oct 16 11:18:03 user nova-compute[74683]: iface.tcp_timestamp = <empty>
Oct 16 11:18:03 user nova-compute[74683]: iface.redirect = <empty>
Oct 16 11:18:03 user nova-compute[74683]: iface.def_task_mgmt_timeout = 0
Oct 16 11:18:03 user nova-compute[74683]: iface.header_digest = <empty>
Oct 16 11:18:03 user nova-compute[74683]: iface.data_digest = <empty>
Oct 16 11:18:03 user nova-compute[74683]: iface.immediate_data = <empty>
Oct 16 11:18:03 user nova-compute[74683]: iface.initial_r2t = <empty>
Oct 16 11:18:03 user nova-compute[74683]: iface.data_seq_inorder = <empty>
Oct 16 11:18:03 user nova-compute[74683]: iface.data_pdu_inorder = <empty>
Oct 16 11:18:03 user nova-compute[74683]: iface.erl = 0
Oct 16 11:18:03 user nova-compute[74683]: iface.max_receive_data_len = 0
Oct 16 11:18:03 user nova-compute[74683]: iface.first_burst_len = 0
Oct 16 11:18:03 user nova-compute[74683]: iface.max_outstanding_r2t = 0
Oct 16 11:18:03 user nova-compute[74683]: iface.max_burst_len = 0
Oct 16 11:18:03 user nova-compute[74683]: iface.chap_auth = <empty>
Oct 16 11:18:03 user nova-compute[74683]: iface.bidi_chap = <empty>
Oct 16 11:18:03 user nova-compute[74683]: iface.strict_login_compliance = <empty>
Oct 16 11:18:03 user nova-compute[74683]: iface.discovery_auth = <empty>
Oct 16 11:18:03 user nova-compute[74683]: iface.discovery_logout = <empty>
Oct 16 11:18:03 user nova-compute[74683]: node.discovery_address = <empty>
Oct 16 11:18:03 user nova-compute[74683]: node.discovery_port = 0
Oct 16 11:18:03 user nova-compute[74683]: node.discovery_type = static
Oct 16 11:18:03 user nova-compute[74683]: node.session.initial_cmdsn = 0
Oct 16 11:18:03 user nova-compute[74683]: node.session.initial_login_retry_max = 8
Oct 16 11:18:03 user nova-compute[74683]: node.session.xmit_thread_priority = -20
Oct 16 11:18:03 user nova-compute[74683]: node.session.cmds_max = 128
Oct 16 11:18:03 user nova-compute[74683]: node.session.queue_depth = 32
Oct 16 11:18:03 user nova-compute[74683]: node.session.nr_sessions = 1
Oct 16 11:18:03 user nova-compute[74683]: node.session.auth.authmethod = CHAP
Oct 16 11:18:03 user nova-compute[74683]: node.session.auth.username = yuvqsfmL
Oct 16 11:18:03 user nova-compute[74683]: node.session.auth.password = ***
Oct 16 11:18:03 user nova-compute[74683]: node.session.auth.username_in = <empty>
Oct 16 11:18:03 user nova-compute[74683]: node.session.auth.password_in = <empty>
Oct 16 11:18:03 user nova-compute[74683]: node.session.auth.chap_algs = MD5
Oct 16 11:18:03 user nova-compute[74683]: node.session.timeo.replacement_timeout = 120
Oct 16 11:18:03 user nova-compute[74683]: node.session.err_timeo.abort_timeout = 15
Oct 16 11:18:03 user nova-compute[74683]: node.session.err_timeo.lu_reset_timeout = 30
Oct 16 11:18:03 user nova-compute[74683]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 16 11:18:03 user nova-compute[74683]: node.session.err_timeo.host_reset_timeout = 60
Oct 16 11:18:03 user nova-compute[74683]: node.session.iscsi.FastAbort = Yes
Oct 16 11:18:03 user nova-compute[74683]: node.session.iscsi.InitialR2T = No
Oct 16 11:18:03 user nova-compute[74683]: node.session.iscsi.ImmediateData = Yes
Oct 16 11:18:03 user nova-compute[74683]: node.session.iscsi.FirstBurstLength = 262144
Oct 16 11:18:03 user nova-compute[74683]: node.session.iscsi.MaxBurstLength = 16776192
Oct 16 11:18:03 user nova-compute[74683]: node.session.iscsi.DefaultTime2Retain = 0
Oct 16 11:18:03 user nova-compute[74683]: node.session.iscsi.DefaultTime2Wait = 2
Oct 16 11:18:03 user nova-compute[74683]: node.session.iscsi.MaxConnections = 1
Oct 16 11:18:03 user nova-compute[74683]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 16 11:18:03 user nova-compute[74683]: node.session.iscsi.ERL = 0
Oct 16 11:18:03 user nova-compute[74683]: node.session.scan = manual
Oct 16 11:18:03 user nova-compute[74683]: node.session.reopen_max = 0
Oct 16 11:18:03 user nova-compute[74683]: node.conn[0].address = 172.16.0.220
Oct 16 11:18:03 user nova-compute[74683]: node.conn[0].port = 3260
Oct 16 11:18:03 user nova-compute[74683]: node.conn[0].startup = manual
Oct 16 11:18:03 user nova-compute[74683]: node.conn[0].tcp.window_size = 524288
Oct 16 11:18:03 user nova-compute[74683]: node.conn[0].tcp.type_of_service = 0
Oct 16 11:18:03 user nova-compute[74683]: node.conn[0].timeo.logout_timeout = 15
Oct 16 11:18:03 user nova-compute[74683]: node.conn[0].timeo.login_timeout = 15
Oct 16 11:18:03 user nova-compute[74683]: node.conn[0].timeo.auth_timeout = 45
Oct 16 11:18:03 user nova-compute[74683]: node.conn[0].timeo.noop_out_interval = 5
Oct 16 11:18:03 user nova-compute[74683]: node.conn[0].timeo.noop_out_timeout = 5
Oct 16 11:18:03 user nova-compute[74683]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 16 11:18:03 user nova-compute[74683]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 16 11:18:03 user nova-compute[74683]: node.conn[0].iscsi.HeaderDigest = None
Oct 16 11:18:03 user nova-compute[74683]: node.conn[0].iscsi.DataDigest = None
Oct 16 11:18:03 user nova-compute[74683]: node.conn[0].iscsi.IFMarker = No
Oct 16 11:18:03 user nova-compute[74683]: node.conn[0].iscsi.OFMarker = No
Oct 16 11:18:03 user nova-compute[74683]: # END RECORD
Oct 16 11:18:03 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e7c8abb-1bec-4664-aaf4-9faf4f3bb8a9]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09cd7e8-356a-4cc2-a5dc-6e660a11ba38]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yuvqsfmL {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yuvqsfmL" returned: 0 in 0.025s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[68decbac-c582-4f0f-b25e-cc5547ba8dc0]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yuvqsfmL'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[27dc0e55-018c-45b2-b832-52b0113ab9a8]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fdee6d0-c974-4615-8d02-028f8cf6d9b0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)
Oct 16 11:18:03 user nova-compute[74683]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)
Oct 16 11:18:03 user nova-compute[74683]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e (non-flash)
Oct 16 11:18:03 user nova-compute[74683]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:18:03 user nova-compute[74683]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)
Oct 16 11:18:03 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:18:03 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)
Oct 16 11:18:03 user nova-compute[74683]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)
Oct 16 11:18:03 user nova-compute[74683]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e (non-flash)
Oct 16 11:18:03 user nova-compute[74683]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:18:03 user nova-compute[74683]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)
Oct 16 11:18:03 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:18:03 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.200s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Connected to 172.16.0.220:3260 {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] HCTL ('37', '0', '0', 0) found on session 13 with lun 0 {{(pid=74683) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=74683) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb27968-bea9-454b-beac-0a22bbb7e3fd]: (4, ('0 0 0', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Searching for a device in session 13 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yuvqsfmL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.229s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] <== connect_volume: return (230ms) {'type': 'block', 'scsi_wwn': '26164646534383662', 'path': '/dev/sdf'} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26164646534383662', 'path': '/dev/sdf'} {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:16:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1230353272',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1230353272',id=12,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:16:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d6e0046017b4bba85caf2a39d1c67b3',ramdisk_id='',reservation_id='r-ve22na1w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1787816377',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:16:51Z,user_data=None,user_id='76a41804541e4a259771702727d9993e',uuid=d5e55361-d9ed-4d07-91b0-ec4d08b2e817,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ade44b63-49bb-4dbc-b0f9-95156f4fd6db", "address": "fa:16:3e:ad:0a:5c", "network": {"id": "4d43cc12-d2cd-4552-90a4-884a0ff3dc66", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-825513246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-825513246-network", "vif_mac": "fa:16:3e:ad:0a:5c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6e0046017b4bba85caf2a39d1c67b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade44b63-49", "ovs_interfaceid": "ade44b63-49bb-4dbc-b0f9-95156f4fd6db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Converting VIF {"id": "ade44b63-49bb-4dbc-b0f9-95156f4fd6db", "address": "fa:16:3e:ad:0a:5c", "network": {"id": "4d43cc12-d2cd-4552-90a4-884a0ff3dc66", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-825513246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-825513246-network", "vif_mac": "fa:16:3e:ad:0a:5c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6e0046017b4bba85caf2a39d1c67b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade44b63-49", "ovs_interfaceid": "ade44b63-49bb-4dbc-b0f9-95156f4fd6db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ad:0a:5c,bridge_name='br-int',has_traffic_filtering=True,id=ade44b63-49bb-4dbc-b0f9-95156f4fd6db,network=Network(4d43cc12-d2cd-4552-90a4-884a0ff3dc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapade44b63-49') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG nova.objects.instance [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lazy-loading 'pci_devices' on Instance uuid d5e55361-d9ed-4d07-91b0-ec4d08b2e817 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Acquiring lock "45ca3cbb-53d6-4046-9be3-92cc6b71bfad" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lock "45ca3cbb-53d6-4046-9be3-92cc6b71bfad" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG nova.objects.base [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Object Instance<d5e55361-d9ed-4d07-91b0-ec4d08b2e817> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:18:03 user nova-compute[74683]:   <uuid>d5e55361-d9ed-4d07-91b0-ec4d08b2e817</uuid>
Oct 16 11:18:03 user nova-compute[74683]:   <name>instance-0000000c</name>
Oct 16 11:18:03 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:18:03 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:18:03 user nova-compute[74683]:   <metadata>
Oct 16 11:18:03 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:18:03 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:18:03 user nova-compute[74683]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1230353272</nova:name>
Oct 16 11:18:03 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:18:03</nova:creationTime>
Oct 16 11:18:03 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:18:03 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:18:03 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:18:03 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:18:03 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:18:03 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:18:03 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:18:03 user nova-compute[74683]:       <nova:owner>
Oct 16 11:18:03 user nova-compute[74683]:         <nova:user uuid="76a41804541e4a259771702727d9993e">tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member</nova:user>
Oct 16 11:18:03 user nova-compute[74683]:         <nova:project uuid="4d6e0046017b4bba85caf2a39d1c67b3">tempest-ServerBootFromVolumeStableRescueTest-1787816377</nova:project>
Oct 16 11:18:03 user nova-compute[74683]:       </nova:owner>
Oct 16 11:18:03 user nova-compute[74683]:       <nova:root type="image" uuid="0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f"/>
Oct 16 11:18:03 user nova-compute[74683]:       <nova:ports>
Oct 16 11:18:03 user nova-compute[74683]:         <nova:port uuid="ade44b63-49bb-4dbc-b0f9-95156f4fd6db">
Oct 16 11:18:03 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 16 11:18:03 user nova-compute[74683]:         </nova:port>
Oct 16 11:18:03 user nova-compute[74683]:       </nova:ports>
Oct 16 11:18:03 user nova-compute[74683]:     </nova:instance>
Oct 16 11:18:03 user nova-compute[74683]:   </metadata>
Oct 16 11:18:03 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:18:03 user nova-compute[74683]:     <system>
Oct 16 11:18:03 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:18:03 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:18:03 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:18:03 user nova-compute[74683]:       <entry name="serial">d5e55361-d9ed-4d07-91b0-ec4d08b2e817</entry>
Oct 16 11:18:03 user nova-compute[74683]:       <entry name="uuid">d5e55361-d9ed-4d07-91b0-ec4d08b2e817</entry>
Oct 16 11:18:03 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:18:03 user nova-compute[74683]:     </system>
Oct 16 11:18:03 user nova-compute[74683]:   </sysinfo>
Oct 16 11:18:03 user nova-compute[74683]:   <os>
Oct 16 11:18:03 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:18:03 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:18:03 user nova-compute[74683]:   </os>
Oct 16 11:18:03 user nova-compute[74683]:   <features>
Oct 16 11:18:03 user nova-compute[74683]:     <acpi/>
Oct 16 11:18:03 user nova-compute[74683]:     <apic/>
Oct 16 11:18:03 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:18:03 user nova-compute[74683]:   </features>
Oct 16 11:18:03 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:18:03 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:18:03 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:18:03 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:18:03 user nova-compute[74683]:   </clock>
Oct 16 11:18:03 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:18:03 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:18:03 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:18:03 user nova-compute[74683]:   </cpu>
Oct 16 11:18:03 user nova-compute[74683]:   <devices>
Oct 16 11:18:03 user nova-compute[74683]:     <disk type="block" device="disk">
Oct 16 11:18:03 user nova-compute[74683]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:18:03 user nova-compute[74683]:       <source dev="/dev/sdf"/>
Oct 16 11:18:03 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:18:03 user nova-compute[74683]:       <serial>c6adf91a-024f-493b-9a81-eef3c4ca39fb</serial>
Oct 16 11:18:03 user nova-compute[74683]:     </disk>
Oct 16 11:18:03 user nova-compute[74683]:     <disk type="file" device="disk">
Oct 16 11:18:03 user nova-compute[74683]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 11:18:03 user nova-compute[74683]:       <source file="/opt/stack/data/nova/instances/d5e55361-d9ed-4d07-91b0-ec4d08b2e817/disk.rescue"/>
Oct 16 11:18:03 user nova-compute[74683]:       <target dev="vdb" bus="virtio"/>
Oct 16 11:18:03 user nova-compute[74683]:       <boot order="1"/>
Oct 16 11:18:03 user nova-compute[74683]:     </disk>
Oct 16 11:18:03 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:18:03 user nova-compute[74683]:       <mac address="fa:16:3e:ad:0a:5c"/>
Oct 16 11:18:03 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:18:03 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:18:03 user nova-compute[74683]:       <target dev="tapade44b63-49"/>
Oct 16 11:18:03 user nova-compute[74683]:     </interface>
Oct 16 11:18:03 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:18:03 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/d5e55361-d9ed-4d07-91b0-ec4d08b2e817/console.log" append="off"/>
Oct 16 11:18:03 user nova-compute[74683]:     </serial>
Oct 16 11:18:03 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:18:03 user nova-compute[74683]:     <video>
Oct 16 11:18:03 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:18:03 user nova-compute[74683]:     </video>
Oct 16 11:18:03 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:18:03 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:18:03 user nova-compute[74683]:     </rng>
Oct 16 11:18:03 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:18:03 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:18:03 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:18:03 user nova-compute[74683]:     </memballoon>
Oct 16 11:18:03 user nova-compute[74683]:   </devices>
Oct 16 11:18:03 user nova-compute[74683]: </domain>
Oct 16 11:18:03 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74683) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 11:18:03 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Instance destroyed successfully.
Oct 16 11:18:03 user nova-compute[74683]: DEBUG nova.compute.manager [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Starting instance... {{(pid=74683) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] No VIF found with MAC fa:16:3e:ad:0a:5c, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Starting heal instance info cache {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74683) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 11:18:03 user nova-compute[74683]: INFO nova.compute.claims [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Claim successful on node user
Oct 16 11:18:03 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "refresh_cache-2f1db5e2-0b25-4d61-9dd3-038811b4eda1" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquired lock "refresh_cache-2f1db5e2-0b25-4d61-9dd3-038811b4eda1" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:18:03 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Forcefully refreshing network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 11:18:04 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:18:04 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:18:04 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.581s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:18:04 user nova-compute[74683]: DEBUG nova.compute.manager [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Start building networks asynchronously for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 11:18:04 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Updating instance_info_cache with network_info: [{"id": "9476563e-0758-43d9-b920-87f412881869", "address": "fa:16:3e:18:cc:d6", "network": {"id": "5a04a566-92ef-4300-976b-5c34656ec9c7", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-706076145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "207a79fe27c042d8b081272246b98245", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9476563e-07", "ovs_interfaceid": "9476563e-0758-43d9-b920-87f412881869", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:18:04 user nova-compute[74683]: DEBUG nova.compute.manager [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Allocating IP information in the background. {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 11:18:04 user nova-compute[74683]: DEBUG nova.network.neutron [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] allocate_for_instance() {{(pid=74683) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 11:18:04 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Releasing lock "refresh_cache-2f1db5e2-0b25-4d61-9dd3-038811b4eda1" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:18:04 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Updated the network info_cache for instance {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 11:18:04 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 11:18:04 user nova-compute[74683]: DEBUG nova.compute.manager [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Start building block device mappings for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 11:18:04 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:18:04 user nova-compute[74683]: DEBUG nova.policy [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ff1b11c3ed3b4ffdbe6a3feada64f5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377cd8de2ae042938a9072f64567a911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74683) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 11:18:04 user nova-compute[74683]: DEBUG nova.compute.manager [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Start spawning the instance on the hypervisor. {{(pid=74683) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 11:18:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Creating instance directory {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 11:18:04 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Creating image(s)
Oct 16 11:18:04 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Acquiring lock "/opt/stack/data/nova/instances/45ca3cbb-53d6-4046-9be3-92cc6b71bfad/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:18:04 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lock "/opt/stack/data/nova/instances/45ca3cbb-53d6-4046-9be3-92cc6b71bfad/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:18:04 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lock "/opt/stack/data/nova/instances/45ca3cbb-53d6-4046-9be3-92cc6b71bfad/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:18:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.202s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:05 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Acquiring lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:18:05 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:18:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.213s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/45ca3cbb-53d6-4046-9be3-92cc6b71bfad/disk 1073741824 {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:05 user nova-compute[74683]: DEBUG nova.compute.manager [req-95822fc3-107d-4b6d-bb49-cf70d2b33461 req-d34257bc-5660-4baa-be61-cf7b9e01d607 service nova] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Received event network-vif-unplugged-ade44b63-49bb-4dbc-b0f9-95156f4fd6db {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:18:05 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-95822fc3-107d-4b6d-bb49-cf70d2b33461 req-d34257bc-5660-4baa-be61-cf7b9e01d607 service nova] Acquiring lock "d5e55361-d9ed-4d07-91b0-ec4d08b2e817-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:18:05 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-95822fc3-107d-4b6d-bb49-cf70d2b33461 req-d34257bc-5660-4baa-be61-cf7b9e01d607 service nova] Lock "d5e55361-d9ed-4d07-91b0-ec4d08b2e817-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:18:05 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-95822fc3-107d-4b6d-bb49-cf70d2b33461 req-d34257bc-5660-4baa-be61-cf7b9e01d607 service nova] Lock "d5e55361-d9ed-4d07-91b0-ec4d08b2e817-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:18:05 user nova-compute[74683]: DEBUG nova.compute.manager [req-95822fc3-107d-4b6d-bb49-cf70d2b33461 req-d34257bc-5660-4baa-be61-cf7b9e01d607 service nova] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] No waiting events found dispatching network-vif-unplugged-ade44b63-49bb-4dbc-b0f9-95156f4fd6db {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:18:05 user nova-compute[74683]: WARNING nova.compute.manager [req-95822fc3-107d-4b6d-bb49-cf70d2b33461 req-d34257bc-5660-4baa-be61-cf7b9e01d607 service nova] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Received unexpected event network-vif-unplugged-ade44b63-49bb-4dbc-b0f9-95156f4fd6db for instance with vm_state active and task_state rescuing.
Oct 16 11:18:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/45ca3cbb-53d6-4046-9be3-92cc6b71bfad/disk 1073741824" returned: 0 in 0.091s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:05 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.310s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:18:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.192s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:05 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Checking if we can resize image /opt/stack/data/nova/instances/45ca3cbb-53d6-4046-9be3-92cc6b71bfad/disk. size=1073741824 {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 11:18:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45ca3cbb-53d6-4046-9be3-92cc6b71bfad/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:05 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:18:05 user nova-compute[74683]: DEBUG nova.network.neutron [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Successfully created port: 28029fd9-7463-4b6a-8dc9-c47993f71bb5 {{(pid=74683) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 11:18:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45ca3cbb-53d6-4046-9be3-92cc6b71bfad/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:05 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Cannot resize image /opt/stack/data/nova/instances/45ca3cbb-53d6-4046-9be3-92cc6b71bfad/disk to a smaller size. {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 11:18:05 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Created local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 11:18:05 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Ensure instance console log exists: /opt/stack/data/nova/instances/45ca3cbb-53d6-4046-9be3-92cc6b71bfad/console.log {{(pid=74683) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 11:18:05 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:18:05 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:18:05 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:18:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:06 user nova-compute[74683]: DEBUG nova.network.neutron [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Successfully updated port: 28029fd9-7463-4b6a-8dc9-c47993f71bb5 {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:18:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Acquiring lock "refresh_cache-45ca3cbb-53d6-4046-9be3-92cc6b71bfad" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:18:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Acquired lock "refresh_cache-45ca3cbb-53d6-4046-9be3-92cc6b71bfad" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:18:06 user nova-compute[74683]: DEBUG nova.network.neutron [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:18:06 user nova-compute[74683]: DEBUG nova.compute.manager [req-1649ca4e-3315-410d-af7f-6ff55e003440 req-d15fdb4c-0639-4c8b-9e16-f240e0dd5635 service nova] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Received event network-changed-28029fd9-7463-4b6a-8dc9-c47993f71bb5 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:18:06 user nova-compute[74683]: DEBUG nova.compute.manager [req-1649ca4e-3315-410d-af7f-6ff55e003440 req-d15fdb4c-0639-4c8b-9e16-f240e0dd5635 service nova] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Refreshing instance network info cache due to event network-changed-28029fd9-7463-4b6a-8dc9-c47993f71bb5. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:18:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-1649ca4e-3315-410d-af7f-6ff55e003440 req-d15fdb4c-0639-4c8b-9e16-f240e0dd5635 service nova] Acquiring lock "refresh_cache-45ca3cbb-53d6-4046-9be3-92cc6b71bfad" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:18:06 user nova-compute[74683]: DEBUG nova.network.neutron [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:18:06 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:18:06 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:18:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:18:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:18:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:18:06 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Auditing locally available compute resources for user (node: user) {{(pid=74683) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 11:18:06 user nova-compute[74683]: DEBUG nova.network.neutron [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Updating instance_info_cache with network_info: [{"id": "28029fd9-7463-4b6a-8dc9-c47993f71bb5", "address": "fa:16:3e:fd:e5:2b", "network": {"id": "76ba31b5-c467-45e4-ae9a-111f41fd62a3", "bridge": "br-int", "label": "tempest-TestStampPattern-2049888281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "377cd8de2ae042938a9072f64567a911", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28029fd9-74", "ovs_interfaceid": "28029fd9-7463-4b6a-8dc9-c47993f71bb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:18:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Releasing lock "refresh_cache-45ca3cbb-53d6-4046-9be3-92cc6b71bfad" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:18:06 user nova-compute[74683]: DEBUG nova.compute.manager [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Instance network_info: |[{"id": "28029fd9-7463-4b6a-8dc9-c47993f71bb5", "address": "fa:16:3e:fd:e5:2b", "network": {"id": "76ba31b5-c467-45e4-ae9a-111f41fd62a3", "bridge": "br-int", "label": "tempest-TestStampPattern-2049888281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "377cd8de2ae042938a9072f64567a911", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28029fd9-74", "ovs_interfaceid": "28029fd9-7463-4b6a-8dc9-c47993f71bb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 11:18:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-1649ca4e-3315-410d-af7f-6ff55e003440 req-d15fdb4c-0639-4c8b-9e16-f240e0dd5635 service nova] Acquired lock "refresh_cache-45ca3cbb-53d6-4046-9be3-92cc6b71bfad" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:18:06 user nova-compute[74683]: DEBUG nova.network.neutron [req-1649ca4e-3315-410d-af7f-6ff55e003440 req-d15fdb4c-0639-4c8b-9e16-f240e0dd5635 service nova] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Refreshing network info cache for port 28029fd9-7463-4b6a-8dc9-c47993f71bb5 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:18:06 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Start _get_guest_xml network_info=[{"id": "28029fd9-7463-4b6a-8dc9-c47993f71bb5", "address": "fa:16:3e:fd:e5:2b", "network": {"id": "76ba31b5-c467-45e4-ae9a-111f41fd62a3", "bridge": "br-int", "label": "tempest-TestStampPattern-2049888281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "377cd8de2ae042938a9072f64567a911", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28029fd9-74", "ovs_interfaceid": "28029fd9-7463-4b6a-8dc9-c47993f71bb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:18:06 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:18:06 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:18:06 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:18:06 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:18:06 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:18:06 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:18:06 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:18:06 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:18:06 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:18:06 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:18:06 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:18:06 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:18:06 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:18:06 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:18:06 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:18:06 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:18:06 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:18:06 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:18:06 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:18:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1861434879',display_name='tempest-TestStampPattern-server-1861434879',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1861434879',id=16,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFV+ROpInHshi5FjeDxPiEyFZ7Qvi9jeJ0//dAB7L9KvmXxPyMWLDkzIIO+4mTNqVHH1o36yJrMR626Ju/qnnIOZjnMoP87MpQ3Ptrg2AmfvntWHi+q/nHH1XQPsx2j/Gw==',key_name='tempest-TestStampPattern-1014736713',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='377cd8de2ae042938a9072f64567a911',ramdisk_id='',reservation_id='r-99kziqc0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1657953611',owner_user_name='tempest-TestStampPattern-1657953611-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:18:05Z,user_data=None,user_id='ff1b11c3ed3b4ffdbe6a3feada64f5ec',uuid=45ca3cbb-53d6-4046-9be3-92cc6b71bfad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28029fd9-7463-4b6a-8dc9-c47993f71bb5", "address": "fa:16:3e:fd:e5:2b", "network": {"id": "76ba31b5-c467-45e4-ae9a-111f41fd62a3", "bridge": "br-int", "label": "tempest-TestStampPattern-2049888281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "377cd8de2ae042938a9072f64567a911", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28029fd9-74", "ovs_interfaceid": "28029fd9-7463-4b6a-8dc9-c47993f71bb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:18:06 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Converting VIF {"id": "28029fd9-7463-4b6a-8dc9-c47993f71bb5", "address": "fa:16:3e:fd:e5:2b", "network": {"id": "76ba31b5-c467-45e4-ae9a-111f41fd62a3", "bridge": "br-int", "label": "tempest-TestStampPattern-2049888281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "377cd8de2ae042938a9072f64567a911", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28029fd9-74", "ovs_interfaceid": "28029fd9-7463-4b6a-8dc9-c47993f71bb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:18:06 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:e5:2b,bridge_name='br-int',has_traffic_filtering=True,id=28029fd9-7463-4b6a-8dc9-c47993f71bb5,network=Network(76ba31b5-c467-45e4-ae9a-111f41fd62a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28029fd9-74') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:18:06 user nova-compute[74683]: DEBUG nova.objects.instance [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lazy-loading 'pci_devices' on Instance uuid 45ca3cbb-53d6-4046-9be3-92cc6b71bfad {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:18:06 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:18:06 user nova-compute[74683]:   <uuid>45ca3cbb-53d6-4046-9be3-92cc6b71bfad</uuid>
Oct 16 11:18:06 user nova-compute[74683]:   <name>instance-00000010</name>
Oct 16 11:18:06 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:18:06 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:18:06 user nova-compute[74683]:   <metadata>
Oct 16 11:18:06 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:18:06 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:18:06 user nova-compute[74683]:       <nova:name>tempest-TestStampPattern-server-1861434879</nova:name>
Oct 16 11:18:06 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:18:06</nova:creationTime>
Oct 16 11:18:06 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:18:06 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:18:06 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:18:06 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:18:06 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:18:06 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:18:06 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:18:06 user nova-compute[74683]:       <nova:owner>
Oct 16 11:18:06 user nova-compute[74683]:         <nova:user uuid="ff1b11c3ed3b4ffdbe6a3feada64f5ec">tempest-TestStampPattern-1657953611-project-member</nova:user>
Oct 16 11:18:06 user nova-compute[74683]:         <nova:project uuid="377cd8de2ae042938a9072f64567a911">tempest-TestStampPattern-1657953611</nova:project>
Oct 16 11:18:06 user nova-compute[74683]:       </nova:owner>
Oct 16 11:18:06 user nova-compute[74683]:       <nova:root type="image" uuid="0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f"/>
Oct 16 11:18:06 user nova-compute[74683]:       <nova:ports>
Oct 16 11:18:06 user nova-compute[74683]:         <nova:port uuid="28029fd9-7463-4b6a-8dc9-c47993f71bb5">
Oct 16 11:18:06 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 16 11:18:06 user nova-compute[74683]:         </nova:port>
Oct 16 11:18:06 user nova-compute[74683]:       </nova:ports>
Oct 16 11:18:06 user nova-compute[74683]:     </nova:instance>
Oct 16 11:18:06 user nova-compute[74683]:   </metadata>
Oct 16 11:18:06 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:18:06 user nova-compute[74683]:     <system>
Oct 16 11:18:06 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:18:06 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:18:06 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:18:06 user nova-compute[74683]:       <entry name="serial">45ca3cbb-53d6-4046-9be3-92cc6b71bfad</entry>
Oct 16 11:18:06 user nova-compute[74683]:       <entry name="uuid">45ca3cbb-53d6-4046-9be3-92cc6b71bfad</entry>
Oct 16 11:18:06 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:18:06 user nova-compute[74683]:     </system>
Oct 16 11:18:06 user nova-compute[74683]:   </sysinfo>
Oct 16 11:18:06 user nova-compute[74683]:   <os>
Oct 16 11:18:06 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:18:06 user nova-compute[74683]:     <boot dev="hd"/>
Oct 16 11:18:06 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:18:06 user nova-compute[74683]:   </os>
Oct 16 11:18:06 user nova-compute[74683]:   <features>
Oct 16 11:18:06 user nova-compute[74683]:     <acpi/>
Oct 16 11:18:06 user nova-compute[74683]:     <apic/>
Oct 16 11:18:06 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:18:06 user nova-compute[74683]:   </features>
Oct 16 11:18:06 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:18:06 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:18:06 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:18:06 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:18:06 user nova-compute[74683]:   </clock>
Oct 16 11:18:06 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:18:06 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:18:06 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:18:06 user nova-compute[74683]:   </cpu>
Oct 16 11:18:06 user nova-compute[74683]:   <devices>
Oct 16 11:18:06 user nova-compute[74683]:     <disk type="file" device="disk">
Oct 16 11:18:06 user nova-compute[74683]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 11:18:06 user nova-compute[74683]:       <source file="/opt/stack/data/nova/instances/45ca3cbb-53d6-4046-9be3-92cc6b71bfad/disk"/>
Oct 16 11:18:06 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:18:06 user nova-compute[74683]:     </disk>
Oct 16 11:18:06 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:18:06 user nova-compute[74683]:       <mac address="fa:16:3e:fd:e5:2b"/>
Oct 16 11:18:06 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:18:06 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:18:06 user nova-compute[74683]:       <target dev="tap28029fd9-74"/>
Oct 16 11:18:06 user nova-compute[74683]:     </interface>
Oct 16 11:18:06 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:18:06 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/45ca3cbb-53d6-4046-9be3-92cc6b71bfad/console.log" append="off"/>
Oct 16 11:18:06 user nova-compute[74683]:     </serial>
Oct 16 11:18:06 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:18:06 user nova-compute[74683]:     <video>
Oct 16 11:18:06 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:18:06 user nova-compute[74683]:     </video>
Oct 16 11:18:06 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:18:06 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:18:06 user nova-compute[74683]:     </rng>
Oct 16 11:18:06 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:18:06 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:18:06 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:18:06 user nova-compute[74683]:     </memballoon>
Oct 16 11:18:06 user nova-compute[74683]:   </devices>
Oct 16 11:18:06 user nova-compute[74683]: </domain>
Oct 16 11:18:06 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:18:06 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:18:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1861434879',display_name='tempest-TestStampPattern-server-1861434879',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1861434879',id=16,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFV+ROpInHshi5FjeDxPiEyFZ7Qvi9jeJ0//dAB7L9KvmXxPyMWLDkzIIO+4mTNqVHH1o36yJrMR626Ju/qnnIOZjnMoP87MpQ3Ptrg2AmfvntWHi+q/nHH1XQPsx2j/Gw==',key_name='tempest-TestStampPattern-1014736713',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='377cd8de2ae042938a9072f64567a911',ramdisk_id='',reservation_id='r-99kziqc0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1657953611',owner_user_name='tempest-TestStampPattern-1657953611-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:18:05Z,user_data=None,user_id='ff1b11c3ed3b4ffdbe6a3feada64f5ec',uuid=45ca3cbb-53d6-4046-9be3-92cc6b71bfad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28029fd9-7463-4b6a-8dc9-c47993f71bb5", "address": "fa:16:3e:fd:e5:2b", "network": {"id": "76ba31b5-c467-45e4-ae9a-111f41fd62a3", "bridge": "br-int", "label": "tempest-TestStampPattern-2049888281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "377cd8de2ae042938a9072f64567a911", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28029fd9-74", "ovs_interfaceid": "28029fd9-7463-4b6a-8dc9-c47993f71bb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:18:06 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Converting VIF {"id": "28029fd9-7463-4b6a-8dc9-c47993f71bb5", "address": "fa:16:3e:fd:e5:2b", "network": {"id": "76ba31b5-c467-45e4-ae9a-111f41fd62a3", "bridge": "br-int", "label": "tempest-TestStampPattern-2049888281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "377cd8de2ae042938a9072f64567a911", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28029fd9-74", "ovs_interfaceid": "28029fd9-7463-4b6a-8dc9-c47993f71bb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:18:06 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:e5:2b,bridge_name='br-int',has_traffic_filtering=True,id=28029fd9-7463-4b6a-8dc9-c47993f71bb5,network=Network(76ba31b5-c467-45e4-ae9a-111f41fd62a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28029fd9-74') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:18:06 user nova-compute[74683]: DEBUG os_vif [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:e5:2b,bridge_name='br-int',has_traffic_filtering=True,id=28029fd9-7463-4b6a-8dc9-c47993f71bb5,network=Network(76ba31b5-c467-45e4-ae9a-111f41fd62a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28029fd9-74') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:18:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:18:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:18:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '75ff71b4-6f1a-50dd-a670-5ce1cd2e11d9', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:18:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:18:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap28029fd9-74, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:18:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap28029fd9-74, col_values=(('qos', UUID('89fe1731-c375-4efc-ae0b-107c6edc9270')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:18:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap28029fd9-74, col_values=(('external_ids', {'iface-id': '28029fd9-7463-4b6a-8dc9-c47993f71bb5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:e5:2b', 'vm-uuid': '45ca3cbb-53d6-4046-9be3-92cc6b71bfad'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:18:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:18:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:07 user nova-compute[74683]: INFO os_vif [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:e5:2b,bridge_name='br-int',has_traffic_filtering=True,id=28029fd9-7463-4b6a-8dc9-c47993f71bb5,network=Network(76ba31b5-c467-45e4-ae9a-111f41fd62a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28029fd9-74')
Oct 16 11:18:07 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:18:07 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] No VIF found with MAC fa:16:3e:fd:e5:2b, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:18:07 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:07 user nova-compute[74683]: DEBUG nova.network.neutron [req-1649ca4e-3315-410d-af7f-6ff55e003440 req-d15fdb4c-0639-4c8b-9e16-f240e0dd5635 service nova] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Updated VIF entry in instance network info cache for port 28029fd9-7463-4b6a-8dc9-c47993f71bb5. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:18:07 user nova-compute[74683]: DEBUG nova.network.neutron [req-1649ca4e-3315-410d-af7f-6ff55e003440 req-d15fdb4c-0639-4c8b-9e16-f240e0dd5635 service nova] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Updating instance_info_cache with network_info: [{"id": "28029fd9-7463-4b6a-8dc9-c47993f71bb5", "address": "fa:16:3e:fd:e5:2b", "network": {"id": "76ba31b5-c467-45e4-ae9a-111f41fd62a3", "bridge": "br-int", "label": "tempest-TestStampPattern-2049888281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "377cd8de2ae042938a9072f64567a911", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28029fd9-74", "ovs_interfaceid": "28029fd9-7463-4b6a-8dc9-c47993f71bb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:18:07 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:07 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-1649ca4e-3315-410d-af7f-6ff55e003440 req-d15fdb4c-0639-4c8b-9e16-f240e0dd5635 service nova] Releasing lock "refresh_cache-45ca3cbb-53d6-4046-9be3-92cc6b71bfad" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:18:07 user nova-compute[74683]: DEBUG nova.compute.manager [req-b0f6154b-37d2-45b6-ad4b-d8a08b0dc4f2 req-2baebe2d-72bb-498a-8d22-5a23cdcb5217 service nova] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Received event network-vif-plugged-ade44b63-49bb-4dbc-b0f9-95156f4fd6db {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:18:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b0f6154b-37d2-45b6-ad4b-d8a08b0dc4f2 req-2baebe2d-72bb-498a-8d22-5a23cdcb5217 service nova] Acquiring lock "d5e55361-d9ed-4d07-91b0-ec4d08b2e817-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:18:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b0f6154b-37d2-45b6-ad4b-d8a08b0dc4f2 req-2baebe2d-72bb-498a-8d22-5a23cdcb5217 service nova] Lock "d5e55361-d9ed-4d07-91b0-ec4d08b2e817-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:18:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b0f6154b-37d2-45b6-ad4b-d8a08b0dc4f2 req-2baebe2d-72bb-498a-8d22-5a23cdcb5217 service nova] Lock "d5e55361-d9ed-4d07-91b0-ec4d08b2e817-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:18:07 user nova-compute[74683]: DEBUG nova.compute.manager [req-b0f6154b-37d2-45b6-ad4b-d8a08b0dc4f2 req-2baebe2d-72bb-498a-8d22-5a23cdcb5217 service nova] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] No waiting events found dispatching network-vif-plugged-ade44b63-49bb-4dbc-b0f9-95156f4fd6db {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:18:07 user nova-compute[74683]: WARNING nova.compute.manager [req-b0f6154b-37d2-45b6-ad4b-d8a08b0dc4f2 req-2baebe2d-72bb-498a-8d22-5a23cdcb5217 service nova] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Received unexpected event network-vif-plugged-ade44b63-49bb-4dbc-b0f9-95156f4fd6db for instance with vm_state active and task_state rescuing.
Oct 16 11:18:07 user nova-compute[74683]: DEBUG nova.compute.manager [req-b0f6154b-37d2-45b6-ad4b-d8a08b0dc4f2 req-2baebe2d-72bb-498a-8d22-5a23cdcb5217 service nova] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Received event network-vif-plugged-ade44b63-49bb-4dbc-b0f9-95156f4fd6db {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:18:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b0f6154b-37d2-45b6-ad4b-d8a08b0dc4f2 req-2baebe2d-72bb-498a-8d22-5a23cdcb5217 service nova] Acquiring lock "d5e55361-d9ed-4d07-91b0-ec4d08b2e817-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:18:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b0f6154b-37d2-45b6-ad4b-d8a08b0dc4f2 req-2baebe2d-72bb-498a-8d22-5a23cdcb5217 service nova] Lock "d5e55361-d9ed-4d07-91b0-ec4d08b2e817-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:18:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b0f6154b-37d2-45b6-ad4b-d8a08b0dc4f2 req-2baebe2d-72bb-498a-8d22-5a23cdcb5217 service nova] Lock "d5e55361-d9ed-4d07-91b0-ec4d08b2e817-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:18:07 user nova-compute[74683]: DEBUG nova.compute.manager [req-b0f6154b-37d2-45b6-ad4b-d8a08b0dc4f2 req-2baebe2d-72bb-498a-8d22-5a23cdcb5217 service nova] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] No waiting events found dispatching network-vif-plugged-ade44b63-49bb-4dbc-b0f9-95156f4fd6db {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:18:07 user nova-compute[74683]: WARNING nova.compute.manager [req-b0f6154b-37d2-45b6-ad4b-d8a08b0dc4f2 req-2baebe2d-72bb-498a-8d22-5a23cdcb5217 service nova] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Received unexpected event network-vif-plugged-ade44b63-49bb-4dbc-b0f9-95156f4fd6db for instance with vm_state active and task_state rescuing.
Oct 16 11:18:07 user nova-compute[74683]: DEBUG nova.compute.manager [req-b0f6154b-37d2-45b6-ad4b-d8a08b0dc4f2 req-2baebe2d-72bb-498a-8d22-5a23cdcb5217 service nova] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Received event network-vif-plugged-ade44b63-49bb-4dbc-b0f9-95156f4fd6db {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:18:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b0f6154b-37d2-45b6-ad4b-d8a08b0dc4f2 req-2baebe2d-72bb-498a-8d22-5a23cdcb5217 service nova] Acquiring lock "d5e55361-d9ed-4d07-91b0-ec4d08b2e817-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:18:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b0f6154b-37d2-45b6-ad4b-d8a08b0dc4f2 req-2baebe2d-72bb-498a-8d22-5a23cdcb5217 service nova] Lock "d5e55361-d9ed-4d07-91b0-ec4d08b2e817-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:18:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b0f6154b-37d2-45b6-ad4b-d8a08b0dc4f2 req-2baebe2d-72bb-498a-8d22-5a23cdcb5217 service nova] Lock "d5e55361-d9ed-4d07-91b0-ec4d08b2e817-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:18:07 user nova-compute[74683]: DEBUG nova.compute.manager [req-b0f6154b-37d2-45b6-ad4b-d8a08b0dc4f2 req-2baebe2d-72bb-498a-8d22-5a23cdcb5217 service nova] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] No waiting events found dispatching network-vif-plugged-ade44b63-49bb-4dbc-b0f9-95156f4fd6db {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:18:07 user nova-compute[74683]: WARNING nova.compute.manager [req-b0f6154b-37d2-45b6-ad4b-d8a08b0dc4f2 req-2baebe2d-72bb-498a-8d22-5a23cdcb5217 service nova] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Received unexpected event network-vif-plugged-ade44b63-49bb-4dbc-b0f9-95156f4fd6db for instance with vm_state active and task_state rescuing.
Oct 16 11:18:07 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:07 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1db5e2-0b25-4d61-9dd3-038811b4eda1/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:07 user nova-compute[74683]: DEBUG nova.compute.manager [None req-40429797-8d99-4ae9-8b37-0d0b5b90a8fc tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:18:07 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1db5e2-0b25-4d61-9dd3-038811b4eda1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:07 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1db5e2-0b25-4d61-9dd3-038811b4eda1/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:07 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1db5e2-0b25-4d61-9dd3-038811b4eda1/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:07 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:18:07 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1db5e2-0b25-4d61-9dd3-038811b4eda1/disk.rescue --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1db5e2-0b25-4d61-9dd3-038811b4eda1/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1db5e2-0b25-4d61-9dd3-038811b4eda1/disk.rescue --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1db5e2-0b25-4d61-9dd3-038811b4eda1/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5951e708-5667-4ff0-871b-34845bb20f7c/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:08 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:08 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:08 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5951e708-5667-4ff0-871b-34845bb20f7c/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5951e708-5667-4ff0-871b-34845bb20f7c/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5951e708-5667-4ff0-871b-34845bb20f7c/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:09 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:09 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:09 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:09 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:18:09 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:18:09 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:18:09 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdk (vdc) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:18:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd60be9c-0ff3-40a5-aaab-f31fa88a67f1/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:09 user nova-compute[74683]: DEBUG nova.compute.manager [req-e719690b-f712-4895-bf23-f66582a63d11 req-dc58bcfa-11f6-400a-ad60-4fe4b7c8c2c1 service nova] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Received event network-vif-plugged-28029fd9-7463-4b6a-8dc9-c47993f71bb5 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:18:09 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e719690b-f712-4895-bf23-f66582a63d11 req-dc58bcfa-11f6-400a-ad60-4fe4b7c8c2c1 service nova] Acquiring lock "45ca3cbb-53d6-4046-9be3-92cc6b71bfad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:18:09 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e719690b-f712-4895-bf23-f66582a63d11 req-dc58bcfa-11f6-400a-ad60-4fe4b7c8c2c1 service nova] Lock "45ca3cbb-53d6-4046-9be3-92cc6b71bfad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:18:09 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e719690b-f712-4895-bf23-f66582a63d11 req-dc58bcfa-11f6-400a-ad60-4fe4b7c8c2c1 service nova] Lock "45ca3cbb-53d6-4046-9be3-92cc6b71bfad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:18:09 user nova-compute[74683]: DEBUG nova.compute.manager [req-e719690b-f712-4895-bf23-f66582a63d11 req-dc58bcfa-11f6-400a-ad60-4fe4b7c8c2c1 service nova] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] No waiting events found dispatching network-vif-plugged-28029fd9-7463-4b6a-8dc9-c47993f71bb5 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:18:09 user nova-compute[74683]: WARNING nova.compute.manager [req-e719690b-f712-4895-bf23-f66582a63d11 req-dc58bcfa-11f6-400a-ad60-4fe4b7c8c2c1 service nova] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Received unexpected event network-vif-plugged-28029fd9-7463-4b6a-8dc9-c47993f71bb5 for instance with vm_state building and task_state spawning.
Oct 16 11:18:09 user nova-compute[74683]: DEBUG nova.compute.manager [req-e719690b-f712-4895-bf23-f66582a63d11 req-dc58bcfa-11f6-400a-ad60-4fe4b7c8c2c1 service nova] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Received event network-vif-plugged-28029fd9-7463-4b6a-8dc9-c47993f71bb5 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:18:09 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e719690b-f712-4895-bf23-f66582a63d11 req-dc58bcfa-11f6-400a-ad60-4fe4b7c8c2c1 service nova] Acquiring lock "45ca3cbb-53d6-4046-9be3-92cc6b71bfad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:18:09 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e719690b-f712-4895-bf23-f66582a63d11 req-dc58bcfa-11f6-400a-ad60-4fe4b7c8c2c1 service nova] Lock "45ca3cbb-53d6-4046-9be3-92cc6b71bfad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:18:09 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e719690b-f712-4895-bf23-f66582a63d11 req-dc58bcfa-11f6-400a-ad60-4fe4b7c8c2c1 service nova] Lock "45ca3cbb-53d6-4046-9be3-92cc6b71bfad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:18:09 user nova-compute[74683]: DEBUG nova.compute.manager [req-e719690b-f712-4895-bf23-f66582a63d11 req-dc58bcfa-11f6-400a-ad60-4fe4b7c8c2c1 service nova] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] No waiting events found dispatching network-vif-plugged-28029fd9-7463-4b6a-8dc9-c47993f71bb5 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:18:09 user nova-compute[74683]: WARNING nova.compute.manager [req-e719690b-f712-4895-bf23-f66582a63d11 req-dc58bcfa-11f6-400a-ad60-4fe4b7c8c2c1 service nova] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Received unexpected event network-vif-plugged-28029fd9-7463-4b6a-8dc9-c47993f71bb5 for instance with vm_state building and task_state spawning.
Oct 16 11:18:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd60be9c-0ff3-40a5-aaab-f31fa88a67f1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd60be9c-0ff3-40a5-aaab-f31fa88a67f1/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd60be9c-0ff3-40a5-aaab-f31fa88a67f1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:09 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:18:09 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:18:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5e55361-d9ed-4d07-91b0-ec4d08b2e817/disk.rescue --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5e55361-d9ed-4d07-91b0-ec4d08b2e817/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5e55361-d9ed-4d07-91b0-ec4d08b2e817/disk.rescue --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5e55361-d9ed-4d07-91b0-ec4d08b2e817/disk.rescue --force-share --output=json" returned: 0 in 0.233s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae15ce7-996c-460f-a901-1570a2012af1/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:10 user nova-compute[74683]: DEBUG nova.compute.manager [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Instance event wait completed in 0 seconds for  {{(pid=74683) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 11:18:10 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Guest created on hypervisor {{(pid=74683) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 11:18:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae15ce7-996c-460f-a901-1570a2012af1/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae15ce7-996c-460f-a901-1570a2012af1/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:10 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Instance spawned successfully.
Oct 16 11:18:10 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 11:18:10 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Found default for hw_cdrom_bus of ide {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:18:10 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Found default for hw_disk_bus of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:18:10 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Found default for hw_input_bus of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:18:10 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Found default for hw_pointer_model of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:18:10 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Found default for hw_video_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:18:10 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Found default for hw_vif_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:18:10 user nova-compute[74683]: INFO nova.compute.manager [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Took 6.08 seconds to spawn the instance on the hypervisor.
Oct 16 11:18:10 user nova-compute[74683]: DEBUG nova.compute.manager [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:18:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae15ce7-996c-460f-a901-1570a2012af1/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15b7e00-a608-4796-8e6e-1304785a9af5/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:11 user nova-compute[74683]: INFO nova.compute.manager [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Took 7.31 seconds to build instance.
Oct 16 11:18:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1432cf1b-1fbe-47b9-88ee-fb6234b7f379 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lock "45ca3cbb-53d6-4046-9be3-92cc6b71bfad" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.477s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:18:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15b7e00-a608-4796-8e6e-1304785a9af5/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15b7e00-a608-4796-8e6e-1304785a9af5/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:11 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15b7e00-a608-4796-8e6e-1304785a9af5/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:11 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:18:11 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:18:11 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Hypervisor/Node resource view: name=user free_ram=7578MB free_disk=25.24335479736328GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74683) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 11:18:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:18:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:18:11 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Applying migration context for instance f192d1ec-311d-4a30-9766-361b27a8dae8 as it has an incoming, in-progress migration a748c33b-b037-42b4-81ba-0cc2bc8370bf. Migration status is post-migrating {{(pid=74683) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 16 11:18:11 user nova-compute[74683]: INFO nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Updating resource usage from migration a748c33b-b037-42b4-81ba-0cc2bc8370bf
Oct 16 11:18:11 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:12 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 18a77385-fab9-4ea0-8aa6-666cf7e798a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:18:12 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance bd60be9c-0ff3-40a5-aaab-f31fa88a67f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:18:12 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 2f1db5e2-0b25-4d61-9dd3-038811b4eda1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:18:12 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:18:12 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance d944f646-4c4d-4712-8dfe-9b1f0ff60683 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:18:12 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance d5e55361-d9ed-4d07-91b0-ec4d08b2e817 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:18:12 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 5951e708-5667-4ff0-871b-34845bb20f7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:18:12 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 9ae15ce7-996c-460f-a901-1570a2012af1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:18:12 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance c15b7e00-a608-4796-8e6e-1304785a9af5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:18:12 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Migration a748c33b-b037-42b4-81ba-0cc2bc8370bf is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 16 11:18:12 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance f192d1ec-311d-4a30-9766-361b27a8dae8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:18:12 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 45ca3cbb-53d6-4046-9be3-92cc6b71bfad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:18:12 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 11:18:12 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 11:18:12 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:18:12 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:18:12 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Compute_service record updated for user:user {{(pid=74683) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 11:18:12 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.646s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:18:13 user nova-compute[74683]: DEBUG nova.compute.manager [req-54ef4c82-3685-4abc-b81a-b65f75c445c0 req-c93b2c87-5e32-4359-9696-f58c791a005b service nova] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] Received event network-changed-52b6ce44-5078-43ef-aa7d-a0a0bfa1184e {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:18:13 user nova-compute[74683]: DEBUG nova.compute.manager [req-54ef4c82-3685-4abc-b81a-b65f75c445c0 req-c93b2c87-5e32-4359-9696-f58c791a005b service nova] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] Refreshing instance network info cache due to event network-changed-52b6ce44-5078-43ef-aa7d-a0a0bfa1184e. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:18:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-54ef4c82-3685-4abc-b81a-b65f75c445c0 req-c93b2c87-5e32-4359-9696-f58c791a005b service nova] Acquiring lock "refresh_cache-5951e708-5667-4ff0-871b-34845bb20f7c" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:18:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-54ef4c82-3685-4abc-b81a-b65f75c445c0 req-c93b2c87-5e32-4359-9696-f58c791a005b service nova] Acquired lock "refresh_cache-5951e708-5667-4ff0-871b-34845bb20f7c" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:18:13 user nova-compute[74683]: DEBUG nova.network.neutron [req-54ef4c82-3685-4abc-b81a-b65f75c445c0 req-c93b2c87-5e32-4359-9696-f58c791a005b service nova] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] Refreshing network info cache for port 52b6ce44-5078-43ef-aa7d-a0a0bfa1184e {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:18:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-361ae4f8-d133-40b0-b267-843ca8fd235b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Acquiring lock "5951e708-5667-4ff0-871b-34845bb20f7c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:18:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-361ae4f8-d133-40b0-b267-843ca8fd235b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "5951e708-5667-4ff0-871b-34845bb20f7c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:18:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-361ae4f8-d133-40b0-b267-843ca8fd235b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Acquiring lock "5951e708-5667-4ff0-871b-34845bb20f7c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:18:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-361ae4f8-d133-40b0-b267-843ca8fd235b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "5951e708-5667-4ff0-871b-34845bb20f7c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:18:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-361ae4f8-d133-40b0-b267-843ca8fd235b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "5951e708-5667-4ff0-871b-34845bb20f7c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:18:13 user nova-compute[74683]: INFO nova.compute.manager [None req-361ae4f8-d133-40b0-b267-843ca8fd235b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] Terminating instance
Oct 16 11:18:13 user nova-compute[74683]: DEBUG nova.compute.manager [None req-361ae4f8-d133-40b0-b267-843ca8fd235b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] Start destroying the instance on the hypervisor. {{(pid=74683) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 11:18:13 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Starting finish_migration {{(pid=74683) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Oct 16 11:18:13 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Instance directory exists: not creating {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 16 11:18:13 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Creating image(s)
Oct 16 11:18:13 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:13 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:13 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:13 user nova-compute[74683]: DEBUG nova.network.neutron [req-54ef4c82-3685-4abc-b81a-b65f75c445c0 req-c93b2c87-5e32-4359-9696-f58c791a005b service nova] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] Updated VIF entry in instance network info cache for port 52b6ce44-5078-43ef-aa7d-a0a0bfa1184e. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:18:13 user nova-compute[74683]: DEBUG nova.network.neutron [req-54ef4c82-3685-4abc-b81a-b65f75c445c0 req-c93b2c87-5e32-4359-9696-f58c791a005b service nova] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] Updating instance_info_cache with network_info: [{"id": "52b6ce44-5078-43ef-aa7d-a0a0bfa1184e", "address": "fa:16:3e:f9:2e:68", "network": {"id": "f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-137528169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c66aa774134aa6a873eabffc28ec07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52b6ce44-50", "ovs_interfaceid": "52b6ce44-5078-43ef-aa7d-a0a0bfa1184e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:18:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-54ef4c82-3685-4abc-b81a-b65f75c445c0 req-c93b2c87-5e32-4359-9696-f58c791a005b service nova] Releasing lock "refresh_cache-5951e708-5667-4ff0-871b-34845bb20f7c" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:18:13 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.239s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:13 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/disk. size=21474836480 {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 11:18:13 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:13 user nova-compute[74683]: DEBUG nova.compute.manager [req-d02fd59b-9cf7-4f9f-a624-67ef1a6a27ae req-06b3d393-b85b-40bd-a46f-8c7c92b70846 service nova] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] Received event network-vif-unplugged-52b6ce44-5078-43ef-aa7d-a0a0bfa1184e {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:18:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-d02fd59b-9cf7-4f9f-a624-67ef1a6a27ae req-06b3d393-b85b-40bd-a46f-8c7c92b70846 service nova] Acquiring lock "5951e708-5667-4ff0-871b-34845bb20f7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:18:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-d02fd59b-9cf7-4f9f-a624-67ef1a6a27ae req-06b3d393-b85b-40bd-a46f-8c7c92b70846 service nova] Lock "5951e708-5667-4ff0-871b-34845bb20f7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:18:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-d02fd59b-9cf7-4f9f-a624-67ef1a6a27ae req-06b3d393-b85b-40bd-a46f-8c7c92b70846 service nova] Lock "5951e708-5667-4ff0-871b-34845bb20f7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:18:13 user nova-compute[74683]: DEBUG nova.compute.manager [req-d02fd59b-9cf7-4f9f-a624-67ef1a6a27ae req-06b3d393-b85b-40bd-a46f-8c7c92b70846 service nova] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] No waiting events found dispatching network-vif-unplugged-52b6ce44-5078-43ef-aa7d-a0a0bfa1184e {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:18:13 user nova-compute[74683]: DEBUG nova.compute.manager [req-d02fd59b-9cf7-4f9f-a624-67ef1a6a27ae req-06b3d393-b85b-40bd-a46f-8c7c92b70846 service nova] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] Received event network-vif-unplugged-52b6ce44-5078-43ef-aa7d-a0a0bfa1184e for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 11:18:13 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:13 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/disk 21474836480 {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/disk 21474836480" returned: 0 in 0.052s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Did not create local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Ensure instance console log exists: /opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/console.log {{(pid=74683) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Start _get_guest_xml network_info=[{"id": "dbbeadad-745e-4d28-a242-577b3197b079", "address": "fa:16:3e:2b:14:bf", "network": {"id": "33f5edce-0901-42ea-b07a-47da2819b133", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-117849665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-117849665-network", "vif_mac": "fa:16:3e:2b:14:bf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d7573bebfe47e3989f8eedd90dee6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbbeadad-74", "ovs_interfaceid": "dbbeadad-745e-4d28-a242-577b3197b079", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nGRHmKco', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'f192d1ec-311d-4a30-9766-361b27a8dae8', 'attached_at': '2023-10-16T11:18:13.000000', 'detached_at': '', 'volume_id': 'e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b', 'serial': 'e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': None, 'delete_on_termination': False, 'attachment_id': 'e65f078d-4a6d-450b-b219-43ed423d2119', 'volume_type': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:18:14 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:18:14 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:18:14 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Calling os-brick to attach iSCSI Volume {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nGRHmKco', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:18:14 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:18:14 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:18:14 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:18:14 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:18:14 user nova-compute[74683]: INFO os_brick.initiator.connectors.iscsi [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 11:18:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe772fd-3dcc-447a-aaeb-8cc2f95bee8e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 11:18:14 user nova-compute[74683]:  {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260 --interface default --op new {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2dbcb5-c79c-4ce0-92ee-87be11546cfb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b] added\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b] added
Oct 16 11:18:14 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a1ffff-8b0a-4eb6-9daa-6eaacc898018]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[619e87ae-0f72-49f0-b780-05220fc39057]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nGRHmKco {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nGRHmKco" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e047ff0-fbfd-42af-b99c-b75e563067da]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nGRHmKco'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a546dd18-142a-4001-ae50-5a0228ed12e2]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:14 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] Instance destroyed successfully.
Oct 16 11:18:14 user nova-compute[74683]: DEBUG nova.objects.instance [None req-361ae4f8-d133-40b0-b267-843ca8fd235b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lazy-loading 'resources' on Instance uuid 5951e708-5667-4ff0-871b-34845bb20f7c {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-361ae4f8-d133-40b0-b267-843ca8fd235b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:16:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-482897188',display_name='tempest-AttachVolumeNegativeTest-server-482897188',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-482897188',id=13,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE5IpzQDTkkSAhXXtuYKdTWVfFeRBgR/PmHMQgn92/JFiTOZ8MLA1Dl8ctacv8NBs4JbklDxS8DYHOAB9zd+w58vIE8g1qn6joP0Xc1NJPqr5O3322NBqx5hGIuj6X7CZw==',key_name='tempest-keypair-1871302629',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:16:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72c66aa774134aa6a873eabffc28ec07',ramdisk_id='',reservation_id='r-ysdicaz0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-845934820',owner_user_name='tempest-AttachVolumeNegativeTest-845934820-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:16:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cdc203c025d84efe86e25cfdf75107b8',uuid=5951e708-5667-4ff0-871b-34845bb20f7c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "52b6ce44-5078-43ef-aa7d-a0a0bfa1184e", "address": "fa:16:3e:f9:2e:68", "network": {"id": "f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-137528169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c66aa774134aa6a873eabffc28ec07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52b6ce44-50", "ovs_interfaceid": "52b6ce44-5078-43ef-aa7d-a0a0bfa1184e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-361ae4f8-d133-40b0-b267-843ca8fd235b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Converting VIF {"id": "52b6ce44-5078-43ef-aa7d-a0a0bfa1184e", "address": "fa:16:3e:f9:2e:68", "network": {"id": "f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-137528169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c66aa774134aa6a873eabffc28ec07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52b6ce44-50", "ovs_interfaceid": "52b6ce44-5078-43ef-aa7d-a0a0bfa1184e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-361ae4f8-d133-40b0-b267-843ca8fd235b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:2e:68,bridge_name='br-int',has_traffic_filtering=True,id=52b6ce44-5078-43ef-aa7d-a0a0bfa1184e,network=Network(f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52b6ce44-50') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG os_vif [None req-361ae4f8-d133-40b0-b267-843ca8fd235b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:2e:68,bridge_name='br-int',has_traffic_filtering=True,id=52b6ce44-5078-43ef-aa7d-a0a0bfa1184e,network=Network(f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52b6ce44-50') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e25ab4e-92d7-495d-867c-5661241a95a5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)
Oct 16 11:18:14 user nova-compute[74683]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)
Oct 16 11:18:14 user nova-compute[74683]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e (non-flash)
Oct 16 11:18:14 user nova-compute[74683]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:18:14 user nova-compute[74683]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)
Oct 16 11:18:14 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:18:14 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)
Oct 16 11:18:14 user nova-compute[74683]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)
Oct 16 11:18:14 user nova-compute[74683]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e (non-flash)
Oct 16 11:18:14 user nova-compute[74683]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:18:14 user nova-compute[74683]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)
Oct 16 11:18:14 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:18:14 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap52b6ce44-50, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260 --login {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=710822f3-8bf0-440a-b0bf-a071ce116629) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:14 user nova-compute[74683]: INFO os_vif [None req-361ae4f8-d133-40b0-b267-843ca8fd235b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:2e:68,bridge_name='br-int',has_traffic_filtering=True,id=52b6ce44-5078-43ef-aa7d-a0a0bfa1184e,network=Network(f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52b6ce44-50')
Oct 16 11:18:14 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-361ae4f8-d133-40b0-b267-843ca8fd235b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] Deleting instance files /opt/stack/data/nova/instances/5951e708-5667-4ff0-871b-34845bb20f7c_del
Oct 16 11:18:14 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-361ae4f8-d133-40b0-b267-843ca8fd235b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] Deletion of /opt/stack/data/nova/instances/5951e708-5667-4ff0-871b-34845bb20f7c_del complete
Oct 16 11:18:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e33771-6b51-4623-bade-96fd741db10b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b, portal: 172.16.0.220,3260]
Oct 16 11:18:14 user nova-compute[74683]: Login to [iface: default, target: iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b, portal: 172.16.0.220,3260] successful.
Oct 16 11:18:14 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:14 user nova-compute[74683]: INFO nova.compute.manager [None req-361ae4f8-d133-40b0-b267-843ca8fd235b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] Took 0.93 seconds to destroy the instance on the hypervisor.
Oct 16 11:18:14 user nova-compute[74683]: DEBUG oslo.service.loopingcall [None req-361ae4f8-d133-40b0-b267-843ca8fd235b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74683) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG nova.compute.manager [-] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] Deallocating network for instance {{(pid=74683) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] deallocate_for_instance() {{(pid=74683) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0913e27-cd85-4e61-86df-12f19f76553e]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8da70d6-1233-4489-bdbd-86c70c5570ba]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)
Oct 16 11:18:14 user nova-compute[74683]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)
Oct 16 11:18:14 user nova-compute[74683]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e (non-flash)
Oct 16 11:18:14 user nova-compute[74683]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:18:14 user nova-compute[74683]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)
Oct 16 11:18:14 user nova-compute[74683]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)
Oct 16 11:18:14 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:18:14 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)
Oct 16 11:18:14 user nova-compute[74683]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)
Oct 16 11:18:14 user nova-compute[74683]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e (non-flash)
Oct 16 11:18:14 user nova-compute[74683]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:18:14 user nova-compute[74683]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)
Oct 16 11:18:14 user nova-compute[74683]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)
Oct 16 11:18:14 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:18:14 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Connected to 172.16.0.220:3260 {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=74683) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74683) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[c439ef34-9746-4e4f-b8dd-410e2a75d92b]: (4, ('- - 0', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:18:14 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nGRHmKco', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 11:18:15 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:15 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:18:15 user nova-compute[74683]: INFO nova.compute.manager [-] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] Took 0.81 seconds to deallocate network for instance.
Oct 16 11:18:15 user nova-compute[74683]: DEBUG nova.compute.manager [req-a8249c6f-230b-43d8-bde5-382b5d25257a req-1283e61f-60f2-43d6-bddb-3b8a3a4598d3 service nova] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] Received event network-vif-deleted-52b6ce44-5078-43ef-aa7d-a0a0bfa1184e {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:18:15 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-361ae4f8-d133-40b0-b267-843ca8fd235b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:18:15 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-361ae4f8-d133-40b0-b267-843ca8fd235b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:18:15 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:18:15 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] <== connect_volume: return (1384ms) {'type': 'block', 'scsi_wwn': '23238393562653037', 'path': '/dev/sdb'} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:18:15 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23238393562653037', 'path': '/dev/sdb'} {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 11:18:15 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:13:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-983209770',display_name='tempest-ServerActionsTestOtherB-server-983209770',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-983209770',id=4,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9H9XkO3ueDaPVFedHBs8IBjQP+O3m5MP98XnfC/J6UPNHq/d/RZvz6o5PlZR6OTg+H3cDaV7C6HUM8WearORwrzPoJ/Wxd8/4rMuBZ4j1C0aE5FLDGnbq9yp0LqlVHBQ==',key_name='tempest-keypair-650579759',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:13:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e1d7573bebfe47e3989f8eedd90dee6c',ramdisk_id='',reservation_id='r-wwd9qybu',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1241350688',owner_user_name='tempest-ServerActionsTestOtherB-1241350688-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:17:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fc0a33378424a9080c747d4f78528a5',uuid=f192d1ec-311d-4a30-9766-361b27a8dae8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dbbeadad-745e-4d28-a242-577b3197b079", "address": "fa:16:3e:2b:14:bf", "network": {"id": "33f5edce-0901-42ea-b07a-47da2819b133", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-117849665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-117849665-network", "vif_mac": "fa:16:3e:2b:14:bf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d7573bebfe47e3989f8eedd90dee6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbbeadad-74", "ovs_interfaceid": "dbbeadad-745e-4d28-a242-577b3197b079", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:18:15 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Converting VIF {"id": "dbbeadad-745e-4d28-a242-577b3197b079", "address": "fa:16:3e:2b:14:bf", "network": {"id": "33f5edce-0901-42ea-b07a-47da2819b133", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-117849665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-117849665-network", "vif_mac": "fa:16:3e:2b:14:bf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d7573bebfe47e3989f8eedd90dee6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbbeadad-74", "ovs_interfaceid": "dbbeadad-745e-4d28-a242-577b3197b079", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:18:15 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:14:bf,bridge_name='br-int',has_traffic_filtering=True,id=dbbeadad-745e-4d28-a242-577b3197b079,network=Network(33f5edce-0901-42ea-b07a-47da2819b133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbbeadad-74') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:18:15 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:18:15 user nova-compute[74683]:   <uuid>f192d1ec-311d-4a30-9766-361b27a8dae8</uuid>
Oct 16 11:18:15 user nova-compute[74683]:   <name>instance-00000004</name>
Oct 16 11:18:15 user nova-compute[74683]:   <memory>2097152</memory>
Oct 16 11:18:15 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:18:15 user nova-compute[74683]:   <metadata>
Oct 16 11:18:15 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:18:15 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:18:15 user nova-compute[74683]:       <nova:name>tempest-ServerActionsTestOtherB-server-983209770</nova:name>
Oct 16 11:18:15 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:18:14</nova:creationTime>
Oct 16 11:18:15 user nova-compute[74683]:       <nova:flavor name="m1.small">
Oct 16 11:18:15 user nova-compute[74683]:         <nova:memory>2048</nova:memory>
Oct 16 11:18:15 user nova-compute[74683]:         <nova:disk>20</nova:disk>
Oct 16 11:18:15 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:18:15 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:18:15 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:18:15 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:18:15 user nova-compute[74683]:       <nova:owner>
Oct 16 11:18:15 user nova-compute[74683]:         <nova:user uuid="0fc0a33378424a9080c747d4f78528a5">tempest-ServerActionsTestOtherB-1241350688-project-member</nova:user>
Oct 16 11:18:15 user nova-compute[74683]:         <nova:project uuid="e1d7573bebfe47e3989f8eedd90dee6c">tempest-ServerActionsTestOtherB-1241350688</nova:project>
Oct 16 11:18:15 user nova-compute[74683]:       </nova:owner>
Oct 16 11:18:15 user nova-compute[74683]:       <nova:root type="image" uuid="0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f"/>
Oct 16 11:18:15 user nova-compute[74683]:       <nova:ports>
Oct 16 11:18:15 user nova-compute[74683]:         <nova:port uuid="dbbeadad-745e-4d28-a242-577b3197b079">
Oct 16 11:18:15 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 16 11:18:15 user nova-compute[74683]:         </nova:port>
Oct 16 11:18:15 user nova-compute[74683]:       </nova:ports>
Oct 16 11:18:15 user nova-compute[74683]:     </nova:instance>
Oct 16 11:18:15 user nova-compute[74683]:   </metadata>
Oct 16 11:18:15 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:18:15 user nova-compute[74683]:     <system>
Oct 16 11:18:15 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:18:15 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:18:15 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:18:15 user nova-compute[74683]:       <entry name="serial">f192d1ec-311d-4a30-9766-361b27a8dae8</entry>
Oct 16 11:18:15 user nova-compute[74683]:       <entry name="uuid">f192d1ec-311d-4a30-9766-361b27a8dae8</entry>
Oct 16 11:18:15 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:18:15 user nova-compute[74683]:     </system>
Oct 16 11:18:15 user nova-compute[74683]:   </sysinfo>
Oct 16 11:18:15 user nova-compute[74683]:   <os>
Oct 16 11:18:15 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:18:15 user nova-compute[74683]:     <boot dev="hd"/>
Oct 16 11:18:15 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:18:15 user nova-compute[74683]:   </os>
Oct 16 11:18:15 user nova-compute[74683]:   <features>
Oct 16 11:18:15 user nova-compute[74683]:     <acpi/>
Oct 16 11:18:15 user nova-compute[74683]:     <apic/>
Oct 16 11:18:15 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:18:15 user nova-compute[74683]:   </features>
Oct 16 11:18:15 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:18:15 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:18:15 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:18:15 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:18:15 user nova-compute[74683]:   </clock>
Oct 16 11:18:15 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:18:15 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:18:15 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:18:15 user nova-compute[74683]:   </cpu>
Oct 16 11:18:15 user nova-compute[74683]:   <devices>
Oct 16 11:18:15 user nova-compute[74683]:     <disk type="file" device="disk">
Oct 16 11:18:15 user nova-compute[74683]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 11:18:15 user nova-compute[74683]:       <source file="/opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/disk"/>
Oct 16 11:18:15 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:18:15 user nova-compute[74683]:     </disk>
Oct 16 11:18:15 user nova-compute[74683]:     <disk type="block" device="disk">
Oct 16 11:18:15 user nova-compute[74683]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:18:15 user nova-compute[74683]:       <source dev="/dev/sdb"/>
Oct 16 11:18:15 user nova-compute[74683]:       <target dev="vdb" bus="virtio"/>
Oct 16 11:18:15 user nova-compute[74683]:       <serial>e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b</serial>
Oct 16 11:18:15 user nova-compute[74683]:     </disk>
Oct 16 11:18:15 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:18:15 user nova-compute[74683]:       <mac address="fa:16:3e:2b:14:bf"/>
Oct 16 11:18:15 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:18:15 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:18:15 user nova-compute[74683]:       <target dev="tapdbbeadad-74"/>
Oct 16 11:18:15 user nova-compute[74683]:     </interface>
Oct 16 11:18:15 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:18:15 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/console.log" append="off"/>
Oct 16 11:18:15 user nova-compute[74683]:     </serial>
Oct 16 11:18:15 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:18:15 user nova-compute[74683]:     <video>
Oct 16 11:18:15 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:18:15 user nova-compute[74683]:     </video>
Oct 16 11:18:15 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:18:15 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:18:15 user nova-compute[74683]:     </rng>
Oct 16 11:18:15 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:18:15 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:18:15 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:18:15 user nova-compute[74683]:     </memballoon>
Oct 16 11:18:15 user nova-compute[74683]:   </devices>
Oct 16 11:18:15 user nova-compute[74683]: </domain>
Oct 16 11:18:15 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:18:15 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:13:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-983209770',display_name='tempest-ServerActionsTestOtherB-server-983209770',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-983209770',id=4,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9H9XkO3ueDaPVFedHBs8IBjQP+O3m5MP98XnfC/J6UPNHq/d/RZvz6o5PlZR6OTg+H3cDaV7C6HUM8WearORwrzPoJ/Wxd8/4rMuBZ4j1C0aE5FLDGnbq9yp0LqlVHBQ==',key_name='tempest-keypair-650579759',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:13:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e1d7573bebfe47e3989f8eedd90dee6c',ramdisk_id='',reservation_id='r-wwd9qybu',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1241350688',owner_user_name='tempest-ServerActionsTestOtherB-1241350688-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:17:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fc0a33378424a9080c747d4f78528a5',uuid=f192d1ec-311d-4a30-9766-361b27a8dae8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dbbeadad-745e-4d28-a242-577b3197b079", "address": "fa:16:3e:2b:14:bf", "network": {"id": "33f5edce-0901-42ea-b07a-47da2819b133", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-117849665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-117849665-network", "vif_mac": "fa:16:3e:2b:14:bf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d7573bebfe47e3989f8eedd90dee6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbbeadad-74", "ovs_interfaceid": "dbbeadad-745e-4d28-a242-577b3197b079", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:18:15 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Converting VIF {"id": "dbbeadad-745e-4d28-a242-577b3197b079", "address": "fa:16:3e:2b:14:bf", "network": {"id": "33f5edce-0901-42ea-b07a-47da2819b133", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-117849665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-117849665-network", "vif_mac": "fa:16:3e:2b:14:bf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d7573bebfe47e3989f8eedd90dee6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbbeadad-74", "ovs_interfaceid": "dbbeadad-745e-4d28-a242-577b3197b079", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:18:15 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:14:bf,bridge_name='br-int',has_traffic_filtering=True,id=dbbeadad-745e-4d28-a242-577b3197b079,network=Network(33f5edce-0901-42ea-b07a-47da2819b133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbbeadad-74') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:18:15 user nova-compute[74683]: DEBUG os_vif [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:14:bf,bridge_name='br-int',has_traffic_filtering=True,id=dbbeadad-745e-4d28-a242-577b3197b079,network=Network(33f5edce-0901-42ea-b07a-47da2819b133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbbeadad-74') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:18:15 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:15 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:18:15 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:18:15 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:15 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '56f2a605-bb46-5863-87e8-d5b8b20d92cc', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:18:15 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:15 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:15 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:15 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdbbeadad-74, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:18:15 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdbbeadad-74, col_values=(('qos', UUID('14bb3ce2-9f76-46ad-8c9b-2836ec417e61')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:18:15 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdbbeadad-74, col_values=(('external_ids', {'iface-id': 'dbbeadad-745e-4d28-a242-577b3197b079', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:14:bf', 'vm-uuid': 'f192d1ec-311d-4a30-9766-361b27a8dae8'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:18:15 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:15 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:18:15 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:15 user nova-compute[74683]: INFO os_vif [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:14:bf,bridge_name='br-int',has_traffic_filtering=True,id=dbbeadad-745e-4d28-a242-577b3197b079,network=Network(33f5edce-0901-42ea-b07a-47da2819b133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbbeadad-74')
Oct 16 11:18:15 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:18:15 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:18:15 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] No VIF found with MAC fa:16:3e:2b:14:bf, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:18:15 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-361ae4f8-d133-40b0-b267-843ca8fd235b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:18:15 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-361ae4f8-d133-40b0-b267-843ca8fd235b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:18:15 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-361ae4f8-d133-40b0-b267-843ca8fd235b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.485s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:18:15 user nova-compute[74683]: INFO nova.scheduler.client.report [None req-361ae4f8-d133-40b0-b267-843ca8fd235b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Deleted allocations for instance 5951e708-5667-4ff0-871b-34845bb20f7c
Oct 16 11:18:15 user nova-compute[74683]: DEBUG nova.compute.manager [req-112b7b4b-2f0b-42a6-b776-b9fcbbe58f37 req-6cde5b74-5405-4d94-92ea-9a74454fb772 service nova] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] Received event network-vif-plugged-52b6ce44-5078-43ef-aa7d-a0a0bfa1184e {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:18:15 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-112b7b4b-2f0b-42a6-b776-b9fcbbe58f37 req-6cde5b74-5405-4d94-92ea-9a74454fb772 service nova] Acquiring lock "5951e708-5667-4ff0-871b-34845bb20f7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:18:15 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-112b7b4b-2f0b-42a6-b776-b9fcbbe58f37 req-6cde5b74-5405-4d94-92ea-9a74454fb772 service nova] Lock "5951e708-5667-4ff0-871b-34845bb20f7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.008s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:18:15 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-112b7b4b-2f0b-42a6-b776-b9fcbbe58f37 req-6cde5b74-5405-4d94-92ea-9a74454fb772 service nova] Lock "5951e708-5667-4ff0-871b-34845bb20f7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:18:15 user nova-compute[74683]: DEBUG nova.compute.manager [req-112b7b4b-2f0b-42a6-b776-b9fcbbe58f37 req-6cde5b74-5405-4d94-92ea-9a74454fb772 service nova] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] No waiting events found dispatching network-vif-plugged-52b6ce44-5078-43ef-aa7d-a0a0bfa1184e {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:18:15 user nova-compute[74683]: WARNING nova.compute.manager [req-112b7b4b-2f0b-42a6-b776-b9fcbbe58f37 req-6cde5b74-5405-4d94-92ea-9a74454fb772 service nova] [instance: 5951e708-5667-4ff0-871b-34845bb20f7c] Received unexpected event network-vif-plugged-52b6ce44-5078-43ef-aa7d-a0a0bfa1184e for instance with vm_state deleted and task_state None.
Oct 16 11:18:16 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-361ae4f8-d133-40b0-b267-843ca8fd235b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "5951e708-5667-4ff0-871b-34845bb20f7c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.525s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:18:16 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:18 user nova-compute[74683]: DEBUG nova.compute.manager [req-eae71128-a362-4741-8401-4ca381589313 req-fa65f527-a650-4f9c-bb98-6a5db9b469dd service nova] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Received event network-vif-plugged-dbbeadad-745e-4d28-a242-577b3197b079 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:18:18 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-eae71128-a362-4741-8401-4ca381589313 req-fa65f527-a650-4f9c-bb98-6a5db9b469dd service nova] Acquiring lock "f192d1ec-311d-4a30-9766-361b27a8dae8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:18:18 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-eae71128-a362-4741-8401-4ca381589313 req-fa65f527-a650-4f9c-bb98-6a5db9b469dd service nova] Lock "f192d1ec-311d-4a30-9766-361b27a8dae8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:18:18 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-eae71128-a362-4741-8401-4ca381589313 req-fa65f527-a650-4f9c-bb98-6a5db9b469dd service nova] Lock "f192d1ec-311d-4a30-9766-361b27a8dae8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:18:18 user nova-compute[74683]: DEBUG nova.compute.manager [req-eae71128-a362-4741-8401-4ca381589313 req-fa65f527-a650-4f9c-bb98-6a5db9b469dd service nova] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] No waiting events found dispatching network-vif-plugged-dbbeadad-745e-4d28-a242-577b3197b079 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:18:18 user nova-compute[74683]: WARNING nova.compute.manager [req-eae71128-a362-4741-8401-4ca381589313 req-fa65f527-a650-4f9c-bb98-6a5db9b469dd service nova] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Received unexpected event network-vif-plugged-dbbeadad-745e-4d28-a242-577b3197b079 for instance with vm_state active and task_state resize_finish.
Oct 16 11:18:19 user nova-compute[74683]: DEBUG nova.compute.manager [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Instance event wait completed in 0 seconds for  {{(pid=74683) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 11:18:19 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Instance running successfully.
Oct 16 11:18:19 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Failed to set time: agent not configured {{(pid=74683) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Oct 16 11:18:19 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-1da1f0f6-186c-4422-a04e-93c1e2c3750f tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] finish_migration finished successfully. {{(pid=74683) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Oct 16 11:18:20 user nova-compute[74683]: DEBUG nova.compute.manager [req-77d38a0d-7481-41ad-ab6e-748090e951e4 req-c0a5b73f-00d2-49fd-8a03-81eeaf643298 service nova] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Received event network-vif-plugged-dbbeadad-745e-4d28-a242-577b3197b079 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:18:20 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-77d38a0d-7481-41ad-ab6e-748090e951e4 req-c0a5b73f-00d2-49fd-8a03-81eeaf643298 service nova] Acquiring lock "f192d1ec-311d-4a30-9766-361b27a8dae8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:18:20 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-77d38a0d-7481-41ad-ab6e-748090e951e4 req-c0a5b73f-00d2-49fd-8a03-81eeaf643298 service nova] Lock "f192d1ec-311d-4a30-9766-361b27a8dae8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:18:20 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-77d38a0d-7481-41ad-ab6e-748090e951e4 req-c0a5b73f-00d2-49fd-8a03-81eeaf643298 service nova] Lock "f192d1ec-311d-4a30-9766-361b27a8dae8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:18:20 user nova-compute[74683]: DEBUG nova.compute.manager [req-77d38a0d-7481-41ad-ab6e-748090e951e4 req-c0a5b73f-00d2-49fd-8a03-81eeaf643298 service nova] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] No waiting events found dispatching network-vif-plugged-dbbeadad-745e-4d28-a242-577b3197b079 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:18:20 user nova-compute[74683]: WARNING nova.compute.manager [req-77d38a0d-7481-41ad-ab6e-748090e951e4 req-c0a5b73f-00d2-49fd-8a03-81eeaf643298 service nova] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Received unexpected event network-vif-plugged-dbbeadad-745e-4d28-a242-577b3197b079 for instance with vm_state resized and task_state None.
Oct 16 11:18:20 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:23 user nova-compute[74683]: DEBUG nova.compute.manager [req-3f9144b4-4eb2-4902-beb3-9056fe149b73 req-96e7af5b-5aad-42d7-87cb-ce9054860969 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received event network-changed-e57a2375-e447-4210-bbcf-41b3e5fc247c {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:18:23 user nova-compute[74683]: DEBUG nova.compute.manager [req-3f9144b4-4eb2-4902-beb3-9056fe149b73 req-96e7af5b-5aad-42d7-87cb-ce9054860969 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Refreshing instance network info cache due to event network-changed-e57a2375-e447-4210-bbcf-41b3e5fc247c. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:18:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-3f9144b4-4eb2-4902-beb3-9056fe149b73 req-96e7af5b-5aad-42d7-87cb-ce9054860969 service nova] Acquiring lock "refresh_cache-d944f646-4c4d-4712-8dfe-9b1f0ff60683" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:18:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-3f9144b4-4eb2-4902-beb3-9056fe149b73 req-96e7af5b-5aad-42d7-87cb-ce9054860969 service nova] Acquired lock "refresh_cache-d944f646-4c4d-4712-8dfe-9b1f0ff60683" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:18:24 user nova-compute[74683]: DEBUG nova.network.neutron [req-3f9144b4-4eb2-4902-beb3-9056fe149b73 req-96e7af5b-5aad-42d7-87cb-ce9054860969 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Refreshing network info cache for port e57a2375-e447-4210-bbcf-41b3e5fc247c {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:18:25 user nova-compute[74683]: DEBUG nova.network.neutron [req-3f9144b4-4eb2-4902-beb3-9056fe149b73 req-96e7af5b-5aad-42d7-87cb-ce9054860969 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Updated VIF entry in instance network info cache for port e57a2375-e447-4210-bbcf-41b3e5fc247c. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:18:25 user nova-compute[74683]: DEBUG nova.network.neutron [req-3f9144b4-4eb2-4902-beb3-9056fe149b73 req-96e7af5b-5aad-42d7-87cb-ce9054860969 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Updating instance_info_cache with network_info: [{"id": "e57a2375-e447-4210-bbcf-41b3e5fc247c", "address": "fa:16:3e:20:c8:bf", "network": {"id": "540c0f36-606c-4006-8d84-50054c6727fa", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-308363250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape57a2375-e4", "ovs_interfaceid": "e57a2375-e447-4210-bbcf-41b3e5fc247c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ce7eb587-a6b4-4512-b0e2-80a4da1dbfb4", "address": "fa:16:3e:63:d7:c6", "network": {"id": "c1575c96-f936-4f92-9b3c-6355d69d0f52", "bridge": "br-int", "label": "tempest-device-tagging-net1-1179473676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce7eb587-a6", "ovs_interfaceid": "ce7eb587-a6b4-4512-b0e2-80a4da1dbfb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a6b7eb88-42a3-46b9-8cd2-5b5b06d8849a", "address": "fa:16:3e:9b:41:93", "network": {"id": "c1575c96-f936-4f92-9b3c-6355d69d0f52", "bridge": "br-int", "label": "tempest-device-tagging-net1-1179473676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6b7eb88-42", "ovs_interfaceid": "a6b7eb88-42a3-46b9-8cd2-5b5b06d8849a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9cb93e0f-104e-4f2b-9b61-6d89781b34ca", "address": "fa:16:3e:cd:71:b8", "network": {"id": "c1575c96-f936-4f92-9b3c-6355d69d0f52", "bridge": "br-int", "label": "tempest-device-tagging-net1-1179473676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cb93e0f-10", "ovs_interfaceid": "9cb93e0f-104e-4f2b-9b61-6d89781b34ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "890aa3e7-41ea-4c2a-bcef-7f412d80f1ac", "address": "fa:16:3e:75:e3:67", "network": {"id": "c1575c96-f936-4f92-9b3c-6355d69d0f52", "bridge": "br-int", "label": "tempest-device-tagging-net1-1179473676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap890aa3e7-41", "ovs_interfaceid": "890aa3e7-41ea-4c2a-bcef-7f412d80f1ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f447e989-eb77-4618-9ce5-271b79c2441f", "address": "fa:16:3e:d8:a4:a5", "network": {"id": "92db7fdf-c810-43ef-883b-69a04a04e5e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-66216092", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf447e989-eb", "ovs_interfaceid": "f447e989-eb77-4618-9ce5-271b79c2441f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4a78f612-a4ed-431d-b6c6-b62a23d83a95", "address": "fa:16:3e:13:b8:ac", "network": {"id": "92db7fdf-c810-43ef-883b-69a04a04e5e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-66216092", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a78f612-a4", "ovs_interfaceid": "4a78f612-a4ed-431d-b6c6-b62a23d83a95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:18:25 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-3f9144b4-4eb2-4902-beb3-9056fe149b73 req-96e7af5b-5aad-42d7-87cb-ce9054860969 service nova] Releasing lock "refresh_cache-d944f646-4c4d-4712-8dfe-9b1f0ff60683" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:18:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Acquiring lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:18:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:18:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Acquiring lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:18:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:18:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:18:27 user nova-compute[74683]: INFO nova.compute.manager [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Terminating instance
Oct 16 11:18:27 user nova-compute[74683]: DEBUG nova.compute.manager [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Start destroying the instance on the hypervisor. {{(pid=74683) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 11:18:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:27 user nova-compute[74683]: DEBUG nova.compute.manager [req-7d2a18c5-7201-4884-9179-381c723e6e4c req-0f878039-25c1-4be6-97f8-861cf93bcb70 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received event network-vif-unplugged-e57a2375-e447-4210-bbcf-41b3e5fc247c {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:18:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-7d2a18c5-7201-4884-9179-381c723e6e4c req-0f878039-25c1-4be6-97f8-861cf93bcb70 service nova] Acquiring lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:18:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-7d2a18c5-7201-4884-9179-381c723e6e4c req-0f878039-25c1-4be6-97f8-861cf93bcb70 service nova] Lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:18:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-7d2a18c5-7201-4884-9179-381c723e6e4c req-0f878039-25c1-4be6-97f8-861cf93bcb70 service nova] Lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:18:27 user nova-compute[74683]: DEBUG nova.compute.manager [req-7d2a18c5-7201-4884-9179-381c723e6e4c req-0f878039-25c1-4be6-97f8-861cf93bcb70 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] No waiting events found dispatching network-vif-unplugged-e57a2375-e447-4210-bbcf-41b3e5fc247c {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:18:27 user nova-compute[74683]: DEBUG nova.compute.manager [req-7d2a18c5-7201-4884-9179-381c723e6e4c req-0f878039-25c1-4be6-97f8-861cf93bcb70 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received event network-vif-unplugged-e57a2375-e447-4210-bbcf-41b3e5fc247c for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 11:18:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:28 user nova-compute[74683]: DEBUG nova.compute.manager [req-33f971cf-303e-4bdf-876a-2cd935e36095 req-074b9eb7-f25b-425e-9430-6f82f27de5ff service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received event network-vif-unplugged-ce7eb587-a6b4-4512-b0e2-80a4da1dbfb4 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:18:28 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-33f971cf-303e-4bdf-876a-2cd935e36095 req-074b9eb7-f25b-425e-9430-6f82f27de5ff service nova] Acquiring lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:18:28 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-33f971cf-303e-4bdf-876a-2cd935e36095 req-074b9eb7-f25b-425e-9430-6f82f27de5ff service nova] Lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:18:28 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-33f971cf-303e-4bdf-876a-2cd935e36095 req-074b9eb7-f25b-425e-9430-6f82f27de5ff service nova] Lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:18:28 user nova-compute[74683]: DEBUG nova.compute.manager [req-33f971cf-303e-4bdf-876a-2cd935e36095 req-074b9eb7-f25b-425e-9430-6f82f27de5ff service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] No waiting events found dispatching network-vif-unplugged-ce7eb587-a6b4-4512-b0e2-80a4da1dbfb4 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:18:28 user nova-compute[74683]: DEBUG nova.compute.manager [req-33f971cf-303e-4bdf-876a-2cd935e36095 req-074b9eb7-f25b-425e-9430-6f82f27de5ff service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received event network-vif-unplugged-ce7eb587-a6b4-4512-b0e2-80a4da1dbfb4 for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 11:18:28 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:28 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:28 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:28 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:28 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:28 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:28 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:28 user nova-compute[74683]: DEBUG nova.compute.manager [req-f9e21001-57b6-43da-a9e4-808ddac28830 req-72b23e85-193f-42a6-a546-a5807e323a5a service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received event network-vif-unplugged-4a78f612-a4ed-431d-b6c6-b62a23d83a95 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:18:28 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f9e21001-57b6-43da-a9e4-808ddac28830 req-72b23e85-193f-42a6-a546-a5807e323a5a service nova] Acquiring lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:18:28 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f9e21001-57b6-43da-a9e4-808ddac28830 req-72b23e85-193f-42a6-a546-a5807e323a5a service nova] Lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:18:28 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f9e21001-57b6-43da-a9e4-808ddac28830 req-72b23e85-193f-42a6-a546-a5807e323a5a service nova] Lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:18:28 user nova-compute[74683]: DEBUG nova.compute.manager [req-f9e21001-57b6-43da-a9e4-808ddac28830 req-72b23e85-193f-42a6-a546-a5807e323a5a service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] No waiting events found dispatching network-vif-unplugged-4a78f612-a4ed-431d-b6c6-b62a23d83a95 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:18:28 user nova-compute[74683]: DEBUG nova.compute.manager [req-f9e21001-57b6-43da-a9e4-808ddac28830 req-72b23e85-193f-42a6-a546-a5807e323a5a service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received event network-vif-unplugged-4a78f612-a4ed-431d-b6c6-b62a23d83a95 for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 11:18:28 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:28 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:29 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Instance destroyed successfully.
Oct 16 11:18:29 user nova-compute[74683]: DEBUG nova.objects.instance [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Lazy-loading 'resources' on Instance uuid d944f646-4c4d-4712-8dfe-9b1f0ff60683 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T11:14:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-153004525',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-153004525',id=11,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPT0wFGepT2AbMdp1rAx79xDZxHu2H/2AkbfKha2i6dolhWnV2tQPzUnhpCRMrAf5PLBt6Ls2nh9OlA5dn90oD2J+97H6rdIu1Yx2AsfyI0saOnNSsTFksp9Zunxk73fQ==',key_name='tempest-keypair-273034633',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:16:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ac0a84f26f244dcb698429bb447feff',ramdisk_id='',reservation_id='r-ev6lcphm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2030851280',owner_user_name='tempest-TaggedBootDevicesTest_v242-2030851280-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:16:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='08a96cdfeb5746cea70a478c307e5998',uuid=d944f646-4c4d-4712-8dfe-9b1f0ff60683,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e57a2375-e447-4210-bbcf-41b3e5fc247c", "address": "fa:16:3e:20:c8:bf", "network": {"id": "540c0f36-606c-4006-8d84-50054c6727fa", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-308363250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape57a2375-e4", "ovs_interfaceid": "e57a2375-e447-4210-bbcf-41b3e5fc247c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Converting VIF {"id": "e57a2375-e447-4210-bbcf-41b3e5fc247c", "address": "fa:16:3e:20:c8:bf", "network": {"id": "540c0f36-606c-4006-8d84-50054c6727fa", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-308363250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape57a2375-e4", "ovs_interfaceid": "e57a2375-e447-4210-bbcf-41b3e5fc247c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:c8:bf,bridge_name='br-int',has_traffic_filtering=True,id=e57a2375-e447-4210-bbcf-41b3e5fc247c,network=Network(540c0f36-606c-4006-8d84-50054c6727fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape57a2375-e4') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG os_vif [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:c8:bf,bridge_name='br-int',has_traffic_filtering=True,id=e57a2375-e447-4210-bbcf-41b3e5fc247c,network=Network(540c0f36-606c-4006-8d84-50054c6727fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape57a2375-e4') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape57a2375-e4, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ca8ac82e-15d4-484b-a8d4-df54590f30e0) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:29 user nova-compute[74683]: INFO os_vif [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:c8:bf,bridge_name='br-int',has_traffic_filtering=True,id=e57a2375-e447-4210-bbcf-41b3e5fc247c,network=Network(540c0f36-606c-4006-8d84-50054c6727fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape57a2375-e4')
Oct 16 11:18:29 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T11:14:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-153004525',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-153004525',id=11,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPT0wFGepT2AbMdp1rAx79xDZxHu2H/2AkbfKha2i6dolhWnV2tQPzUnhpCRMrAf5PLBt6Ls2nh9OlA5dn90oD2J+97H6rdIu1Yx2AsfyI0saOnNSsTFksp9Zunxk73fQ==',key_name='tempest-keypair-273034633',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:16:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ac0a84f26f244dcb698429bb447feff',ramdisk_id='',reservation_id='r-ev6lcphm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2030851280',owner_user_name='tempest-TaggedBootDevicesTest_v242-2030851280-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:16:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='08a96cdfeb5746cea70a478c307e5998',uuid=d944f646-4c4d-4712-8dfe-9b1f0ff60683,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce7eb587-a6b4-4512-b0e2-80a4da1dbfb4", "address": "fa:16:3e:63:d7:c6", "network": {"id": "c1575c96-f936-4f92-9b3c-6355d69d0f52", "bridge": "br-int", "label": "tempest-device-tagging-net1-1179473676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce7eb587-a6", "ovs_interfaceid": "ce7eb587-a6b4-4512-b0e2-80a4da1dbfb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Converting VIF {"id": "ce7eb587-a6b4-4512-b0e2-80a4da1dbfb4", "address": "fa:16:3e:63:d7:c6", "network": {"id": "c1575c96-f936-4f92-9b3c-6355d69d0f52", "bridge": "br-int", "label": "tempest-device-tagging-net1-1179473676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce7eb587-a6", "ovs_interfaceid": "ce7eb587-a6b4-4512-b0e2-80a4da1dbfb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:d7:c6,bridge_name='br-int',has_traffic_filtering=True,id=ce7eb587-a6b4-4512-b0e2-80a4da1dbfb4,network=Network(c1575c96-f936-4f92-9b3c-6355d69d0f52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapce7eb587-a6') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG os_vif [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:d7:c6,bridge_name='br-int',has_traffic_filtering=True,id=ce7eb587-a6b4-4512-b0e2-80a4da1dbfb4,network=Network(c1575c96-f936-4f92-9b3c-6355d69d0f52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapce7eb587-a6') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapce7eb587-a6, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5e37a2be-5dd7-4df4-ba4c-361174148a22) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:29 user nova-compute[74683]: INFO os_vif [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:d7:c6,bridge_name='br-int',has_traffic_filtering=True,id=ce7eb587-a6b4-4512-b0e2-80a4da1dbfb4,network=Network(c1575c96-f936-4f92-9b3c-6355d69d0f52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapce7eb587-a6')
Oct 16 11:18:29 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T11:14:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-153004525',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-153004525',id=11,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPT0wFGepT2AbMdp1rAx79xDZxHu2H/2AkbfKha2i6dolhWnV2tQPzUnhpCRMrAf5PLBt6Ls2nh9OlA5dn90oD2J+97H6rdIu1Yx2AsfyI0saOnNSsTFksp9Zunxk73fQ==',key_name='tempest-keypair-273034633',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:16:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ac0a84f26f244dcb698429bb447feff',ramdisk_id='',reservation_id='r-ev6lcphm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2030851280',owner_user_name='tempest-TaggedBootDevicesTest_v242-2030851280-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:16:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='08a96cdfeb5746cea70a478c307e5998',uuid=d944f646-4c4d-4712-8dfe-9b1f0ff60683,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a6b7eb88-42a3-46b9-8cd2-5b5b06d8849a", "address": "fa:16:3e:9b:41:93", "network": {"id": "c1575c96-f936-4f92-9b3c-6355d69d0f52", "bridge": "br-int", "label": "tempest-device-tagging-net1-1179473676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6b7eb88-42", "ovs_interfaceid": "a6b7eb88-42a3-46b9-8cd2-5b5b06d8849a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Converting VIF {"id": "a6b7eb88-42a3-46b9-8cd2-5b5b06d8849a", "address": "fa:16:3e:9b:41:93", "network": {"id": "c1575c96-f936-4f92-9b3c-6355d69d0f52", "bridge": "br-int", "label": "tempest-device-tagging-net1-1179473676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6b7eb88-42", "ovs_interfaceid": "a6b7eb88-42a3-46b9-8cd2-5b5b06d8849a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:41:93,bridge_name='br-int',has_traffic_filtering=True,id=a6b7eb88-42a3-46b9-8cd2-5b5b06d8849a,network=Network(c1575c96-f936-4f92-9b3c-6355d69d0f52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa6b7eb88-42') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG os_vif [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:41:93,bridge_name='br-int',has_traffic_filtering=True,id=a6b7eb88-42a3-46b9-8cd2-5b5b06d8849a,network=Network(c1575c96-f936-4f92-9b3c-6355d69d0f52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa6b7eb88-42') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa6b7eb88-42, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c80f6a54-12f1-46cf-9232-e21a77402c83) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:29 user nova-compute[74683]: INFO os_vif [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:41:93,bridge_name='br-int',has_traffic_filtering=True,id=a6b7eb88-42a3-46b9-8cd2-5b5b06d8849a,network=Network(c1575c96-f936-4f92-9b3c-6355d69d0f52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa6b7eb88-42')
Oct 16 11:18:29 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T11:14:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-153004525',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-153004525',id=11,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPT0wFGepT2AbMdp1rAx79xDZxHu2H/2AkbfKha2i6dolhWnV2tQPzUnhpCRMrAf5PLBt6Ls2nh9OlA5dn90oD2J+97H6rdIu1Yx2AsfyI0saOnNSsTFksp9Zunxk73fQ==',key_name='tempest-keypair-273034633',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:16:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ac0a84f26f244dcb698429bb447feff',ramdisk_id='',reservation_id='r-ev6lcphm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2030851280',owner_user_name='tempest-TaggedBootDevicesTest_v242-2030851280-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:16:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='08a96cdfeb5746cea70a478c307e5998',uuid=d944f646-4c4d-4712-8dfe-9b1f0ff60683,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9cb93e0f-104e-4f2b-9b61-6d89781b34ca", "address": "fa:16:3e:cd:71:b8", "network": {"id": "c1575c96-f936-4f92-9b3c-6355d69d0f52", "bridge": "br-int", "label": "tempest-device-tagging-net1-1179473676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cb93e0f-10", "ovs_interfaceid": "9cb93e0f-104e-4f2b-9b61-6d89781b34ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Converting VIF {"id": "9cb93e0f-104e-4f2b-9b61-6d89781b34ca", "address": "fa:16:3e:cd:71:b8", "network": {"id": "c1575c96-f936-4f92-9b3c-6355d69d0f52", "bridge": "br-int", "label": "tempest-device-tagging-net1-1179473676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cb93e0f-10", "ovs_interfaceid": "9cb93e0f-104e-4f2b-9b61-6d89781b34ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:71:b8,bridge_name='br-int',has_traffic_filtering=True,id=9cb93e0f-104e-4f2b-9b61-6d89781b34ca,network=Network(c1575c96-f936-4f92-9b3c-6355d69d0f52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cb93e0f-10') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG os_vif [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:71:b8,bridge_name='br-int',has_traffic_filtering=True,id=9cb93e0f-104e-4f2b-9b61-6d89781b34ca,network=Network(c1575c96-f936-4f92-9b3c-6355d69d0f52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cb93e0f-10') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9cb93e0f-10, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b469f1b6-6a44-4251-8e4a-dd5196dda8d5) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:29 user nova-compute[74683]: INFO os_vif [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:71:b8,bridge_name='br-int',has_traffic_filtering=True,id=9cb93e0f-104e-4f2b-9b61-6d89781b34ca,network=Network(c1575c96-f936-4f92-9b3c-6355d69d0f52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cb93e0f-10')
Oct 16 11:18:29 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T11:14:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-153004525',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-153004525',id=11,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPT0wFGepT2AbMdp1rAx79xDZxHu2H/2AkbfKha2i6dolhWnV2tQPzUnhpCRMrAf5PLBt6Ls2nh9OlA5dn90oD2J+97H6rdIu1Yx2AsfyI0saOnNSsTFksp9Zunxk73fQ==',key_name='tempest-keypair-273034633',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:16:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ac0a84f26f244dcb698429bb447feff',ramdisk_id='',reservation_id='r-ev6lcphm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2030851280',owner_user_name='tempest-TaggedBootDevicesTest_v242-2030851280-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:16:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='08a96cdfeb5746cea70a478c307e5998',uuid=d944f646-4c4d-4712-8dfe-9b1f0ff60683,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "890aa3e7-41ea-4c2a-bcef-7f412d80f1ac", "address": "fa:16:3e:75:e3:67", "network": {"id": "c1575c96-f936-4f92-9b3c-6355d69d0f52", "bridge": "br-int", "label": "tempest-device-tagging-net1-1179473676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap890aa3e7-41", "ovs_interfaceid": "890aa3e7-41ea-4c2a-bcef-7f412d80f1ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Converting VIF {"id": "890aa3e7-41ea-4c2a-bcef-7f412d80f1ac", "address": "fa:16:3e:75:e3:67", "network": {"id": "c1575c96-f936-4f92-9b3c-6355d69d0f52", "bridge": "br-int", "label": "tempest-device-tagging-net1-1179473676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap890aa3e7-41", "ovs_interfaceid": "890aa3e7-41ea-4c2a-bcef-7f412d80f1ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:e3:67,bridge_name='br-int',has_traffic_filtering=True,id=890aa3e7-41ea-4c2a-bcef-7f412d80f1ac,network=Network(c1575c96-f936-4f92-9b3c-6355d69d0f52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap890aa3e7-41') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG os_vif [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:e3:67,bridge_name='br-int',has_traffic_filtering=True,id=890aa3e7-41ea-4c2a-bcef-7f412d80f1ac,network=Network(c1575c96-f936-4f92-9b3c-6355d69d0f52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap890aa3e7-41') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap890aa3e7-41, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e7760ed5-4c36-464d-ae18-31169740d14c) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:29 user nova-compute[74683]: INFO os_vif [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:e3:67,bridge_name='br-int',has_traffic_filtering=True,id=890aa3e7-41ea-4c2a-bcef-7f412d80f1ac,network=Network(c1575c96-f936-4f92-9b3c-6355d69d0f52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap890aa3e7-41')
Oct 16 11:18:29 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T11:14:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-153004525',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-153004525',id=11,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPT0wFGepT2AbMdp1rAx79xDZxHu2H/2AkbfKha2i6dolhWnV2tQPzUnhpCRMrAf5PLBt6Ls2nh9OlA5dn90oD2J+97H6rdIu1Yx2AsfyI0saOnNSsTFksp9Zunxk73fQ==',key_name='tempest-keypair-273034633',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:16:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ac0a84f26f244dcb698429bb447feff',ramdisk_id='',reservation_id='r-ev6lcphm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2030851280',owner_user_name='tempest-TaggedBootDevicesTest_v242-2030851280-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:16:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='08a96cdfeb5746cea70a478c307e5998',uuid=d944f646-4c4d-4712-8dfe-9b1f0ff60683,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f447e989-eb77-4618-9ce5-271b79c2441f", "address": "fa:16:3e:d8:a4:a5", "network": {"id": "92db7fdf-c810-43ef-883b-69a04a04e5e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-66216092", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf447e989-eb", "ovs_interfaceid": "f447e989-eb77-4618-9ce5-271b79c2441f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Converting VIF {"id": "f447e989-eb77-4618-9ce5-271b79c2441f", "address": "fa:16:3e:d8:a4:a5", "network": {"id": "92db7fdf-c810-43ef-883b-69a04a04e5e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-66216092", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf447e989-eb", "ovs_interfaceid": "f447e989-eb77-4618-9ce5-271b79c2441f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:a4:a5,bridge_name='br-int',has_traffic_filtering=True,id=f447e989-eb77-4618-9ce5-271b79c2441f,network=Network(92db7fdf-c810-43ef-883b-69a04a04e5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf447e989-eb') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG os_vif [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:a4:a5,bridge_name='br-int',has_traffic_filtering=True,id=f447e989-eb77-4618-9ce5-271b79c2441f,network=Network(92db7fdf-c810-43ef-883b-69a04a04e5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf447e989-eb') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf447e989-eb, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1e3e3c42-698d-438b-83c4-199b55b7870e) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:29 user nova-compute[74683]: INFO os_vif [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:a4:a5,bridge_name='br-int',has_traffic_filtering=True,id=f447e989-eb77-4618-9ce5-271b79c2441f,network=Network(92db7fdf-c810-43ef-883b-69a04a04e5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf447e989-eb')
Oct 16 11:18:29 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T11:14:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-153004525',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-153004525',id=11,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPT0wFGepT2AbMdp1rAx79xDZxHu2H/2AkbfKha2i6dolhWnV2tQPzUnhpCRMrAf5PLBt6Ls2nh9OlA5dn90oD2J+97H6rdIu1Yx2AsfyI0saOnNSsTFksp9Zunxk73fQ==',key_name='tempest-keypair-273034633',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:16:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ac0a84f26f244dcb698429bb447feff',ramdisk_id='',reservation_id='r-ev6lcphm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2030851280',owner_user_name='tempest-TaggedBootDevicesTest_v242-2030851280-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:16:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='08a96cdfeb5746cea70a478c307e5998',uuid=d944f646-4c4d-4712-8dfe-9b1f0ff60683,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a78f612-a4ed-431d-b6c6-b62a23d83a95", "address": "fa:16:3e:13:b8:ac", "network": {"id": "92db7fdf-c810-43ef-883b-69a04a04e5e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-66216092", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a78f612-a4", "ovs_interfaceid": "4a78f612-a4ed-431d-b6c6-b62a23d83a95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Converting VIF {"id": "4a78f612-a4ed-431d-b6c6-b62a23d83a95", "address": "fa:16:3e:13:b8:ac", "network": {"id": "92db7fdf-c810-43ef-883b-69a04a04e5e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-66216092", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a78f612-a4", "ovs_interfaceid": "4a78f612-a4ed-431d-b6c6-b62a23d83a95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:b8:ac,bridge_name='br-int',has_traffic_filtering=True,id=4a78f612-a4ed-431d-b6c6-b62a23d83a95,network=Network(92db7fdf-c810-43ef-883b-69a04a04e5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a78f612-a4') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG os_vif [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:b8:ac,bridge_name='br-int',has_traffic_filtering=True,id=4a78f612-a4ed-431d-b6c6-b62a23d83a95,network=Network(92db7fdf-c810-43ef-883b-69a04a04e5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a78f612-a4') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4a78f612-a4, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aeb05028-3660-40d4-9a5f-db1dca0ba8d0) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:18:29 user nova-compute[74683]: INFO os_vif [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:b8:ac,bridge_name='br-int',has_traffic_filtering=True,id=4a78f612-a4ed-431d-b6c6-b62a23d83a95,network=Network(92db7fdf-c810-43ef-883b-69a04a04e5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a78f612-a4')
Oct 16 11:18:29 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] calling os-brick to detach iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, {'target_iqn': 'iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hZAjBwSM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:18:29 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:18:29 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a92ee1-f075-416e-9d5d-4b8672d55861]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 11:18:29 user nova-compute[74683]: No targets found.
Oct 16 11:18:29 user nova-compute[74683]: iSNS:
Oct 16 11:18:29 user nova-compute[74683]: No targets found.
Oct 16 11:18:29 user nova-compute[74683]: STATIC:
Oct 16 11:18:29 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e
Oct 16 11:18:29 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:18:29 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:18:29 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5
Oct 16 11:18:29 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:18:29 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:18:29 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e
Oct 16 11:18:29 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:18:29 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:18:29 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb
Oct 16 11:18:29 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:18:29 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:18:29 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3
Oct 16 11:18:29 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:18:29 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:18:29 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020
Oct 16 11:18:29 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:18:29 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:18:29 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b
Oct 16 11:18:29 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:18:29 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:18:29 user nova-compute[74683]: FIRMWARE:
Oct 16 11:18:29 user nova-compute[74683]: No targets found.
Oct 16 11:18:29 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 11:18:29 user nova-compute[74683]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 11:18:29 user nova-compute[74683]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74683) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e', 0)] {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG nova.compute.manager [req-fd4d2581-4a7b-4a6b-938e-ee6e50bf43c0 req-8addf653-1b21-448e-9df5-731cab7d9577 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received event network-vif-plugged-e57a2375-e447-4210-bbcf-41b3e5fc247c {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-fd4d2581-4a7b-4a6b-938e-ee6e50bf43c0 req-8addf653-1b21-448e-9df5-731cab7d9577 service nova] Acquiring lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-fd4d2581-4a7b-4a6b-938e-ee6e50bf43c0 req-8addf653-1b21-448e-9df5-731cab7d9577 service nova] Lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-fd4d2581-4a7b-4a6b-938e-ee6e50bf43c0 req-8addf653-1b21-448e-9df5-731cab7d9577 service nova] Lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG nova.compute.manager [req-fd4d2581-4a7b-4a6b-938e-ee6e50bf43c0 req-8addf653-1b21-448e-9df5-731cab7d9577 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] No waiting events found dispatching network-vif-plugged-e57a2375-e447-4210-bbcf-41b3e5fc247c {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:18:29 user nova-compute[74683]: WARNING nova.compute.manager [req-fd4d2581-4a7b-4a6b-938e-ee6e50bf43c0 req-8addf653-1b21-448e-9df5-731cab7d9577 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received unexpected event network-vif-plugged-e57a2375-e447-4210-bbcf-41b3e5fc247c for instance with vm_state active and task_state deleting.
Oct 16 11:18:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d59464-5564-4279-9a51-ce1857efc9fb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[2974bf06-9206-4c1a-b71c-c6de67ecbf37]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)
Oct 16 11:18:29 user nova-compute[74683]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)
Oct 16 11:18:29 user nova-compute[74683]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e (non-flash)
Oct 16 11:18:29 user nova-compute[74683]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:18:29 user nova-compute[74683]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)
Oct 16 11:18:29 user nova-compute[74683]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)
Oct 16 11:18:29 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:18:29 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e (non-flash)
Oct 16 11:18:29 user nova-compute[74683]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)
Oct 16 11:18:29 user nova-compute[74683]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e (non-flash)
Oct 16 11:18:29 user nova-compute[74683]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:18:29 user nova-compute[74683]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)
Oct 16 11:18:29 user nova-compute[74683]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)
Oct 16 11:18:29 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:18:29 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda4c77c9d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e'): ({'sdi'}, set())}) {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Removing single pathed devices sdi {{(pid=74683) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5a4a55-c11b-45b6-84b7-b0dece0ea902]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[b511d3f6-7e7e-41b9-8899-e20b9270a5c7]: (4, ('ok\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Flushing IO for device /dev/sdi {{(pid=74683) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.016s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[206e7783-2030-4ee8-a74f-d30be19ac151]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74683) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 11:18:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.044s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d956dafe-74f2-469f-b726-705694d3d570]: (4, ('1', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] SCSI volumes sdi have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e')] {{(pid=74683) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[09987ae5-bb92-41f2-b7f4-ee0e2d55b940]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e -p 172.16.0.220:3260 --logout {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG nova.compute.manager [req-cf33c822-9bc1-4089-a6e8-95804441308d req-0dbee4fa-223d-4a9e-acc2-9031598f5aa7 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received event network-vif-plugged-ce7eb587-a6b4-4512-b0e2-80a4da1dbfb4 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-cf33c822-9bc1-4089-a6e8-95804441308d req-0dbee4fa-223d-4a9e-acc2-9031598f5aa7 service nova] Acquiring lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-cf33c822-9bc1-4089-a6e8-95804441308d req-0dbee4fa-223d-4a9e-acc2-9031598f5aa7 service nova] Lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-cf33c822-9bc1-4089-a6e8-95804441308d req-0dbee4fa-223d-4a9e-acc2-9031598f5aa7 service nova] Lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG nova.compute.manager [req-cf33c822-9bc1-4089-a6e8-95804441308d req-0dbee4fa-223d-4a9e-acc2-9031598f5aa7 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] No waiting events found dispatching network-vif-plugged-ce7eb587-a6b4-4512-b0e2-80a4da1dbfb4 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:18:30 user nova-compute[74683]: WARNING nova.compute.manager [req-cf33c822-9bc1-4089-a6e8-95804441308d req-0dbee4fa-223d-4a9e-acc2-9031598f5aa7 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received unexpected event network-vif-plugged-ce7eb587-a6b4-4512-b0e2-80a4da1dbfb4 for instance with vm_state active and task_state deleting.
Oct 16 11:18:30 user nova-compute[74683]: DEBUG nova.compute.manager [req-cf33c822-9bc1-4089-a6e8-95804441308d req-0dbee4fa-223d-4a9e-acc2-9031598f5aa7 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received event network-vif-unplugged-a6b7eb88-42a3-46b9-8cd2-5b5b06d8849a {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-cf33c822-9bc1-4089-a6e8-95804441308d req-0dbee4fa-223d-4a9e-acc2-9031598f5aa7 service nova] Acquiring lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-cf33c822-9bc1-4089-a6e8-95804441308d req-0dbee4fa-223d-4a9e-acc2-9031598f5aa7 service nova] Lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-cf33c822-9bc1-4089-a6e8-95804441308d req-0dbee4fa-223d-4a9e-acc2-9031598f5aa7 service nova] Lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG nova.compute.manager [req-cf33c822-9bc1-4089-a6e8-95804441308d req-0dbee4fa-223d-4a9e-acc2-9031598f5aa7 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] No waiting events found dispatching network-vif-unplugged-a6b7eb88-42a3-46b9-8cd2-5b5b06d8849a {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG nova.compute.manager [req-cf33c822-9bc1-4089-a6e8-95804441308d req-0dbee4fa-223d-4a9e-acc2-9031598f5aa7 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received event network-vif-unplugged-a6b7eb88-42a3-46b9-8cd2-5b5b06d8849a for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG nova.compute.manager [req-cf33c822-9bc1-4089-a6e8-95804441308d req-0dbee4fa-223d-4a9e-acc2-9031598f5aa7 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received event network-vif-plugged-a6b7eb88-42a3-46b9-8cd2-5b5b06d8849a {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-cf33c822-9bc1-4089-a6e8-95804441308d req-0dbee4fa-223d-4a9e-acc2-9031598f5aa7 service nova] Acquiring lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-cf33c822-9bc1-4089-a6e8-95804441308d req-0dbee4fa-223d-4a9e-acc2-9031598f5aa7 service nova] Lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-cf33c822-9bc1-4089-a6e8-95804441308d req-0dbee4fa-223d-4a9e-acc2-9031598f5aa7 service nova] Lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG nova.compute.manager [req-cf33c822-9bc1-4089-a6e8-95804441308d req-0dbee4fa-223d-4a9e-acc2-9031598f5aa7 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] No waiting events found dispatching network-vif-plugged-a6b7eb88-42a3-46b9-8cd2-5b5b06d8849a {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:18:30 user nova-compute[74683]: WARNING nova.compute.manager [req-cf33c822-9bc1-4089-a6e8-95804441308d req-0dbee4fa-223d-4a9e-acc2-9031598f5aa7 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received unexpected event network-vif-plugged-a6b7eb88-42a3-46b9-8cd2-5b5b06d8849a for instance with vm_state active and task_state deleting.
Oct 16 11:18:30 user nova-compute[74683]: DEBUG nova.compute.manager [req-cf33c822-9bc1-4089-a6e8-95804441308d req-0dbee4fa-223d-4a9e-acc2-9031598f5aa7 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received event network-vif-unplugged-9cb93e0f-104e-4f2b-9b61-6d89781b34ca {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-cf33c822-9bc1-4089-a6e8-95804441308d req-0dbee4fa-223d-4a9e-acc2-9031598f5aa7 service nova] Acquiring lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-cf33c822-9bc1-4089-a6e8-95804441308d req-0dbee4fa-223d-4a9e-acc2-9031598f5aa7 service nova] Lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-cf33c822-9bc1-4089-a6e8-95804441308d req-0dbee4fa-223d-4a9e-acc2-9031598f5aa7 service nova] Lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG nova.compute.manager [req-cf33c822-9bc1-4089-a6e8-95804441308d req-0dbee4fa-223d-4a9e-acc2-9031598f5aa7 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] No waiting events found dispatching network-vif-unplugged-9cb93e0f-104e-4f2b-9b61-6d89781b34ca {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG nova.compute.manager [req-cf33c822-9bc1-4089-a6e8-95804441308d req-0dbee4fa-223d-4a9e-acc2-9031598f5aa7 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received event network-vif-unplugged-9cb93e0f-104e-4f2b-9b61-6d89781b34ca for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG nova.compute.manager [req-cf33c822-9bc1-4089-a6e8-95804441308d req-0dbee4fa-223d-4a9e-acc2-9031598f5aa7 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received event network-vif-plugged-9cb93e0f-104e-4f2b-9b61-6d89781b34ca {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-cf33c822-9bc1-4089-a6e8-95804441308d req-0dbee4fa-223d-4a9e-acc2-9031598f5aa7 service nova] Acquiring lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-cf33c822-9bc1-4089-a6e8-95804441308d req-0dbee4fa-223d-4a9e-acc2-9031598f5aa7 service nova] Lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-cf33c822-9bc1-4089-a6e8-95804441308d req-0dbee4fa-223d-4a9e-acc2-9031598f5aa7 service nova] Lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG nova.compute.manager [req-cf33c822-9bc1-4089-a6e8-95804441308d req-0dbee4fa-223d-4a9e-acc2-9031598f5aa7 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] No waiting events found dispatching network-vif-plugged-9cb93e0f-104e-4f2b-9b61-6d89781b34ca {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:18:30 user nova-compute[74683]: WARNING nova.compute.manager [req-cf33c822-9bc1-4089-a6e8-95804441308d req-0dbee4fa-223d-4a9e-acc2-9031598f5aa7 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received unexpected event network-vif-plugged-9cb93e0f-104e-4f2b-9b61-6d89781b34ca for instance with vm_state active and task_state deleting.
Oct 16 11:18:30 user nova-compute[74683]: DEBUG nova.compute.manager [req-cf33c822-9bc1-4089-a6e8-95804441308d req-0dbee4fa-223d-4a9e-acc2-9031598f5aa7 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received event network-vif-unplugged-890aa3e7-41ea-4c2a-bcef-7f412d80f1ac {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-cf33c822-9bc1-4089-a6e8-95804441308d req-0dbee4fa-223d-4a9e-acc2-9031598f5aa7 service nova] Acquiring lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-cf33c822-9bc1-4089-a6e8-95804441308d req-0dbee4fa-223d-4a9e-acc2-9031598f5aa7 service nova] Lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-cf33c822-9bc1-4089-a6e8-95804441308d req-0dbee4fa-223d-4a9e-acc2-9031598f5aa7 service nova] Lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG nova.compute.manager [req-cf33c822-9bc1-4089-a6e8-95804441308d req-0dbee4fa-223d-4a9e-acc2-9031598f5aa7 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] No waiting events found dispatching network-vif-unplugged-890aa3e7-41ea-4c2a-bcef-7f412d80f1ac {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG nova.compute.manager [req-cf33c822-9bc1-4089-a6e8-95804441308d req-0dbee4fa-223d-4a9e-acc2-9031598f5aa7 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received event network-vif-unplugged-890aa3e7-41ea-4c2a-bcef-7f412d80f1ac for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG nova.compute.manager [req-cf33c822-9bc1-4089-a6e8-95804441308d req-0dbee4fa-223d-4a9e-acc2-9031598f5aa7 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received event network-vif-plugged-890aa3e7-41ea-4c2a-bcef-7f412d80f1ac {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-cf33c822-9bc1-4089-a6e8-95804441308d req-0dbee4fa-223d-4a9e-acc2-9031598f5aa7 service nova] Acquiring lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-cf33c822-9bc1-4089-a6e8-95804441308d req-0dbee4fa-223d-4a9e-acc2-9031598f5aa7 service nova] Lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-cf33c822-9bc1-4089-a6e8-95804441308d req-0dbee4fa-223d-4a9e-acc2-9031598f5aa7 service nova] Lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG nova.compute.manager [req-cf33c822-9bc1-4089-a6e8-95804441308d req-0dbee4fa-223d-4a9e-acc2-9031598f5aa7 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] No waiting events found dispatching network-vif-plugged-890aa3e7-41ea-4c2a-bcef-7f412d80f1ac {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:18:30 user nova-compute[74683]: WARNING nova.compute.manager [req-cf33c822-9bc1-4089-a6e8-95804441308d req-0dbee4fa-223d-4a9e-acc2-9031598f5aa7 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received unexpected event network-vif-plugged-890aa3e7-41ea-4c2a-bcef-7f412d80f1ac for instance with vm_state active and task_state deleting.
Oct 16 11:18:30 user nova-compute[74683]: DEBUG nova.compute.manager [req-cf33c822-9bc1-4089-a6e8-95804441308d req-0dbee4fa-223d-4a9e-acc2-9031598f5aa7 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received event network-vif-unplugged-f447e989-eb77-4618-9ce5-271b79c2441f {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-cf33c822-9bc1-4089-a6e8-95804441308d req-0dbee4fa-223d-4a9e-acc2-9031598f5aa7 service nova] Acquiring lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-cf33c822-9bc1-4089-a6e8-95804441308d req-0dbee4fa-223d-4a9e-acc2-9031598f5aa7 service nova] Lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-cf33c822-9bc1-4089-a6e8-95804441308d req-0dbee4fa-223d-4a9e-acc2-9031598f5aa7 service nova] Lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG nova.compute.manager [req-cf33c822-9bc1-4089-a6e8-95804441308d req-0dbee4fa-223d-4a9e-acc2-9031598f5aa7 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] No waiting events found dispatching network-vif-unplugged-f447e989-eb77-4618-9ce5-271b79c2441f {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG nova.compute.manager [req-cf33c822-9bc1-4089-a6e8-95804441308d req-0dbee4fa-223d-4a9e-acc2-9031598f5aa7 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received event network-vif-unplugged-f447e989-eb77-4618-9ce5-271b79c2441f for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG nova.compute.manager [req-cf33c822-9bc1-4089-a6e8-95804441308d req-0dbee4fa-223d-4a9e-acc2-9031598f5aa7 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received event network-vif-plugged-f447e989-eb77-4618-9ce5-271b79c2441f {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-cf33c822-9bc1-4089-a6e8-95804441308d req-0dbee4fa-223d-4a9e-acc2-9031598f5aa7 service nova] Acquiring lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-cf33c822-9bc1-4089-a6e8-95804441308d req-0dbee4fa-223d-4a9e-acc2-9031598f5aa7 service nova] Lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-cf33c822-9bc1-4089-a6e8-95804441308d req-0dbee4fa-223d-4a9e-acc2-9031598f5aa7 service nova] Lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG nova.compute.manager [req-cf33c822-9bc1-4089-a6e8-95804441308d req-0dbee4fa-223d-4a9e-acc2-9031598f5aa7 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] No waiting events found dispatching network-vif-plugged-f447e989-eb77-4618-9ce5-271b79c2441f {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:18:30 user nova-compute[74683]: WARNING nova.compute.manager [req-cf33c822-9bc1-4089-a6e8-95804441308d req-0dbee4fa-223d-4a9e-acc2-9031598f5aa7 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received unexpected event network-vif-plugged-f447e989-eb77-4618-9ce5-271b79c2441f for instance with vm_state active and task_state deleting.
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e570b7f-c3b9-4631-9508-66f07f4c0d9a]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e, portal: 172.16.0.220,3260]
Oct 16 11:18:30 user nova-compute[74683]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e, portal: 172.16.0.220,3260] successful.
Oct 16 11:18:30 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e -p 172.16.0.220:3260 --op delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d1cac00-6344-49fe-9d7a-1c6fe160414e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65bdc37-5003-4480-b3cd-8f498b7a8607]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.381s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] <== disconnect_volume: return (383ms) None {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Disconnected iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] calling os-brick to detach iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, {'target_iqn': 'iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AEDJnfZU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': True}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:18:30 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:18:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da435ca-c818-4bba-ac05-2999fbb8500b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 11:18:30 user nova-compute[74683]: No targets found.
Oct 16 11:18:30 user nova-compute[74683]: iSNS:
Oct 16 11:18:30 user nova-compute[74683]: No targets found.
Oct 16 11:18:30 user nova-compute[74683]: STATIC:
Oct 16 11:18:30 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e
Oct 16 11:18:30 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:18:30 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:18:30 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5
Oct 16 11:18:30 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:18:30 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:18:30 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb
Oct 16 11:18:30 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:18:30 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:18:30 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3
Oct 16 11:18:30 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:18:30 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:18:30 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020
Oct 16 11:18:30 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:18:30 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:18:30 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b
Oct 16 11:18:30 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:18:30 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:18:30 user nova-compute[74683]: FIRMWARE:
Oct 16 11:18:30 user nova-compute[74683]: No targets found.
Oct 16 11:18:30 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 11:18:30 user nova-compute[74683]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 11:18:30 user nova-compute[74683]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74683) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e', 0)] {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[83db2c52-70d0-4e19-b8e0-f609e4cc00d7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[90830d5e-9da6-405e-bc66-c3c6ca09c305]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)
Oct 16 11:18:30 user nova-compute[74683]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e (non-flash)
Oct 16 11:18:30 user nova-compute[74683]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:18:30 user nova-compute[74683]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)
Oct 16 11:18:30 user nova-compute[74683]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)
Oct 16 11:18:30 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:18:30 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)
Oct 16 11:18:30 user nova-compute[74683]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e (non-flash)
Oct 16 11:18:30 user nova-compute[74683]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:18:30 user nova-compute[74683]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)
Oct 16 11:18:30 user nova-compute[74683]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)
Oct 16 11:18:30 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:18:30 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda4c616a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e'): ({'sdk'}, set())}) {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Removing single pathed devices sdk {{(pid=74683) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e880352f-684f-46e3-bd50-179ed6e67f2e]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[95cc07cb-21ba-4e54-b55b-56caeba360f8]: (4, ('ok\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Flushing IO for device /dev/sdk {{(pid=74683) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.016s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[054fa3aa-75f4-4217-841d-42c486434a97]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=74683) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.040s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2165a5-7954-4887-a9f1-0f980b7b2697]: (4, ('1', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] SCSI volumes sdk have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e')] {{(pid=74683) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[24636ac6-8436-46a5-a7d8-4d55bedb2150]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e -p 172.16.0.220:3260 --logout {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[63bbd43e-0ba5-41a3-8340-ab2cc916185f]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e, portal: 172.16.0.220,3260]
Oct 16 11:18:30 user nova-compute[74683]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e, portal: 172.16.0.220,3260] successful.
Oct 16 11:18:30 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e -p 172.16.0.220:3260 --op delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80b502e7-5d0d-489c-8f84-29551a9e5e0e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b407fd4-6810-4c5b-b203-49a0db918c1f]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] <== disconnect_volume: return (325ms) None {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Disconnected iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] calling os-brick to detach iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, {'target_iqn': 'iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cNXhSmaE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': True}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:18:30 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:18:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[40359509-c3df-4ae4-a480-a9e4e810e3e3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 11:18:30 user nova-compute[74683]: No targets found.
Oct 16 11:18:30 user nova-compute[74683]: iSNS:
Oct 16 11:18:30 user nova-compute[74683]: No targets found.
Oct 16 11:18:30 user nova-compute[74683]: STATIC:
Oct 16 11:18:30 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5
Oct 16 11:18:30 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:18:30 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:18:30 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb
Oct 16 11:18:30 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:18:30 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:18:30 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3
Oct 16 11:18:30 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:18:30 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:18:30 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020
Oct 16 11:18:30 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:18:30 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:18:30 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b
Oct 16 11:18:30 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:18:30 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:18:30 user nova-compute[74683]: FIRMWARE:
Oct 16 11:18:30 user nova-compute[74683]: No targets found.
Oct 16 11:18:30 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 11:18:30 user nova-compute[74683]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 11:18:30 user nova-compute[74683]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74683) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3', 0)] {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d602cc6d-9c66-440a-97b4-38d65983e5b5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[327f255c-459d-451b-ac4b-1a9d6ef8c73a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)
Oct 16 11:18:30 user nova-compute[74683]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:18:30 user nova-compute[74683]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)
Oct 16 11:18:30 user nova-compute[74683]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)
Oct 16 11:18:30 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:18:30 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 (non-flash)
Oct 16 11:18:30 user nova-compute[74683]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:18:30 user nova-compute[74683]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)
Oct 16 11:18:30 user nova-compute[74683]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)
Oct 16 11:18:30 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:18:30 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda4c616a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3'): ({'sdj'}, set())}) {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Removing single pathed devices sdj {{(pid=74683) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[32570fe5-bd86-4f31-ac8e-13b19a70637d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a25e7b4-1046-4208-82c0-0559cd34590c]: (4, ('ok\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Flushing IO for device /dev/sdj {{(pid=74683) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e262f819-e27a-46ca-a471-0d0cd9241024]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=74683) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG nova.compute.manager [req-a0968621-7c0f-4aaf-85be-6653a8b7b2e0 req-717232f7-1022-4c3b-87fb-2b48c5be466f service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received event network-vif-plugged-4a78f612-a4ed-431d-b6c6-b62a23d83a95 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a0968621-7c0f-4aaf-85be-6653a8b7b2e0 req-717232f7-1022-4c3b-87fb-2b48c5be466f service nova] Acquiring lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a0968621-7c0f-4aaf-85be-6653a8b7b2e0 req-717232f7-1022-4c3b-87fb-2b48c5be466f service nova] Lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a0968621-7c0f-4aaf-85be-6653a8b7b2e0 req-717232f7-1022-4c3b-87fb-2b48c5be466f service nova] Lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG nova.compute.manager [req-a0968621-7c0f-4aaf-85be-6653a8b7b2e0 req-717232f7-1022-4c3b-87fb-2b48c5be466f service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] No waiting events found dispatching network-vif-plugged-4a78f612-a4ed-431d-b6c6-b62a23d83a95 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:18:30 user nova-compute[74683]: WARNING nova.compute.manager [req-a0968621-7c0f-4aaf-85be-6653a8b7b2e0 req-717232f7-1022-4c3b-87fb-2b48c5be466f service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received unexpected event network-vif-plugged-4a78f612-a4ed-431d-b6c6-b62a23d83a95 for instance with vm_state active and task_state deleting.
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.031s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c37d79-dea1-4d0e-bec1-6c52b4809f0e]: (4, ('1', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] SCSI volumes sdj have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3')] {{(pid=74683) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9757b5-264f-4bcd-9dc4-2cb0f986fbad]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 -p 172.16.0.220:3260 --logout {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[87470959-73f8-49b7-b11a-59c751490372]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3, portal: 172.16.0.220,3260]
Oct 16 11:18:30 user nova-compute[74683]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3, portal: 172.16.0.220,3260] successful.
Oct 16 11:18:30 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 -p 172.16.0.220:3260 --op delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1e2d623-19a9-4b4c-9fe1-18e656aef0f3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e86e91-32ab-4fc3-ac59-ab048506726b]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] <== disconnect_volume: return (332ms) None {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Disconnected iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 11:18:30 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Deleting instance files /opt/stack/data/nova/instances/d944f646-4c4d-4712-8dfe-9b1f0ff60683_del
Oct 16 11:18:30 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Deletion of /opt/stack/data/nova/instances/d944f646-4c4d-4712-8dfe-9b1f0ff60683_del complete
Oct 16 11:18:30 user nova-compute[74683]: INFO nova.compute.manager [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Took 3.53 seconds to destroy the instance on the hypervisor.
Oct 16 11:18:30 user nova-compute[74683]: DEBUG oslo.service.loopingcall [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74683) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG nova.compute.manager [-] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Deallocating network for instance {{(pid=74683) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 11:18:30 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] deallocate_for_instance() {{(pid=74683) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 11:18:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:32 user nova-compute[74683]: DEBUG nova.compute.manager [req-9990245b-70ad-4abc-b72d-32e333ebf0c6 req-3e22760f-029d-45f7-ae5a-ba3964fa9325 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received event network-vif-deleted-9cb93e0f-104e-4f2b-9b61-6d89781b34ca {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:18:32 user nova-compute[74683]: INFO nova.compute.manager [req-9990245b-70ad-4abc-b72d-32e333ebf0c6 req-3e22760f-029d-45f7-ae5a-ba3964fa9325 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Neutron deleted interface 9cb93e0f-104e-4f2b-9b61-6d89781b34ca; detaching it from the instance and deleting it from the info cache
Oct 16 11:18:32 user nova-compute[74683]: DEBUG nova.network.neutron [req-9990245b-70ad-4abc-b72d-32e333ebf0c6 req-3e22760f-029d-45f7-ae5a-ba3964fa9325 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Updating instance_info_cache with network_info: [{"id": "e57a2375-e447-4210-bbcf-41b3e5fc247c", "address": "fa:16:3e:20:c8:bf", "network": {"id": "540c0f36-606c-4006-8d84-50054c6727fa", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-308363250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape57a2375-e4", "ovs_interfaceid": "e57a2375-e447-4210-bbcf-41b3e5fc247c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ce7eb587-a6b4-4512-b0e2-80a4da1dbfb4", "address": "fa:16:3e:63:d7:c6", "network": {"id": "c1575c96-f936-4f92-9b3c-6355d69d0f52", "bridge": "br-int", "label": "tempest-device-tagging-net1-1179473676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce7eb587-a6", "ovs_interfaceid": "ce7eb587-a6b4-4512-b0e2-80a4da1dbfb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a6b7eb88-42a3-46b9-8cd2-5b5b06d8849a", "address": "fa:16:3e:9b:41:93", "network": {"id": "c1575c96-f936-4f92-9b3c-6355d69d0f52", "bridge": "br-int", "label": "tempest-device-tagging-net1-1179473676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6b7eb88-42", "ovs_interfaceid": "a6b7eb88-42a3-46b9-8cd2-5b5b06d8849a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "890aa3e7-41ea-4c2a-bcef-7f412d80f1ac", "address": "fa:16:3e:75:e3:67", "network": {"id": "c1575c96-f936-4f92-9b3c-6355d69d0f52", "bridge": "br-int", "label": "tempest-device-tagging-net1-1179473676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap890aa3e7-41", "ovs_interfaceid": "890aa3e7-41ea-4c2a-bcef-7f412d80f1ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f447e989-eb77-4618-9ce5-271b79c2441f", "address": "fa:16:3e:d8:a4:a5", "network": {"id": "92db7fdf-c810-43ef-883b-69a04a04e5e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-66216092", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf447e989-eb", "ovs_interfaceid": "f447e989-eb77-4618-9ce5-271b79c2441f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4a78f612-a4ed-431d-b6c6-b62a23d83a95", "address": "fa:16:3e:13:b8:ac", "network": {"id": "92db7fdf-c810-43ef-883b-69a04a04e5e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-66216092", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ac0a84f26f244dcb698429bb447feff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a78f612-a4", "ovs_interfaceid": "4a78f612-a4ed-431d-b6c6-b62a23d83a95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:18:32 user nova-compute[74683]: DEBUG nova.compute.manager [req-9990245b-70ad-4abc-b72d-32e333ebf0c6 req-3e22760f-029d-45f7-ae5a-ba3964fa9325 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Detach interface failed, port_id=9cb93e0f-104e-4f2b-9b61-6d89781b34ca, reason: Instance d944f646-4c4d-4712-8dfe-9b1f0ff60683 could not be found. {{(pid=74683) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 16 11:18:34 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:34 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:18:34 user nova-compute[74683]: INFO nova.compute.manager [-] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Took 3.88 seconds to deallocate network for instance.
Oct 16 11:18:34 user nova-compute[74683]: DEBUG nova.compute.manager [req-eaac7552-f06d-496e-b3db-f55b4c2976eb req-f8d8d126-fdb2-4698-a412-b41aa0dba850 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received event network-vif-deleted-e57a2375-e447-4210-bbcf-41b3e5fc247c {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:18:34 user nova-compute[74683]: DEBUG nova.compute.manager [req-eaac7552-f06d-496e-b3db-f55b4c2976eb req-f8d8d126-fdb2-4698-a412-b41aa0dba850 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received event network-vif-deleted-890aa3e7-41ea-4c2a-bcef-7f412d80f1ac {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:18:34 user nova-compute[74683]: DEBUG nova.compute.manager [req-eaac7552-f06d-496e-b3db-f55b4c2976eb req-f8d8d126-fdb2-4698-a412-b41aa0dba850 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received event network-vif-deleted-4a78f612-a4ed-431d-b6c6-b62a23d83a95 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:18:34 user nova-compute[74683]: DEBUG nova.compute.manager [req-eaac7552-f06d-496e-b3db-f55b4c2976eb req-f8d8d126-fdb2-4698-a412-b41aa0dba850 service nova] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Received event network-vif-deleted-f447e989-eb77-4618-9ce5-271b79c2441f {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:18:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:37 user nova-compute[74683]: INFO nova.compute.manager [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] [instance: d944f646-4c4d-4712-8dfe-9b1f0ff60683] Took 2.65 seconds to detach 3 volumes for instance.
Oct 16 11:18:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:18:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:18:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:37 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:18:37 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:18:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.365s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:18:37 user nova-compute[74683]: INFO nova.scheduler.client.report [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Deleted allocations for instance d944f646-4c4d-4712-8dfe-9b1f0ff60683
Oct 16 11:18:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-82810680-9949-4998-947b-f41058f51aaa tempest-TaggedBootDevicesTest_v242-2030851280 tempest-TaggedBootDevicesTest_v242-2030851280-project-member] Lock "d944f646-4c4d-4712-8dfe-9b1f0ff60683" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.636s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:18:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:44 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:44 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:46 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:49 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:51 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:51 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:53 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:54 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:18:58 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:18:58 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Cleaning up deleted instances {{(pid=74683) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 16 11:18:58 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] There are 0 instances to clean {{(pid=74683) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 16 11:18:59 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:18:59 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:18:59 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:00 user nova-compute[74683]: DEBUG nova.compute.manager [req-252a4073-04ed-4c14-bb9f-695934d294fe req-cabb191d-f3cb-43df-9572-8d9966580a86 service nova] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Received event network-changed-84d9dc84-2273-4e6b-a8fe-9a94bddd198c {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:19:00 user nova-compute[74683]: DEBUG nova.compute.manager [req-252a4073-04ed-4c14-bb9f-695934d294fe req-cabb191d-f3cb-43df-9572-8d9966580a86 service nova] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Refreshing instance network info cache due to event network-changed-84d9dc84-2273-4e6b-a8fe-9a94bddd198c. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:19:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-252a4073-04ed-4c14-bb9f-695934d294fe req-cabb191d-f3cb-43df-9572-8d9966580a86 service nova] Acquiring lock "refresh_cache-9ae15ce7-996c-460f-a901-1570a2012af1" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:19:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-252a4073-04ed-4c14-bb9f-695934d294fe req-cabb191d-f3cb-43df-9572-8d9966580a86 service nova] Acquired lock "refresh_cache-9ae15ce7-996c-460f-a901-1570a2012af1" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:19:00 user nova-compute[74683]: DEBUG nova.network.neutron [req-252a4073-04ed-4c14-bb9f-695934d294fe req-cabb191d-f3cb-43df-9572-8d9966580a86 service nova] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Refreshing network info cache for port 84d9dc84-2273-4e6b-a8fe-9a94bddd198c {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:19:00 user nova-compute[74683]: DEBUG nova.network.neutron [req-252a4073-04ed-4c14-bb9f-695934d294fe req-cabb191d-f3cb-43df-9572-8d9966580a86 service nova] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Updated VIF entry in instance network info cache for port 84d9dc84-2273-4e6b-a8fe-9a94bddd198c. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:19:00 user nova-compute[74683]: DEBUG nova.network.neutron [req-252a4073-04ed-4c14-bb9f-695934d294fe req-cabb191d-f3cb-43df-9572-8d9966580a86 service nova] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Updating instance_info_cache with network_info: [{"id": "84d9dc84-2273-4e6b-a8fe-9a94bddd198c", "address": "fa:16:3e:07:96:fd", "network": {"id": "33b6ba99-0d95-497e-a744-1ae84c9d63e1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-240536039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5042cdda42b74341b6c592437b6bbdbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d9dc84-22", "ovs_interfaceid": "84d9dc84-2273-4e6b-a8fe-9a94bddd198c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:19:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-252a4073-04ed-4c14-bb9f-695934d294fe req-cabb191d-f3cb-43df-9572-8d9966580a86 service nova] Releasing lock "refresh_cache-9ae15ce7-996c-460f-a901-1570a2012af1" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:19:00 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:19:01 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-e3dc18c1-c155-4763-94d4-c8b4e56b6c9f tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Acquiring lock "interface-9ae15ce7-996c-460f-a901-1570a2012af1-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:19:01 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-e3dc18c1-c155-4763-94d4-c8b4e56b6c9f tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Lock "interface-9ae15ce7-996c-460f-a901-1570a2012af1-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:19:01 user nova-compute[74683]: DEBUG nova.objects.instance [None req-e3dc18c1-c155-4763-94d4-c8b4e56b6c9f tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Lazy-loading 'flavor' on Instance uuid 9ae15ce7-996c-460f-a901-1570a2012af1 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:19:01 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:01 user nova-compute[74683]: DEBUG nova.objects.instance [None req-e3dc18c1-c155-4763-94d4-c8b4e56b6c9f tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Lazy-loading 'pci_requests' on Instance uuid 9ae15ce7-996c-460f-a901-1570a2012af1 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:19:01 user nova-compute[74683]: DEBUG nova.objects.base [None req-e3dc18c1-c155-4763-94d4-c8b4e56b6c9f tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Object Instance<9ae15ce7-996c-460f-a901-1570a2012af1> lazy-loaded attributes: flavor,pci_requests {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:19:01 user nova-compute[74683]: DEBUG nova.network.neutron [None req-e3dc18c1-c155-4763-94d4-c8b4e56b6c9f tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] allocate_for_instance() {{(pid=74683) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 11:19:01 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:01 user nova-compute[74683]: DEBUG nova.policy [None req-e3dc18c1-c155-4763-94d4-c8b4e56b6c9f tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ceb56d9dc1b04324adfd4f8d0b1a9766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5042cdda42b74341b6c592437b6bbdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74683) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 11:19:02 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:19:03 user nova-compute[74683]: DEBUG nova.network.neutron [None req-e3dc18c1-c155-4763-94d4-c8b4e56b6c9f tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Successfully created port: ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05 {{(pid=74683) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 11:19:03 user nova-compute[74683]: DEBUG nova.network.neutron [None req-e3dc18c1-c155-4763-94d4-c8b4e56b6c9f tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Successfully updated port: ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05 {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:19:03 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-e3dc18c1-c155-4763-94d4-c8b4e56b6c9f tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Acquiring lock "refresh_cache-9ae15ce7-996c-460f-a901-1570a2012af1" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:19:03 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-e3dc18c1-c155-4763-94d4-c8b4e56b6c9f tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Acquired lock "refresh_cache-9ae15ce7-996c-460f-a901-1570a2012af1" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:19:03 user nova-compute[74683]: DEBUG nova.network.neutron [None req-e3dc18c1-c155-4763-94d4-c8b4e56b6c9f tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:19:04 user nova-compute[74683]: DEBUG nova.compute.manager [req-02b8aa03-d85f-4207-8a4c-3877668aa347 req-133eaf58-88d0-4872-9177-d6d018954cae service nova] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Received event network-changed-ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:19:04 user nova-compute[74683]: DEBUG nova.compute.manager [req-02b8aa03-d85f-4207-8a4c-3877668aa347 req-133eaf58-88d0-4872-9177-d6d018954cae service nova] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Refreshing instance network info cache due to event network-changed-ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:19:04 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-02b8aa03-d85f-4207-8a4c-3877668aa347 req-133eaf58-88d0-4872-9177-d6d018954cae service nova] Acquiring lock "refresh_cache-9ae15ce7-996c-460f-a901-1570a2012af1" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:19:04 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:19:04 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Starting heal instance info cache {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 11:19:04 user nova-compute[74683]: DEBUG nova.network.neutron [None req-e3dc18c1-c155-4763-94d4-c8b4e56b6c9f tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Updating instance_info_cache with network_info: [{"id": "84d9dc84-2273-4e6b-a8fe-9a94bddd198c", "address": "fa:16:3e:07:96:fd", "network": {"id": "33b6ba99-0d95-497e-a744-1ae84c9d63e1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-240536039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5042cdda42b74341b6c592437b6bbdbf", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d9dc84-22", "ovs_interfaceid": "84d9dc84-2273-4e6b-a8fe-9a94bddd198c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05", "address": "fa:16:3e:61:ea:f6", "network": {"id": "693d56b4-4756-4957-94a4-1f1bca480f12", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-659453574", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5042cdda42b74341b6c592437b6bbdbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecf30d0f-8f", "ovs_interfaceid": "ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:19:04 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-e3dc18c1-c155-4763-94d4-c8b4e56b6c9f tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Releasing lock "refresh_cache-9ae15ce7-996c-460f-a901-1570a2012af1" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:19:04 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-02b8aa03-d85f-4207-8a4c-3877668aa347 req-133eaf58-88d0-4872-9177-d6d018954cae service nova] Acquired lock "refresh_cache-9ae15ce7-996c-460f-a901-1570a2012af1" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:19:04 user nova-compute[74683]: DEBUG nova.network.neutron [req-02b8aa03-d85f-4207-8a4c-3877668aa347 req-133eaf58-88d0-4872-9177-d6d018954cae service nova] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Refreshing network info cache for port ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:19:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-e3dc18c1-c155-4763-94d4-c8b4e56b6c9f tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T11:17:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-717081521',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-717081521',id=14,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8efJVroKVuigryD4GSp1jU2h74/46LP7zUTBq1YNdoS9sGz/cMTsYXKQK2+Lj6yR1spH3hPAhB6Y4h51NvH2BYFIARH1zI9goHYvZdEeIkuG1XUEV0yYBKVJjNs/qPig==',key_name='tempest-keypair-1457686750',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:17:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5042cdda42b74341b6c592437b6bbdbf',ramdisk_id='',reservation_id='r-ezaz9z78',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2119065928',owner_user_name='tempest-TaggedAttachmentsTest-2119065928-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:17:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ceb56d9dc1b04324adfd4f8d0b1a9766',uuid=9ae15ce7-996c-460f-a901-1570a2012af1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05", "address": "fa:16:3e:61:ea:f6", "network": {"id": "693d56b4-4756-4957-94a4-1f1bca480f12", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-659453574", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5042cdda42b74341b6c592437b6bbdbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecf30d0f-8f", "ovs_interfaceid": "ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:19:04 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-e3dc18c1-c155-4763-94d4-c8b4e56b6c9f tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Converting VIF {"id": "ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05", "address": "fa:16:3e:61:ea:f6", "network": {"id": "693d56b4-4756-4957-94a4-1f1bca480f12", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-659453574", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5042cdda42b74341b6c592437b6bbdbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecf30d0f-8f", "ovs_interfaceid": "ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:19:04 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-e3dc18c1-c155-4763-94d4-c8b4e56b6c9f tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:ea:f6,bridge_name='br-int',has_traffic_filtering=True,id=ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05,network=Network(693d56b4-4756-4957-94a4-1f1bca480f12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecf30d0f-8f') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:19:04 user nova-compute[74683]: DEBUG os_vif [None req-e3dc18c1-c155-4763-94d4-c8b4e56b6c9f tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:ea:f6,bridge_name='br-int',has_traffic_filtering=True,id=ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05,network=Network(693d56b4-4756-4957-94a4-1f1bca480f12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecf30d0f-8f') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:19:04 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:04 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:19:04 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:19:04 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:04 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1b14ea9b-daa4-56ff-b9b2-779863402d73', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:19:04 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:04 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:19:04 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:04 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:04 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapecf30d0f-8f, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:19:04 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapecf30d0f-8f, col_values=(('qos', UUID('3a3e19ac-31c4-4c3c-b921-58dcc2dd9b2d')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:19:04 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapecf30d0f-8f, col_values=(('external_ids', {'iface-id': 'ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:ea:f6', 'vm-uuid': '9ae15ce7-996c-460f-a901-1570a2012af1'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:19:04 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:04 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:19:04 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:04 user nova-compute[74683]: INFO os_vif [None req-e3dc18c1-c155-4763-94d4-c8b4e56b6c9f tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:ea:f6,bridge_name='br-int',has_traffic_filtering=True,id=ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05,network=Network(693d56b4-4756-4957-94a4-1f1bca480f12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecf30d0f-8f')
Oct 16 11:19:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-e3dc18c1-c155-4763-94d4-c8b4e56b6c9f tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T11:17:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-717081521',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-717081521',id=14,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8efJVroKVuigryD4GSp1jU2h74/46LP7zUTBq1YNdoS9sGz/cMTsYXKQK2+Lj6yR1spH3hPAhB6Y4h51NvH2BYFIARH1zI9goHYvZdEeIkuG1XUEV0yYBKVJjNs/qPig==',key_name='tempest-keypair-1457686750',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:17:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5042cdda42b74341b6c592437b6bbdbf',ramdisk_id='',reservation_id='r-ezaz9z78',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2119065928',owner_user_name='tempest-TaggedAttachmentsTest-2119065928-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:17:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ceb56d9dc1b04324adfd4f8d0b1a9766',uuid=9ae15ce7-996c-460f-a901-1570a2012af1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05", "address": "fa:16:3e:61:ea:f6", "network": {"id": "693d56b4-4756-4957-94a4-1f1bca480f12", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-659453574", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5042cdda42b74341b6c592437b6bbdbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecf30d0f-8f", "ovs_interfaceid": "ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:19:04 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-e3dc18c1-c155-4763-94d4-c8b4e56b6c9f tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Converting VIF {"id": "ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05", "address": "fa:16:3e:61:ea:f6", "network": {"id": "693d56b4-4756-4957-94a4-1f1bca480f12", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-659453574", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5042cdda42b74341b6c592437b6bbdbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecf30d0f-8f", "ovs_interfaceid": "ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:19:04 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-e3dc18c1-c155-4763-94d4-c8b4e56b6c9f tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:ea:f6,bridge_name='br-int',has_traffic_filtering=True,id=ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05,network=Network(693d56b4-4756-4957-94a4-1f1bca480f12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecf30d0f-8f') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:19:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-e3dc18c1-c155-4763-94d4-c8b4e56b6c9f tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] attach device xml: <interface type="ethernet">
Oct 16 11:19:04 user nova-compute[74683]:   <mac address="fa:16:3e:61:ea:f6"/>
Oct 16 11:19:04 user nova-compute[74683]:   <model type="virtio"/>
Oct 16 11:19:04 user nova-compute[74683]:   <mtu size="1442"/>
Oct 16 11:19:04 user nova-compute[74683]:   <target dev="tapecf30d0f-8f"/>
Oct 16 11:19:04 user nova-compute[74683]: </interface>
Oct 16 11:19:04 user nova-compute[74683]:  {{(pid=74683) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 11:19:04 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:04 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "refresh_cache-fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:19:04 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquired lock "refresh_cache-fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:19:04 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Forcefully refreshing network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 11:19:04 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:05 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-5bafd51e-dccb-4bed-bce1-a5c6d4779673 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Acquiring lock "bd60be9c-0ff3-40a5-aaab-f31fa88a67f1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:19:05 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-5bafd51e-dccb-4bed-bce1-a5c6d4779673 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "bd60be9c-0ff3-40a5-aaab-f31fa88a67f1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:19:05 user nova-compute[74683]: INFO nova.compute.manager [None req-5bafd51e-dccb-4bed-bce1-a5c6d4779673 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Detaching volume 77512c13-eaac-4b26-8c71-57564bfca020
Oct 16 11:19:05 user nova-compute[74683]: INFO nova.virt.block_device [None req-5bafd51e-dccb-4bed-bce1-a5c6d4779673 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Attempting to driver detach volume 77512c13-eaac-4b26-8c71-57564bfca020 from mountpoint /dev/vdb
Oct 16 11:19:05 user nova-compute[74683]: DEBUG nova.compute.manager [req-abfc5275-048b-4604-a8b8-8f9ecaccc473 req-17a657df-7251-4b9d-9e06-d07f3e61afb5 service nova] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Received event network-vif-plugged-ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:19:05 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-abfc5275-048b-4604-a8b8-8f9ecaccc473 req-17a657df-7251-4b9d-9e06-d07f3e61afb5 service nova] Acquiring lock "9ae15ce7-996c-460f-a901-1570a2012af1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:19:05 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-abfc5275-048b-4604-a8b8-8f9ecaccc473 req-17a657df-7251-4b9d-9e06-d07f3e61afb5 service nova] Lock "9ae15ce7-996c-460f-a901-1570a2012af1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:19:05 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-abfc5275-048b-4604-a8b8-8f9ecaccc473 req-17a657df-7251-4b9d-9e06-d07f3e61afb5 service nova] Lock "9ae15ce7-996c-460f-a901-1570a2012af1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:19:05 user nova-compute[74683]: DEBUG nova.compute.manager [req-abfc5275-048b-4604-a8b8-8f9ecaccc473 req-17a657df-7251-4b9d-9e06-d07f3e61afb5 service nova] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] No waiting events found dispatching network-vif-plugged-ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:19:05 user nova-compute[74683]: WARNING nova.compute.manager [req-abfc5275-048b-4604-a8b8-8f9ecaccc473 req-17a657df-7251-4b9d-9e06-d07f3e61afb5 service nova] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Received unexpected event network-vif-plugged-ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05 for instance with vm_state active and task_state None.
Oct 16 11:19:05 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-5bafd51e-dccb-4bed-bce1-a5c6d4779673 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Attempting to detach device vdb from instance bd60be9c-0ff3-40a5-aaab-f31fa88a67f1 from the persistent domain config. {{(pid=74683) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 11:19:05 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-5bafd51e-dccb-4bed-bce1-a5c6d4779673 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 11:19:05 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:19:05 user nova-compute[74683]:   <source dev="/dev/sde"/>
Oct 16 11:19:05 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:19:05 user nova-compute[74683]:   <serial>77512c13-eaac-4b26-8c71-57564bfca020</serial>
Oct 16 11:19:05 user nova-compute[74683]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 11:19:05 user nova-compute[74683]: </disk>
Oct 16 11:19:05 user nova-compute[74683]:  {{(pid=74683) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 11:19:05 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-5bafd51e-dccb-4bed-bce1-a5c6d4779673 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Successfully detached device vdb from instance bd60be9c-0ff3-40a5-aaab-f31fa88a67f1 from the persistent domain config.
Oct 16 11:19:05 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-5bafd51e-dccb-4bed-bce1-a5c6d4779673 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bd60be9c-0ff3-40a5-aaab-f31fa88a67f1 from the live domain config. {{(pid=74683) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 11:19:05 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-5bafd51e-dccb-4bed-bce1-a5c6d4779673 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 11:19:05 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:19:05 user nova-compute[74683]:   <source dev="/dev/sde"/>
Oct 16 11:19:05 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:19:05 user nova-compute[74683]:   <serial>77512c13-eaac-4b26-8c71-57564bfca020</serial>
Oct 16 11:19:05 user nova-compute[74683]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 11:19:05 user nova-compute[74683]: </disk>
Oct 16 11:19:05 user nova-compute[74683]:  {{(pid=74683) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 11:19:05 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-e3dc18c1-c155-4763-94d4-c8b4e56b6c9f tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:19:05 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-e3dc18c1-c155-4763-94d4-c8b4e56b6c9f tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] No BDM found with device name hda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:19:05 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-e3dc18c1-c155-4763-94d4-c8b4e56b6c9f tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] No VIF found with MAC fa:16:3e:07:96:fd, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:19:05 user nova-compute[74683]: DEBUG nova.network.neutron [req-02b8aa03-d85f-4207-8a4c-3877668aa347 req-133eaf58-88d0-4872-9177-d6d018954cae service nova] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Updated VIF entry in instance network info cache for port ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:19:05 user nova-compute[74683]: DEBUG nova.network.neutron [req-02b8aa03-d85f-4207-8a4c-3877668aa347 req-133eaf58-88d0-4872-9177-d6d018954cae service nova] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Updating instance_info_cache with network_info: [{"id": "84d9dc84-2273-4e6b-a8fe-9a94bddd198c", "address": "fa:16:3e:07:96:fd", "network": {"id": "33b6ba99-0d95-497e-a744-1ae84c9d63e1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-240536039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5042cdda42b74341b6c592437b6bbdbf", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d9dc84-22", "ovs_interfaceid": "84d9dc84-2273-4e6b-a8fe-9a94bddd198c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05", "address": "fa:16:3e:61:ea:f6", "network": {"id": "693d56b4-4756-4957-94a4-1f1bca480f12", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-659453574", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5042cdda42b74341b6c592437b6bbdbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecf30d0f-8f", "ovs_interfaceid": "ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:19:05 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-e3dc18c1-c155-4763-94d4-c8b4e56b6c9f tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:19:05 user nova-compute[74683]:   <nova:package version="0.0.0"/>
Oct 16 11:19:05 user nova-compute[74683]:   <nova:name>tempest-device-tagging-server-717081521</nova:name>
Oct 16 11:19:05 user nova-compute[74683]:   <nova:creationTime>2023-10-16 11:19:05</nova:creationTime>
Oct 16 11:19:05 user nova-compute[74683]:   <nova:flavor name="m1.tiny">
Oct 16 11:19:05 user nova-compute[74683]:     <nova:memory>512</nova:memory>
Oct 16 11:19:05 user nova-compute[74683]:     <nova:disk>1</nova:disk>
Oct 16 11:19:05 user nova-compute[74683]:     <nova:swap>0</nova:swap>
Oct 16 11:19:05 user nova-compute[74683]:     <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:19:05 user nova-compute[74683]:     <nova:vcpus>1</nova:vcpus>
Oct 16 11:19:05 user nova-compute[74683]:   </nova:flavor>
Oct 16 11:19:05 user nova-compute[74683]:   <nova:owner>
Oct 16 11:19:05 user nova-compute[74683]:     <nova:user uuid="ceb56d9dc1b04324adfd4f8d0b1a9766">tempest-TaggedAttachmentsTest-2119065928-project-member</nova:user>
Oct 16 11:19:05 user nova-compute[74683]:     <nova:project uuid="5042cdda42b74341b6c592437b6bbdbf">tempest-TaggedAttachmentsTest-2119065928</nova:project>
Oct 16 11:19:05 user nova-compute[74683]:   </nova:owner>
Oct 16 11:19:05 user nova-compute[74683]:   <nova:root type="image" uuid="0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f"/>
Oct 16 11:19:05 user nova-compute[74683]:   <nova:ports>
Oct 16 11:19:05 user nova-compute[74683]:     <nova:port uuid="84d9dc84-2273-4e6b-a8fe-9a94bddd198c">
Oct 16 11:19:05 user nova-compute[74683]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 16 11:19:05 user nova-compute[74683]:     </nova:port>
Oct 16 11:19:05 user nova-compute[74683]:     <nova:port uuid="ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05">
Oct 16 11:19:05 user nova-compute[74683]:       <nova:ip type="fixed" address="10.10.10.17" ipVersion="4"/>
Oct 16 11:19:05 user nova-compute[74683]:     </nova:port>
Oct 16 11:19:05 user nova-compute[74683]:   </nova:ports>
Oct 16 11:19:05 user nova-compute[74683]: </nova:instance>
Oct 16 11:19:05 user nova-compute[74683]:  {{(pid=74683) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 16 11:19:05 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-02b8aa03-d85f-4207-8a4c-3877668aa347 req-133eaf58-88d0-4872-9177-d6d018954cae service nova] Releasing lock "refresh_cache-9ae15ce7-996c-460f-a901-1570a2012af1" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:19:05 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-e3dc18c1-c155-4763-94d4-c8b4e56b6c9f tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Lock "interface-9ae15ce7-996c-460f-a901-1570a2012af1-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 4.208s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:19:05 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Updating instance_info_cache with network_info: [{"id": "4e82d9f4-a743-4e67-bc9d-e9f7c527b102", "address": "fa:16:3e:5a:7a:f8", "network": {"id": "2bf14a39-69ea-4656-956a-f1578bb1836d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1838676509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e03b7938f054e1fadb9f650ac8db1c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e82d9f4-a7", "ovs_interfaceid": "4e82d9f4-a743-4e67-bc9d-e9f7c527b102", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:19:05 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Releasing lock "refresh_cache-fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:19:05 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Updated the network info_cache for instance {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 11:19:05 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:19:05 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74683) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 11:19:05 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:19:05 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Cleaning up deleted instances with incomplete migration  {{(pid=74683) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 16 11:19:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:05 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:19:05 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:19:05 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:19:05 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-25f83992-cb2a-4eca-bffb-07fc5184a7cd tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Acquiring lock "9ae15ce7-996c-460f-a901-1570a2012af1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:19:05 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-25f83992-cb2a-4eca-bffb-07fc5184a7cd tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Lock "9ae15ce7-996c-460f-a901-1570a2012af1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:19:05 user nova-compute[74683]: DEBUG nova.objects.instance [None req-25f83992-cb2a-4eca-bffb-07fc5184a7cd tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Lazy-loading 'flavor' on Instance uuid 9ae15ce7-996c-460f-a901-1570a2012af1 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:19:05 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-5bafd51e-dccb-4bed-bce1-a5c6d4779673 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bd60be9c-0ff3-40a5-aaab-f31fa88a67f1 {{(pid=74683) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 11:19:05 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-25f83992-cb2a-4eca-bffb-07fc5184a7cd tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Lock "9ae15ce7-996c-460f-a901-1570a2012af1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.089s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:19:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-25f83992-cb2a-4eca-bffb-07fc5184a7cd tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Acquiring lock "9ae15ce7-996c-460f-a901-1570a2012af1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:19:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-25f83992-cb2a-4eca-bffb-07fc5184a7cd tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Lock "9ae15ce7-996c-460f-a901-1570a2012af1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:19:06 user nova-compute[74683]: INFO nova.compute.manager [None req-25f83992-cb2a-4eca-bffb-07fc5184a7cd tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Attaching volume dfe37f66-addb-40d6-9d3d-0f0f3e8c3e91 to /dev/vdb
Oct 16 11:19:06 user nova-compute[74683]: DEBUG os_brick.utils [None req-25f83992-cb2a-4eca-bffb-07fc5184a7cd tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:19:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:06 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[424229e8-6f74-4875-bd50-8be659649991]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:70b9d336ab7d\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:19:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:06 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[6782e17c-6a36-452b-ab1e-02a9f6d36ce4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:19:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:06 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e90eff-3f7d-459d-965c-3c075d2be4a7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:19:06 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[8acbb25c-90ca-4d7f-995e-b86a0623e7d3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:19:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-25f83992-cb2a-4eca-bffb-07fc5184a7cd tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Running cmd (subprocess): nvme version {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-25f83992-cb2a-4eca-bffb-07fc5184a7cd tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] 'nvme version' failed. Not Retrying. {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:19:06 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.nvmeof [None req-25f83992-cb2a-4eca-bffb-07fc5184a7cd tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] nvme not present on system {{(pid=74683) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 11:19:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:19:06 user nova-compute[74683]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 11:19:06 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6688f7d-afee-447a-aabf-20b2aae155a3]: (4, '') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:19:06 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-25f83992-cb2a-4eca-bffb-07fc5184a7cd tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74683) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 11:19:06 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-25f83992-cb2a-4eca-bffb-07fc5184a7cd tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 11:19:06 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-25f83992-cb2a-4eca-bffb-07fc5184a7cd tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] LIGHTOS: no hostnqn found. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 11:19:06 user nova-compute[74683]: DEBUG os_brick.utils [None req-25f83992-cb2a-4eca-bffb-07fc5184a7cd tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:70b9d336ab7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:19:06 user nova-compute[74683]: DEBUG nova.virt.block_device [None req-25f83992-cb2a-4eca-bffb-07fc5184a7cd tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Updating existing volume attachment record: 83b2e5fe-2e7f-4db8-af51-de20e1204edb {{(pid=74683) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 11:19:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:06 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:19:07 user nova-compute[74683]: DEBUG nova.compute.manager [req-c7193003-ae05-42fc-bcce-9aced0a06f2a req-d1e72818-70a7-41eb-9eb2-f0ff5173f92c service nova] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Received event network-vif-plugged-ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:19:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c7193003-ae05-42fc-bcce-9aced0a06f2a req-d1e72818-70a7-41eb-9eb2-f0ff5173f92c service nova] Acquiring lock "9ae15ce7-996c-460f-a901-1570a2012af1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:19:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c7193003-ae05-42fc-bcce-9aced0a06f2a req-d1e72818-70a7-41eb-9eb2-f0ff5173f92c service nova] Lock "9ae15ce7-996c-460f-a901-1570a2012af1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:19:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c7193003-ae05-42fc-bcce-9aced0a06f2a req-d1e72818-70a7-41eb-9eb2-f0ff5173f92c service nova] Lock "9ae15ce7-996c-460f-a901-1570a2012af1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:19:07 user nova-compute[74683]: DEBUG nova.compute.manager [req-c7193003-ae05-42fc-bcce-9aced0a06f2a req-d1e72818-70a7-41eb-9eb2-f0ff5173f92c service nova] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] No waiting events found dispatching network-vif-plugged-ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:19:07 user nova-compute[74683]: WARNING nova.compute.manager [req-c7193003-ae05-42fc-bcce-9aced0a06f2a req-d1e72818-70a7-41eb-9eb2-f0ff5173f92c service nova] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Received unexpected event network-vif-plugged-ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05 for instance with vm_state active and task_state None.
Oct 16 11:19:07 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:19:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:19:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:19:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:19:07 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Auditing locally available compute resources for user (node: user) {{(pid=74683) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 11:19:07 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1db5e2-0b25-4d61-9dd3-038811b4eda1/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1db5e2-0b25-4d61-9dd3-038811b4eda1/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1db5e2-0b25-4d61-9dd3-038811b4eda1/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1db5e2-0b25-4d61-9dd3-038811b4eda1/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:08 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:19:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1db5e2-0b25-4d61-9dd3-038811b4eda1/disk.rescue --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1db5e2-0b25-4d61-9dd3-038811b4eda1/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1db5e2-0b25-4d61-9dd3-038811b4eda1/disk.rescue --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1db5e2-0b25-4d61-9dd3-038811b4eda1/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:09 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:19:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd60be9c-0ff3-40a5-aaab-f31fa88a67f1/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:09 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd60be9c-0ff3-40a5-aaab-f31fa88a67f1/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd60be9c-0ff3-40a5-aaab-f31fa88a67f1/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd60be9c-0ff3-40a5-aaab-f31fa88a67f1/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45ca3cbb-53d6-4046-9be3-92cc6b71bfad/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45ca3cbb-53d6-4046-9be3-92cc6b71bfad/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45ca3cbb-53d6-4046-9be3-92cc6b71bfad/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45ca3cbb-53d6-4046-9be3-92cc6b71bfad/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:10 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:19:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5e55361-d9ed-4d07-91b0-ec4d08b2e817/disk.rescue --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5e55361-d9ed-4d07-91b0-ec4d08b2e817/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5e55361-d9ed-4d07-91b0-ec4d08b2e817/disk.rescue --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5e55361-d9ed-4d07-91b0-ec4d08b2e817/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:11 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae15ce7-996c-460f-a901-1570a2012af1/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae15ce7-996c-460f-a901-1570a2012af1/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae15ce7-996c-460f-a901-1570a2012af1/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae15ce7-996c-460f-a901-1570a2012af1/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15b7e00-a608-4796-8e6e-1304785a9af5/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:12 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15b7e00-a608-4796-8e6e-1304785a9af5/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:12 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15b7e00-a608-4796-8e6e-1304785a9af5/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:12 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15b7e00-a608-4796-8e6e-1304785a9af5/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:12 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:19:12 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:19:12 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Hypervisor/Node resource view: name=user free_ram=7453MB free_disk=25.219345092773438GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74683) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 11:19:12 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:19:12 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:19:12 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Applying migration context for instance f192d1ec-311d-4a30-9766-361b27a8dae8 as it has an incoming, in-progress migration a748c33b-b037-42b4-81ba-0cc2bc8370bf. Migration status is finished {{(pid=74683) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 16 11:19:12 user nova-compute[74683]: INFO nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Updating resource usage from migration a748c33b-b037-42b4-81ba-0cc2bc8370bf
Oct 16 11:19:13 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 18a77385-fab9-4ea0-8aa6-666cf7e798a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:19:13 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance bd60be9c-0ff3-40a5-aaab-f31fa88a67f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:19:13 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 2f1db5e2-0b25-4d61-9dd3-038811b4eda1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:19:13 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:19:13 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance d5e55361-d9ed-4d07-91b0-ec4d08b2e817 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:19:13 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 9ae15ce7-996c-460f-a901-1570a2012af1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:19:13 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance c15b7e00-a608-4796-8e6e-1304785a9af5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:19:13 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Migration a748c33b-b037-42b4-81ba-0cc2bc8370bf is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 16 11:19:13 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance f192d1ec-311d-4a30-9766-361b27a8dae8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:19:13 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 45ca3cbb-53d6-4046-9be3-92cc6b71bfad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:19:13 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 11:19:13 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 11:19:13 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Refreshing inventories for resource provider 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 16 11:19:13 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Updating ProviderTree inventory for provider 7142d606-df50-4cbe-b5ed-1802caa31862 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 16 11:19:13 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Updating inventory in ProviderTree for provider 7142d606-df50-4cbe-b5ed-1802caa31862 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 16 11:19:13 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Refreshing aggregate associations for resource provider 7142d606-df50-4cbe-b5ed-1802caa31862, aggregates: None {{(pid=74683) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 16 11:19:13 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Refreshing trait associations for resource provider 7142d606-df50-4cbe-b5ed-1802caa31862, traits: COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VMVGA {{(pid=74683) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 16 11:19:13 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:19:13 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:19:13 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Compute_service record updated for user:user {{(pid=74683) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 11:19:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.994s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:19:14 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:16 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:16 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Acquiring lock "e84bb680-a542-4cb2-b0c5-67a210c25e9e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:19:16 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Lock "e84bb680-a542-4cb2-b0c5-67a210c25e9e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:19:16 user nova-compute[74683]: DEBUG nova.compute.manager [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Starting instance... {{(pid=74683) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 11:19:16 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:19:16 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:19:16 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74683) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 11:19:16 user nova-compute[74683]: INFO nova.compute.claims [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Claim successful on node user
Oct 16 11:19:16 user nova-compute[74683]: INFO nova.compute.manager [None req-2a74922a-2d9a-4151-9489-08d686559e0a tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Unrescuing
Oct 16 11:19:16 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2a74922a-2d9a-4151-9489-08d686559e0a tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Acquiring lock "refresh_cache-2f1db5e2-0b25-4d61-9dd3-038811b4eda1" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:19:16 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2a74922a-2d9a-4151-9489-08d686559e0a tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Acquired lock "refresh_cache-2f1db5e2-0b25-4d61-9dd3-038811b4eda1" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:19:16 user nova-compute[74683]: DEBUG nova.network.neutron [None req-2a74922a-2d9a-4151-9489-08d686559e0a tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:19:17 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:19:17 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:19:17 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.553s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:19:17 user nova-compute[74683]: DEBUG nova.compute.manager [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Start building networks asynchronously for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 11:19:17 user nova-compute[74683]: DEBUG nova.compute.manager [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Allocating IP information in the background. {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 11:19:17 user nova-compute[74683]: DEBUG nova.network.neutron [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] allocate_for_instance() {{(pid=74683) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 11:19:17 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 11:19:17 user nova-compute[74683]: DEBUG nova.compute.manager [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Start building block device mappings for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 11:19:17 user nova-compute[74683]: DEBUG nova.policy [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '12ee22dd1de940e0911943acd54dd7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0f6604619241b798a0043f73efd6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74683) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 11:19:17 user nova-compute[74683]: DEBUG nova.compute.manager [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Start spawning the instance on the hypervisor. {{(pid=74683) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 11:19:17 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Creating instance directory {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 11:19:17 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Creating image(s)
Oct 16 11:19:17 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Acquiring lock "/opt/stack/data/nova/instances/e84bb680-a542-4cb2-b0c5-67a210c25e9e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:19:17 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Lock "/opt/stack/data/nova/instances/e84bb680-a542-4cb2-b0c5-67a210c25e9e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:19:17 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Lock "/opt/stack/data/nova/instances/e84bb680-a542-4cb2-b0c5-67a210c25e9e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:19:17 user nova-compute[74683]: DEBUG nova.network.neutron [None req-2a74922a-2d9a-4151-9489-08d686559e0a tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Updating instance_info_cache with network_info: [{"id": "9476563e-0758-43d9-b920-87f412881869", "address": "fa:16:3e:18:cc:d6", "network": {"id": "5a04a566-92ef-4300-976b-5c34656ec9c7", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-706076145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "207a79fe27c042d8b081272246b98245", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9476563e-07", "ovs_interfaceid": "9476563e-0758-43d9-b920-87f412881869", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:19:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:17 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2a74922a-2d9a-4151-9489-08d686559e0a tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Releasing lock "refresh_cache-2f1db5e2-0b25-4d61-9dd3-038811b4eda1" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:19:17 user nova-compute[74683]: DEBUG nova.objects.instance [None req-2a74922a-2d9a-4151-9489-08d686559e0a tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Lazy-loading 'flavor' on Instance uuid 2f1db5e2-0b25-4d61-9dd3-038811b4eda1 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:19:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.210s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:17 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Acquiring lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:19:17 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:19:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.196s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/e84bb680-a542-4cb2-b0c5-67a210c25e9e/disk 1073741824 {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/e84bb680-a542-4cb2-b0c5-67a210c25e9e/disk 1073741824" returned: 0 in 0.050s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:17 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:19:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:18 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.196s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:18 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e84bb680-a542-4cb2-b0c5-67a210c25e9e/disk. size=1073741824 {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 11:19:18 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84bb680-a542-4cb2-b0c5-67a210c25e9e/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:18 user nova-compute[74683]: DEBUG nova.compute.manager [req-76112de3-9134-425d-913f-30641e5f2616 req-91656fad-872b-4647-8bf5-c25949902ec3 service nova] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Received event network-vif-unplugged-9476563e-0758-43d9-b920-87f412881869 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:19:18 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-76112de3-9134-425d-913f-30641e5f2616 req-91656fad-872b-4647-8bf5-c25949902ec3 service nova] Acquiring lock "2f1db5e2-0b25-4d61-9dd3-038811b4eda1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:19:18 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-76112de3-9134-425d-913f-30641e5f2616 req-91656fad-872b-4647-8bf5-c25949902ec3 service nova] Lock "2f1db5e2-0b25-4d61-9dd3-038811b4eda1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:19:18 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-76112de3-9134-425d-913f-30641e5f2616 req-91656fad-872b-4647-8bf5-c25949902ec3 service nova] Lock "2f1db5e2-0b25-4d61-9dd3-038811b4eda1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:19:18 user nova-compute[74683]: DEBUG nova.compute.manager [req-76112de3-9134-425d-913f-30641e5f2616 req-91656fad-872b-4647-8bf5-c25949902ec3 service nova] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] No waiting events found dispatching network-vif-unplugged-9476563e-0758-43d9-b920-87f412881869 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:19:18 user nova-compute[74683]: WARNING nova.compute.manager [req-76112de3-9134-425d-913f-30641e5f2616 req-91656fad-872b-4647-8bf5-c25949902ec3 service nova] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Received unexpected event network-vif-unplugged-9476563e-0758-43d9-b920-87f412881869 for instance with vm_state rescued and task_state unrescuing.
Oct 16 11:19:18 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:18 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:18 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84bb680-a542-4cb2-b0c5-67a210c25e9e/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:18 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Cannot resize image /opt/stack/data/nova/instances/e84bb680-a542-4cb2-b0c5-67a210c25e9e/disk to a smaller size. {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 11:19:18 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Created local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 11:19:18 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Ensure instance console log exists: /opt/stack/data/nova/instances/e84bb680-a542-4cb2-b0c5-67a210c25e9e/console.log {{(pid=74683) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 11:19:18 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:19:18 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:19:18 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:19:18 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Instance destroyed successfully.
Oct 16 11:19:18 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:18 user nova-compute[74683]: DEBUG nova.compute.manager [req-a0a96e38-3f61-492f-858e-c65ec46fc5d2 req-c3686f8e-2c2f-4f82-b319-ab34090d8a68 service nova] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Received event network-changed-9476563e-0758-43d9-b920-87f412881869 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:19:18 user nova-compute[74683]: DEBUG nova.compute.manager [req-a0a96e38-3f61-492f-858e-c65ec46fc5d2 req-c3686f8e-2c2f-4f82-b319-ab34090d8a68 service nova] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Refreshing instance network info cache due to event network-changed-9476563e-0758-43d9-b920-87f412881869. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:19:18 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a0a96e38-3f61-492f-858e-c65ec46fc5d2 req-c3686f8e-2c2f-4f82-b319-ab34090d8a68 service nova] Acquiring lock "refresh_cache-2f1db5e2-0b25-4d61-9dd3-038811b4eda1" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:19:18 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a0a96e38-3f61-492f-858e-c65ec46fc5d2 req-c3686f8e-2c2f-4f82-b319-ab34090d8a68 service nova] Acquired lock "refresh_cache-2f1db5e2-0b25-4d61-9dd3-038811b4eda1" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:19:18 user nova-compute[74683]: DEBUG nova.network.neutron [req-a0a96e38-3f61-492f-858e-c65ec46fc5d2 req-c3686f8e-2c2f-4f82-b319-ab34090d8a68 service nova] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Refreshing network info cache for port 9476563e-0758-43d9-b920-87f412881869 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:19:19 user nova-compute[74683]: DEBUG nova.network.neutron [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Successfully created port: f57bee45-4d7d-4d93-ab04-0777c2d47ec2 {{(pid=74683) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 11:19:19 user nova-compute[74683]: DEBUG nova.network.neutron [req-a0a96e38-3f61-492f-858e-c65ec46fc5d2 req-c3686f8e-2c2f-4f82-b319-ab34090d8a68 service nova] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Updated VIF entry in instance network info cache for port 9476563e-0758-43d9-b920-87f412881869. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:19:19 user nova-compute[74683]: DEBUG nova.network.neutron [req-a0a96e38-3f61-492f-858e-c65ec46fc5d2 req-c3686f8e-2c2f-4f82-b319-ab34090d8a68 service nova] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Updating instance_info_cache with network_info: [{"id": "9476563e-0758-43d9-b920-87f412881869", "address": "fa:16:3e:18:cc:d6", "network": {"id": "5a04a566-92ef-4300-976b-5c34656ec9c7", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-706076145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "207a79fe27c042d8b081272246b98245", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9476563e-07", "ovs_interfaceid": "9476563e-0758-43d9-b920-87f412881869", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:19:19 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a0a96e38-3f61-492f-858e-c65ec46fc5d2 req-c3686f8e-2c2f-4f82-b319-ab34090d8a68 service nova] Releasing lock "refresh_cache-2f1db5e2-0b25-4d61-9dd3-038811b4eda1" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:19:19 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:19 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:19 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:19 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:20 user nova-compute[74683]: DEBUG nova.network.neutron [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Successfully updated port: f57bee45-4d7d-4d93-ab04-0777c2d47ec2 {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:19:20 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Acquiring lock "refresh_cache-e84bb680-a542-4cb2-b0c5-67a210c25e9e" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:19:20 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Acquired lock "refresh_cache-e84bb680-a542-4cb2-b0c5-67a210c25e9e" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:19:20 user nova-compute[74683]: DEBUG nova.network.neutron [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:19:20 user nova-compute[74683]: DEBUG nova.compute.manager [req-59d580c1-7ccd-4157-a7f1-a8ce62015d06 req-36e4a20f-1a5b-4209-9a89-1930af5eb977 service nova] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Received event network-vif-plugged-9476563e-0758-43d9-b920-87f412881869 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:19:20 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-59d580c1-7ccd-4157-a7f1-a8ce62015d06 req-36e4a20f-1a5b-4209-9a89-1930af5eb977 service nova] Acquiring lock "2f1db5e2-0b25-4d61-9dd3-038811b4eda1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:19:20 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-59d580c1-7ccd-4157-a7f1-a8ce62015d06 req-36e4a20f-1a5b-4209-9a89-1930af5eb977 service nova] Lock "2f1db5e2-0b25-4d61-9dd3-038811b4eda1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:19:20 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-59d580c1-7ccd-4157-a7f1-a8ce62015d06 req-36e4a20f-1a5b-4209-9a89-1930af5eb977 service nova] Lock "2f1db5e2-0b25-4d61-9dd3-038811b4eda1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:19:20 user nova-compute[74683]: DEBUG nova.compute.manager [req-59d580c1-7ccd-4157-a7f1-a8ce62015d06 req-36e4a20f-1a5b-4209-9a89-1930af5eb977 service nova] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] No waiting events found dispatching network-vif-plugged-9476563e-0758-43d9-b920-87f412881869 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:19:20 user nova-compute[74683]: WARNING nova.compute.manager [req-59d580c1-7ccd-4157-a7f1-a8ce62015d06 req-36e4a20f-1a5b-4209-9a89-1930af5eb977 service nova] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Received unexpected event network-vif-plugged-9476563e-0758-43d9-b920-87f412881869 for instance with vm_state rescued and task_state unrescuing.
Oct 16 11:19:20 user nova-compute[74683]: DEBUG nova.network.neutron [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:19:20 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:20 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:20 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:20 user nova-compute[74683]: DEBUG nova.network.neutron [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Updating instance_info_cache with network_info: [{"id": "f57bee45-4d7d-4d93-ab04-0777c2d47ec2", "address": "fa:16:3e:80:bd:6c", "network": {"id": "9fca81bc-e1d4-4e04-83d3-e2a85af3b114", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1394655085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae0f6604619241b798a0043f73efd6df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf57bee45-4d", "ovs_interfaceid": "f57bee45-4d7d-4d93-ab04-0777c2d47ec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:19:21 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Releasing lock "refresh_cache-e84bb680-a542-4cb2-b0c5-67a210c25e9e" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:19:21 user nova-compute[74683]: DEBUG nova.compute.manager [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Instance network_info: |[{"id": "f57bee45-4d7d-4d93-ab04-0777c2d47ec2", "address": "fa:16:3e:80:bd:6c", "network": {"id": "9fca81bc-e1d4-4e04-83d3-e2a85af3b114", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1394655085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae0f6604619241b798a0043f73efd6df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf57bee45-4d", "ovs_interfaceid": "f57bee45-4d7d-4d93-ab04-0777c2d47ec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 11:19:21 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Start _get_guest_xml network_info=[{"id": "f57bee45-4d7d-4d93-ab04-0777c2d47ec2", "address": "fa:16:3e:80:bd:6c", "network": {"id": "9fca81bc-e1d4-4e04-83d3-e2a85af3b114", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1394655085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae0f6604619241b798a0043f73efd6df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf57bee45-4d", "ovs_interfaceid": "f57bee45-4d7d-4d93-ab04-0777c2d47ec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:19:21 user nova-compute[74683]: DEBUG nova.compute.manager [req-dbdfad63-fa7f-4650-a823-a5718b2f6353 req-d43e7ba9-f986-466c-9f32-c7a12964bd5f service nova] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Received event network-changed-9476563e-0758-43d9-b920-87f412881869 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:19:21 user nova-compute[74683]: DEBUG nova.compute.manager [req-dbdfad63-fa7f-4650-a823-a5718b2f6353 req-d43e7ba9-f986-466c-9f32-c7a12964bd5f service nova] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Refreshing instance network info cache due to event network-changed-9476563e-0758-43d9-b920-87f412881869. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:19:21 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-dbdfad63-fa7f-4650-a823-a5718b2f6353 req-d43e7ba9-f986-466c-9f32-c7a12964bd5f service nova] Acquiring lock "refresh_cache-2f1db5e2-0b25-4d61-9dd3-038811b4eda1" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:19:21 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-dbdfad63-fa7f-4650-a823-a5718b2f6353 req-d43e7ba9-f986-466c-9f32-c7a12964bd5f service nova] Acquired lock "refresh_cache-2f1db5e2-0b25-4d61-9dd3-038811b4eda1" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:19:21 user nova-compute[74683]: DEBUG nova.network.neutron [req-dbdfad63-fa7f-4650-a823-a5718b2f6353 req-d43e7ba9-f986-466c-9f32-c7a12964bd5f service nova] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Refreshing network info cache for port 9476563e-0758-43d9-b920-87f412881869 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:19:21 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:19:21 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:19:21 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:19:21 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:19:21 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:19:21 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:19:21 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:19:21 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:19:21 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:19:21 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:19:21 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:19:21 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:19:21 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:19:21 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:19:21 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:19:21 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:19:21 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:19:21 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:19:21 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:19:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1123916680',display_name='tempest-TestVolumeSwap-server-1123916680',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1123916680',id=17,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtJu6KPU+wFH8+oEgO3Gb6kPycHvwJ3cxMZMlUl+zyDZgHVHxTV6VkjR7C0TyWLXR9wkQzP+/vj+MZvv3t2oAR9TsJqTjYF/YD/LGJtaUXyJVeVjyaVfx0kdFqL3Nmcmg==',key_name='tempest-keypair-1228391609',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae0f6604619241b798a0043f73efd6df',ramdisk_id='',reservation_id='r-d9xuwcmi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1722834028',owner_user_name='tempest-TestVolumeSwap-1722834028-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:19:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12ee22dd1de940e0911943acd54dd7bb',uuid=e84bb680-a542-4cb2-b0c5-67a210c25e9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f57bee45-4d7d-4d93-ab04-0777c2d47ec2", "address": "fa:16:3e:80:bd:6c", "network": {"id": "9fca81bc-e1d4-4e04-83d3-e2a85af3b114", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1394655085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae0f6604619241b798a0043f73efd6df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf57bee45-4d", "ovs_interfaceid": "f57bee45-4d7d-4d93-ab04-0777c2d47ec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:19:21 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Converting VIF {"id": "f57bee45-4d7d-4d93-ab04-0777c2d47ec2", "address": "fa:16:3e:80:bd:6c", "network": {"id": "9fca81bc-e1d4-4e04-83d3-e2a85af3b114", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1394655085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae0f6604619241b798a0043f73efd6df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf57bee45-4d", "ovs_interfaceid": "f57bee45-4d7d-4d93-ab04-0777c2d47ec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:19:21 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:bd:6c,bridge_name='br-int',has_traffic_filtering=True,id=f57bee45-4d7d-4d93-ab04-0777c2d47ec2,network=Network(9fca81bc-e1d4-4e04-83d3-e2a85af3b114),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf57bee45-4d') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:19:21 user nova-compute[74683]: DEBUG nova.objects.instance [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Lazy-loading 'pci_devices' on Instance uuid e84bb680-a542-4cb2-b0c5-67a210c25e9e {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:19:21 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:19:21 user nova-compute[74683]:   <uuid>e84bb680-a542-4cb2-b0c5-67a210c25e9e</uuid>
Oct 16 11:19:21 user nova-compute[74683]:   <name>instance-00000011</name>
Oct 16 11:19:21 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:19:21 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:19:21 user nova-compute[74683]:   <metadata>
Oct 16 11:19:21 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:19:21 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:19:21 user nova-compute[74683]:       <nova:name>tempest-TestVolumeSwap-server-1123916680</nova:name>
Oct 16 11:19:21 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:19:21</nova:creationTime>
Oct 16 11:19:21 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:19:21 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:19:21 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:19:21 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:19:21 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:19:21 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:19:21 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:19:21 user nova-compute[74683]:       <nova:owner>
Oct 16 11:19:21 user nova-compute[74683]:         <nova:user uuid="12ee22dd1de940e0911943acd54dd7bb">tempest-TestVolumeSwap-1722834028-project-member</nova:user>
Oct 16 11:19:21 user nova-compute[74683]:         <nova:project uuid="ae0f6604619241b798a0043f73efd6df">tempest-TestVolumeSwap-1722834028</nova:project>
Oct 16 11:19:21 user nova-compute[74683]:       </nova:owner>
Oct 16 11:19:21 user nova-compute[74683]:       <nova:root type="image" uuid="0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f"/>
Oct 16 11:19:21 user nova-compute[74683]:       <nova:ports>
Oct 16 11:19:21 user nova-compute[74683]:         <nova:port uuid="f57bee45-4d7d-4d93-ab04-0777c2d47ec2">
Oct 16 11:19:21 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 16 11:19:21 user nova-compute[74683]:         </nova:port>
Oct 16 11:19:21 user nova-compute[74683]:       </nova:ports>
Oct 16 11:19:21 user nova-compute[74683]:     </nova:instance>
Oct 16 11:19:21 user nova-compute[74683]:   </metadata>
Oct 16 11:19:21 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:19:21 user nova-compute[74683]:     <system>
Oct 16 11:19:21 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:19:21 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:19:21 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:19:21 user nova-compute[74683]:       <entry name="serial">e84bb680-a542-4cb2-b0c5-67a210c25e9e</entry>
Oct 16 11:19:21 user nova-compute[74683]:       <entry name="uuid">e84bb680-a542-4cb2-b0c5-67a210c25e9e</entry>
Oct 16 11:19:21 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:19:21 user nova-compute[74683]:     </system>
Oct 16 11:19:21 user nova-compute[74683]:   </sysinfo>
Oct 16 11:19:21 user nova-compute[74683]:   <os>
Oct 16 11:19:21 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:19:21 user nova-compute[74683]:     <boot dev="hd"/>
Oct 16 11:19:21 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:19:21 user nova-compute[74683]:   </os>
Oct 16 11:19:21 user nova-compute[74683]:   <features>
Oct 16 11:19:21 user nova-compute[74683]:     <acpi/>
Oct 16 11:19:21 user nova-compute[74683]:     <apic/>
Oct 16 11:19:21 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:19:21 user nova-compute[74683]:   </features>
Oct 16 11:19:21 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:19:21 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:19:21 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:19:21 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:19:21 user nova-compute[74683]:   </clock>
Oct 16 11:19:21 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:19:21 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:19:21 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:19:21 user nova-compute[74683]:   </cpu>
Oct 16 11:19:21 user nova-compute[74683]:   <devices>
Oct 16 11:19:21 user nova-compute[74683]:     <disk type="file" device="disk">
Oct 16 11:19:21 user nova-compute[74683]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 11:19:21 user nova-compute[74683]:       <source file="/opt/stack/data/nova/instances/e84bb680-a542-4cb2-b0c5-67a210c25e9e/disk"/>
Oct 16 11:19:21 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:19:21 user nova-compute[74683]:     </disk>
Oct 16 11:19:21 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:19:21 user nova-compute[74683]:       <mac address="fa:16:3e:80:bd:6c"/>
Oct 16 11:19:21 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:19:21 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:19:21 user nova-compute[74683]:       <target dev="tapf57bee45-4d"/>
Oct 16 11:19:21 user nova-compute[74683]:     </interface>
Oct 16 11:19:21 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:19:21 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/e84bb680-a542-4cb2-b0c5-67a210c25e9e/console.log" append="off"/>
Oct 16 11:19:21 user nova-compute[74683]:     </serial>
Oct 16 11:19:21 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:19:21 user nova-compute[74683]:     <video>
Oct 16 11:19:21 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:19:21 user nova-compute[74683]:     </video>
Oct 16 11:19:21 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:19:21 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:19:21 user nova-compute[74683]:     </rng>
Oct 16 11:19:21 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:19:21 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:19:21 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:19:21 user nova-compute[74683]:     </memballoon>
Oct 16 11:19:21 user nova-compute[74683]:   </devices>
Oct 16 11:19:21 user nova-compute[74683]: </domain>
Oct 16 11:19:21 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:19:21 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:19:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1123916680',display_name='tempest-TestVolumeSwap-server-1123916680',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1123916680',id=17,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtJu6KPU+wFH8+oEgO3Gb6kPycHvwJ3cxMZMlUl+zyDZgHVHxTV6VkjR7C0TyWLXR9wkQzP+/vj+MZvv3t2oAR9TsJqTjYF/YD/LGJtaUXyJVeVjyaVfx0kdFqL3Nmcmg==',key_name='tempest-keypair-1228391609',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae0f6604619241b798a0043f73efd6df',ramdisk_id='',reservation_id='r-d9xuwcmi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1722834028',owner_user_name='tempest-TestVolumeSwap-1722834028-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:19:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12ee22dd1de940e0911943acd54dd7bb',uuid=e84bb680-a542-4cb2-b0c5-67a210c25e9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f57bee45-4d7d-4d93-ab04-0777c2d47ec2", "address": "fa:16:3e:80:bd:6c", "network": {"id": "9fca81bc-e1d4-4e04-83d3-e2a85af3b114", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1394655085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae0f6604619241b798a0043f73efd6df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf57bee45-4d", "ovs_interfaceid": "f57bee45-4d7d-4d93-ab04-0777c2d47ec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:19:21 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Converting VIF {"id": "f57bee45-4d7d-4d93-ab04-0777c2d47ec2", "address": "fa:16:3e:80:bd:6c", "network": {"id": "9fca81bc-e1d4-4e04-83d3-e2a85af3b114", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1394655085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae0f6604619241b798a0043f73efd6df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf57bee45-4d", "ovs_interfaceid": "f57bee45-4d7d-4d93-ab04-0777c2d47ec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:19:21 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:bd:6c,bridge_name='br-int',has_traffic_filtering=True,id=f57bee45-4d7d-4d93-ab04-0777c2d47ec2,network=Network(9fca81bc-e1d4-4e04-83d3-e2a85af3b114),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf57bee45-4d') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:19:21 user nova-compute[74683]: DEBUG os_vif [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:bd:6c,bridge_name='br-int',has_traffic_filtering=True,id=f57bee45-4d7d-4d93-ab04-0777c2d47ec2,network=Network(9fca81bc-e1d4-4e04-83d3-e2a85af3b114),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf57bee45-4d') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:19:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:19:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:19:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8099ffae-aa47-58b1-9dd6-ab461b7dbd69', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:19:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf57bee45-4d, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:19:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf57bee45-4d, col_values=(('qos', UUID('7a629633-ad77-423e-8649-c45c79e21210')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:19:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf57bee45-4d, col_values=(('external_ids', {'iface-id': 'f57bee45-4d7d-4d93-ab04-0777c2d47ec2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:bd:6c', 'vm-uuid': 'e84bb680-a542-4cb2-b0c5-67a210c25e9e'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:19:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:19:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:21 user nova-compute[74683]: INFO os_vif [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:bd:6c,bridge_name='br-int',has_traffic_filtering=True,id=f57bee45-4d7d-4d93-ab04-0777c2d47ec2,network=Network(9fca81bc-e1d4-4e04-83d3-e2a85af3b114),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf57bee45-4d')
Oct 16 11:19:21 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:19:21 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] No VIF found with MAC fa:16:3e:80:bd:6c, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:19:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:21 user nova-compute[74683]: DEBUG nova.network.neutron [req-dbdfad63-fa7f-4650-a823-a5718b2f6353 req-d43e7ba9-f986-466c-9f32-c7a12964bd5f service nova] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Updated VIF entry in instance network info cache for port 9476563e-0758-43d9-b920-87f412881869. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:19:21 user nova-compute[74683]: DEBUG nova.network.neutron [req-dbdfad63-fa7f-4650-a823-a5718b2f6353 req-d43e7ba9-f986-466c-9f32-c7a12964bd5f service nova] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Updating instance_info_cache with network_info: [{"id": "9476563e-0758-43d9-b920-87f412881869", "address": "fa:16:3e:18:cc:d6", "network": {"id": "5a04a566-92ef-4300-976b-5c34656ec9c7", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-706076145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "207a79fe27c042d8b081272246b98245", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9476563e-07", "ovs_interfaceid": "9476563e-0758-43d9-b920-87f412881869", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:19:21 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-dbdfad63-fa7f-4650-a823-a5718b2f6353 req-d43e7ba9-f986-466c-9f32-c7a12964bd5f service nova] Releasing lock "refresh_cache-2f1db5e2-0b25-4d61-9dd3-038811b4eda1" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:19:21 user nova-compute[74683]: DEBUG nova.compute.manager [req-dbdfad63-fa7f-4650-a823-a5718b2f6353 req-d43e7ba9-f986-466c-9f32-c7a12964bd5f service nova] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Received event network-changed-f57bee45-4d7d-4d93-ab04-0777c2d47ec2 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:19:21 user nova-compute[74683]: DEBUG nova.compute.manager [req-dbdfad63-fa7f-4650-a823-a5718b2f6353 req-d43e7ba9-f986-466c-9f32-c7a12964bd5f service nova] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Refreshing instance network info cache due to event network-changed-f57bee45-4d7d-4d93-ab04-0777c2d47ec2. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:19:21 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-dbdfad63-fa7f-4650-a823-a5718b2f6353 req-d43e7ba9-f986-466c-9f32-c7a12964bd5f service nova] Acquiring lock "refresh_cache-e84bb680-a542-4cb2-b0c5-67a210c25e9e" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:19:21 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-dbdfad63-fa7f-4650-a823-a5718b2f6353 req-d43e7ba9-f986-466c-9f32-c7a12964bd5f service nova] Acquired lock "refresh_cache-e84bb680-a542-4cb2-b0c5-67a210c25e9e" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:19:21 user nova-compute[74683]: DEBUG nova.network.neutron [req-dbdfad63-fa7f-4650-a823-a5718b2f6353 req-d43e7ba9-f986-466c-9f32-c7a12964bd5f service nova] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Refreshing network info cache for port f57bee45-4d7d-4d93-ab04-0777c2d47ec2 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:19:22 user nova-compute[74683]: DEBUG nova.network.neutron [req-dbdfad63-fa7f-4650-a823-a5718b2f6353 req-d43e7ba9-f986-466c-9f32-c7a12964bd5f service nova] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Updated VIF entry in instance network info cache for port f57bee45-4d7d-4d93-ab04-0777c2d47ec2. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:19:22 user nova-compute[74683]: DEBUG nova.network.neutron [req-dbdfad63-fa7f-4650-a823-a5718b2f6353 req-d43e7ba9-f986-466c-9f32-c7a12964bd5f service nova] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Updating instance_info_cache with network_info: [{"id": "f57bee45-4d7d-4d93-ab04-0777c2d47ec2", "address": "fa:16:3e:80:bd:6c", "network": {"id": "9fca81bc-e1d4-4e04-83d3-e2a85af3b114", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1394655085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae0f6604619241b798a0043f73efd6df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf57bee45-4d", "ovs_interfaceid": "f57bee45-4d7d-4d93-ab04-0777c2d47ec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:19:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-dbdfad63-fa7f-4650-a823-a5718b2f6353 req-d43e7ba9-f986-466c-9f32-c7a12964bd5f service nova] Releasing lock "refresh_cache-e84bb680-a542-4cb2-b0c5-67a210c25e9e" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:19:22 user nova-compute[74683]: DEBUG nova.compute.manager [None req-2a74922a-2d9a-4151-9489-08d686559e0a tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:19:22 user nova-compute[74683]: DEBUG nova.compute.manager [req-c6acd2a5-0ba2-4226-9b14-ab13aafda6e3 req-7a784c4d-fda0-4575-b951-a05b40789818 service nova] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Received event network-vif-plugged-9476563e-0758-43d9-b920-87f412881869 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:19:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c6acd2a5-0ba2-4226-9b14-ab13aafda6e3 req-7a784c4d-fda0-4575-b951-a05b40789818 service nova] Acquiring lock "2f1db5e2-0b25-4d61-9dd3-038811b4eda1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:19:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c6acd2a5-0ba2-4226-9b14-ab13aafda6e3 req-7a784c4d-fda0-4575-b951-a05b40789818 service nova] Lock "2f1db5e2-0b25-4d61-9dd3-038811b4eda1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:19:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c6acd2a5-0ba2-4226-9b14-ab13aafda6e3 req-7a784c4d-fda0-4575-b951-a05b40789818 service nova] Lock "2f1db5e2-0b25-4d61-9dd3-038811b4eda1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:19:22 user nova-compute[74683]: DEBUG nova.compute.manager [req-c6acd2a5-0ba2-4226-9b14-ab13aafda6e3 req-7a784c4d-fda0-4575-b951-a05b40789818 service nova] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] No waiting events found dispatching network-vif-plugged-9476563e-0758-43d9-b920-87f412881869 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:19:22 user nova-compute[74683]: WARNING nova.compute.manager [req-c6acd2a5-0ba2-4226-9b14-ab13aafda6e3 req-7a784c4d-fda0-4575-b951-a05b40789818 service nova] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Received unexpected event network-vif-plugged-9476563e-0758-43d9-b920-87f412881869 for instance with vm_state active and task_state None.
Oct 16 11:19:22 user nova-compute[74683]: DEBUG nova.compute.manager [req-c6acd2a5-0ba2-4226-9b14-ab13aafda6e3 req-7a784c4d-fda0-4575-b951-a05b40789818 service nova] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Received event network-vif-plugged-9476563e-0758-43d9-b920-87f412881869 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:19:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c6acd2a5-0ba2-4226-9b14-ab13aafda6e3 req-7a784c4d-fda0-4575-b951-a05b40789818 service nova] Acquiring lock "2f1db5e2-0b25-4d61-9dd3-038811b4eda1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:19:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c6acd2a5-0ba2-4226-9b14-ab13aafda6e3 req-7a784c4d-fda0-4575-b951-a05b40789818 service nova] Lock "2f1db5e2-0b25-4d61-9dd3-038811b4eda1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:19:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c6acd2a5-0ba2-4226-9b14-ab13aafda6e3 req-7a784c4d-fda0-4575-b951-a05b40789818 service nova] Lock "2f1db5e2-0b25-4d61-9dd3-038811b4eda1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:19:22 user nova-compute[74683]: DEBUG nova.compute.manager [req-c6acd2a5-0ba2-4226-9b14-ab13aafda6e3 req-7a784c4d-fda0-4575-b951-a05b40789818 service nova] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] No waiting events found dispatching network-vif-plugged-9476563e-0758-43d9-b920-87f412881869 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:19:22 user nova-compute[74683]: WARNING nova.compute.manager [req-c6acd2a5-0ba2-4226-9b14-ab13aafda6e3 req-7a784c4d-fda0-4575-b951-a05b40789818 service nova] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Received unexpected event network-vif-plugged-9476563e-0758-43d9-b920-87f412881869 for instance with vm_state active and task_state None.
Oct 16 11:19:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:23 user nova-compute[74683]: DEBUG nova.compute.manager [req-a286b317-b5b8-4cfb-8b78-97b8f65951a6 req-02cbcf06-0e3d-4bc5-a36b-5c4c2062ced0 service nova] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Received event network-vif-plugged-f57bee45-4d7d-4d93-ab04-0777c2d47ec2 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:19:23 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a286b317-b5b8-4cfb-8b78-97b8f65951a6 req-02cbcf06-0e3d-4bc5-a36b-5c4c2062ced0 service nova] Acquiring lock "e84bb680-a542-4cb2-b0c5-67a210c25e9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:19:23 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a286b317-b5b8-4cfb-8b78-97b8f65951a6 req-02cbcf06-0e3d-4bc5-a36b-5c4c2062ced0 service nova] Lock "e84bb680-a542-4cb2-b0c5-67a210c25e9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:19:23 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a286b317-b5b8-4cfb-8b78-97b8f65951a6 req-02cbcf06-0e3d-4bc5-a36b-5c4c2062ced0 service nova] Lock "e84bb680-a542-4cb2-b0c5-67a210c25e9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:19:23 user nova-compute[74683]: DEBUG nova.compute.manager [req-a286b317-b5b8-4cfb-8b78-97b8f65951a6 req-02cbcf06-0e3d-4bc5-a36b-5c4c2062ced0 service nova] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] No waiting events found dispatching network-vif-plugged-f57bee45-4d7d-4d93-ab04-0777c2d47ec2 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:19:23 user nova-compute[74683]: WARNING nova.compute.manager [req-a286b317-b5b8-4cfb-8b78-97b8f65951a6 req-02cbcf06-0e3d-4bc5-a36b-5c4c2062ced0 service nova] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Received unexpected event network-vif-plugged-f57bee45-4d7d-4d93-ab04-0777c2d47ec2 for instance with vm_state building and task_state spawning.
Oct 16 11:19:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:24 user nova-compute[74683]: DEBUG nova.compute.manager [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Instance event wait completed in 0 seconds for  {{(pid=74683) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 11:19:24 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Guest created on hypervisor {{(pid=74683) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 11:19:24 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Instance spawned successfully.
Oct 16 11:19:24 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 11:19:24 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Found default for hw_cdrom_bus of ide {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:19:24 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Found default for hw_disk_bus of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:19:24 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Found default for hw_input_bus of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:19:24 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Found default for hw_pointer_model of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:19:24 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Found default for hw_video_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:19:25 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Found default for hw_vif_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:19:25 user nova-compute[74683]: INFO nova.compute.manager [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Took 7.63 seconds to spawn the instance on the hypervisor.
Oct 16 11:19:25 user nova-compute[74683]: DEBUG nova.compute.manager [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:19:25 user nova-compute[74683]: DEBUG nova.compute.manager [req-f2e0ce67-b86c-4d70-b929-a5f5af236eda req-58101728-f088-4ba5-b7b4-d29ed83be907 service nova] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Received event network-vif-plugged-f57bee45-4d7d-4d93-ab04-0777c2d47ec2 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:19:25 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f2e0ce67-b86c-4d70-b929-a5f5af236eda req-58101728-f088-4ba5-b7b4-d29ed83be907 service nova] Acquiring lock "e84bb680-a542-4cb2-b0c5-67a210c25e9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:19:25 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f2e0ce67-b86c-4d70-b929-a5f5af236eda req-58101728-f088-4ba5-b7b4-d29ed83be907 service nova] Lock "e84bb680-a542-4cb2-b0c5-67a210c25e9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:19:25 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f2e0ce67-b86c-4d70-b929-a5f5af236eda req-58101728-f088-4ba5-b7b4-d29ed83be907 service nova] Lock "e84bb680-a542-4cb2-b0c5-67a210c25e9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:19:25 user nova-compute[74683]: DEBUG nova.compute.manager [req-f2e0ce67-b86c-4d70-b929-a5f5af236eda req-58101728-f088-4ba5-b7b4-d29ed83be907 service nova] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] No waiting events found dispatching network-vif-plugged-f57bee45-4d7d-4d93-ab04-0777c2d47ec2 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:19:25 user nova-compute[74683]: WARNING nova.compute.manager [req-f2e0ce67-b86c-4d70-b929-a5f5af236eda req-58101728-f088-4ba5-b7b4-d29ed83be907 service nova] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Received unexpected event network-vif-plugged-f57bee45-4d7d-4d93-ab04-0777c2d47ec2 for instance with vm_state building and task_state spawning.
Oct 16 11:19:25 user nova-compute[74683]: INFO nova.compute.manager [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Took 8.59 seconds to build instance.
Oct 16 11:19:25 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-fbf775ba-32b8-42bb-aab6-96ba3fce5d6b tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Lock "e84bb680-a542-4cb2-b0c5-67a210c25e9e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.721s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:19:25 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-5bafd51e-dccb-4bed-bce1-a5c6d4779673 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bd60be9c-0ff3-40a5-aaab-f31fa88a67f1 is timed out.
Oct 16 11:19:25 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-5bafd51e-dccb-4bed-bce1-a5c6d4779673 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Successfully detached device vdb from instance bd60be9c-0ff3-40a5-aaab-f31fa88a67f1 from the live domain config.
Oct 16 11:19:25 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bafd51e-dccb-4bed-bce1-a5c6d4779673 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] calling os-brick to detach iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 11:19:25 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bafd51e-dccb-4bed-bce1-a5c6d4779673 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, {'target_iqn': 'iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wFLNUMEY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:19:25 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-5bafd51e-dccb-4bed-bce1-a5c6d4779673 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:19:25 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-5bafd51e-dccb-4bed-bce1-a5c6d4779673 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:19:25 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-5bafd51e-dccb-4bed-bce1-a5c6d4779673 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:19:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:25 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3092e7-fe80-47fc-a49e-4b10bb8b5f7b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:19:25 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bafd51e-dccb-4bed-bce1-a5c6d4779673 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 11:19:25 user nova-compute[74683]: No targets found.
Oct 16 11:19:25 user nova-compute[74683]: iSNS:
Oct 16 11:19:25 user nova-compute[74683]: No targets found.
Oct 16 11:19:25 user nova-compute[74683]: STATIC:
Oct 16 11:19:25 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5
Oct 16 11:19:25 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:19:25 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:19:25 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb
Oct 16 11:19:25 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:19:25 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:19:25 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020
Oct 16 11:19:25 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:19:25 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:19:25 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b
Oct 16 11:19:25 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:19:25 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:19:25 user nova-compute[74683]: FIRMWARE:
Oct 16 11:19:25 user nova-compute[74683]: No targets found.
Oct 16 11:19:25 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:19:25 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bafd51e-dccb-4bed-bce1-a5c6d4779673 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 11:19:25 user nova-compute[74683]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 11:19:25 user nova-compute[74683]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74683) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 11:19:25 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bafd51e-dccb-4bed-bce1-a5c6d4779673 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020', 0)] {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 11:19:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:25 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a035f1c3-a189-438f-9493-6ba4c7241e06]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:19:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:25 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63afc1e-c3ee-450a-a625-607ecd9a5134]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:19:25 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bafd51e-dccb-4bed-bce1-a5c6d4779673 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:19:25 user nova-compute[74683]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)
Oct 16 11:19:25 user nova-compute[74683]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)
Oct 16 11:19:25 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:19:25 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:19:25 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bafd51e-dccb-4bed-bce1-a5c6d4779673 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:19:25 user nova-compute[74683]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)
Oct 16 11:19:25 user nova-compute[74683]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)
Oct 16 11:19:25 user nova-compute[74683]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 (non-flash)
Oct 16 11:19:25 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:19:25 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bafd51e-dccb-4bed-bce1-a5c6d4779673 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda4c794c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020'): ({'sde'}, set())}) {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 11:19:25 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-5bafd51e-dccb-4bed-bce1-a5c6d4779673 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Removing single pathed devices sde {{(pid=74683) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 11:19:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:26 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[746179d1-8843-49df-8616-e43863ccfd81]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:19:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.034s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:26 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d479feff-5dab-4ad7-b91a-e7fbd29df5fa]: (4, ('ok\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:19:26 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-5bafd51e-dccb-4bed-bce1-a5c6d4779673 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Flushing IO for device /dev/sde {{(pid=74683) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 11:19:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:26 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf82aad-31c7-46f5-ac12-7039f35dd157]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:19:26 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-5bafd51e-dccb-4bed-bce1-a5c6d4779673 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74683) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 11:19:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.060s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:26 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[801b1e4c-cc95-4a57-86b9-cbb2fac7c637]: (4, ('1', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:19:26 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-5bafd51e-dccb-4bed-bce1-a5c6d4779673 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 11:19:26 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-5bafd51e-dccb-4bed-bce1-a5c6d4779673 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] SCSI volumes sde have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 11:19:26 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bafd51e-dccb-4bed-bce1-a5c6d4779673 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020')] {{(pid=74683) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 11:19:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:26 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[919fea23-34ff-4cc9-a36c-5b45aefe8e90]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:19:26 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bafd51e-dccb-4bed-bce1-a5c6d4779673 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:19:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 -p 172.16.0.220:3260 --logout {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:26 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a12cb0-859c-4aaf-84e3-e4bca50b7ab7]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:19:26 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bafd51e-dccb-4bed-bce1-a5c6d4779673 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020, portal: 172.16.0.220,3260]
Oct 16 11:19:26 user nova-compute[74683]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020, portal: 172.16.0.220,3260] successful.
Oct 16 11:19:26 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:19:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 -p 172.16.0.220:3260 --op delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77512c13-eaac-4b26-8c71-57564bfca020 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:26 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d67bcd-6438-4a6f-963d-a76664546878]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:19:26 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bafd51e-dccb-4bed-bce1-a5c6d4779673 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:19:26 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-5bafd51e-dccb-4bed-bce1-a5c6d4779673 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.389s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:19:26 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bafd51e-dccb-4bed-bce1-a5c6d4779673 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] <== disconnect_volume: return (392ms) None {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:19:26 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bafd51e-dccb-4bed-bce1-a5c6d4779673 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Disconnected iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 11:19:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:27 user nova-compute[74683]: DEBUG nova.objects.instance [None req-5bafd51e-dccb-4bed-bce1-a5c6d4779673 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lazy-loading 'flavor' on Instance uuid bd60be9c-0ff3-40a5-aaab-f31fa88a67f1 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:19:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-5bafd51e-dccb-4bed-bce1-a5c6d4779673 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "bd60be9c-0ff3-40a5-aaab-f31fa88a67f1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.318s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:19:30 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:33 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:37 user nova-compute[74683]: DEBUG nova.network.neutron [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Port dbbeadad-745e-4d28-a242-577b3197b079 binding to destination host user is already ACTIVE {{(pid=74683) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Oct 16 11:19:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Acquiring lock "refresh_cache-f192d1ec-311d-4a30-9766-361b27a8dae8" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:19:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Acquired lock "refresh_cache-f192d1ec-311d-4a30-9766-361b27a8dae8" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:19:37 user nova-compute[74683]: DEBUG nova.network.neutron [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:19:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Acquiring lock "edd01413-1f8a-49e3-aa3c-ecb19c62afae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:19:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "edd01413-1f8a-49e3-aa3c-ecb19c62afae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:19:37 user nova-compute[74683]: DEBUG nova.compute.manager [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Starting instance... {{(pid=74683) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 11:19:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:19:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:19:37 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74683) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 11:19:37 user nova-compute[74683]: INFO nova.compute.claims [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Claim successful on node user
Oct 16 11:19:37 user nova-compute[74683]: DEBUG nova.network.neutron [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Updating instance_info_cache with network_info: [{"id": "dbbeadad-745e-4d28-a242-577b3197b079", "address": "fa:16:3e:2b:14:bf", "network": {"id": "33f5edce-0901-42ea-b07a-47da2819b133", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-117849665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d7573bebfe47e3989f8eedd90dee6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbbeadad-74", "ovs_interfaceid": "dbbeadad-745e-4d28-a242-577b3197b079", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:19:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Releasing lock "refresh_cache-f192d1ec-311d-4a30-9766-361b27a8dae8" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:19:37 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Creating tmpfile /opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/tmp7dmpyiow to verify with other compute node that the instance is on the same shared storage. {{(pid=74683) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Oct 16 11:19:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.603s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG nova.compute.manager [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Start building networks asynchronously for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG nova.compute.manager [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Allocating IP information in the background. {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG nova.network.neutron [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] allocate_for_instance() {{(pid=74683) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG nova.compute.manager [req-8a203495-123a-4b9e-a3e2-0d275793e69c req-4b06d5ac-c850-47ef-bef2-f0a4ab96a7da service nova] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Received event network-vif-unplugged-dbbeadad-745e-4d28-a242-577b3197b079 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-8a203495-123a-4b9e-a3e2-0d275793e69c req-4b06d5ac-c850-47ef-bef2-f0a4ab96a7da service nova] Acquiring lock "f192d1ec-311d-4a30-9766-361b27a8dae8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-8a203495-123a-4b9e-a3e2-0d275793e69c req-4b06d5ac-c850-47ef-bef2-f0a4ab96a7da service nova] Lock "f192d1ec-311d-4a30-9766-361b27a8dae8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-8a203495-123a-4b9e-a3e2-0d275793e69c req-4b06d5ac-c850-47ef-bef2-f0a4ab96a7da service nova] Lock "f192d1ec-311d-4a30-9766-361b27a8dae8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG nova.compute.manager [req-8a203495-123a-4b9e-a3e2-0d275793e69c req-4b06d5ac-c850-47ef-bef2-f0a4ab96a7da service nova] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] No waiting events found dispatching network-vif-unplugged-dbbeadad-745e-4d28-a242-577b3197b079 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:19:38 user nova-compute[74683]: WARNING nova.compute.manager [req-8a203495-123a-4b9e-a3e2-0d275793e69c req-4b06d5ac-c850-47ef-bef2-f0a4ab96a7da service nova] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Received unexpected event network-vif-unplugged-dbbeadad-745e-4d28-a242-577b3197b079 for instance with vm_state resized and task_state resize_reverting.
Oct 16 11:19:38 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 11:19:38 user nova-compute[74683]: DEBUG nova.compute.manager [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Start building block device mappings for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG nova.policy [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6a55641a42b142ea9fb6c6c1fdb9963e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb8da41d6584a689e9b50155288aa5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74683) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG nova.compute.manager [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Start spawning the instance on the hypervisor. {{(pid=74683) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Creating instance directory {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 11:19:38 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Creating image(s)
Oct 16 11:19:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Acquiring lock "/opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "/opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "/opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:38 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Instance destroyed successfully.
Oct 16 11:19:38 user nova-compute[74683]: DEBUG nova.objects.instance [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Lazy-loading 'resources' on Instance uuid f192d1ec-311d-4a30-9766-361b27a8dae8 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:13:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-983209770',display_name='tempest-ServerActionsTestOtherB-server-983209770',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-983209770',id=4,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9H9XkO3ueDaPVFedHBs8IBjQP+O3m5MP98XnfC/J6UPNHq/d/RZvz6o5PlZR6OTg+H3cDaV7C6HUM8WearORwrzPoJ/Wxd8/4rMuBZ4j1C0aE5FLDGnbq9yp0LqlVHBQ==',key_name='tempest-keypair-650579759',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:18:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e1d7573bebfe47e3989f8eedd90dee6c',ramdisk_id='',reservation_id='r-wwd9qybu',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1241350688',owner_user_name='tempest-ServerActionsTestOtherB-1241350688-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:18:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fc0a33378424a9080c747d4f78528a5',uuid=f192d1ec-311d-4a30-9766-361b27a8dae8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "dbbeadad-745e-4d28-a242-577b3197b079", "address": "fa:16:3e:2b:14:bf", "network": {"id": "33f5edce-0901-42ea-b07a-47da2819b133", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-117849665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d7573bebfe47e3989f8eedd90dee6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbbeadad-74", "ovs_interfaceid": "dbbeadad-745e-4d28-a242-577b3197b079", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Converting VIF {"id": "dbbeadad-745e-4d28-a242-577b3197b079", "address": "fa:16:3e:2b:14:bf", "network": {"id": "33f5edce-0901-42ea-b07a-47da2819b133", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-117849665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d7573bebfe47e3989f8eedd90dee6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbbeadad-74", "ovs_interfaceid": "dbbeadad-745e-4d28-a242-577b3197b079", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2b:14:bf,bridge_name='br-int',has_traffic_filtering=True,id=dbbeadad-745e-4d28-a242-577b3197b079,network=Network(33f5edce-0901-42ea-b07a-47da2819b133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbbeadad-74') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG os_vif [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:14:bf,bridge_name='br-int',has_traffic_filtering=True,id=dbbeadad-745e-4d28-a242-577b3197b079,network=Network(33f5edce-0901-42ea-b07a-47da2819b133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbbeadad-74') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.226s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdbbeadad-74, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Acquiring lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=14bb3ce2-9f76-46ad-8c9b-2836ec417e61) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:19:38 user nova-compute[74683]: INFO os_vif [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:14:bf,bridge_name='br-int',has_traffic_filtering=True,id=dbbeadad-745e-4d28-a242-577b3197b079,network=Network(33f5edce-0901-42ea-b07a-47da2819b133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbbeadad-74')
Oct 16 11:19:38 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] calling os-brick to detach iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, {'target_iqn': 'iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nGRHmKco', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:19:38 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:19:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a03bd1-ad39-42c9-8abc-0ef7d8530732]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 11:19:38 user nova-compute[74683]: No targets found.
Oct 16 11:19:38 user nova-compute[74683]: iSNS:
Oct 16 11:19:38 user nova-compute[74683]: No targets found.
Oct 16 11:19:38 user nova-compute[74683]: STATIC:
Oct 16 11:19:38 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5
Oct 16 11:19:38 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:19:38 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:19:38 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb
Oct 16 11:19:38 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:19:38 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:19:38 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b
Oct 16 11:19:38 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:19:38 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:19:38 user nova-compute[74683]: FIRMWARE:
Oct 16 11:19:38 user nova-compute[74683]: No targets found.
Oct 16 11:19:38 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 11:19:38 user nova-compute[74683]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 11:19:38 user nova-compute[74683]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74683) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b', 0)] {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9be1956-36b0-4cd8-b65b-f9eba91e960a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4fc9b0-ed5b-4194-89a7-f84c53990a81]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:19:38 user nova-compute[74683]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)
Oct 16 11:19:38 user nova-compute[74683]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)
Oct 16 11:19:38 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:19:38 user nova-compute[74683]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)
Oct 16 11:19:38 user nova-compute[74683]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)
Oct 16 11:19:38 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda4c511a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b'): ({'sdb'}, set())}) {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Removing single pathed devices sdb {{(pid=74683) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9e4e43-47ac-43b3-94fb-b64af384a215]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.208s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk 1073741824 {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5fc5ef6-3266-49ac-a7e6-2624344a139c]: (4, ('ok\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Flushing IO for device /dev/sdb {{(pid=74683) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25f83992-cb2a-4eca-bffb-07fc5184a7cd tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Calling os-brick to attach iSCSI Volume {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f83992-cb2a-4eca-bffb-07fc5184a7cd tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dfe37f66-addb-40d6-9d3d-0f0f3e8c3e91', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ekGuQhnP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:19:38 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-25f83992-cb2a-4eca-bffb-07fc5184a7cd tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:19:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-25f83992-cb2a-4eca-bffb-07fc5184a7cd tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk 1073741824" returned: 0 in 0.066s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:19:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b4caed6-3614-4dd7-8165-0250845ede3e]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74683) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[9520dd76-b0cf-4e6f-9f1c-768b1c9a094b]: (4, ('1', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] SCSI volumes sdb have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b')] {{(pid=74683) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-71b8f16d-8d7d-47c6-814b-32331c647d86 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Acquiring lock "c15b7e00-a608-4796-8e6e-1304785a9af5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-71b8f16d-8d7d-47c6-814b-32331c647d86 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Lock "c15b7e00-a608-4796-8e6e-1304785a9af5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-71b8f16d-8d7d-47c6-814b-32331c647d86 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Acquiring lock "c15b7e00-a608-4796-8e6e-1304785a9af5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-71b8f16d-8d7d-47c6-814b-32331c647d86 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Lock "c15b7e00-a608-4796-8e6e-1304785a9af5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-71b8f16d-8d7d-47c6-814b-32331c647d86 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Lock "c15b7e00-a608-4796-8e6e-1304785a9af5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[033fb8eb-88e5-406f-acfa-f6ecc0c3c037]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:19:39 user nova-compute[74683]: INFO nova.compute.manager [None req-71b8f16d-8d7d-47c6-814b-32331c647d86 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: c15b7e00-a608-4796-8e6e-1304785a9af5] Terminating instance
Oct 16 11:19:39 user nova-compute[74683]: DEBUG nova.compute.manager [None req-71b8f16d-8d7d-47c6-814b-32331c647d86 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: c15b7e00-a608-4796-8e6e-1304785a9af5] Start destroying the instance on the hypervisor. {{(pid=74683) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260 --logout {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.214s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Checking if we can resize image /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk. size=1073741824 {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG nova.network.neutron [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Successfully created port: 7ba36bb4-91c7-42ee-b592-6653e63a1d50 {{(pid=74683) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c0330d-e1f0-44ee-a5a6-f4c92d20d841]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b, portal: 172.16.0.220,3260]
Oct 16 11:19:39 user nova-compute[74683]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b, portal: 172.16.0.220,3260] successful.
Oct 16 11:19:39 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260 --op delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86299d7-8b63-4f39-adc8-0ac3c2d459ac]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.520s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] <== disconnect_volume: return (521ms) None {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Disconnected iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-25f83992-cb2a-4eca-bffb-07fc5184a7cd tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.313s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:19:39 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-25f83992-cb2a-4eca-bffb-07fc5184a7cd tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:19:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-25f83992-cb2a-4eca-bffb-07fc5184a7cd tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dfe37f66-addb-40d6-9d3d-0f0f3e8c3e91" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-25f83992-cb2a-4eca-bffb-07fc5184a7cd tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dfe37f66-addb-40d6-9d3d-0f0f3e8c3e91" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:19:39 user nova-compute[74683]: INFO os_brick.initiator.connectors.iscsi [None req-25f83992-cb2a-4eca-bffb-07fc5184a7cd tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 11:19:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfe37f66-addb-40d6-9d3d-0f0f3e8c3e91 -p 172.16.0.220:3260 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfe37f66-addb-40d6-9d3d-0f0f3e8c3e91 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fda32ec-f4dd-4f25-9539-3e969ae8518c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f83992-cb2a-4eca-bffb-07fc5184a7cd tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 11:19:39 user nova-compute[74683]:  {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfe37f66-addb-40d6-9d3d-0f0f3e8c3e91 -p 172.16.0.220:3260 --interface default --op new {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfe37f66-addb-40d6-9d3d-0f0f3e8c3e91 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[030d8608-d257-409a-a84f-b28a51ff79ee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dfe37f66-addb-40d6-9d3d-0f0f3e8c3e91] added\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f83992-cb2a-4eca-bffb-07fc5184a7cd tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dfe37f66-addb-40d6-9d3d-0f0f3e8c3e91] added
Oct 16 11:19:39 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfe37f66-addb-40d6-9d3d-0f0f3e8c3e91 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfe37f66-addb-40d6-9d3d-0f0f3e8c3e91 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7fbed1c-db49-4fd6-b3f3-959973851028]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f83992-cb2a-4eca-bffb-07fc5184a7cd tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfe37f66-addb-40d6-9d3d-0f0f3e8c3e91 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Cannot resize image /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk to a smaller size. {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Created local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Ensure instance console log exists: /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/console.log {{(pid=74683) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfe37f66-addb-40d6-9d3d-0f0f3e8c3e91 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74572c2-e316-43ac-8a90-e4853c2e4a31]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f83992-cb2a-4eca-bffb-07fc5184a7cd tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfe37f66-addb-40d6-9d3d-0f0f3e8c3e91 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ekGuQhnP {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfe37f66-addb-40d6-9d3d-0f0f3e8c3e91 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ekGuQhnP" returned: 0 in 0.041s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d014702-3db7-4784-8e42-bbb5df2de175]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f83992-cb2a-4eca-bffb-07fc5184a7cd tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ekGuQhnP'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfe37f66-addb-40d6-9d3d-0f0f3e8c3e91 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfe37f66-addb-40d6-9d3d-0f0f3e8c3e91 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a68fa8-c9c9-498a-9d5e-ed9ec78ff6aa]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f83992-cb2a-4eca-bffb-07fc5184a7cd tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e2f865-3fce-455d-a536-614e35d17c84]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f83992-cb2a-4eca-bffb-07fc5184a7cd tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:19:39 user nova-compute[74683]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)
Oct 16 11:19:39 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f83992-cb2a-4eca-bffb-07fc5184a7cd tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:19:39 user nova-compute[74683]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)
Oct 16 11:19:39 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfe37f66-addb-40d6-9d3d-0f0f3e8c3e91 -p 172.16.0.220:3260 --login {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfe37f66-addb-40d6-9d3d-0f0f3e8c3e91 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[220ab028-16f7-4c06-9b99-bd8e24051f3d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dfe37f66-addb-40d6-9d3d-0f0f3e8c3e91, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dfe37f66-addb-40d6-9d3d-0f0f3e8c3e91, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f83992-cb2a-4eca-bffb-07fc5184a7cd tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dfe37f66-addb-40d6-9d3d-0f0f3e8c3e91, portal: 172.16.0.220,3260]
Oct 16 11:19:39 user nova-compute[74683]: Login to [iface: default, target: iqn.2010-10.org.openstack:dfe37f66-addb-40d6-9d3d-0f0f3e8c3e91, portal: 172.16.0.220,3260] successful.
Oct 16 11:19:39 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfe37f66-addb-40d6-9d3d-0f0f3e8c3e91 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfe37f66-addb-40d6-9d3d-0f0f3e8c3e91 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f826f9a-8e3e-47c7-89b9-198cf473bf4d]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f83992-cb2a-4eca-bffb-07fc5184a7cd tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[6659d5fa-ab24-4c2e-a383-d2dd336adbeb]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfe37f66-addb-40d6-9d3d-0f0f3e8c3e91 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f83992-cb2a-4eca-bffb-07fc5184a7cd tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:19:39 user nova-compute[74683]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)
Oct 16 11:19:39 user nova-compute[74683]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfe37f66-addb-40d6-9d3d-0f0f3e8c3e91 (non-flash)
Oct 16 11:19:39 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f83992-cb2a-4eca-bffb-07fc5184a7cd tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:19:39 user nova-compute[74683]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)
Oct 16 11:19:39 user nova-compute[74683]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfe37f66-addb-40d6-9d3d-0f0f3e8c3e91 (non-flash)
Oct 16 11:19:39 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-25f83992-cb2a-4eca-bffb-07fc5184a7cd tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dfe37f66-addb-40d6-9d3d-0f0f3e8c3e91" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.365s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f83992-cb2a-4eca-bffb-07fc5184a7cd tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Connected to 172.16.0.220:3260 {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-25f83992-cb2a-4eca-bffb-07fc5184a7cd tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=74683) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-25f83992-cb2a-4eca-bffb-07fc5184a7cd tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74683) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc782ab-7463-4546-8566-731f7a803432]: (4, ('- - 0', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-25f83992-cb2a-4eca-bffb-07fc5184a7cd tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:19:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f83992-cb2a-4eca-bffb-07fc5184a7cd tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:dfe37f66-addb-40d6-9d3d-0f0f3e8c3e91', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ekGuQhnP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG nova.network.neutron [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Successfully updated port: 7ba36bb4-91c7-42ee-b592-6653e63a1d50 {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:19:40 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: c15b7e00-a608-4796-8e6e-1304785a9af5] Instance destroyed successfully.
Oct 16 11:19:40 user nova-compute[74683]: DEBUG nova.objects.instance [None req-71b8f16d-8d7d-47c6-814b-32331c647d86 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Lazy-loading 'resources' on Instance uuid c15b7e00-a608-4796-8e6e-1304785a9af5 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG nova.compute.manager [req-bab5aa0e-dab3-4586-8f0f-cefa0af299d7 req-47fc4917-c29a-4b02-91b1-2c54357bcebc service nova] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Received event network-changed-7ba36bb4-91c7-42ee-b592-6653e63a1d50 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG nova.compute.manager [req-bab5aa0e-dab3-4586-8f0f-cefa0af299d7 req-47fc4917-c29a-4b02-91b1-2c54357bcebc service nova] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Refreshing instance network info cache due to event network-changed-7ba36bb4-91c7-42ee-b592-6653e63a1d50. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-bab5aa0e-dab3-4586-8f0f-cefa0af299d7 req-47fc4917-c29a-4b02-91b1-2c54357bcebc service nova] Acquiring lock "refresh_cache-edd01413-1f8a-49e3-aa3c-ecb19c62afae" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-bab5aa0e-dab3-4586-8f0f-cefa0af299d7 req-47fc4917-c29a-4b02-91b1-2c54357bcebc service nova] Acquired lock "refresh_cache-edd01413-1f8a-49e3-aa3c-ecb19c62afae" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG nova.network.neutron [req-bab5aa0e-dab3-4586-8f0f-cefa0af299d7 req-47fc4917-c29a-4b02-91b1-2c54357bcebc service nova] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Refreshing network info cache for port 7ba36bb4-91c7-42ee-b592-6653e63a1d50 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Acquiring lock "refresh_cache-edd01413-1f8a-49e3-aa3c-ecb19c62afae" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-71b8f16d-8d7d-47c6-814b-32331c647d86 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:17:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-906045810',display_name='tempest-VolumesAdminNegativeTest-server-906045810',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-906045810',id=15,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:17:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e03b7938f054e1fadb9f650ac8db1c9',ramdisk_id='',reservation_id='r-i603i6lm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-191985547',owner_user_name='tempest-VolumesAdminNegativeTest-191985547-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:17:18Z,user_data=None,user_id='77caa7602ea343f4a0932cc033e1fc82',uuid=c15b7e00-a608-4796-8e6e-1304785a9af5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f319be8e-d271-46e3-b31c-6271d47baaf1", "address": "fa:16:3e:94:3d:dc", "network": {"id": "2bf14a39-69ea-4656-956a-f1578bb1836d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1838676509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e03b7938f054e1fadb9f650ac8db1c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf319be8e-d2", "ovs_interfaceid": "f319be8e-d271-46e3-b31c-6271d47baaf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-71b8f16d-8d7d-47c6-814b-32331c647d86 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Converting VIF {"id": "f319be8e-d271-46e3-b31c-6271d47baaf1", "address": "fa:16:3e:94:3d:dc", "network": {"id": "2bf14a39-69ea-4656-956a-f1578bb1836d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1838676509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e03b7938f054e1fadb9f650ac8db1c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf319be8e-d2", "ovs_interfaceid": "f319be8e-d271-46e3-b31c-6271d47baaf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-71b8f16d-8d7d-47c6-814b-32331c647d86 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:3d:dc,bridge_name='br-int',has_traffic_filtering=True,id=f319be8e-d271-46e3-b31c-6271d47baaf1,network=Network(2bf14a39-69ea-4656-956a-f1578bb1836d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf319be8e-d2') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG os_vif [None req-71b8f16d-8d7d-47c6-814b-32331c647d86 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:3d:dc,bridge_name='br-int',has_traffic_filtering=True,id=f319be8e-d271-46e3-b31c-6271d47baaf1,network=Network(2bf14a39-69ea-4656-956a-f1578bb1836d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf319be8e-d2') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf319be8e-d2, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d841ccf7-31a5-48bc-ae59-b158acdbb9c5) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:40 user nova-compute[74683]: INFO os_vif [None req-71b8f16d-8d7d-47c6-814b-32331c647d86 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:3d:dc,bridge_name='br-int',has_traffic_filtering=True,id=f319be8e-d271-46e3-b31c-6271d47baaf1,network=Network(2bf14a39-69ea-4656-956a-f1578bb1836d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf319be8e-d2')
Oct 16 11:19:40 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-71b8f16d-8d7d-47c6-814b-32331c647d86 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: c15b7e00-a608-4796-8e6e-1304785a9af5] Deleting instance files /opt/stack/data/nova/instances/c15b7e00-a608-4796-8e6e-1304785a9af5_del
Oct 16 11:19:40 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-71b8f16d-8d7d-47c6-814b-32331c647d86 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: c15b7e00-a608-4796-8e6e-1304785a9af5] Deletion of /opt/stack/data/nova/instances/c15b7e00-a608-4796-8e6e-1304785a9af5_del complete
Oct 16 11:19:40 user nova-compute[74683]: DEBUG nova.network.neutron [req-bab5aa0e-dab3-4586-8f0f-cefa0af299d7 req-47fc4917-c29a-4b02-91b1-2c54357bcebc service nova] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG nova.compute.manager [req-9f1fc066-1389-4d0b-baaf-5db0b88d6ec2 req-9213ecc8-d4e0-41fe-b332-58b9c2f9707b service nova] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Received event network-vif-plugged-dbbeadad-745e-4d28-a242-577b3197b079 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-9f1fc066-1389-4d0b-baaf-5db0b88d6ec2 req-9213ecc8-d4e0-41fe-b332-58b9c2f9707b service nova] Acquiring lock "f192d1ec-311d-4a30-9766-361b27a8dae8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-9f1fc066-1389-4d0b-baaf-5db0b88d6ec2 req-9213ecc8-d4e0-41fe-b332-58b9c2f9707b service nova] Lock "f192d1ec-311d-4a30-9766-361b27a8dae8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-9f1fc066-1389-4d0b-baaf-5db0b88d6ec2 req-9213ecc8-d4e0-41fe-b332-58b9c2f9707b service nova] Lock "f192d1ec-311d-4a30-9766-361b27a8dae8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG nova.compute.manager [req-9f1fc066-1389-4d0b-baaf-5db0b88d6ec2 req-9213ecc8-d4e0-41fe-b332-58b9c2f9707b service nova] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] No waiting events found dispatching network-vif-plugged-dbbeadad-745e-4d28-a242-577b3197b079 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:19:40 user nova-compute[74683]: WARNING nova.compute.manager [req-9f1fc066-1389-4d0b-baaf-5db0b88d6ec2 req-9213ecc8-d4e0-41fe-b332-58b9c2f9707b service nova] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Received unexpected event network-vif-plugged-dbbeadad-745e-4d28-a242-577b3197b079 for instance with vm_state resized and task_state resize_reverting.
Oct 16 11:19:40 user nova-compute[74683]: DEBUG nova.compute.manager [req-9f1fc066-1389-4d0b-baaf-5db0b88d6ec2 req-9213ecc8-d4e0-41fe-b332-58b9c2f9707b service nova] [instance: c15b7e00-a608-4796-8e6e-1304785a9af5] Received event network-vif-unplugged-f319be8e-d271-46e3-b31c-6271d47baaf1 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-9f1fc066-1389-4d0b-baaf-5db0b88d6ec2 req-9213ecc8-d4e0-41fe-b332-58b9c2f9707b service nova] Acquiring lock "c15b7e00-a608-4796-8e6e-1304785a9af5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-9f1fc066-1389-4d0b-baaf-5db0b88d6ec2 req-9213ecc8-d4e0-41fe-b332-58b9c2f9707b service nova] Lock "c15b7e00-a608-4796-8e6e-1304785a9af5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-9f1fc066-1389-4d0b-baaf-5db0b88d6ec2 req-9213ecc8-d4e0-41fe-b332-58b9c2f9707b service nova] Lock "c15b7e00-a608-4796-8e6e-1304785a9af5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG nova.compute.manager [req-9f1fc066-1389-4d0b-baaf-5db0b88d6ec2 req-9213ecc8-d4e0-41fe-b332-58b9c2f9707b service nova] [instance: c15b7e00-a608-4796-8e6e-1304785a9af5] No waiting events found dispatching network-vif-unplugged-f319be8e-d271-46e3-b31c-6271d47baaf1 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG nova.compute.manager [req-9f1fc066-1389-4d0b-baaf-5db0b88d6ec2 req-9213ecc8-d4e0-41fe-b332-58b9c2f9707b service nova] [instance: c15b7e00-a608-4796-8e6e-1304785a9af5] Received event network-vif-unplugged-f319be8e-d271-46e3-b31c-6271d47baaf1 for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG nova.compute.manager [req-9f1fc066-1389-4d0b-baaf-5db0b88d6ec2 req-9213ecc8-d4e0-41fe-b332-58b9c2f9707b service nova] [instance: c15b7e00-a608-4796-8e6e-1304785a9af5] Received event network-vif-plugged-f319be8e-d271-46e3-b31c-6271d47baaf1 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-9f1fc066-1389-4d0b-baaf-5db0b88d6ec2 req-9213ecc8-d4e0-41fe-b332-58b9c2f9707b service nova] Acquiring lock "c15b7e00-a608-4796-8e6e-1304785a9af5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-9f1fc066-1389-4d0b-baaf-5db0b88d6ec2 req-9213ecc8-d4e0-41fe-b332-58b9c2f9707b service nova] Lock "c15b7e00-a608-4796-8e6e-1304785a9af5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-9f1fc066-1389-4d0b-baaf-5db0b88d6ec2 req-9213ecc8-d4e0-41fe-b332-58b9c2f9707b service nova] Lock "c15b7e00-a608-4796-8e6e-1304785a9af5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG nova.compute.manager [req-9f1fc066-1389-4d0b-baaf-5db0b88d6ec2 req-9213ecc8-d4e0-41fe-b332-58b9c2f9707b service nova] [instance: c15b7e00-a608-4796-8e6e-1304785a9af5] No waiting events found dispatching network-vif-plugged-f319be8e-d271-46e3-b31c-6271d47baaf1 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:19:40 user nova-compute[74683]: WARNING nova.compute.manager [req-9f1fc066-1389-4d0b-baaf-5db0b88d6ec2 req-9213ecc8-d4e0-41fe-b332-58b9c2f9707b service nova] [instance: c15b7e00-a608-4796-8e6e-1304785a9af5] Received unexpected event network-vif-plugged-f319be8e-d271-46e3-b31c-6271d47baaf1 for instance with vm_state active and task_state deleting.
Oct 16 11:19:40 user nova-compute[74683]: INFO nova.compute.manager [None req-71b8f16d-8d7d-47c6-814b-32331c647d86 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: c15b7e00-a608-4796-8e6e-1304785a9af5] Took 1.22 seconds to destroy the instance on the hypervisor.
Oct 16 11:19:40 user nova-compute[74683]: DEBUG oslo.service.loopingcall [None req-71b8f16d-8d7d-47c6-814b-32331c647d86 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74683) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG nova.compute.manager [-] [instance: c15b7e00-a608-4796-8e6e-1304785a9af5] Deallocating network for instance {{(pid=74683) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: c15b7e00-a608-4796-8e6e-1304785a9af5] deallocate_for_instance() {{(pid=74683) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG nova.network.neutron [req-bab5aa0e-dab3-4586-8f0f-cefa0af299d7 req-47fc4917-c29a-4b02-91b1-2c54357bcebc service nova] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-bab5aa0e-dab3-4586-8f0f-cefa0af299d7 req-47fc4917-c29a-4b02-91b1-2c54357bcebc service nova] Releasing lock "refresh_cache-edd01413-1f8a-49e3-aa3c-ecb19c62afae" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Acquired lock "refresh_cache-edd01413-1f8a-49e3-aa3c-ecb19c62afae" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG nova.network.neutron [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG nova.objects.instance [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Lazy-loading 'migration_context' on Instance uuid f192d1ec-311d-4a30-9766-361b27a8dae8 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG nova.objects.base [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Object Instance<f192d1ec-311d-4a30-9766-361b27a8dae8> lazy-loaded attributes: resources,migration_context {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG nova.network.neutron [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-25f83992-cb2a-4eca-bffb-07fc5184a7cd tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.400s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f83992-cb2a-4eca-bffb-07fc5184a7cd tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] <== connect_volume: return (1713ms) {'type': 'block', 'scsi_wwn': '26464363234653362', 'path': '/dev/sdb'} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25f83992-cb2a-4eca-bffb-07fc5184a7cd tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464363234653362', 'path': '/dev/sdb'} {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG nova.objects.instance [None req-25f83992-cb2a-4eca-bffb-07fc5184a7cd tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Lazy-loading 'flavor' on Instance uuid 9ae15ce7-996c-460f-a901-1570a2012af1 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-25f83992-cb2a-4eca-bffb-07fc5184a7cd tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 11:19:40 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:19:40 user nova-compute[74683]:   <source dev="/dev/sdb"/>
Oct 16 11:19:40 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:19:40 user nova-compute[74683]:   <serial>dfe37f66-addb-40d6-9d3d-0f0f3e8c3e91</serial>
Oct 16 11:19:40 user nova-compute[74683]: </disk>
Oct 16 11:19:40 user nova-compute[74683]:  {{(pid=74683) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG nova.network.neutron [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Updating instance_info_cache with network_info: [{"id": "7ba36bb4-91c7-42ee-b592-6653e63a1d50", "address": "fa:16:3e:b4:d6:37", "network": {"id": "cd8cf08c-d79c-4d2e-b849-640c440e1498", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1091743670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcb8da41d6584a689e9b50155288aa5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba36bb4-91", "ovs_interfaceid": "7ba36bb4-91c7-42ee-b592-6653e63a1d50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Releasing lock "refresh_cache-edd01413-1f8a-49e3-aa3c-ecb19c62afae" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG nova.compute.manager [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Instance network_info: |[{"id": "7ba36bb4-91c7-42ee-b592-6653e63a1d50", "address": "fa:16:3e:b4:d6:37", "network": {"id": "cd8cf08c-d79c-4d2e-b849-640c440e1498", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1091743670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcb8da41d6584a689e9b50155288aa5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba36bb4-91", "ovs_interfaceid": "7ba36bb4-91c7-42ee-b592-6653e63a1d50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Start _get_guest_xml network_info=[{"id": "7ba36bb4-91c7-42ee-b592-6653e63a1d50", "address": "fa:16:3e:b4:d6:37", "network": {"id": "cd8cf08c-d79c-4d2e-b849-640c440e1498", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1091743670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcb8da41d6584a689e9b50155288aa5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba36bb4-91", "ovs_interfaceid": "7ba36bb4-91c7-42ee-b592-6653e63a1d50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:19:40 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:19:40 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:19:40 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: c15b7e00-a608-4796-8e6e-1304785a9af5] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:19:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-540936552',display_name='tempest-ServerActionsTestOtherA-server-540936552',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-540936552',id=18,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBEVF+XohWeGna7xpASkIb8CQzH1AhAApSWM489KR3Xw5eNUrWHdrfnFEDLkNX5O9VFz9JiKaf+QhMQdRVklpUzwWiktfTm3fcbGcjt8FS9CdAQjTtJZQ2xWrypXQEhUiQ==',key_name='tempest-keypair-1801585168',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fcb8da41d6584a689e9b50155288aa5e',ramdisk_id='',reservation_id='r-48u77990',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-327072564',owner_user_name='tempest-ServerActionsTestOtherA-327072564-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:19:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a55641a42b142ea9fb6c6c1fdb9963e',uuid=edd01413-1f8a-49e3-aa3c-ecb19c62afae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ba36bb4-91c7-42ee-b592-6653e63a1d50", "address": "fa:16:3e:b4:d6:37", "network": {"id": "cd8cf08c-d79c-4d2e-b849-640c440e1498", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1091743670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcb8da41d6584a689e9b50155288aa5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba36bb4-91", "ovs_interfaceid": "7ba36bb4-91c7-42ee-b592-6653e63a1d50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Converting VIF {"id": "7ba36bb4-91c7-42ee-b592-6653e63a1d50", "address": "fa:16:3e:b4:d6:37", "network": {"id": "cd8cf08c-d79c-4d2e-b849-640c440e1498", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1091743670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcb8da41d6584a689e9b50155288aa5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba36bb4-91", "ovs_interfaceid": "7ba36bb4-91c7-42ee-b592-6653e63a1d50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:d6:37,bridge_name='br-int',has_traffic_filtering=True,id=7ba36bb4-91c7-42ee-b592-6653e63a1d50,network=Network(cd8cf08c-d79c-4d2e-b849-640c440e1498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ba36bb4-91') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG nova.objects.instance [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lazy-loading 'pci_devices' on Instance uuid edd01413-1f8a-49e3-aa3c-ecb19c62afae {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:19:40 user nova-compute[74683]: INFO nova.compute.manager [-] [instance: c15b7e00-a608-4796-8e6e-1304785a9af5] Took 0.55 seconds to deallocate network for instance.
Oct 16 11:19:40 user nova-compute[74683]: DEBUG nova.compute.manager [req-722c8f1d-95ff-4a29-8db4-cf2f90772a46 req-8cf89f67-f609-4087-9c5f-eb547d4a1455 service nova] [instance: c15b7e00-a608-4796-8e6e-1304785a9af5] Received event network-vif-deleted-f319be8e-d271-46e3-b31c-6271d47baaf1 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:19:40 user nova-compute[74683]: INFO nova.compute.manager [req-722c8f1d-95ff-4a29-8db4-cf2f90772a46 req-8cf89f67-f609-4087-9c5f-eb547d4a1455 service nova] [instance: c15b7e00-a608-4796-8e6e-1304785a9af5] Neutron deleted interface f319be8e-d271-46e3-b31c-6271d47baaf1; detaching it from the instance and deleting it from the info cache
Oct 16 11:19:40 user nova-compute[74683]: DEBUG nova.network.neutron [req-722c8f1d-95ff-4a29-8db4-cf2f90772a46 req-8cf89f67-f609-4087-9c5f-eb547d4a1455 service nova] [instance: c15b7e00-a608-4796-8e6e-1304785a9af5] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:19:40 user nova-compute[74683]:   <uuid>edd01413-1f8a-49e3-aa3c-ecb19c62afae</uuid>
Oct 16 11:19:40 user nova-compute[74683]:   <name>instance-00000012</name>
Oct 16 11:19:40 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:19:40 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:19:40 user nova-compute[74683]:   <metadata>
Oct 16 11:19:40 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:19:40 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:19:40 user nova-compute[74683]:       <nova:name>tempest-ServerActionsTestOtherA-server-540936552</nova:name>
Oct 16 11:19:40 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:19:40</nova:creationTime>
Oct 16 11:19:40 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:19:40 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:19:40 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:19:40 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:19:40 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:19:40 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:19:40 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:19:40 user nova-compute[74683]:       <nova:owner>
Oct 16 11:19:40 user nova-compute[74683]:         <nova:user uuid="6a55641a42b142ea9fb6c6c1fdb9963e">tempest-ServerActionsTestOtherA-327072564-project-member</nova:user>
Oct 16 11:19:40 user nova-compute[74683]:         <nova:project uuid="fcb8da41d6584a689e9b50155288aa5e">tempest-ServerActionsTestOtherA-327072564</nova:project>
Oct 16 11:19:40 user nova-compute[74683]:       </nova:owner>
Oct 16 11:19:40 user nova-compute[74683]:       <nova:root type="image" uuid="0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f"/>
Oct 16 11:19:40 user nova-compute[74683]:       <nova:ports>
Oct 16 11:19:40 user nova-compute[74683]:         <nova:port uuid="7ba36bb4-91c7-42ee-b592-6653e63a1d50">
Oct 16 11:19:40 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 16 11:19:40 user nova-compute[74683]:         </nova:port>
Oct 16 11:19:40 user nova-compute[74683]:       </nova:ports>
Oct 16 11:19:40 user nova-compute[74683]:     </nova:instance>
Oct 16 11:19:40 user nova-compute[74683]:   </metadata>
Oct 16 11:19:40 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:19:40 user nova-compute[74683]:     <system>
Oct 16 11:19:40 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:19:40 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:19:40 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:19:40 user nova-compute[74683]:       <entry name="serial">edd01413-1f8a-49e3-aa3c-ecb19c62afae</entry>
Oct 16 11:19:40 user nova-compute[74683]:       <entry name="uuid">edd01413-1f8a-49e3-aa3c-ecb19c62afae</entry>
Oct 16 11:19:40 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:19:40 user nova-compute[74683]:     </system>
Oct 16 11:19:40 user nova-compute[74683]:   </sysinfo>
Oct 16 11:19:40 user nova-compute[74683]:   <os>
Oct 16 11:19:40 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:19:40 user nova-compute[74683]:     <boot dev="hd"/>
Oct 16 11:19:40 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:19:40 user nova-compute[74683]:   </os>
Oct 16 11:19:40 user nova-compute[74683]:   <features>
Oct 16 11:19:40 user nova-compute[74683]:     <acpi/>
Oct 16 11:19:40 user nova-compute[74683]:     <apic/>
Oct 16 11:19:40 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:19:40 user nova-compute[74683]:   </features>
Oct 16 11:19:40 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:19:40 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:19:40 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:19:40 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:19:40 user nova-compute[74683]:   </clock>
Oct 16 11:19:40 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:19:40 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:19:40 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:19:40 user nova-compute[74683]:   </cpu>
Oct 16 11:19:40 user nova-compute[74683]:   <devices>
Oct 16 11:19:40 user nova-compute[74683]:     <disk type="file" device="disk">
Oct 16 11:19:40 user nova-compute[74683]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 11:19:40 user nova-compute[74683]:       <source file="/opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk"/>
Oct 16 11:19:40 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:19:40 user nova-compute[74683]:     </disk>
Oct 16 11:19:40 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:19:40 user nova-compute[74683]:       <mac address="fa:16:3e:b4:d6:37"/>
Oct 16 11:19:40 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:19:40 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:19:40 user nova-compute[74683]:       <target dev="tap7ba36bb4-91"/>
Oct 16 11:19:40 user nova-compute[74683]:     </interface>
Oct 16 11:19:40 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:19:40 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/console.log" append="off"/>
Oct 16 11:19:40 user nova-compute[74683]:     </serial>
Oct 16 11:19:40 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:19:40 user nova-compute[74683]:     <video>
Oct 16 11:19:40 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:19:40 user nova-compute[74683]:     </video>
Oct 16 11:19:40 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:19:40 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:19:40 user nova-compute[74683]:     </rng>
Oct 16 11:19:40 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:19:40 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:19:40 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:19:40 user nova-compute[74683]:     </memballoon>
Oct 16 11:19:40 user nova-compute[74683]:   </devices>
Oct 16 11:19:40 user nova-compute[74683]: </domain>
Oct 16 11:19:40 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:19:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-540936552',display_name='tempest-ServerActionsTestOtherA-server-540936552',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-540936552',id=18,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBEVF+XohWeGna7xpASkIb8CQzH1AhAApSWM489KR3Xw5eNUrWHdrfnFEDLkNX5O9VFz9JiKaf+QhMQdRVklpUzwWiktfTm3fcbGcjt8FS9CdAQjTtJZQ2xWrypXQEhUiQ==',key_name='tempest-keypair-1801585168',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fcb8da41d6584a689e9b50155288aa5e',ramdisk_id='',reservation_id='r-48u77990',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-327072564',owner_user_name='tempest-ServerActionsTestOtherA-327072564-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:19:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a55641a42b142ea9fb6c6c1fdb9963e',uuid=edd01413-1f8a-49e3-aa3c-ecb19c62afae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ba36bb4-91c7-42ee-b592-6653e63a1d50", "address": "fa:16:3e:b4:d6:37", "network": {"id": "cd8cf08c-d79c-4d2e-b849-640c440e1498", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1091743670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcb8da41d6584a689e9b50155288aa5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba36bb4-91", "ovs_interfaceid": "7ba36bb4-91c7-42ee-b592-6653e63a1d50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Converting VIF {"id": "7ba36bb4-91c7-42ee-b592-6653e63a1d50", "address": "fa:16:3e:b4:d6:37", "network": {"id": "cd8cf08c-d79c-4d2e-b849-640c440e1498", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1091743670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcb8da41d6584a689e9b50155288aa5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba36bb4-91", "ovs_interfaceid": "7ba36bb4-91c7-42ee-b592-6653e63a1d50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:d6:37,bridge_name='br-int',has_traffic_filtering=True,id=7ba36bb4-91c7-42ee-b592-6653e63a1d50,network=Network(cd8cf08c-d79c-4d2e-b849-640c440e1498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ba36bb4-91') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG os_vif [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:d6:37,bridge_name='br-int',has_traffic_filtering=True,id=7ba36bb4-91c7-42ee-b592-6653e63a1d50,network=Network(cd8cf08c-d79c-4d2e-b849-640c440e1498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ba36bb4-91') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4aac1199-e57f-5136-be05-bd98cbe1b685', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG nova.compute.manager [req-722c8f1d-95ff-4a29-8db4-cf2f90772a46 req-8cf89f67-f609-4087-9c5f-eb547d4a1455 service nova] [instance: c15b7e00-a608-4796-8e6e-1304785a9af5] Detach interface failed, port_id=f319be8e-d271-46e3-b31c-6271d47baaf1, reason: Instance c15b7e00-a608-4796-8e6e-1304785a9af5 could not be found. {{(pid=74683) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7ba36bb4-91, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7ba36bb4-91, col_values=(('qos', UUID('3f9c9b11-7411-4be1-88b2-7717b83f0508')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7ba36bb4-91, col_values=(('external_ids', {'iface-id': '7ba36bb4-91c7-42ee-b592-6653e63a1d50', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:d6:37', 'vm-uuid': 'edd01413-1f8a-49e3-aa3c-ecb19c62afae'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:19:40 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:40 user nova-compute[74683]: INFO os_vif [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:d6:37,bridge_name='br-int',has_traffic_filtering=True,id=7ba36bb4-91c7-42ee-b592-6653e63a1d50,network=Network(cd8cf08c-d79c-4d2e-b849-640c440e1498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ba36bb4-91')
Oct 16 11:19:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-71b8f16d-8d7d-47c6-814b-32331c647d86 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:19:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.599s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:19:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-71b8f16d-8d7d-47c6-814b-32331c647d86 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.080s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:19:41 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:19:41 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] No VIF found with MAC fa:16:3e:b4:d6:37, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:19:41 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-25f83992-cb2a-4eca-bffb-07fc5184a7cd tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:19:41 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-25f83992-cb2a-4eca-bffb-07fc5184a7cd tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] No BDM found with device name hda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:19:41 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-25f83992-cb2a-4eca-bffb-07fc5184a7cd tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] No VIF found with MAC fa:16:3e:07:96:fd, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:19:41 user nova-compute[74683]: INFO nova.compute.manager [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Swapping old allocation on dict_keys(['7142d606-df50-4cbe-b5ed-1802caa31862']) held by migration a748c33b-b037-42b4-81ba-0cc2bc8370bf for instance
Oct 16 11:19:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-25f83992-cb2a-4eca-bffb-07fc5184a7cd tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Lock "9ae15ce7-996c-460f-a901-1570a2012af1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 35.237s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:19:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:41 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Overwriting current allocation {'allocations': {'7142d606-df50-4cbe-b5ed-1802caa31862': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 22}}, 'project_id': 'e1d7573bebfe47e3989f8eedd90dee6c', 'user_id': '0fc0a33378424a9080c747d4f78528a5', 'consumer_generation': 1} on consumer f192d1ec-311d-4a30-9766-361b27a8dae8 {{(pid=74683) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Oct 16 11:19:41 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-71b8f16d-8d7d-47c6-814b-32331c647d86 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:19:41 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-71b8f16d-8d7d-47c6-814b-32331c647d86 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:19:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Acquiring lock "refresh_cache-f192d1ec-311d-4a30-9766-361b27a8dae8" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:19:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Acquired lock "refresh_cache-f192d1ec-311d-4a30-9766-361b27a8dae8" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:19:41 user nova-compute[74683]: DEBUG nova.network.neutron [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:19:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-71b8f16d-8d7d-47c6-814b-32331c647d86 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.464s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:19:41 user nova-compute[74683]: INFO nova.scheduler.client.report [None req-71b8f16d-8d7d-47c6-814b-32331c647d86 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Deleted allocations for instance c15b7e00-a608-4796-8e6e-1304785a9af5
Oct 16 11:19:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-71b8f16d-8d7d-47c6-814b-32331c647d86 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Lock "c15b7e00-a608-4796-8e6e-1304785a9af5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.590s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:19:42 user nova-compute[74683]: DEBUG nova.network.neutron [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Updating instance_info_cache with network_info: [{"id": "dbbeadad-745e-4d28-a242-577b3197b079", "address": "fa:16:3e:2b:14:bf", "network": {"id": "33f5edce-0901-42ea-b07a-47da2819b133", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-117849665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d7573bebfe47e3989f8eedd90dee6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbbeadad-74", "ovs_interfaceid": "dbbeadad-745e-4d28-a242-577b3197b079", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:19:42 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Releasing lock "refresh_cache-f192d1ec-311d-4a30-9766-361b27a8dae8" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:19:42 user nova-compute[74683]: DEBUG os_brick.utils [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:19:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:42 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[8842ec5d-624a-422e-81bc-c31a49d8e26a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:70b9d336ab7d\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:19:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:42 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[36739b49-7449-47a6-9eed-f6fec70ac0c5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:19:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:42 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d015f9-f0a2-4c5e-81ae-876287e4fb50]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:19:42 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d7248f-db2f-4cee-a921-64a71785d9af]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:19:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Running cmd (subprocess): nvme version {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] 'nvme version' failed. Not Retrying. {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:19:42 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] nvme not present on system {{(pid=74683) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 11:19:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:19:42 user nova-compute[74683]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 11:19:42 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6cdc653-a434-49ae-b042-b8f9392c475f]: (4, '') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:19:42 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74683) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 11:19:42 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 11:19:42 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] LIGHTOS: no hostnqn found. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 11:19:42 user nova-compute[74683]: DEBUG os_brick.utils [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:70b9d336ab7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:19:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:42 user nova-compute[74683]: DEBUG nova.compute.manager [req-c204c678-7cc9-4cbe-a231-205dc26d78b7 req-3a17b0d8-0e9a-40d8-81e8-598ddf13a74c service nova] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Received event network-vif-plugged-7ba36bb4-91c7-42ee-b592-6653e63a1d50 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:19:42 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c204c678-7cc9-4cbe-a231-205dc26d78b7 req-3a17b0d8-0e9a-40d8-81e8-598ddf13a74c service nova] Acquiring lock "edd01413-1f8a-49e3-aa3c-ecb19c62afae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:19:42 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c204c678-7cc9-4cbe-a231-205dc26d78b7 req-3a17b0d8-0e9a-40d8-81e8-598ddf13a74c service nova] Lock "edd01413-1f8a-49e3-aa3c-ecb19c62afae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:19:42 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c204c678-7cc9-4cbe-a231-205dc26d78b7 req-3a17b0d8-0e9a-40d8-81e8-598ddf13a74c service nova] Lock "edd01413-1f8a-49e3-aa3c-ecb19c62afae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:19:42 user nova-compute[74683]: DEBUG nova.compute.manager [req-c204c678-7cc9-4cbe-a231-205dc26d78b7 req-3a17b0d8-0e9a-40d8-81e8-598ddf13a74c service nova] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] No waiting events found dispatching network-vif-plugged-7ba36bb4-91c7-42ee-b592-6653e63a1d50 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:19:42 user nova-compute[74683]: WARNING nova.compute.manager [req-c204c678-7cc9-4cbe-a231-205dc26d78b7 req-3a17b0d8-0e9a-40d8-81e8-598ddf13a74c service nova] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Received unexpected event network-vif-plugged-7ba36bb4-91c7-42ee-b592-6653e63a1d50 for instance with vm_state building and task_state spawning.
Oct 16 11:19:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2883788d-808d-479b-a411-4f88fd870378 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Acquiring lock "9ae15ce7-996c-460f-a901-1570a2012af1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:19:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2883788d-808d-479b-a411-4f88fd870378 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Lock "9ae15ce7-996c-460f-a901-1570a2012af1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:19:43 user nova-compute[74683]: INFO nova.compute.manager [None req-2883788d-808d-479b-a411-4f88fd870378 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Detaching volume dfe37f66-addb-40d6-9d3d-0f0f3e8c3e91
Oct 16 11:19:43 user nova-compute[74683]: INFO nova.virt.block_device [None req-2883788d-808d-479b-a411-4f88fd870378 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Attempting to driver detach volume dfe37f66-addb-40d6-9d3d-0f0f3e8c3e91 from mountpoint /dev/vdb
Oct 16 11:19:43 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-2883788d-808d-479b-a411-4f88fd870378 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Attempting to detach device vdb from instance 9ae15ce7-996c-460f-a901-1570a2012af1 from the persistent domain config. {{(pid=74683) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 11:19:43 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-2883788d-808d-479b-a411-4f88fd870378 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 11:19:43 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:19:43 user nova-compute[74683]:   <source dev="/dev/sdb"/>
Oct 16 11:19:43 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:19:43 user nova-compute[74683]:   <serial>dfe37f66-addb-40d6-9d3d-0f0f3e8c3e91</serial>
Oct 16 11:19:43 user nova-compute[74683]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 16 11:19:43 user nova-compute[74683]: </disk>
Oct 16 11:19:43 user nova-compute[74683]:  {{(pid=74683) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 11:19:43 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-2883788d-808d-479b-a411-4f88fd870378 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Successfully detached device vdb from instance 9ae15ce7-996c-460f-a901-1570a2012af1 from the persistent domain config.
Oct 16 11:19:43 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-2883788d-808d-479b-a411-4f88fd870378 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9ae15ce7-996c-460f-a901-1570a2012af1 from the live domain config. {{(pid=74683) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 11:19:43 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-2883788d-808d-479b-a411-4f88fd870378 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 11:19:43 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:19:43 user nova-compute[74683]:   <source dev="/dev/sdb"/>
Oct 16 11:19:43 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:19:43 user nova-compute[74683]:   <serial>dfe37f66-addb-40d6-9d3d-0f0f3e8c3e91</serial>
Oct 16 11:19:43 user nova-compute[74683]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 16 11:19:43 user nova-compute[74683]: </disk>
Oct 16 11:19:43 user nova-compute[74683]:  {{(pid=74683) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 11:19:44 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-2883788d-808d-479b-a411-4f88fd870378 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9ae15ce7-996c-460f-a901-1570a2012af1 {{(pid=74683) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 11:19:44 user nova-compute[74683]: DEBUG nova.compute.manager [req-ace98ef1-2ff0-4940-8d58-d87025ab69ed req-582c4a25-ec82-47f9-87b3-fd199e15a63a service nova] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Received event network-vif-plugged-7ba36bb4-91c7-42ee-b592-6653e63a1d50 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:19:44 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-ace98ef1-2ff0-4940-8d58-d87025ab69ed req-582c4a25-ec82-47f9-87b3-fd199e15a63a service nova] Acquiring lock "edd01413-1f8a-49e3-aa3c-ecb19c62afae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:19:44 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-ace98ef1-2ff0-4940-8d58-d87025ab69ed req-582c4a25-ec82-47f9-87b3-fd199e15a63a service nova] Lock "edd01413-1f8a-49e3-aa3c-ecb19c62afae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:19:44 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-ace98ef1-2ff0-4940-8d58-d87025ab69ed req-582c4a25-ec82-47f9-87b3-fd199e15a63a service nova] Lock "edd01413-1f8a-49e3-aa3c-ecb19c62afae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:19:44 user nova-compute[74683]: DEBUG nova.compute.manager [req-ace98ef1-2ff0-4940-8d58-d87025ab69ed req-582c4a25-ec82-47f9-87b3-fd199e15a63a service nova] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] No waiting events found dispatching network-vif-plugged-7ba36bb4-91c7-42ee-b592-6653e63a1d50 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:19:44 user nova-compute[74683]: WARNING nova.compute.manager [req-ace98ef1-2ff0-4940-8d58-d87025ab69ed req-582c4a25-ec82-47f9-87b3-fd199e15a63a service nova] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Received unexpected event network-vif-plugged-7ba36bb4-91c7-42ee-b592-6653e63a1d50 for instance with vm_state building and task_state spawning.
Oct 16 11:19:44 user nova-compute[74683]: DEBUG nova.compute.manager [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Instance event wait completed in 0 seconds for  {{(pid=74683) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 11:19:44 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Guest created on hypervisor {{(pid=74683) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 11:19:44 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Instance spawned successfully.
Oct 16 11:19:44 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 11:19:44 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Found default for hw_cdrom_bus of ide {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:19:44 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Found default for hw_disk_bus of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:19:44 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Found default for hw_input_bus of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:19:44 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Found default for hw_pointer_model of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:19:44 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Found default for hw_video_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:19:44 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Found default for hw_vif_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:19:45 user nova-compute[74683]: INFO nova.compute.manager [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Took 6.85 seconds to spawn the instance on the hypervisor.
Oct 16 11:19:45 user nova-compute[74683]: DEBUG nova.compute.manager [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:19:45 user nova-compute[74683]: INFO nova.compute.manager [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Took 7.86 seconds to build instance.
Oct 16 11:19:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ab541b0b-44d9-43cf-9320-d07eda6e516f tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "edd01413-1f8a-49e3-aa3c-ecb19c62afae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.971s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:19:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:46 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:50 user nova-compute[74683]: INFO nova.compute.manager [None req-42547417-3815-4123-9af9-93512f4fc3bb tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Unrescuing
Oct 16 11:19:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-42547417-3815-4123-9af9-93512f4fc3bb tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Acquiring lock "refresh_cache-d5e55361-d9ed-4d07-91b0-ec4d08b2e817" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:19:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-42547417-3815-4123-9af9-93512f4fc3bb tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Acquired lock "refresh_cache-d5e55361-d9ed-4d07-91b0-ec4d08b2e817" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:19:50 user nova-compute[74683]: DEBUG nova.network.neutron [None req-42547417-3815-4123-9af9-93512f4fc3bb tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:19:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b727ef33-327d-48f5-87cc-deae43759452 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Acquiring lock "2f1db5e2-0b25-4d61-9dd3-038811b4eda1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:19:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b727ef33-327d-48f5-87cc-deae43759452 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Lock "2f1db5e2-0b25-4d61-9dd3-038811b4eda1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:19:50 user nova-compute[74683]: INFO nova.compute.manager [None req-b727ef33-327d-48f5-87cc-deae43759452 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Detaching volume a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5
Oct 16 11:19:50 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:51 user nova-compute[74683]: DEBUG nova.network.neutron [None req-42547417-3815-4123-9af9-93512f4fc3bb tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Updating instance_info_cache with network_info: [{"id": "ade44b63-49bb-4dbc-b0f9-95156f4fd6db", "address": "fa:16:3e:ad:0a:5c", "network": {"id": "4d43cc12-d2cd-4552-90a4-884a0ff3dc66", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-825513246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6e0046017b4bba85caf2a39d1c67b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade44b63-49", "ovs_interfaceid": "ade44b63-49bb-4dbc-b0f9-95156f4fd6db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:19:51 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-42547417-3815-4123-9af9-93512f4fc3bb tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Releasing lock "refresh_cache-d5e55361-d9ed-4d07-91b0-ec4d08b2e817" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:19:51 user nova-compute[74683]: DEBUG nova.objects.instance [None req-42547417-3815-4123-9af9-93512f4fc3bb tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lazy-loading 'flavor' on Instance uuid d5e55361-d9ed-4d07-91b0-ec4d08b2e817 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:19:51 user nova-compute[74683]: INFO nova.virt.block_device [None req-b727ef33-327d-48f5-87cc-deae43759452 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Attempting to driver detach volume a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 from mountpoint /dev/vdb
Oct 16 11:19:51 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b727ef33-327d-48f5-87cc-deae43759452 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Attempting to detach device vdb from instance 2f1db5e2-0b25-4d61-9dd3-038811b4eda1 from the persistent domain config. {{(pid=74683) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 11:19:51 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-b727ef33-327d-48f5-87cc-deae43759452 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 11:19:51 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:19:51 user nova-compute[74683]:   <source dev="/dev/sdg"/>
Oct 16 11:19:51 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:19:51 user nova-compute[74683]:   <serial>a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5</serial>
Oct 16 11:19:51 user nova-compute[74683]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 11:19:51 user nova-compute[74683]: </disk>
Oct 16 11:19:51 user nova-compute[74683]:  {{(pid=74683) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 11:19:51 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-b727ef33-327d-48f5-87cc-deae43759452 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Successfully detached device vdb from instance 2f1db5e2-0b25-4d61-9dd3-038811b4eda1 from the persistent domain config.
Oct 16 11:19:51 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b727ef33-327d-48f5-87cc-deae43759452 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2f1db5e2-0b25-4d61-9dd3-038811b4eda1 from the live domain config. {{(pid=74683) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 11:19:51 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-b727ef33-327d-48f5-87cc-deae43759452 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 11:19:51 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:19:51 user nova-compute[74683]:   <source dev="/dev/sdg"/>
Oct 16 11:19:51 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:19:51 user nova-compute[74683]:   <serial>a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5</serial>
Oct 16 11:19:51 user nova-compute[74683]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 11:19:51 user nova-compute[74683]: </disk>
Oct 16 11:19:51 user nova-compute[74683]:  {{(pid=74683) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 11:19:51 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:51 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:51 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:51 user nova-compute[74683]: DEBUG nova.compute.manager [req-3c8ac887-137b-4b1b-a487-56421492c699 req-7043c5f5-4f56-49f1-b33a-c040f725c4c1 service nova] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Received event network-vif-unplugged-ade44b63-49bb-4dbc-b0f9-95156f4fd6db {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:19:51 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-3c8ac887-137b-4b1b-a487-56421492c699 req-7043c5f5-4f56-49f1-b33a-c040f725c4c1 service nova] Acquiring lock "d5e55361-d9ed-4d07-91b0-ec4d08b2e817-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:19:51 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-3c8ac887-137b-4b1b-a487-56421492c699 req-7043c5f5-4f56-49f1-b33a-c040f725c4c1 service nova] Lock "d5e55361-d9ed-4d07-91b0-ec4d08b2e817-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:19:51 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-3c8ac887-137b-4b1b-a487-56421492c699 req-7043c5f5-4f56-49f1-b33a-c040f725c4c1 service nova] Lock "d5e55361-d9ed-4d07-91b0-ec4d08b2e817-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:19:51 user nova-compute[74683]: DEBUG nova.compute.manager [req-3c8ac887-137b-4b1b-a487-56421492c699 req-7043c5f5-4f56-49f1-b33a-c040f725c4c1 service nova] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] No waiting events found dispatching network-vif-unplugged-ade44b63-49bb-4dbc-b0f9-95156f4fd6db {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:19:51 user nova-compute[74683]: WARNING nova.compute.manager [req-3c8ac887-137b-4b1b-a487-56421492c699 req-7043c5f5-4f56-49f1-b33a-c040f725c4c1 service nova] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Received unexpected event network-vif-unplugged-ade44b63-49bb-4dbc-b0f9-95156f4fd6db for instance with vm_state rescued and task_state unrescuing.
Oct 16 11:19:51 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:51 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:51 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b727ef33-327d-48f5-87cc-deae43759452 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2f1db5e2-0b25-4d61-9dd3-038811b4eda1 {{(pid=74683) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 11:19:51 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Instance destroyed successfully.
Oct 16 11:19:52 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._sync_power_states {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:19:53 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:53 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:53 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:53 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:53 user nova-compute[74683]: DEBUG nova.compute.manager [req-f29f4771-9ad9-4bd7-8c70-e512bc84acea req-729f7716-d67b-4c3c-85a7-b8b9fda81d72 service nova] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Received event network-vif-plugged-ade44b63-49bb-4dbc-b0f9-95156f4fd6db {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:19:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f29f4771-9ad9-4bd7-8c70-e512bc84acea req-729f7716-d67b-4c3c-85a7-b8b9fda81d72 service nova] Acquiring lock "d5e55361-d9ed-4d07-91b0-ec4d08b2e817-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:19:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f29f4771-9ad9-4bd7-8c70-e512bc84acea req-729f7716-d67b-4c3c-85a7-b8b9fda81d72 service nova] Lock "d5e55361-d9ed-4d07-91b0-ec4d08b2e817-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:19:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f29f4771-9ad9-4bd7-8c70-e512bc84acea req-729f7716-d67b-4c3c-85a7-b8b9fda81d72 service nova] Lock "d5e55361-d9ed-4d07-91b0-ec4d08b2e817-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:19:53 user nova-compute[74683]: DEBUG nova.compute.manager [req-f29f4771-9ad9-4bd7-8c70-e512bc84acea req-729f7716-d67b-4c3c-85a7-b8b9fda81d72 service nova] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] No waiting events found dispatching network-vif-plugged-ade44b63-49bb-4dbc-b0f9-95156f4fd6db {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:19:53 user nova-compute[74683]: WARNING nova.compute.manager [req-f29f4771-9ad9-4bd7-8c70-e512bc84acea req-729f7716-d67b-4c3c-85a7-b8b9fda81d72 service nova] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Received unexpected event network-vif-plugged-ade44b63-49bb-4dbc-b0f9-95156f4fd6db for instance with vm_state rescued and task_state unrescuing.
Oct 16 11:19:53 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:53 user nova-compute[74683]: WARNING nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] While synchronizing instance power states, found 10 instances in the database and 9 instances on the hypervisor.
Oct 16 11:19:53 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Triggering sync for uuid 18a77385-fab9-4ea0-8aa6-666cf7e798a6 {{(pid=74683) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 11:19:53 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Triggering sync for uuid bd60be9c-0ff3-40a5-aaab-f31fa88a67f1 {{(pid=74683) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 11:19:53 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Triggering sync for uuid f192d1ec-311d-4a30-9766-361b27a8dae8 {{(pid=74683) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 11:19:53 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Triggering sync for uuid 2f1db5e2-0b25-4d61-9dd3-038811b4eda1 {{(pid=74683) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 11:19:53 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Triggering sync for uuid fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7 {{(pid=74683) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 11:19:53 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Triggering sync for uuid d5e55361-d9ed-4d07-91b0-ec4d08b2e817 {{(pid=74683) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 11:19:53 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Triggering sync for uuid 9ae15ce7-996c-460f-a901-1570a2012af1 {{(pid=74683) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 11:19:53 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Triggering sync for uuid 45ca3cbb-53d6-4046-9be3-92cc6b71bfad {{(pid=74683) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 11:19:53 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Triggering sync for uuid e84bb680-a542-4cb2-b0c5-67a210c25e9e {{(pid=74683) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 11:19:53 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Triggering sync for uuid edd01413-1f8a-49e3-aa3c-ecb19c62afae {{(pid=74683) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 11:19:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "18a77385-fab9-4ea0-8aa6-666cf7e798a6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:19:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "18a77385-fab9-4ea0-8aa6-666cf7e798a6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:19:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "bd60be9c-0ff3-40a5-aaab-f31fa88a67f1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:19:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "bd60be9c-0ff3-40a5-aaab-f31fa88a67f1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:19:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "f192d1ec-311d-4a30-9766-361b27a8dae8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:19:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "f192d1ec-311d-4a30-9766-361b27a8dae8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:19:53 user nova-compute[74683]: INFO nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Oct 16 11:19:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "f192d1ec-311d-4a30-9766-361b27a8dae8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:19:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "2f1db5e2-0b25-4d61-9dd3-038811b4eda1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:19:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:19:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:19:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "d5e55361-d9ed-4d07-91b0-ec4d08b2e817" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:19:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "d5e55361-d9ed-4d07-91b0-ec4d08b2e817" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:19:53 user nova-compute[74683]: INFO nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] During sync_power_state the instance has a pending task (unrescuing). Skip.
Oct 16 11:19:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "d5e55361-d9ed-4d07-91b0-ec4d08b2e817" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:19:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "9ae15ce7-996c-460f-a901-1570a2012af1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:19:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "45ca3cbb-53d6-4046-9be3-92cc6b71bfad" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:19:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "45ca3cbb-53d6-4046-9be3-92cc6b71bfad" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:19:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "e84bb680-a542-4cb2-b0c5-67a210c25e9e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:19:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "e84bb680-a542-4cb2-b0c5-67a210c25e9e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:19:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "edd01413-1f8a-49e3-aa3c-ecb19c62afae" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:19:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "edd01413-1f8a-49e3-aa3c-ecb19c62afae" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:19:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "18a77385-fab9-4ea0-8aa6-666cf7e798a6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.097s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:19:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "45ca3cbb-53d6-4046-9be3-92cc6b71bfad" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:19:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "bd60be9c-0ff3-40a5-aaab-f31fa88a67f1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.106s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:19:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.108s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:19:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "e84bb680-a542-4cb2-b0c5-67a210c25e9e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.100s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:19:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "edd01413-1f8a-49e3-aa3c-ecb19c62afae" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.107s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:19:55 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-cc922720-83cb-43bf-812a-61af86ba923b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Acquiring lock "bd60be9c-0ff3-40a5-aaab-f31fa88a67f1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:19:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-cc922720-83cb-43bf-812a-61af86ba923b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "bd60be9c-0ff3-40a5-aaab-f31fa88a67f1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:19:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-cc922720-83cb-43bf-812a-61af86ba923b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Acquiring lock "bd60be9c-0ff3-40a5-aaab-f31fa88a67f1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:19:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-cc922720-83cb-43bf-812a-61af86ba923b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "bd60be9c-0ff3-40a5-aaab-f31fa88a67f1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:19:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-cc922720-83cb-43bf-812a-61af86ba923b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "bd60be9c-0ff3-40a5-aaab-f31fa88a67f1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:19:55 user nova-compute[74683]: INFO nova.compute.manager [None req-cc922720-83cb-43bf-812a-61af86ba923b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Terminating instance
Oct 16 11:19:55 user nova-compute[74683]: DEBUG nova.compute.manager [None req-cc922720-83cb-43bf-812a-61af86ba923b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Start destroying the instance on the hypervisor. {{(pid=74683) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 11:19:55 user nova-compute[74683]: DEBUG nova.compute.manager [req-66e455bb-b3ab-4194-a6ca-f8f7e5e397c5 req-96299288-3e1f-459e-a92a-14564505f9b9 service nova] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Received event network-vif-plugged-ade44b63-49bb-4dbc-b0f9-95156f4fd6db {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:19:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-66e455bb-b3ab-4194-a6ca-f8f7e5e397c5 req-96299288-3e1f-459e-a92a-14564505f9b9 service nova] Acquiring lock "d5e55361-d9ed-4d07-91b0-ec4d08b2e817-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:19:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-66e455bb-b3ab-4194-a6ca-f8f7e5e397c5 req-96299288-3e1f-459e-a92a-14564505f9b9 service nova] Lock "d5e55361-d9ed-4d07-91b0-ec4d08b2e817-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:19:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-66e455bb-b3ab-4194-a6ca-f8f7e5e397c5 req-96299288-3e1f-459e-a92a-14564505f9b9 service nova] Lock "d5e55361-d9ed-4d07-91b0-ec4d08b2e817-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:19:55 user nova-compute[74683]: DEBUG nova.compute.manager [req-66e455bb-b3ab-4194-a6ca-f8f7e5e397c5 req-96299288-3e1f-459e-a92a-14564505f9b9 service nova] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] No waiting events found dispatching network-vif-plugged-ade44b63-49bb-4dbc-b0f9-95156f4fd6db {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:19:55 user nova-compute[74683]: WARNING nova.compute.manager [req-66e455bb-b3ab-4194-a6ca-f8f7e5e397c5 req-96299288-3e1f-459e-a92a-14564505f9b9 service nova] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Received unexpected event network-vif-plugged-ade44b63-49bb-4dbc-b0f9-95156f4fd6db for instance with vm_state rescued and task_state unrescuing.
Oct 16 11:19:55 user nova-compute[74683]: DEBUG nova.compute.manager [req-66e455bb-b3ab-4194-a6ca-f8f7e5e397c5 req-96299288-3e1f-459e-a92a-14564505f9b9 service nova] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Received event network-vif-plugged-ade44b63-49bb-4dbc-b0f9-95156f4fd6db {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:19:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-66e455bb-b3ab-4194-a6ca-f8f7e5e397c5 req-96299288-3e1f-459e-a92a-14564505f9b9 service nova] Acquiring lock "d5e55361-d9ed-4d07-91b0-ec4d08b2e817-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:19:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-66e455bb-b3ab-4194-a6ca-f8f7e5e397c5 req-96299288-3e1f-459e-a92a-14564505f9b9 service nova] Lock "d5e55361-d9ed-4d07-91b0-ec4d08b2e817-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:19:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-66e455bb-b3ab-4194-a6ca-f8f7e5e397c5 req-96299288-3e1f-459e-a92a-14564505f9b9 service nova] Lock "d5e55361-d9ed-4d07-91b0-ec4d08b2e817-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:19:55 user nova-compute[74683]: DEBUG nova.compute.manager [req-66e455bb-b3ab-4194-a6ca-f8f7e5e397c5 req-96299288-3e1f-459e-a92a-14564505f9b9 service nova] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] No waiting events found dispatching network-vif-plugged-ade44b63-49bb-4dbc-b0f9-95156f4fd6db {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:19:55 user nova-compute[74683]: WARNING nova.compute.manager [req-66e455bb-b3ab-4194-a6ca-f8f7e5e397c5 req-96299288-3e1f-459e-a92a-14564505f9b9 service nova] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Received unexpected event network-vif-plugged-ade44b63-49bb-4dbc-b0f9-95156f4fd6db for instance with vm_state rescued and task_state unrescuing.
Oct 16 11:19:55 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:55 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:55 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:55 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:55 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:55 user nova-compute[74683]: DEBUG nova.compute.manager [None req-42547417-3815-4123-9af9-93512f4fc3bb tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:19:55 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:56 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Instance destroyed successfully.
Oct 16 11:19:56 user nova-compute[74683]: DEBUG nova.objects.instance [None req-cc922720-83cb-43bf-812a-61af86ba923b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lazy-loading 'resources' on Instance uuid bd60be9c-0ff3-40a5-aaab-f31fa88a67f1 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:19:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:56 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-cc922720-83cb-43bf-812a-61af86ba923b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:13:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-687235212',display_name='tempest-AttachVolumeNegativeTest-server-687235212',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-687235212',id=3,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOywkcEzrUZv0QsEOR/KzK23mIO19zjdNcrZQotK0DXVfR/PCkmEXQivNn7weVounhNFBFD+tcIW7x+9qvaLgIAsl/ws0bQ5I+kRtdBr1boO2+AuRpkkrMAYOd9PLlvHLA==',key_name='tempest-keypair-895417366',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:13:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72c66aa774134aa6a873eabffc28ec07',ramdisk_id='',reservation_id='r-u7l2fvjl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-845934820',owner_user_name='tempest-AttachVolumeNegativeTest-845934820-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:13:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cdc203c025d84efe86e25cfdf75107b8',uuid=bd60be9c-0ff3-40a5-aaab-f31fa88a67f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "05cf5b29-bd7b-498d-b3d0-b7de22551793", "address": "fa:16:3e:dd:07:47", "network": {"id": "f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-137528169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c66aa774134aa6a873eabffc28ec07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05cf5b29-bd", "ovs_interfaceid": "05cf5b29-bd7b-498d-b3d0-b7de22551793", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:19:56 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-cc922720-83cb-43bf-812a-61af86ba923b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Converting VIF {"id": "05cf5b29-bd7b-498d-b3d0-b7de22551793", "address": "fa:16:3e:dd:07:47", "network": {"id": "f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-137528169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c66aa774134aa6a873eabffc28ec07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05cf5b29-bd", "ovs_interfaceid": "05cf5b29-bd7b-498d-b3d0-b7de22551793", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:19:56 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-cc922720-83cb-43bf-812a-61af86ba923b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:07:47,bridge_name='br-int',has_traffic_filtering=True,id=05cf5b29-bd7b-498d-b3d0-b7de22551793,network=Network(f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05cf5b29-bd') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:19:56 user nova-compute[74683]: DEBUG os_vif [None req-cc922720-83cb-43bf-812a-61af86ba923b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:07:47,bridge_name='br-int',has_traffic_filtering=True,id=05cf5b29-bd7b-498d-b3d0-b7de22551793,network=Network(f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05cf5b29-bd') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:19:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap05cf5b29-bd, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:19:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:56 user nova-compute[74683]: DEBUG nova.compute.manager [req-23bb3292-8e55-4533-a3aa-b690362e4dd5 req-233539d9-4cc1-4a1e-87bc-5b30f8b5f06c service nova] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Received event network-changed-28029fd9-7463-4b6a-8dc9-c47993f71bb5 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:19:56 user nova-compute[74683]: DEBUG nova.compute.manager [req-23bb3292-8e55-4533-a3aa-b690362e4dd5 req-233539d9-4cc1-4a1e-87bc-5b30f8b5f06c service nova] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Refreshing instance network info cache due to event network-changed-28029fd9-7463-4b6a-8dc9-c47993f71bb5. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:19:56 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-23bb3292-8e55-4533-a3aa-b690362e4dd5 req-233539d9-4cc1-4a1e-87bc-5b30f8b5f06c service nova] Acquiring lock "refresh_cache-45ca3cbb-53d6-4046-9be3-92cc6b71bfad" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:19:56 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-23bb3292-8e55-4533-a3aa-b690362e4dd5 req-233539d9-4cc1-4a1e-87bc-5b30f8b5f06c service nova] Acquired lock "refresh_cache-45ca3cbb-53d6-4046-9be3-92cc6b71bfad" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:19:56 user nova-compute[74683]: DEBUG nova.network.neutron [req-23bb3292-8e55-4533-a3aa-b690362e4dd5 req-233539d9-4cc1-4a1e-87bc-5b30f8b5f06c service nova] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Refreshing network info cache for port 28029fd9-7463-4b6a-8dc9-c47993f71bb5 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:19:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:19:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a35f6c94-42d4-4866-9a7a-87d2e738d602) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:19:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:19:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:19:56 user nova-compute[74683]: INFO os_vif [None req-cc922720-83cb-43bf-812a-61af86ba923b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:07:47,bridge_name='br-int',has_traffic_filtering=True,id=05cf5b29-bd7b-498d-b3d0-b7de22551793,network=Network(f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05cf5b29-bd')
Oct 16 11:19:56 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-cc922720-83cb-43bf-812a-61af86ba923b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Deleting instance files /opt/stack/data/nova/instances/bd60be9c-0ff3-40a5-aaab-f31fa88a67f1_del
Oct 16 11:19:56 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-cc922720-83cb-43bf-812a-61af86ba923b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Deletion of /opt/stack/data/nova/instances/bd60be9c-0ff3-40a5-aaab-f31fa88a67f1_del complete
Oct 16 11:19:56 user nova-compute[74683]: INFO nova.compute.manager [None req-cc922720-83cb-43bf-812a-61af86ba923b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Took 0.99 seconds to destroy the instance on the hypervisor.
Oct 16 11:19:56 user nova-compute[74683]: DEBUG oslo.service.loopingcall [None req-cc922720-83cb-43bf-812a-61af86ba923b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74683) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 11:19:56 user nova-compute[74683]: DEBUG nova.compute.manager [-] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Deallocating network for instance {{(pid=74683) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 11:19:56 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] deallocate_for_instance() {{(pid=74683) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 11:19:56 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2a292805-bfa1-4942-8c15-5d950b30fca7 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Acquiring lock "45ca3cbb-53d6-4046-9be3-92cc6b71bfad" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:19:56 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2a292805-bfa1-4942-8c15-5d950b30fca7 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lock "45ca3cbb-53d6-4046-9be3-92cc6b71bfad" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:19:56 user nova-compute[74683]: DEBUG nova.objects.instance [None req-2a292805-bfa1-4942-8c15-5d950b30fca7 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lazy-loading 'flavor' on Instance uuid 45ca3cbb-53d6-4046-9be3-92cc6b71bfad {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:19:56 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2a292805-bfa1-4942-8c15-5d950b30fca7 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lock "45ca3cbb-53d6-4046-9be3-92cc6b71bfad" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:19:57 user nova-compute[74683]: DEBUG nova.network.neutron [req-23bb3292-8e55-4533-a3aa-b690362e4dd5 req-233539d9-4cc1-4a1e-87bc-5b30f8b5f06c service nova] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Updated VIF entry in instance network info cache for port 28029fd9-7463-4b6a-8dc9-c47993f71bb5. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:19:57 user nova-compute[74683]: DEBUG nova.network.neutron [req-23bb3292-8e55-4533-a3aa-b690362e4dd5 req-233539d9-4cc1-4a1e-87bc-5b30f8b5f06c service nova] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Updating instance_info_cache with network_info: [{"id": "28029fd9-7463-4b6a-8dc9-c47993f71bb5", "address": "fa:16:3e:fd:e5:2b", "network": {"id": "76ba31b5-c467-45e4-ae9a-111f41fd62a3", "bridge": "br-int", "label": "tempest-TestStampPattern-2049888281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "377cd8de2ae042938a9072f64567a911", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28029fd9-74", "ovs_interfaceid": "28029fd9-7463-4b6a-8dc9-c47993f71bb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:19:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-23bb3292-8e55-4533-a3aa-b690362e4dd5 req-233539d9-4cc1-4a1e-87bc-5b30f8b5f06c service nova] Releasing lock "refresh_cache-45ca3cbb-53d6-4046-9be3-92cc6b71bfad" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:19:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2a292805-bfa1-4942-8c15-5d950b30fca7 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Acquiring lock "45ca3cbb-53d6-4046-9be3-92cc6b71bfad" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:19:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2a292805-bfa1-4942-8c15-5d950b30fca7 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lock "45ca3cbb-53d6-4046-9be3-92cc6b71bfad" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:19:57 user nova-compute[74683]: INFO nova.compute.manager [None req-2a292805-bfa1-4942-8c15-5d950b30fca7 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Attaching volume bc3f1451-b39f-4059-8d9a-0556c9bbef86 to /dev/vdb
Oct 16 11:19:57 user nova-compute[74683]: DEBUG os_brick.utils [None req-2a292805-bfa1-4942-8c15-5d950b30fca7 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:19:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:57 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[781a8a02-027f-47e7-ae35-84f3b14d432e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:70b9d336ab7d\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:19:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:57 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c971a4-445a-4099-a5bd-7588ee4d1c94]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:19:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.028s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:19:57 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[298b4ee7-7c1b-45a9-9e41-e0b9de450220]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:19:57 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[40fb744a-8537-4632-923d-760c88adbb65]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:19:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-2a292805-bfa1-4942-8c15-5d950b30fca7 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Running cmd (subprocess): nvme version {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-2a292805-bfa1-4942-8c15-5d950b30fca7 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] 'nvme version' failed. Not Retrying. {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:19:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2a292805-bfa1-4942-8c15-5d950b30fca7 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] nvme not present on system {{(pid=74683) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 11:19:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:19:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:19:57 user nova-compute[74683]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 11:19:57 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0073ae-1f77-47f0-9716-cc214c064531]: (4, '') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:19:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-2a292805-bfa1-4942-8c15-5d950b30fca7 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74683) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 11:19:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-2a292805-bfa1-4942-8c15-5d950b30fca7 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 11:19:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-2a292805-bfa1-4942-8c15-5d950b30fca7 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] LIGHTOS: no hostnqn found. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 11:19:57 user nova-compute[74683]: DEBUG os_brick.utils [None req-2a292805-bfa1-4942-8c15-5d950b30fca7 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:70b9d336ab7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:19:57 user nova-compute[74683]: DEBUG nova.virt.block_device [None req-2a292805-bfa1-4942-8c15-5d950b30fca7 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Updating existing volume attachment record: 0801f96f-f385-4c8c-a1ac-15a0ce720811 {{(pid=74683) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 11:19:57 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:19:57 user nova-compute[74683]: INFO nova.compute.manager [-] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Took 1.16 seconds to deallocate network for instance.
Oct 16 11:19:57 user nova-compute[74683]: DEBUG nova.compute.manager [req-9077ca76-3482-4f42-a6f3-f7f2059bd28a req-c4f4bb7a-6e31-4ea0-85d6-9b4260163349 service nova] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Received event network-vif-unplugged-05cf5b29-bd7b-498d-b3d0-b7de22551793 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:19:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-9077ca76-3482-4f42-a6f3-f7f2059bd28a req-c4f4bb7a-6e31-4ea0-85d6-9b4260163349 service nova] Acquiring lock "bd60be9c-0ff3-40a5-aaab-f31fa88a67f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:19:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-9077ca76-3482-4f42-a6f3-f7f2059bd28a req-c4f4bb7a-6e31-4ea0-85d6-9b4260163349 service nova] Lock "bd60be9c-0ff3-40a5-aaab-f31fa88a67f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:19:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-9077ca76-3482-4f42-a6f3-f7f2059bd28a req-c4f4bb7a-6e31-4ea0-85d6-9b4260163349 service nova] Lock "bd60be9c-0ff3-40a5-aaab-f31fa88a67f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:19:57 user nova-compute[74683]: DEBUG nova.compute.manager [req-9077ca76-3482-4f42-a6f3-f7f2059bd28a req-c4f4bb7a-6e31-4ea0-85d6-9b4260163349 service nova] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] No waiting events found dispatching network-vif-unplugged-05cf5b29-bd7b-498d-b3d0-b7de22551793 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:19:57 user nova-compute[74683]: DEBUG nova.compute.manager [req-9077ca76-3482-4f42-a6f3-f7f2059bd28a req-c4f4bb7a-6e31-4ea0-85d6-9b4260163349 service nova] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Received event network-vif-unplugged-05cf5b29-bd7b-498d-b3d0-b7de22551793 for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 11:19:57 user nova-compute[74683]: DEBUG nova.compute.manager [req-9077ca76-3482-4f42-a6f3-f7f2059bd28a req-c4f4bb7a-6e31-4ea0-85d6-9b4260163349 service nova] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Received event network-vif-plugged-05cf5b29-bd7b-498d-b3d0-b7de22551793 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:19:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-9077ca76-3482-4f42-a6f3-f7f2059bd28a req-c4f4bb7a-6e31-4ea0-85d6-9b4260163349 service nova] Acquiring lock "bd60be9c-0ff3-40a5-aaab-f31fa88a67f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:19:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-9077ca76-3482-4f42-a6f3-f7f2059bd28a req-c4f4bb7a-6e31-4ea0-85d6-9b4260163349 service nova] Lock "bd60be9c-0ff3-40a5-aaab-f31fa88a67f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:19:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-9077ca76-3482-4f42-a6f3-f7f2059bd28a req-c4f4bb7a-6e31-4ea0-85d6-9b4260163349 service nova] Lock "bd60be9c-0ff3-40a5-aaab-f31fa88a67f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:19:57 user nova-compute[74683]: DEBUG nova.compute.manager [req-9077ca76-3482-4f42-a6f3-f7f2059bd28a req-c4f4bb7a-6e31-4ea0-85d6-9b4260163349 service nova] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] No waiting events found dispatching network-vif-plugged-05cf5b29-bd7b-498d-b3d0-b7de22551793 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:19:57 user nova-compute[74683]: WARNING nova.compute.manager [req-9077ca76-3482-4f42-a6f3-f7f2059bd28a req-c4f4bb7a-6e31-4ea0-85d6-9b4260163349 service nova] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Received unexpected event network-vif-plugged-05cf5b29-bd7b-498d-b3d0-b7de22551793 for instance with vm_state active and task_state deleting.
Oct 16 11:19:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-cc922720-83cb-43bf-812a-61af86ba923b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:19:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-cc922720-83cb-43bf-812a-61af86ba923b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:19:58 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-cc922720-83cb-43bf-812a-61af86ba923b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:19:58 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-cc922720-83cb-43bf-812a-61af86ba923b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:19:58 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-cc922720-83cb-43bf-812a-61af86ba923b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.456s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:19:58 user nova-compute[74683]: INFO nova.scheduler.client.report [None req-cc922720-83cb-43bf-812a-61af86ba923b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Deleted allocations for instance bd60be9c-0ff3-40a5-aaab-f31fa88a67f1
Oct 16 11:19:58 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-cc922720-83cb-43bf-812a-61af86ba923b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "bd60be9c-0ff3-40a5-aaab-f31fa88a67f1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.868s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:19:58 user nova-compute[74683]: DEBUG nova.compute.manager [req-b704eea4-9368-4988-8a81-179298db4d78 req-bcd2223d-3638-462b-ab2f-3203c09577a6 service nova] [instance: bd60be9c-0ff3-40a5-aaab-f31fa88a67f1] Received event network-vif-deleted-05cf5b29-bd7b-498d-b3d0-b7de22551793 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:19:59 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:01 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:20:01 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:01 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:01 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:20:01 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Starting finish_revert_migration {{(pid=74683) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Oct 16 11:20:01 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Start _get_guest_xml network_info=[{"id": "dbbeadad-745e-4d28-a242-577b3197b079", "address": "fa:16:3e:2b:14:bf", "network": {"id": "33f5edce-0901-42ea-b07a-47da2819b133", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-117849665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d7573bebfe47e3989f8eedd90dee6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbbeadad-74", "ovs_interfaceid": "dbbeadad-745e-4d28-a242-577b3197b079", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nGRHmKco', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'f192d1ec-311d-4a30-9766-361b27a8dae8', 'attached_at': '2023-10-16T11:20:02.000000', 'detached_at': '', 'volume_id': 'e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b', 'serial': 'e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': None, 'delete_on_termination': False, 'attachment_id': '3c3ab647-295a-4fdf-8e01-598dbfafc963', 'volume_type': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:20:01 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:20:01 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:20:01 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:20:01 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:20:01 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:20:01 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:20:01 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:20:01 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:20:01 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:20:01 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:20:01 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:20:01 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:20:01 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:20:01 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:20:01 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:20:01 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:20:01 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:20:01 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:20:01 user nova-compute[74683]: DEBUG nova.objects.instance [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Lazy-loading 'vcpu_model' on Instance uuid f192d1ec-311d-4a30-9766-361b27a8dae8 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:20:02 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Calling os-brick to attach iSCSI Volume {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 11:20:02 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nGRHmKco', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:20:02 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:20:02 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:20:02 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:20:02 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:20:02 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:20:02 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:20:02 user nova-compute[74683]: INFO os_brick.initiator.connectors.iscsi [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 11:20:02 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:02 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260" returned: 21 in 0.030s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:02 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab660ba-7909-49c1-adc2-ba8c96931e40]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:20:02 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 11:20:02 user nova-compute[74683]:  {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:20:02 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260 --interface default --op new {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:02 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:02 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa44082-283d-4bf6-8b03-b73597c675f0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b] added\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:20:02 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b] added
Oct 16 11:20:02 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:20:02 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:02 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:02 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[72761a36-0d3e-459f-9870-0ab6a9937d42]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:20:02 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:20:02 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:02 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:02 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5621687-f15d-48de-8698-4612c8a58f9a]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:20:02 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:20:02 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nGRHmKco {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:02 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nGRHmKco" returned: 0 in 0.039s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:02 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae68ecf-641c-4319-ba00-1fc578e2173e]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:20:02 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nGRHmKco'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:20:02 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:02 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:02 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e9afc5-916b-4b94-afc0-4c0e03061f42]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:20:02 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:20:02 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:02 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:02 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[535c6f74-265b-4029-a133-334d08ca8755]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfe37f66-addb-40d6-9d3d-0f0f3e8c3e91 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:20:02 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:20:02 user nova-compute[74683]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)
Oct 16 11:20:02 user nova-compute[74683]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfe37f66-addb-40d6-9d3d-0f0f3e8c3e91 (non-flash)
Oct 16 11:20:02 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:20:02 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:20:02 user nova-compute[74683]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)
Oct 16 11:20:02 user nova-compute[74683]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfe37f66-addb-40d6-9d3d-0f0f3e8c3e91 (non-flash)
Oct 16 11:20:02 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:20:02 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260 --login {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:02 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:02 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5fd4a1-2510-4afb-9d9d-6548af16facf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:20:02 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b, portal: 172.16.0.220,3260]
Oct 16 11:20:02 user nova-compute[74683]: Login to [iface: default, target: iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b, portal: 172.16.0.220,3260] successful.
Oct 16 11:20:02 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:20:02 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:02 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:02 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[63bb3cb2-41ef-4b51-9d13-8b9c8ac842d8]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:20:02 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:20:02 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:02 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:02 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d5f927-1092-41db-8abf-5d31f32cc5eb]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfe37f66-addb-40d6-9d3d-0f0f3e8c3e91 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:20:02 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:20:02 user nova-compute[74683]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)
Oct 16 11:20:02 user nova-compute[74683]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfe37f66-addb-40d6-9d3d-0f0f3e8c3e91 (non-flash)
Oct 16 11:20:02 user nova-compute[74683]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)
Oct 16 11:20:02 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:20:02 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:20:02 user nova-compute[74683]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)
Oct 16 11:20:02 user nova-compute[74683]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfe37f66-addb-40d6-9d3d-0f0f3e8c3e91 (non-flash)
Oct 16 11:20:02 user nova-compute[74683]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)
Oct 16 11:20:02 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:20:02 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.373s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:20:02 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Connected to 172.16.0.220:3260 {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 11:20:02 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] HCTL ('34', '-', '-', 0) found on session 18 with lun 0 {{(pid=74683) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 11:20:02 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74683) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 11:20:02 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:02 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:02 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f703af8-bda3-46cd-a981-23becf8b084d]: (4, ('- - 0', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:20:02 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:20:02 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nGRHmKco', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 11:20:03 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.417s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:20:03 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] <== connect_volume: return (1419ms) {'type': 'block', 'scsi_wwn': '23238393562653037', 'path': '/dev/sdc'} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:20:03 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23238393562653037', 'path': '/dev/sdc'} {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 11:20:03 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:13:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-983209770',display_name='tempest-ServerActionsTestOtherB-server-983209770',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-983209770',id=4,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9H9XkO3ueDaPVFedHBs8IBjQP+O3m5MP98XnfC/J6UPNHq/d/RZvz6o5PlZR6OTg+H3cDaV7C6HUM8WearORwrzPoJ/Wxd8/4rMuBZ4j1C0aE5FLDGnbq9yp0LqlVHBQ==',key_name='tempest-keypair-650579759',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:18:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e1d7573bebfe47e3989f8eedd90dee6c',ramdisk_id='',reservation_id='r-wwd9qybu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1241350688',owner_user_name='tempest-ServerActionsTestOtherB-1241350688-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:19:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fc0a33378424a9080c747d4f78528a5',uuid=f192d1ec-311d-4a30-9766-361b27a8dae8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "dbbeadad-745e-4d28-a242-577b3197b079", "address": "fa:16:3e:2b:14:bf", "network": {"id": "33f5edce-0901-42ea-b07a-47da2819b133", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-117849665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d7573bebfe47e3989f8eedd90dee6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbbeadad-74", "ovs_interfaceid": "dbbeadad-745e-4d28-a242-577b3197b079", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:20:03 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Converting VIF {"id": "dbbeadad-745e-4d28-a242-577b3197b079", "address": "fa:16:3e:2b:14:bf", "network": {"id": "33f5edce-0901-42ea-b07a-47da2819b133", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-117849665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d7573bebfe47e3989f8eedd90dee6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbbeadad-74", "ovs_interfaceid": "dbbeadad-745e-4d28-a242-577b3197b079", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:20:03 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:14:bf,bridge_name='br-int',has_traffic_filtering=True,id=dbbeadad-745e-4d28-a242-577b3197b079,network=Network(33f5edce-0901-42ea-b07a-47da2819b133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbbeadad-74') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:20:03 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:20:03 user nova-compute[74683]:   <uuid>f192d1ec-311d-4a30-9766-361b27a8dae8</uuid>
Oct 16 11:20:03 user nova-compute[74683]:   <name>instance-00000004</name>
Oct 16 11:20:03 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:20:03 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:20:03 user nova-compute[74683]:   <metadata>
Oct 16 11:20:03 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:20:03 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:20:03 user nova-compute[74683]:       <nova:name>tempest-ServerActionsTestOtherB-server-983209770</nova:name>
Oct 16 11:20:03 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:20:01</nova:creationTime>
Oct 16 11:20:03 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:20:03 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:20:03 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:20:03 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:20:03 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:20:03 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:20:03 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:20:03 user nova-compute[74683]:       <nova:owner>
Oct 16 11:20:03 user nova-compute[74683]:         <nova:user uuid="0fc0a33378424a9080c747d4f78528a5">tempest-ServerActionsTestOtherB-1241350688-project-member</nova:user>
Oct 16 11:20:03 user nova-compute[74683]:         <nova:project uuid="e1d7573bebfe47e3989f8eedd90dee6c">tempest-ServerActionsTestOtherB-1241350688</nova:project>
Oct 16 11:20:03 user nova-compute[74683]:       </nova:owner>
Oct 16 11:20:03 user nova-compute[74683]:       <nova:root type="image" uuid="0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f"/>
Oct 16 11:20:03 user nova-compute[74683]:       <nova:ports>
Oct 16 11:20:03 user nova-compute[74683]:         <nova:port uuid="dbbeadad-745e-4d28-a242-577b3197b079">
Oct 16 11:20:03 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 16 11:20:03 user nova-compute[74683]:         </nova:port>
Oct 16 11:20:03 user nova-compute[74683]:       </nova:ports>
Oct 16 11:20:03 user nova-compute[74683]:     </nova:instance>
Oct 16 11:20:03 user nova-compute[74683]:   </metadata>
Oct 16 11:20:03 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:20:03 user nova-compute[74683]:     <system>
Oct 16 11:20:03 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:20:03 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:20:03 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:20:03 user nova-compute[74683]:       <entry name="serial">f192d1ec-311d-4a30-9766-361b27a8dae8</entry>
Oct 16 11:20:03 user nova-compute[74683]:       <entry name="uuid">f192d1ec-311d-4a30-9766-361b27a8dae8</entry>
Oct 16 11:20:03 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:20:03 user nova-compute[74683]:     </system>
Oct 16 11:20:03 user nova-compute[74683]:   </sysinfo>
Oct 16 11:20:03 user nova-compute[74683]:   <os>
Oct 16 11:20:03 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:20:03 user nova-compute[74683]:     <boot dev="hd"/>
Oct 16 11:20:03 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:20:03 user nova-compute[74683]:   </os>
Oct 16 11:20:03 user nova-compute[74683]:   <features>
Oct 16 11:20:03 user nova-compute[74683]:     <acpi/>
Oct 16 11:20:03 user nova-compute[74683]:     <apic/>
Oct 16 11:20:03 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:20:03 user nova-compute[74683]:   </features>
Oct 16 11:20:03 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:20:03 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:20:03 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:20:03 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:20:03 user nova-compute[74683]:   </clock>
Oct 16 11:20:03 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:20:03 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:20:03 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:20:03 user nova-compute[74683]:   </cpu>
Oct 16 11:20:03 user nova-compute[74683]:   <devices>
Oct 16 11:20:03 user nova-compute[74683]:     <disk type="file" device="disk">
Oct 16 11:20:03 user nova-compute[74683]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 11:20:03 user nova-compute[74683]:       <source file="/opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/disk"/>
Oct 16 11:20:03 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:20:03 user nova-compute[74683]:     </disk>
Oct 16 11:20:03 user nova-compute[74683]:     <disk type="block" device="disk">
Oct 16 11:20:03 user nova-compute[74683]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:20:03 user nova-compute[74683]:       <source dev="/dev/sdc"/>
Oct 16 11:20:03 user nova-compute[74683]:       <target dev="vdb" bus="virtio"/>
Oct 16 11:20:03 user nova-compute[74683]:       <serial>e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b</serial>
Oct 16 11:20:03 user nova-compute[74683]:     </disk>
Oct 16 11:20:03 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:20:03 user nova-compute[74683]:       <mac address="fa:16:3e:2b:14:bf"/>
Oct 16 11:20:03 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:20:03 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:20:03 user nova-compute[74683]:       <target dev="tapdbbeadad-74"/>
Oct 16 11:20:03 user nova-compute[74683]:     </interface>
Oct 16 11:20:03 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:20:03 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/console.log" append="off"/>
Oct 16 11:20:03 user nova-compute[74683]:     </serial>
Oct 16 11:20:03 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:20:03 user nova-compute[74683]:     <video>
Oct 16 11:20:03 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:20:03 user nova-compute[74683]:     </video>
Oct 16 11:20:03 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:20:03 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:20:03 user nova-compute[74683]:     </rng>
Oct 16 11:20:03 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:20:03 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:20:03 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:20:03 user nova-compute[74683]:     </memballoon>
Oct 16 11:20:03 user nova-compute[74683]:   </devices>
Oct 16 11:20:03 user nova-compute[74683]: </domain>
Oct 16 11:20:03 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:20:03 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:13:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-983209770',display_name='tempest-ServerActionsTestOtherB-server-983209770',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-983209770',id=4,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9H9XkO3ueDaPVFedHBs8IBjQP+O3m5MP98XnfC/J6UPNHq/d/RZvz6o5PlZR6OTg+H3cDaV7C6HUM8WearORwrzPoJ/Wxd8/4rMuBZ4j1C0aE5FLDGnbq9yp0LqlVHBQ==',key_name='tempest-keypair-650579759',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:18:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e1d7573bebfe47e3989f8eedd90dee6c',ramdisk_id='',reservation_id='r-wwd9qybu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1241350688',owner_user_name='tempest-ServerActionsTestOtherB-1241350688-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:19:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fc0a33378424a9080c747d4f78528a5',uuid=f192d1ec-311d-4a30-9766-361b27a8dae8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "dbbeadad-745e-4d28-a242-577b3197b079", "address": "fa:16:3e:2b:14:bf", "network": {"id": "33f5edce-0901-42ea-b07a-47da2819b133", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-117849665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d7573bebfe47e3989f8eedd90dee6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbbeadad-74", "ovs_interfaceid": "dbbeadad-745e-4d28-a242-577b3197b079", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:20:03 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Converting VIF {"id": "dbbeadad-745e-4d28-a242-577b3197b079", "address": "fa:16:3e:2b:14:bf", "network": {"id": "33f5edce-0901-42ea-b07a-47da2819b133", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-117849665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d7573bebfe47e3989f8eedd90dee6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbbeadad-74", "ovs_interfaceid": "dbbeadad-745e-4d28-a242-577b3197b079", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:20:03 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:14:bf,bridge_name='br-int',has_traffic_filtering=True,id=dbbeadad-745e-4d28-a242-577b3197b079,network=Network(33f5edce-0901-42ea-b07a-47da2819b133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbbeadad-74') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:20:03 user nova-compute[74683]: DEBUG os_vif [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:14:bf,bridge_name='br-int',has_traffic_filtering=True,id=dbbeadad-745e-4d28-a242-577b3197b079,network=Network(33f5edce-0901-42ea-b07a-47da2819b133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbbeadad-74') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:20:03 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:03 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:20:03 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:20:03 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:03 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '56f2a605-bb46-5863-87e8-d5b8b20d92cc', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:20:03 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:03 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:20:03 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:03 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdbbeadad-74, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:20:03 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdbbeadad-74, col_values=(('qos', UUID('36012291-90a0-4546-a827-707030f2b87e')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:20:03 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdbbeadad-74, col_values=(('external_ids', {'iface-id': 'dbbeadad-745e-4d28-a242-577b3197b079', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:14:bf', 'vm-uuid': 'f192d1ec-311d-4a30-9766-361b27a8dae8'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:20:03 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:03 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:20:03 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:03 user nova-compute[74683]: INFO os_vif [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:14:bf,bridge_name='br-int',has_traffic_filtering=True,id=dbbeadad-745e-4d28-a242-577b3197b079,network=Network(33f5edce-0901-42ea-b07a-47da2819b133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbbeadad-74')
Oct 16 11:20:04 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-2883788d-808d-479b-a411-4f88fd870378 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9ae15ce7-996c-460f-a901-1570a2012af1 is timed out.
Oct 16 11:20:04 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-2883788d-808d-479b-a411-4f88fd870378 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Successfully detached device vdb from instance 9ae15ce7-996c-460f-a901-1570a2012af1 from the live domain config.
Oct 16 11:20:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2883788d-808d-479b-a411-4f88fd870378 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] calling os-brick to detach iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 11:20:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-2883788d-808d-479b-a411-4f88fd870378 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, {'target_iqn': 'iqn.2010-10.org.openstack:dfe37f66-addb-40d6-9d3d-0f0f3e8c3e91', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ekGuQhnP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:20:04 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-2883788d-808d-479b-a411-4f88fd870378 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:20:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-2883788d-808d-479b-a411-4f88fd870378 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:20:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-2883788d-808d-479b-a411-4f88fd870378 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:20:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b785733-adcb-4f86-820f-48e892e9fe0e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dfe37f66-addb-40d6-9d3d-0f0f3e8c3e91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:20:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-2883788d-808d-479b-a411-4f88fd870378 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 11:20:04 user nova-compute[74683]: No targets found.
Oct 16 11:20:04 user nova-compute[74683]: iSNS:
Oct 16 11:20:04 user nova-compute[74683]: No targets found.
Oct 16 11:20:04 user nova-compute[74683]: STATIC:
Oct 16 11:20:04 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5
Oct 16 11:20:04 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:20:04 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:20:04 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:dfe37f66-addb-40d6-9d3d-0f0f3e8c3e91
Oct 16 11:20:04 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:20:04 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:20:04 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb
Oct 16 11:20:04 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:20:04 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:20:04 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b
Oct 16 11:20:04 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:20:04 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:20:04 user nova-compute[74683]: FIRMWARE:
Oct 16 11:20:04 user nova-compute[74683]: No targets found.
Oct 16 11:20:04 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:20:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-2883788d-808d-479b-a411-4f88fd870378 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 11:20:04 user nova-compute[74683]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 11:20:04 user nova-compute[74683]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74683) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 11:20:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-2883788d-808d-479b-a411-4f88fd870378 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dfe37f66-addb-40d6-9d3d-0f0f3e8c3e91', 0)] {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 11:20:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b603058-527a-4a4b-acae-66c3e282ce85]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfe37f66-addb-40d6-9d3d-0f0f3e8c3e91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:20:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf30799-b787-42e7-b416-4bd7da5849a0]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfe37f66-addb-40d6-9d3d-0f0f3e8c3e91 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:20:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-2883788d-808d-479b-a411-4f88fd870378 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:20:04 user nova-compute[74683]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)
Oct 16 11:20:04 user nova-compute[74683]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfe37f66-addb-40d6-9d3d-0f0f3e8c3e91 (non-flash)
Oct 16 11:20:04 user nova-compute[74683]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)
Oct 16 11:20:04 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:20:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-2883788d-808d-479b-a411-4f88fd870378 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:20:04 user nova-compute[74683]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)
Oct 16 11:20:04 user nova-compute[74683]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfe37f66-addb-40d6-9d3d-0f0f3e8c3e91 (non-flash)
Oct 16 11:20:04 user nova-compute[74683]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)
Oct 16 11:20:04 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:20:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-2883788d-808d-479b-a411-4f88fd870378 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda4c7a2cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dfe37f66-addb-40d6-9d3d-0f0f3e8c3e91'): ({'sdb'}, set())}) {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 11:20:04 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-2883788d-808d-479b-a411-4f88fd870378 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Removing single pathed devices sdb {{(pid=74683) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 11:20:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[496575a8-029a-499e-9a48-fd7195a8b51d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:20:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4f6c3e-1320-4ed1-92b0-d1c8f730c0f9]: (4, ('ok\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:20:04 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-2883788d-808d-479b-a411-4f88fd870378 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Flushing IO for device /dev/sdb {{(pid=74683) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 11:20:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8d750e-a1ea-4466-aa77-c2075a41ad1c]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:20:04 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-2883788d-808d-479b-a411-4f88fd870378 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74683) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 11:20:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.096s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[185acd76-7bbb-4a0c-86be-4c03c1c9b731]: (4, ('1', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:20:04 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-2883788d-808d-479b-a411-4f88fd870378 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 11:20:04 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-2883788d-808d-479b-a411-4f88fd870378 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] SCSI volumes sdb have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 11:20:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-2883788d-808d-479b-a411-4f88fd870378 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dfe37f66-addb-40d6-9d3d-0f0f3e8c3e91')] {{(pid=74683) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 11:20:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfe37f66-addb-40d6-9d3d-0f0f3e8c3e91 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfe37f66-addb-40d6-9d3d-0f0f3e8c3e91 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.059s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc1a071-5ff1-4157-ae2e-9969afdeb8d1]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:20:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-2883788d-808d-479b-a411-4f88fd870378 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:20:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfe37f66-addb-40d6-9d3d-0f0f3e8c3e91 -p 172.16.0.220:3260 --logout {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfe37f66-addb-40d6-9d3d-0f0f3e8c3e91 -p 172.16.0.220:3260 --logout" returned: 0 in 0.236s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e5d156-09d4-4d4b-9813-329e204a3f20]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:dfe37f66-addb-40d6-9d3d-0f0f3e8c3e91, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:dfe37f66-addb-40d6-9d3d-0f0f3e8c3e91, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:20:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-2883788d-808d-479b-a411-4f88fd870378 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:dfe37f66-addb-40d6-9d3d-0f0f3e8c3e91, portal: 172.16.0.220,3260]
Oct 16 11:20:04 user nova-compute[74683]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:dfe37f66-addb-40d6-9d3d-0f0f3e8c3e91, portal: 172.16.0.220,3260] successful.
Oct 16 11:20:04 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:20:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfe37f66-addb-40d6-9d3d-0f0f3e8c3e91 -p 172.16.0.220:3260 --op delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:04 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:20:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfe37f66-addb-40d6-9d3d-0f0f3e8c3e91 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.061s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cbd431f-e244-427f-8e93-364ebbcce5b4]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:20:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-2883788d-808d-479b-a411-4f88fd870378 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:20:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-2883788d-808d-479b-a411-4f88fd870378 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.632s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:20:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-2883788d-808d-479b-a411-4f88fd870378 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] <== disconnect_volume: return (633ms) None {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:20:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2883788d-808d-479b-a411-4f88fd870378 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Disconnected iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 11:20:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:05 user nova-compute[74683]: DEBUG nova.compute.manager [req-e9ab5a2e-15b5-4d6e-a182-4c1200e09502 req-67e5950a-2a52-4b9f-a68a-151cc29a8ca9 service nova] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Received event network-vif-plugged-dbbeadad-745e-4d28-a242-577b3197b079 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:20:05 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e9ab5a2e-15b5-4d6e-a182-4c1200e09502 req-67e5950a-2a52-4b9f-a68a-151cc29a8ca9 service nova] Acquiring lock "f192d1ec-311d-4a30-9766-361b27a8dae8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:20:05 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e9ab5a2e-15b5-4d6e-a182-4c1200e09502 req-67e5950a-2a52-4b9f-a68a-151cc29a8ca9 service nova] Lock "f192d1ec-311d-4a30-9766-361b27a8dae8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:20:05 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e9ab5a2e-15b5-4d6e-a182-4c1200e09502 req-67e5950a-2a52-4b9f-a68a-151cc29a8ca9 service nova] Lock "f192d1ec-311d-4a30-9766-361b27a8dae8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:20:05 user nova-compute[74683]: DEBUG nova.compute.manager [req-e9ab5a2e-15b5-4d6e-a182-4c1200e09502 req-67e5950a-2a52-4b9f-a68a-151cc29a8ca9 service nova] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] No waiting events found dispatching network-vif-plugged-dbbeadad-745e-4d28-a242-577b3197b079 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:20:05 user nova-compute[74683]: WARNING nova.compute.manager [req-e9ab5a2e-15b5-4d6e-a182-4c1200e09502 req-67e5950a-2a52-4b9f-a68a-151cc29a8ca9 service nova] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Received unexpected event network-vif-plugged-dbbeadad-745e-4d28-a242-577b3197b079 for instance with vm_state resized and task_state resize_reverting.
Oct 16 11:20:05 user nova-compute[74683]: DEBUG nova.objects.instance [None req-2883788d-808d-479b-a411-4f88fd870378 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Lazy-loading 'flavor' on Instance uuid 9ae15ce7-996c-460f-a901-1570a2012af1 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:20:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:05 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2883788d-808d-479b-a411-4f88fd870378 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Lock "9ae15ce7-996c-460f-a901-1570a2012af1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.373s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:20:05 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "9ae15ce7-996c-460f-a901-1570a2012af1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 12.101s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:20:05 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "9ae15ce7-996c-460f-a901-1570a2012af1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:20:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-309b9a64-efde-47c3-a955-c1c2802812b0 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Acquiring lock "interface-9ae15ce7-996c-460f-a901-1570a2012af1-ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:20:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-309b9a64-efde-47c3-a955-c1c2802812b0 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Lock "interface-9ae15ce7-996c-460f-a901-1570a2012af1-ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:20:06 user nova-compute[74683]: DEBUG nova.objects.instance [None req-309b9a64-efde-47c3-a955-c1c2802812b0 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Lazy-loading 'flavor' on Instance uuid 9ae15ce7-996c-460f-a901-1570a2012af1 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:20:06 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-309b9a64-efde-47c3-a955-c1c2802812b0 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T11:17:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-717081521',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-717081521',id=14,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8efJVroKVuigryD4GSp1jU2h74/46LP7zUTBq1YNdoS9sGz/cMTsYXKQK2+Lj6yR1spH3hPAhB6Y4h51NvH2BYFIARH1zI9goHYvZdEeIkuG1XUEV0yYBKVJjNs/qPig==',key_name='tempest-keypair-1457686750',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:17:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5042cdda42b74341b6c592437b6bbdbf',ramdisk_id='',reservation_id='r-ezaz9z78',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2119065928',owner_user_name='tempest-TaggedAttachmentsTest-2119065928-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:17:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ceb56d9dc1b04324adfd4f8d0b1a9766',uuid=9ae15ce7-996c-460f-a901-1570a2012af1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05", "address": "fa:16:3e:61:ea:f6", "network": {"id": "693d56b4-4756-4957-94a4-1f1bca480f12", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-659453574", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5042cdda42b74341b6c592437b6bbdbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecf30d0f-8f", "ovs_interfaceid": "ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:20:06 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-309b9a64-efde-47c3-a955-c1c2802812b0 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Converting VIF {"id": "ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05", "address": "fa:16:3e:61:ea:f6", "network": {"id": "693d56b4-4756-4957-94a4-1f1bca480f12", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-659453574", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5042cdda42b74341b6c592437b6bbdbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecf30d0f-8f", "ovs_interfaceid": "ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:20:06 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-309b9a64-efde-47c3-a955-c1c2802812b0 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:ea:f6,bridge_name='br-int',has_traffic_filtering=True,id=ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05,network=Network(693d56b4-4756-4957-94a4-1f1bca480f12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecf30d0f-8f') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:20:06 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-309b9a64-efde-47c3-a955-c1c2802812b0 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:61:ea:f6"/><model type="virtio"/><mtu size="1442"/><target dev="tapecf30d0f-8f"/></interface> {{(pid=74683) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 16 11:20:06 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-309b9a64-efde-47c3-a955-c1c2802812b0 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:61:ea:f6"/><model type="virtio"/><mtu size="1442"/><target dev="tapecf30d0f-8f"/></interface> {{(pid=74683) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 16 11:20:06 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-309b9a64-efde-47c3-a955-c1c2802812b0 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Attempting to detach device tapecf30d0f-8f from instance 9ae15ce7-996c-460f-a901-1570a2012af1 from the persistent domain config. {{(pid=74683) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 11:20:06 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-309b9a64-efde-47c3-a955-c1c2802812b0 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] detach device xml: <interface type="ethernet">
Oct 16 11:20:06 user nova-compute[74683]:   <mac address="fa:16:3e:61:ea:f6"/>
Oct 16 11:20:06 user nova-compute[74683]:   <model type="virtio"/>
Oct 16 11:20:06 user nova-compute[74683]:   <mtu size="1442"/>
Oct 16 11:20:06 user nova-compute[74683]:   <target dev="tapecf30d0f-8f"/>
Oct 16 11:20:06 user nova-compute[74683]: </interface>
Oct 16 11:20:06 user nova-compute[74683]:  {{(pid=74683) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 11:20:06 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-309b9a64-efde-47c3-a955-c1c2802812b0 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:61:ea:f6"/><model type="virtio"/><mtu size="1442"/><target dev="tapecf30d0f-8f"/></interface> {{(pid=74683) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 16 11:20:06 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-309b9a64-efde-47c3-a955-c1c2802812b0 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:61:ea:f6"/><model type="virtio"/><mtu size="1442"/><target dev="tapecf30d0f-8f"/></interface>not found in domain: <domain type='kvm' id='14'>
Oct 16 11:20:06 user nova-compute[74683]:   <name>instance-0000000e</name>
Oct 16 11:20:06 user nova-compute[74683]:   <uuid>9ae15ce7-996c-460f-a901-1570a2012af1</uuid>
Oct 16 11:20:06 user nova-compute[74683]:   <metadata>
Oct 16 11:20:06 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:20:06 user nova-compute[74683]:   <nova:package version="0.0.0"/>
Oct 16 11:20:06 user nova-compute[74683]:   <nova:name>tempest-device-tagging-server-717081521</nova:name>
Oct 16 11:20:06 user nova-compute[74683]:   <nova:creationTime>2023-10-16 11:19:05</nova:creationTime>
Oct 16 11:20:06 user nova-compute[74683]:   <nova:flavor name="m1.tiny">
Oct 16 11:20:06 user nova-compute[74683]:     <nova:memory>512</nova:memory>
Oct 16 11:20:06 user nova-compute[74683]:     <nova:disk>1</nova:disk>
Oct 16 11:20:06 user nova-compute[74683]:     <nova:swap>0</nova:swap>
Oct 16 11:20:06 user nova-compute[74683]:     <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:20:06 user nova-compute[74683]:     <nova:vcpus>1</nova:vcpus>
Oct 16 11:20:06 user nova-compute[74683]:   </nova:flavor>
Oct 16 11:20:06 user nova-compute[74683]:   <nova:owner>
Oct 16 11:20:06 user nova-compute[74683]:     <nova:user uuid="ceb56d9dc1b04324adfd4f8d0b1a9766">tempest-TaggedAttachmentsTest-2119065928-project-member</nova:user>
Oct 16 11:20:06 user nova-compute[74683]:     <nova:project uuid="5042cdda42b74341b6c592437b6bbdbf">tempest-TaggedAttachmentsTest-2119065928</nova:project>
Oct 16 11:20:06 user nova-compute[74683]:   </nova:owner>
Oct 16 11:20:06 user nova-compute[74683]:   <nova:root type="image" uuid="0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f"/>
Oct 16 11:20:06 user nova-compute[74683]:   <nova:ports>
Oct 16 11:20:06 user nova-compute[74683]:     <nova:port uuid="84d9dc84-2273-4e6b-a8fe-9a94bddd198c">
Oct 16 11:20:06 user nova-compute[74683]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 16 11:20:06 user nova-compute[74683]:     </nova:port>
Oct 16 11:20:06 user nova-compute[74683]:     <nova:port uuid="ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05">
Oct 16 11:20:06 user nova-compute[74683]:       <nova:ip type="fixed" address="10.10.10.17" ipVersion="4"/>
Oct 16 11:20:06 user nova-compute[74683]:     </nova:port>
Oct 16 11:20:06 user nova-compute[74683]:   </nova:ports>
Oct 16 11:20:06 user nova-compute[74683]: </nova:instance>
Oct 16 11:20:06 user nova-compute[74683]:   </metadata>
Oct 16 11:20:06 user nova-compute[74683]:   <memory unit='KiB'>524288</memory>
Oct 16 11:20:06 user nova-compute[74683]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 16 11:20:06 user nova-compute[74683]:   <vcpu placement='static'>1</vcpu>
Oct 16 11:20:06 user nova-compute[74683]:   <resource>
Oct 16 11:20:06 user nova-compute[74683]:     <partition>/machine</partition>
Oct 16 11:20:06 user nova-compute[74683]:   </resource>
Oct 16 11:20:06 user nova-compute[74683]:   <sysinfo type='smbios'>
Oct 16 11:20:06 user nova-compute[74683]:     <system>
Oct 16 11:20:06 user nova-compute[74683]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 16 11:20:06 user nova-compute[74683]:       <entry name='product'>OpenStack Nova</entry>
Oct 16 11:20:06 user nova-compute[74683]:       <entry name='version'>0.0.0</entry>
Oct 16 11:20:06 user nova-compute[74683]:       <entry name='serial'>9ae15ce7-996c-460f-a901-1570a2012af1</entry>
Oct 16 11:20:06 user nova-compute[74683]:       <entry name='uuid'>9ae15ce7-996c-460f-a901-1570a2012af1</entry>
Oct 16 11:20:06 user nova-compute[74683]:       <entry name='family'>Virtual Machine</entry>
Oct 16 11:20:06 user nova-compute[74683]:     </system>
Oct 16 11:20:06 user nova-compute[74683]:   </sysinfo>
Oct 16 11:20:06 user nova-compute[74683]:   <os>
Oct 16 11:20:06 user nova-compute[74683]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 16 11:20:06 user nova-compute[74683]:     <boot dev='hd'/>
Oct 16 11:20:06 user nova-compute[74683]:     <smbios mode='sysinfo'/>
Oct 16 11:20:06 user nova-compute[74683]:   </os>
Oct 16 11:20:06 user nova-compute[74683]:   <features>
Oct 16 11:20:06 user nova-compute[74683]:     <acpi/>
Oct 16 11:20:06 user nova-compute[74683]:     <apic/>
Oct 16 11:20:06 user nova-compute[74683]:     <vmcoreinfo state='on'/>
Oct 16 11:20:06 user nova-compute[74683]:   </features>
Oct 16 11:20:06 user nova-compute[74683]:   <cpu mode='custom' match='exact' check='full'>
Oct 16 11:20:06 user nova-compute[74683]:     <model fallback='forbid'>Nehalem</model>
Oct 16 11:20:06 user nova-compute[74683]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 16 11:20:06 user nova-compute[74683]:     <feature policy='require' name='vme'/>
Oct 16 11:20:06 user nova-compute[74683]:     <feature policy='require' name='x2apic'/>
Oct 16 11:20:06 user nova-compute[74683]:     <feature policy='require' name='hypervisor'/>
Oct 16 11:20:06 user nova-compute[74683]:   </cpu>
Oct 16 11:20:06 user nova-compute[74683]:   <clock offset='utc'>
Oct 16 11:20:06 user nova-compute[74683]:     <timer name='pit' tickpolicy='delay'/>
Oct 16 11:20:06 user nova-compute[74683]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 16 11:20:06 user nova-compute[74683]:     <timer name='hpet' present='no'/>
Oct 16 11:20:06 user nova-compute[74683]:   </clock>
Oct 16 11:20:06 user nova-compute[74683]:   <on_poweroff>destroy</on_poweroff>
Oct 16 11:20:06 user nova-compute[74683]:   <on_reboot>restart</on_reboot>
Oct 16 11:20:06 user nova-compute[74683]:   <on_crash>destroy</on_crash>
Oct 16 11:20:06 user nova-compute[74683]:   <devices>
Oct 16 11:20:06 user nova-compute[74683]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 16 11:20:06 user nova-compute[74683]:     <disk type='file' device='disk'>
Oct 16 11:20:06 user nova-compute[74683]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 16 11:20:06 user nova-compute[74683]:       <source file='/opt/stack/data/nova/instances/9ae15ce7-996c-460f-a901-1570a2012af1/disk' index='2'/>
Oct 16 11:20:06 user nova-compute[74683]:       <backingStore type='file' index='3'>
Oct 16 11:20:06 user nova-compute[74683]:         <format type='raw'/>
Oct 16 11:20:06 user nova-compute[74683]:         <source file='/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66'/>
Oct 16 11:20:06 user nova-compute[74683]:         <backingStore/>
Oct 16 11:20:06 user nova-compute[74683]:       </backingStore>
Oct 16 11:20:06 user nova-compute[74683]:       <target dev='vda' bus='virtio'/>
Oct 16 11:20:06 user nova-compute[74683]:       <alias name='virtio-disk0'/>
Oct 16 11:20:06 user nova-compute[74683]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 16 11:20:06 user nova-compute[74683]:     </disk>
Oct 16 11:20:06 user nova-compute[74683]:     <disk type='file' device='cdrom'>
Oct 16 11:20:06 user nova-compute[74683]:       <driver name='qemu' type='raw' cache='none'/>
Oct 16 11:20:06 user nova-compute[74683]:       <source file='/opt/stack/data/nova/instances/9ae15ce7-996c-460f-a901-1570a2012af1/disk.config' index='1'/>
Oct 16 11:20:06 user nova-compute[74683]:       <backingStore/>
Oct 16 11:20:06 user nova-compute[74683]:       <target dev='hda' bus='ide'/>
Oct 16 11:20:06 user nova-compute[74683]:       <readonly/>
Oct 16 11:20:06 user nova-compute[74683]:       <alias name='ide0-0-0'/>
Oct 16 11:20:06 user nova-compute[74683]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 16 11:20:06 user nova-compute[74683]:     </disk>
Oct 16 11:20:06 user nova-compute[74683]:     <controller type='usb' index='0' model='none'>
Oct 16 11:20:06 user nova-compute[74683]:       <alias name='usb'/>
Oct 16 11:20:06 user nova-compute[74683]:     </controller>
Oct 16 11:20:06 user nova-compute[74683]:     <controller type='pci' index='0' model='pci-root'>
Oct 16 11:20:06 user nova-compute[74683]:       <alias name='pci.0'/>
Oct 16 11:20:06 user nova-compute[74683]:     </controller>
Oct 16 11:20:06 user nova-compute[74683]:     <controller type='ide' index='0'>
Oct 16 11:20:06 user nova-compute[74683]:       <alias name='ide'/>
Oct 16 11:20:06 user nova-compute[74683]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 16 11:20:06 user nova-compute[74683]:     </controller>
Oct 16 11:20:06 user nova-compute[74683]:     <interface type='ethernet'>
Oct 16 11:20:06 user nova-compute[74683]:       <mac address='fa:16:3e:07:96:fd'/>
Oct 16 11:20:06 user nova-compute[74683]:       <target dev='tap84d9dc84-22'/>
Oct 16 11:20:06 user nova-compute[74683]:       <model type='virtio'/>
Oct 16 11:20:06 user nova-compute[74683]:       <mtu size='1442'/>
Oct 16 11:20:06 user nova-compute[74683]:       <alias name='net0'/>
Oct 16 11:20:06 user nova-compute[74683]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 16 11:20:06 user nova-compute[74683]:     </interface>
Oct 16 11:20:06 user nova-compute[74683]:     <interface type='ethernet'>
Oct 16 11:20:06 user nova-compute[74683]:       <mac address='fa:16:3e:61:ea:f6'/>
Oct 16 11:20:06 user nova-compute[74683]:       <target dev='tapecf30d0f-8f'/>
Oct 16 11:20:06 user nova-compute[74683]:       <model type='virtio'/>
Oct 16 11:20:06 user nova-compute[74683]:       <mtu size='1442'/>
Oct 16 11:20:06 user nova-compute[74683]:       <alias name='net1'/>
Oct 16 11:20:06 user nova-compute[74683]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Oct 16 11:20:06 user nova-compute[74683]:     </interface>
Oct 16 11:20:06 user nova-compute[74683]:     <serial type='pty'>
Oct 16 11:20:06 user nova-compute[74683]:       <source path='/dev/pts/10'/>
Oct 16 11:20:06 user nova-compute[74683]:       <log file='/opt/stack/data/nova/instances/9ae15ce7-996c-460f-a901-1570a2012af1/console.log' append='off'/>
Oct 16 11:20:06 user nova-compute[74683]:       <target type='isa-serial' port='0'>
Oct 16 11:20:06 user nova-compute[74683]:         <model name='isa-serial'/>
Oct 16 11:20:06 user nova-compute[74683]:       </target>
Oct 16 11:20:06 user nova-compute[74683]:       <alias name='serial0'/>
Oct 16 11:20:06 user nova-compute[74683]:     </serial>
Oct 16 11:20:06 user nova-compute[74683]:     <console type='pty' tty='/dev/pts/10'>
Oct 16 11:20:06 user nova-compute[74683]:       <source path='/dev/pts/10'/>
Oct 16 11:20:06 user nova-compute[74683]:       <log file='/opt/stack/data/nova/instances/9ae15ce7-996c-460f-a901-1570a2012af1/console.log' append='off'/>
Oct 16 11:20:06 user nova-compute[74683]:       <target type='serial' port='0'/>
Oct 16 11:20:06 user nova-compute[74683]:       <alias name='serial0'/>
Oct 16 11:20:06 user nova-compute[74683]:     </console>
Oct 16 11:20:06 user nova-compute[74683]:     <input type='mouse' bus='ps2'>
Oct 16 11:20:06 user nova-compute[74683]:       <alias name='input0'/>
Oct 16 11:20:06 user nova-compute[74683]:     </input>
Oct 16 11:20:06 user nova-compute[74683]:     <input type='keyboard' bus='ps2'>
Oct 16 11:20:06 user nova-compute[74683]:       <alias name='input1'/>
Oct 16 11:20:06 user nova-compute[74683]:     </input>
Oct 16 11:20:06 user nova-compute[74683]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Oct 16 11:20:06 user nova-compute[74683]:       <listen type='address' address='0.0.0.0'/>
Oct 16 11:20:06 user nova-compute[74683]:     </graphics>
Oct 16 11:20:06 user nova-compute[74683]:     <audio id='1' type='none'/>
Oct 16 11:20:06 user nova-compute[74683]:     <video>
Oct 16 11:20:06 user nova-compute[74683]:       <model type='virtio' heads='1' primary='yes'/>
Oct 16 11:20:06 user nova-compute[74683]:       <alias name='video0'/>
Oct 16 11:20:06 user nova-compute[74683]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 16 11:20:06 user nova-compute[74683]:     </video>
Oct 16 11:20:06 user nova-compute[74683]:     <memballoon model='virtio'>
Oct 16 11:20:06 user nova-compute[74683]:       <stats period='10'/>
Oct 16 11:20:06 user nova-compute[74683]:       <alias name='balloon0'/>
Oct 16 11:20:06 user nova-compute[74683]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 16 11:20:06 user nova-compute[74683]:     </memballoon>
Oct 16 11:20:06 user nova-compute[74683]:     <rng model='virtio'>
Oct 16 11:20:06 user nova-compute[74683]:       <backend model='random'>/dev/urandom</backend>
Oct 16 11:20:06 user nova-compute[74683]:       <alias name='rng0'/>
Oct 16 11:20:06 user nova-compute[74683]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 16 11:20:06 user nova-compute[74683]:     </rng>
Oct 16 11:20:06 user nova-compute[74683]:   </devices>
Oct 16 11:20:06 user nova-compute[74683]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 16 11:20:06 user nova-compute[74683]:     <label>libvirt-9ae15ce7-996c-460f-a901-1570a2012af1</label>
Oct 16 11:20:06 user nova-compute[74683]:     <imagelabel>libvirt-9ae15ce7-996c-460f-a901-1570a2012af1</imagelabel>
Oct 16 11:20:06 user nova-compute[74683]:   </seclabel>
Oct 16 11:20:06 user nova-compute[74683]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 16 11:20:06 user nova-compute[74683]:     <label>+64055:+108</label>
Oct 16 11:20:06 user nova-compute[74683]:     <imagelabel>+64055:+108</imagelabel>
Oct 16 11:20:06 user nova-compute[74683]:   </seclabel>
Oct 16 11:20:06 user nova-compute[74683]: </domain>
Oct 16 11:20:06 user nova-compute[74683]:  {{(pid=74683) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 16 11:20:06 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-309b9a64-efde-47c3-a955-c1c2802812b0 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Successfully detached device tapecf30d0f-8f from instance 9ae15ce7-996c-460f-a901-1570a2012af1 from the persistent domain config.
Oct 16 11:20:06 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-309b9a64-efde-47c3-a955-c1c2802812b0 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] (1/8): Attempting to detach device tapecf30d0f-8f with device alias net1 from instance 9ae15ce7-996c-460f-a901-1570a2012af1 from the live domain config. {{(pid=74683) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 11:20:06 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-309b9a64-efde-47c3-a955-c1c2802812b0 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] detach device xml: <interface type="ethernet">
Oct 16 11:20:06 user nova-compute[74683]:   <mac address="fa:16:3e:61:ea:f6"/>
Oct 16 11:20:06 user nova-compute[74683]:   <model type="virtio"/>
Oct 16 11:20:06 user nova-compute[74683]:   <mtu size="1442"/>
Oct 16 11:20:06 user nova-compute[74683]:   <target dev="tapecf30d0f-8f"/>
Oct 16 11:20:06 user nova-compute[74683]: </interface>
Oct 16 11:20:06 user nova-compute[74683]:  {{(pid=74683) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 11:20:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:06 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-309b9a64-efde-47c3-a955-c1c2802812b0 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Start waiting for the detach event from libvirt for device tapecf30d0f-8f with device alias net1 for instance 9ae15ce7-996c-460f-a901-1570a2012af1 {{(pid=74683) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 11:20:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:06 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:20:06 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:20:06 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Starting heal instance info cache {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 11:20:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:06 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Didn't find any instances for network info cache update. {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 16 11:20:06 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:20:06 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74683) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 11:20:07 user nova-compute[74683]: DEBUG nova.compute.manager [req-a46f5b18-20c9-4f19-bd72-39e13434e5f9 req-18c4724c-05aa-4fe5-8226-4eb7fe307203 service nova] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Received event network-vif-plugged-dbbeadad-745e-4d28-a242-577b3197b079 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:20:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a46f5b18-20c9-4f19-bd72-39e13434e5f9 req-18c4724c-05aa-4fe5-8226-4eb7fe307203 service nova] Acquiring lock "f192d1ec-311d-4a30-9766-361b27a8dae8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:20:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a46f5b18-20c9-4f19-bd72-39e13434e5f9 req-18c4724c-05aa-4fe5-8226-4eb7fe307203 service nova] Lock "f192d1ec-311d-4a30-9766-361b27a8dae8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:20:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a46f5b18-20c9-4f19-bd72-39e13434e5f9 req-18c4724c-05aa-4fe5-8226-4eb7fe307203 service nova] Lock "f192d1ec-311d-4a30-9766-361b27a8dae8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:20:07 user nova-compute[74683]: DEBUG nova.compute.manager [req-a46f5b18-20c9-4f19-bd72-39e13434e5f9 req-18c4724c-05aa-4fe5-8226-4eb7fe307203 service nova] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] No waiting events found dispatching network-vif-plugged-dbbeadad-745e-4d28-a242-577b3197b079 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:20:07 user nova-compute[74683]: WARNING nova.compute.manager [req-a46f5b18-20c9-4f19-bd72-39e13434e5f9 req-18c4724c-05aa-4fe5-8226-4eb7fe307203 service nova] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Received unexpected event network-vif-plugged-dbbeadad-745e-4d28-a242-577b3197b079 for instance with vm_state resized and task_state resize_reverting.
Oct 16 11:20:07 user nova-compute[74683]: DEBUG nova.compute.manager [req-a46f5b18-20c9-4f19-bd72-39e13434e5f9 req-18c4724c-05aa-4fe5-8226-4eb7fe307203 service nova] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Received event network-vif-unplugged-ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:20:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a46f5b18-20c9-4f19-bd72-39e13434e5f9 req-18c4724c-05aa-4fe5-8226-4eb7fe307203 service nova] Acquiring lock "9ae15ce7-996c-460f-a901-1570a2012af1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:20:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a46f5b18-20c9-4f19-bd72-39e13434e5f9 req-18c4724c-05aa-4fe5-8226-4eb7fe307203 service nova] Lock "9ae15ce7-996c-460f-a901-1570a2012af1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:20:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a46f5b18-20c9-4f19-bd72-39e13434e5f9 req-18c4724c-05aa-4fe5-8226-4eb7fe307203 service nova] Lock "9ae15ce7-996c-460f-a901-1570a2012af1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:20:07 user nova-compute[74683]: DEBUG nova.compute.manager [req-a46f5b18-20c9-4f19-bd72-39e13434e5f9 req-18c4724c-05aa-4fe5-8226-4eb7fe307203 service nova] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] No waiting events found dispatching network-vif-unplugged-ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:20:07 user nova-compute[74683]: WARNING nova.compute.manager [req-a46f5b18-20c9-4f19-bd72-39e13434e5f9 req-18c4724c-05aa-4fe5-8226-4eb7fe307203 service nova] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Received unexpected event network-vif-unplugged-ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05 for instance with vm_state active and task_state None.
Oct 16 11:20:07 user nova-compute[74683]: DEBUG nova.compute.manager [req-a46f5b18-20c9-4f19-bd72-39e13434e5f9 req-18c4724c-05aa-4fe5-8226-4eb7fe307203 service nova] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Received event network-vif-plugged-ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:20:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a46f5b18-20c9-4f19-bd72-39e13434e5f9 req-18c4724c-05aa-4fe5-8226-4eb7fe307203 service nova] Acquiring lock "9ae15ce7-996c-460f-a901-1570a2012af1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:20:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a46f5b18-20c9-4f19-bd72-39e13434e5f9 req-18c4724c-05aa-4fe5-8226-4eb7fe307203 service nova] Lock "9ae15ce7-996c-460f-a901-1570a2012af1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:20:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a46f5b18-20c9-4f19-bd72-39e13434e5f9 req-18c4724c-05aa-4fe5-8226-4eb7fe307203 service nova] Lock "9ae15ce7-996c-460f-a901-1570a2012af1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:20:07 user nova-compute[74683]: DEBUG nova.compute.manager [req-a46f5b18-20c9-4f19-bd72-39e13434e5f9 req-18c4724c-05aa-4fe5-8226-4eb7fe307203 service nova] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] No waiting events found dispatching network-vif-plugged-ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:20:07 user nova-compute[74683]: WARNING nova.compute.manager [req-a46f5b18-20c9-4f19-bd72-39e13434e5f9 req-18c4724c-05aa-4fe5-8226-4eb7fe307203 service nova] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Received unexpected event network-vif-plugged-ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05 for instance with vm_state active and task_state None.
Oct 16 11:20:07 user nova-compute[74683]: DEBUG nova.compute.manager [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Instance event wait completed in 0 seconds for  {{(pid=74683) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 11:20:07 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Instance running successfully.
Oct 16 11:20:07 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] finish_revert_migration finished successfully. {{(pid=74683) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Oct 16 11:20:07 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:20:07 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:20:07 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:20:07 user nova-compute[74683]: INFO nova.compute.manager [None req-eb1d6143-9ee4-4e06-aaa2-9ce2a2c5dd93 tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Updating instance to original state: 'active'
Oct 16 11:20:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:20:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:20:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:20:07 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Auditing locally available compute resources for user (node: user) {{(pid=74683) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 11:20:07 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1db5e2-0b25-4d61-9dd3-038811b4eda1/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1db5e2-0b25-4d61-9dd3-038811b4eda1/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1db5e2-0b25-4d61-9dd3-038811b4eda1/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:08 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1db5e2-0b25-4d61-9dd3-038811b4eda1/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:09 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:20:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84bb680-a542-4cb2-b0c5-67a210c25e9e/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84bb680-a542-4cb2-b0c5-67a210c25e9e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84bb680-a542-4cb2-b0c5-67a210c25e9e/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84bb680-a542-4cb2-b0c5-67a210c25e9e/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45ca3cbb-53d6-4046-9be3-92cc6b71bfad/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45ca3cbb-53d6-4046-9be3-92cc6b71bfad/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45ca3cbb-53d6-4046-9be3-92cc6b71bfad/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45ca3cbb-53d6-4046-9be3-92cc6b71bfad/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:10 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:20:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae15ce7-996c-460f-a901-1570a2012af1/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae15ce7-996c-460f-a901-1570a2012af1/disk --force-share --output=json" returned: 0 in 0.309s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae15ce7-996c-460f-a901-1570a2012af1/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae15ce7-996c-460f-a901-1570a2012af1/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:11 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:11 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-b727ef33-327d-48f5-87cc-deae43759452 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2f1db5e2-0b25-4d61-9dd3-038811b4eda1 is timed out.
Oct 16 11:20:11 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-b727ef33-327d-48f5-87cc-deae43759452 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Successfully detached device vdb from instance 2f1db5e2-0b25-4d61-9dd3-038811b4eda1 from the live domain config.
Oct 16 11:20:11 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:20:11 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:20:11 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Hypervisor/Node resource view: name=user free_ram=7608MB free_disk=25.224681854248047GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74683) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 11:20:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:20:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:20:11 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b727ef33-327d-48f5-87cc-deae43759452 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] calling os-brick to detach iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 11:20:11 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b727ef33-327d-48f5-87cc-deae43759452 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, {'target_iqn': 'iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fKNejHlu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:20:11 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-b727ef33-327d-48f5-87cc-deae43759452 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:20:11 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-b727ef33-327d-48f5-87cc-deae43759452 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:20:11 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-b727ef33-327d-48f5-87cc-deae43759452 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:20:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:11 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c3c010-7d36-4bfa-9f4f-9200110b8845]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:20:11 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b727ef33-327d-48f5-87cc-deae43759452 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 11:20:11 user nova-compute[74683]: No targets found.
Oct 16 11:20:11 user nova-compute[74683]: iSNS:
Oct 16 11:20:11 user nova-compute[74683]: No targets found.
Oct 16 11:20:11 user nova-compute[74683]: STATIC:
Oct 16 11:20:11 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5
Oct 16 11:20:11 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:20:11 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:20:11 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb
Oct 16 11:20:11 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:20:11 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:20:11 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b
Oct 16 11:20:11 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:20:11 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:20:11 user nova-compute[74683]: FIRMWARE:
Oct 16 11:20:11 user nova-compute[74683]: No targets found.
Oct 16 11:20:11 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:20:11 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b727ef33-327d-48f5-87cc-deae43759452 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 11:20:11 user nova-compute[74683]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 11:20:11 user nova-compute[74683]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74683) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 11:20:11 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b727ef33-327d-48f5-87cc-deae43759452 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5', 0)] {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 11:20:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:11 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f3ea67-9171-4f80-b1ad-93a8fcc4ba05]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:20:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:12 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:12 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c0e48e-7edf-4918-8d01-7bda7602e938]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:20:12 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b727ef33-327d-48f5-87cc-deae43759452 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:20:12 user nova-compute[74683]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)
Oct 16 11:20:12 user nova-compute[74683]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)
Oct 16 11:20:12 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:20:12 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b727ef33-327d-48f5-87cc-deae43759452 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:20:12 user nova-compute[74683]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 (non-flash)
Oct 16 11:20:12 user nova-compute[74683]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)
Oct 16 11:20:12 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:20:12 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b727ef33-327d-48f5-87cc-deae43759452 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda4c7a2050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5'): ({'sdg'}, set())}) {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 11:20:12 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-b727ef33-327d-48f5-87cc-deae43759452 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Removing single pathed devices sdg {{(pid=74683) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 11:20:12 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:12 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:12 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a649d86-88e2-426a-b80e-e35b2416ec35]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:20:12 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:12 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:12 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd33761b-f304-4633-afdc-bd5fa088539a]: (4, ('ok\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:20:12 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-b727ef33-327d-48f5-87cc-deae43759452 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Flushing IO for device /dev/sdg {{(pid=74683) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 11:20:12 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:12 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:12 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a395ca-e3c6-48e8-a0d1-d5e040051852]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:20:12 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-b727ef33-327d-48f5-87cc-deae43759452 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74683) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 11:20:12 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 18a77385-fab9-4ea0-8aa6-666cf7e798a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:20:12 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 2f1db5e2-0b25-4d61-9dd3-038811b4eda1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:20:12 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:20:12 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance d5e55361-d9ed-4d07-91b0-ec4d08b2e817 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:20:12 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 9ae15ce7-996c-460f-a901-1570a2012af1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:20:12 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance f192d1ec-311d-4a30-9766-361b27a8dae8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:20:12 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 45ca3cbb-53d6-4046-9be3-92cc6b71bfad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:20:12 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance e84bb680-a542-4cb2-b0c5-67a210c25e9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:20:12 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance edd01413-1f8a-49e3-aa3c-ecb19c62afae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:20:12 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 11:20:12 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 11:20:12 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:12 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.054s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:12 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e978b981-f889-4501-bcec-b9340caa62f8]: (4, ('1', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:20:12 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-b727ef33-327d-48f5-87cc-deae43759452 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 11:20:12 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-b727ef33-327d-48f5-87cc-deae43759452 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] SCSI volumes sdg have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 11:20:12 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b727ef33-327d-48f5-87cc-deae43759452 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5')] {{(pid=74683) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 11:20:12 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:12 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:12 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed948303-5b70-4d08-81b1-7018ed9be898]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:20:12 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b727ef33-327d-48f5-87cc-deae43759452 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:20:12 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 -p 172.16.0.220:3260 --logout {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:12 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:12 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[766b31a7-20d8-46c9-a702-b519238e8a92]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:20:12 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b727ef33-327d-48f5-87cc-deae43759452 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5, portal: 172.16.0.220,3260]
Oct 16 11:20:12 user nova-compute[74683]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5, portal: 172.16.0.220,3260] successful.
Oct 16 11:20:12 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:20:12 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 -p 172.16.0.220:3260 --op delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:12 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a386e8d1-21ff-40ab-bf1b-aaa6fef6f9f5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:12 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb3effb-da88-49ab-aaa8-2e55e8f55c35]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:20:12 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b727ef33-327d-48f5-87cc-deae43759452 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:20:12 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-b727ef33-327d-48f5-87cc-deae43759452 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:20:12 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b727ef33-327d-48f5-87cc-deae43759452 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] <== disconnect_volume: return (360ms) None {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:20:12 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b727ef33-327d-48f5-87cc-deae43759452 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Disconnected iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 11:20:12 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:20:12 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:20:12 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Compute_service record updated for user:user {{(pid=74683) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 11:20:12 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.603s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:20:13 user nova-compute[74683]: DEBUG nova.objects.instance [None req-b727ef33-327d-48f5-87cc-deae43759452 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Lazy-loading 'flavor' on Instance uuid 2f1db5e2-0b25-4d61-9dd3-038811b4eda1 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:20:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b727ef33-327d-48f5-87cc-deae43759452 tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Lock "2f1db5e2-0b25-4d61-9dd3-038811b4eda1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.259s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:20:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "2f1db5e2-0b25-4d61-9dd3-038811b4eda1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 19.428s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:20:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "2f1db5e2-0b25-4d61-9dd3-038811b4eda1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:20:13 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:16 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a292805-bfa1-4942-8c15-5d950b30fca7 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Calling os-brick to attach iSCSI Volume {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 11:20:16 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a292805-bfa1-4942-8c15-5d950b30fca7 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bc3f1451-b39f-4059-8d9a-0556c9bbef86', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'payvInXx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:20:16 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-2a292805-bfa1-4942-8c15-5d950b30fca7 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:20:16 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-2a292805-bfa1-4942-8c15-5d950b30fca7 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:20:16 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-2a292805-bfa1-4942-8c15-5d950b30fca7 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:20:16 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-2a292805-bfa1-4942-8c15-5d950b30fca7 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:20:16 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-2a292805-bfa1-4942-8c15-5d950b30fca7 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc3f1451-b39f-4059-8d9a-0556c9bbef86" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:20:16 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-2a292805-bfa1-4942-8c15-5d950b30fca7 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc3f1451-b39f-4059-8d9a-0556c9bbef86" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:20:16 user nova-compute[74683]: INFO os_brick.initiator.connectors.iscsi [None req-2a292805-bfa1-4942-8c15-5d950b30fca7 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 11:20:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc3f1451-b39f-4059-8d9a-0556c9bbef86 -p 172.16.0.220:3260 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc3f1451-b39f-4059-8d9a-0556c9bbef86 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:16 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6dc594-f96f-4e6a-92b8-25cc6d42151d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:20:16 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a292805-bfa1-4942-8c15-5d950b30fca7 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 11:20:16 user nova-compute[74683]:  {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:20:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc3f1451-b39f-4059-8d9a-0556c9bbef86 -p 172.16.0.220:3260 --interface default --op new {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc3f1451-b39f-4059-8d9a-0556c9bbef86 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.117s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:16 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d758c463-cfff-41ba-a58e-c4b58092efc8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc3f1451-b39f-4059-8d9a-0556c9bbef86] added\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:20:16 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a292805-bfa1-4942-8c15-5d950b30fca7 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc3f1451-b39f-4059-8d9a-0556c9bbef86] added
Oct 16 11:20:16 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:20:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc3f1451-b39f-4059-8d9a-0556c9bbef86 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc3f1451-b39f-4059-8d9a-0556c9bbef86 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:16 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e433b6-2893-4d3f-8e62-d551aaf4ce7b]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:20:16 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a292805-bfa1-4942-8c15-5d950b30fca7 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:20:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc3f1451-b39f-4059-8d9a-0556c9bbef86 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc3f1451-b39f-4059-8d9a-0556c9bbef86 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:16 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[90fd02ab-4f99-421c-9bbb-f60f6bfe4a50]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:20:16 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a292805-bfa1-4942-8c15-5d950b30fca7 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:20:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc3f1451-b39f-4059-8d9a-0556c9bbef86 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v payvInXx {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc3f1451-b39f-4059-8d9a-0556c9bbef86 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v payvInXx" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:16 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6c54d0-4831-4094-b53a-0cd54aa8536d]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:20:16 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a292805-bfa1-4942-8c15-5d950b30fca7 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'payvInXx'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:20:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc3f1451-b39f-4059-8d9a-0556c9bbef86 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc3f1451-b39f-4059-8d9a-0556c9bbef86 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:16 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e43bb6-106d-4f07-851e-3abdb1ae242e]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:20:16 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a292805-bfa1-4942-8c15-5d950b30fca7 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:20:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:16 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60cb2de-63b7-4465-bff4-d4608ca3cb87]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:20:16 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a292805-bfa1-4942-8c15-5d950b30fca7 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:20:16 user nova-compute[74683]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)
Oct 16 11:20:16 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:20:16 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a292805-bfa1-4942-8c15-5d950b30fca7 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:20:16 user nova-compute[74683]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)
Oct 16 11:20:16 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:20:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc3f1451-b39f-4059-8d9a-0556c9bbef86 -p 172.16.0.220:3260 --login {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:16 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc3f1451-b39f-4059-8d9a-0556c9bbef86 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:16 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c5862a-66f9-476a-a183-fac9d82b2f99]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc3f1451-b39f-4059-8d9a-0556c9bbef86, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bc3f1451-b39f-4059-8d9a-0556c9bbef86, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:20:16 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a292805-bfa1-4942-8c15-5d950b30fca7 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc3f1451-b39f-4059-8d9a-0556c9bbef86, portal: 172.16.0.220,3260]
Oct 16 11:20:16 user nova-compute[74683]: Login to [iface: default, target: iqn.2010-10.org.openstack:bc3f1451-b39f-4059-8d9a-0556c9bbef86, portal: 172.16.0.220,3260] successful.
Oct 16 11:20:16 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:20:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc3f1451-b39f-4059-8d9a-0556c9bbef86 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc3f1451-b39f-4059-8d9a-0556c9bbef86 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:16 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e789ed2-9107-47f1-8848-236a954b45dc]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:20:16 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a292805-bfa1-4942-8c15-5d950b30fca7 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:20:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:16 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2c030d-2c69-4575-9ee2-31a18923f734]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc3f1451-b39f-4059-8d9a-0556c9bbef86 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:20:16 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a292805-bfa1-4942-8c15-5d950b30fca7 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:20:16 user nova-compute[74683]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)
Oct 16 11:20:16 user nova-compute[74683]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc3f1451-b39f-4059-8d9a-0556c9bbef86 (non-flash)
Oct 16 11:20:16 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:20:16 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a292805-bfa1-4942-8c15-5d950b30fca7 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:20:16 user nova-compute[74683]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)
Oct 16 11:20:16 user nova-compute[74683]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc3f1451-b39f-4059-8d9a-0556c9bbef86 (non-flash)
Oct 16 11:20:16 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:20:16 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-2a292805-bfa1-4942-8c15-5d950b30fca7 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc3f1451-b39f-4059-8d9a-0556c9bbef86" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.411s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:20:16 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a292805-bfa1-4942-8c15-5d950b30fca7 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Connected to 172.16.0.220:3260 {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 11:20:16 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-2a292805-bfa1-4942-8c15-5d950b30fca7 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=74683) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 11:20:16 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-2a292805-bfa1-4942-8c15-5d950b30fca7 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74683) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 11:20:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:16 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceeeba56-b056-4e40-b958-18031171cdf7]: (4, ('- - 0', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:20:16 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-2a292805-bfa1-4942-8c15-5d950b30fca7 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:20:16 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a292805-bfa1-4942-8c15-5d950b30fca7 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bc3f1451-b39f-4059-8d9a-0556c9bbef86', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'payvInXx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 11:20:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-2a292805-bfa1-4942-8c15-5d950b30fca7 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.447s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:20:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a292805-bfa1-4942-8c15-5d950b30fca7 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] <== connect_volume: return (1448ms) {'type': 'block', 'scsi_wwn': '26564313863663138', 'path': '/dev/sdb'} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:20:17 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a292805-bfa1-4942-8c15-5d950b30fca7 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564313863663138', 'path': '/dev/sdb'} {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 11:20:17 user nova-compute[74683]: DEBUG nova.objects.instance [None req-2a292805-bfa1-4942-8c15-5d950b30fca7 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lazy-loading 'flavor' on Instance uuid 45ca3cbb-53d6-4046-9be3-92cc6b71bfad {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:20:17 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-2a292805-bfa1-4942-8c15-5d950b30fca7 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 11:20:17 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:20:17 user nova-compute[74683]:   <source dev="/dev/sdb"/>
Oct 16 11:20:17 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:20:17 user nova-compute[74683]:   <serial>bc3f1451-b39f-4059-8d9a-0556c9bbef86</serial>
Oct 16 11:20:17 user nova-compute[74683]: </disk>
Oct 16 11:20:17 user nova-compute[74683]:  {{(pid=74683) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 11:20:17 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-2a292805-bfa1-4942-8c15-5d950b30fca7 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:20:17 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-2a292805-bfa1-4942-8c15-5d950b30fca7 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:20:17 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-2a292805-bfa1-4942-8c15-5d950b30fca7 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] No VIF found with MAC fa:16:3e:fd:e5:2b, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:20:18 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2a292805-bfa1-4942-8c15-5d950b30fca7 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lock "45ca3cbb-53d6-4046-9be3-92cc6b71bfad" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.887s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:20:18 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:20 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-61d7af8a-acb1-45fd-a7c3-36f9c6730f5e tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Acquiring lock "45ca3cbb-53d6-4046-9be3-92cc6b71bfad" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:20:20 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-61d7af8a-acb1-45fd-a7c3-36f9c6730f5e tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lock "45ca3cbb-53d6-4046-9be3-92cc6b71bfad" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:20:20 user nova-compute[74683]: INFO nova.compute.manager [None req-61d7af8a-acb1-45fd-a7c3-36f9c6730f5e tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Detaching volume bc3f1451-b39f-4059-8d9a-0556c9bbef86
Oct 16 11:20:21 user nova-compute[74683]: INFO nova.virt.block_device [None req-61d7af8a-acb1-45fd-a7c3-36f9c6730f5e tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Attempting to driver detach volume bc3f1451-b39f-4059-8d9a-0556c9bbef86 from mountpoint /dev/vdb
Oct 16 11:20:21 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-61d7af8a-acb1-45fd-a7c3-36f9c6730f5e tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Attempting to detach device vdb from instance 45ca3cbb-53d6-4046-9be3-92cc6b71bfad from the persistent domain config. {{(pid=74683) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 11:20:21 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-61d7af8a-acb1-45fd-a7c3-36f9c6730f5e tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 11:20:21 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:20:21 user nova-compute[74683]:   <source dev="/dev/sdb"/>
Oct 16 11:20:21 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:20:21 user nova-compute[74683]:   <serial>bc3f1451-b39f-4059-8d9a-0556c9bbef86</serial>
Oct 16 11:20:21 user nova-compute[74683]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 11:20:21 user nova-compute[74683]: </disk>
Oct 16 11:20:21 user nova-compute[74683]:  {{(pid=74683) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 11:20:21 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-61d7af8a-acb1-45fd-a7c3-36f9c6730f5e tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Successfully detached device vdb from instance 45ca3cbb-53d6-4046-9be3-92cc6b71bfad from the persistent domain config.
Oct 16 11:20:21 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-61d7af8a-acb1-45fd-a7c3-36f9c6730f5e tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 45ca3cbb-53d6-4046-9be3-92cc6b71bfad from the live domain config. {{(pid=74683) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 11:20:21 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-61d7af8a-acb1-45fd-a7c3-36f9c6730f5e tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 11:20:21 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:20:21 user nova-compute[74683]:   <source dev="/dev/sdb"/>
Oct 16 11:20:21 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:20:21 user nova-compute[74683]:   <serial>bc3f1451-b39f-4059-8d9a-0556c9bbef86</serial>
Oct 16 11:20:21 user nova-compute[74683]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 11:20:21 user nova-compute[74683]: </disk>
Oct 16 11:20:21 user nova-compute[74683]:  {{(pid=74683) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 11:20:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:21 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-61d7af8a-acb1-45fd-a7c3-36f9c6730f5e tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 45ca3cbb-53d6-4046-9be3-92cc6b71bfad {{(pid=74683) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 11:20:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:26 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-309b9a64-efde-47c3-a955-c1c2802812b0 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Waiting for libvirt event about the detach of device tapecf30d0f-8f with device alias net1 from instance 9ae15ce7-996c-460f-a901-1570a2012af1 is timed out.
Oct 16 11:20:26 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-309b9a64-efde-47c3-a955-c1c2802812b0 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:61:ea:f6"/><model type="virtio"/><mtu size="1442"/><target dev="tapecf30d0f-8f"/></interface> {{(pid=74683) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 16 11:20:26 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-309b9a64-efde-47c3-a955-c1c2802812b0 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:61:ea:f6"/><model type="virtio"/><mtu size="1442"/><target dev="tapecf30d0f-8f"/></interface>not found in domain: <domain type='kvm' id='14'>
Oct 16 11:20:26 user nova-compute[74683]:   <name>instance-0000000e</name>
Oct 16 11:20:26 user nova-compute[74683]:   <uuid>9ae15ce7-996c-460f-a901-1570a2012af1</uuid>
Oct 16 11:20:26 user nova-compute[74683]:   <metadata>
Oct 16 11:20:26 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:20:26 user nova-compute[74683]:   <nova:package version="0.0.0"/>
Oct 16 11:20:26 user nova-compute[74683]:   <nova:name>tempest-device-tagging-server-717081521</nova:name>
Oct 16 11:20:26 user nova-compute[74683]:   <nova:creationTime>2023-10-16 11:19:05</nova:creationTime>
Oct 16 11:20:26 user nova-compute[74683]:   <nova:flavor name="m1.tiny">
Oct 16 11:20:26 user nova-compute[74683]:     <nova:memory>512</nova:memory>
Oct 16 11:20:26 user nova-compute[74683]:     <nova:disk>1</nova:disk>
Oct 16 11:20:26 user nova-compute[74683]:     <nova:swap>0</nova:swap>
Oct 16 11:20:26 user nova-compute[74683]:     <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:20:26 user nova-compute[74683]:     <nova:vcpus>1</nova:vcpus>
Oct 16 11:20:26 user nova-compute[74683]:   </nova:flavor>
Oct 16 11:20:26 user nova-compute[74683]:   <nova:owner>
Oct 16 11:20:26 user nova-compute[74683]:     <nova:user uuid="ceb56d9dc1b04324adfd4f8d0b1a9766">tempest-TaggedAttachmentsTest-2119065928-project-member</nova:user>
Oct 16 11:20:26 user nova-compute[74683]:     <nova:project uuid="5042cdda42b74341b6c592437b6bbdbf">tempest-TaggedAttachmentsTest-2119065928</nova:project>
Oct 16 11:20:26 user nova-compute[74683]:   </nova:owner>
Oct 16 11:20:26 user nova-compute[74683]:   <nova:root type="image" uuid="0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f"/>
Oct 16 11:20:26 user nova-compute[74683]:   <nova:ports>
Oct 16 11:20:26 user nova-compute[74683]:     <nova:port uuid="84d9dc84-2273-4e6b-a8fe-9a94bddd198c">
Oct 16 11:20:26 user nova-compute[74683]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 16 11:20:26 user nova-compute[74683]:     </nova:port>
Oct 16 11:20:26 user nova-compute[74683]:     <nova:port uuid="ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05">
Oct 16 11:20:26 user nova-compute[74683]:       <nova:ip type="fixed" address="10.10.10.17" ipVersion="4"/>
Oct 16 11:20:26 user nova-compute[74683]:     </nova:port>
Oct 16 11:20:26 user nova-compute[74683]:   </nova:ports>
Oct 16 11:20:26 user nova-compute[74683]: </nova:instance>
Oct 16 11:20:26 user nova-compute[74683]:   </metadata>
Oct 16 11:20:26 user nova-compute[74683]:   <memory unit='KiB'>524288</memory>
Oct 16 11:20:26 user nova-compute[74683]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 16 11:20:26 user nova-compute[74683]:   <vcpu placement='static'>1</vcpu>
Oct 16 11:20:26 user nova-compute[74683]:   <resource>
Oct 16 11:20:26 user nova-compute[74683]:     <partition>/machine</partition>
Oct 16 11:20:26 user nova-compute[74683]:   </resource>
Oct 16 11:20:26 user nova-compute[74683]:   <sysinfo type='smbios'>
Oct 16 11:20:26 user nova-compute[74683]:     <system>
Oct 16 11:20:26 user nova-compute[74683]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 16 11:20:26 user nova-compute[74683]:       <entry name='product'>OpenStack Nova</entry>
Oct 16 11:20:26 user nova-compute[74683]:       <entry name='version'>0.0.0</entry>
Oct 16 11:20:26 user nova-compute[74683]:       <entry name='serial'>9ae15ce7-996c-460f-a901-1570a2012af1</entry>
Oct 16 11:20:26 user nova-compute[74683]:       <entry name='uuid'>9ae15ce7-996c-460f-a901-1570a2012af1</entry>
Oct 16 11:20:26 user nova-compute[74683]:       <entry name='family'>Virtual Machine</entry>
Oct 16 11:20:26 user nova-compute[74683]:     </system>
Oct 16 11:20:26 user nova-compute[74683]:   </sysinfo>
Oct 16 11:20:26 user nova-compute[74683]:   <os>
Oct 16 11:20:26 user nova-compute[74683]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 16 11:20:26 user nova-compute[74683]:     <boot dev='hd'/>
Oct 16 11:20:26 user nova-compute[74683]:     <smbios mode='sysinfo'/>
Oct 16 11:20:26 user nova-compute[74683]:   </os>
Oct 16 11:20:26 user nova-compute[74683]:   <features>
Oct 16 11:20:26 user nova-compute[74683]:     <acpi/>
Oct 16 11:20:26 user nova-compute[74683]:     <apic/>
Oct 16 11:20:26 user nova-compute[74683]:     <vmcoreinfo state='on'/>
Oct 16 11:20:26 user nova-compute[74683]:   </features>
Oct 16 11:20:26 user nova-compute[74683]:   <cpu mode='custom' match='exact' check='full'>
Oct 16 11:20:26 user nova-compute[74683]:     <model fallback='forbid'>Nehalem</model>
Oct 16 11:20:26 user nova-compute[74683]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 16 11:20:26 user nova-compute[74683]:     <feature policy='require' name='vme'/>
Oct 16 11:20:26 user nova-compute[74683]:     <feature policy='require' name='x2apic'/>
Oct 16 11:20:26 user nova-compute[74683]:     <feature policy='require' name='hypervisor'/>
Oct 16 11:20:26 user nova-compute[74683]:   </cpu>
Oct 16 11:20:26 user nova-compute[74683]:   <clock offset='utc'>
Oct 16 11:20:26 user nova-compute[74683]:     <timer name='pit' tickpolicy='delay'/>
Oct 16 11:20:26 user nova-compute[74683]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 16 11:20:26 user nova-compute[74683]:     <timer name='hpet' present='no'/>
Oct 16 11:20:26 user nova-compute[74683]:   </clock>
Oct 16 11:20:26 user nova-compute[74683]:   <on_poweroff>destroy</on_poweroff>
Oct 16 11:20:26 user nova-compute[74683]:   <on_reboot>restart</on_reboot>
Oct 16 11:20:26 user nova-compute[74683]:   <on_crash>destroy</on_crash>
Oct 16 11:20:26 user nova-compute[74683]:   <devices>
Oct 16 11:20:26 user nova-compute[74683]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 16 11:20:26 user nova-compute[74683]:     <disk type='file' device='disk'>
Oct 16 11:20:26 user nova-compute[74683]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 16 11:20:26 user nova-compute[74683]:       <source file='/opt/stack/data/nova/instances/9ae15ce7-996c-460f-a901-1570a2012af1/disk' index='2'/>
Oct 16 11:20:26 user nova-compute[74683]:       <backingStore type='file' index='3'>
Oct 16 11:20:26 user nova-compute[74683]:         <format type='raw'/>
Oct 16 11:20:26 user nova-compute[74683]:         <source file='/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66'/>
Oct 16 11:20:26 user nova-compute[74683]:         <backingStore/>
Oct 16 11:20:26 user nova-compute[74683]:       </backingStore>
Oct 16 11:20:26 user nova-compute[74683]:       <target dev='vda' bus='virtio'/>
Oct 16 11:20:26 user nova-compute[74683]:       <alias name='virtio-disk0'/>
Oct 16 11:20:26 user nova-compute[74683]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 16 11:20:26 user nova-compute[74683]:     </disk>
Oct 16 11:20:26 user nova-compute[74683]:     <disk type='file' device='cdrom'>
Oct 16 11:20:26 user nova-compute[74683]:       <driver name='qemu' type='raw' cache='none'/>
Oct 16 11:20:26 user nova-compute[74683]:       <source file='/opt/stack/data/nova/instances/9ae15ce7-996c-460f-a901-1570a2012af1/disk.config' index='1'/>
Oct 16 11:20:26 user nova-compute[74683]:       <backingStore/>
Oct 16 11:20:26 user nova-compute[74683]:       <target dev='hda' bus='ide'/>
Oct 16 11:20:26 user nova-compute[74683]:       <readonly/>
Oct 16 11:20:26 user nova-compute[74683]:       <alias name='ide0-0-0'/>
Oct 16 11:20:26 user nova-compute[74683]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 16 11:20:26 user nova-compute[74683]:     </disk>
Oct 16 11:20:26 user nova-compute[74683]:     <controller type='usb' index='0' model='none'>
Oct 16 11:20:26 user nova-compute[74683]:       <alias name='usb'/>
Oct 16 11:20:26 user nova-compute[74683]:     </controller>
Oct 16 11:20:26 user nova-compute[74683]:     <controller type='pci' index='0' model='pci-root'>
Oct 16 11:20:26 user nova-compute[74683]:       <alias name='pci.0'/>
Oct 16 11:20:26 user nova-compute[74683]:     </controller>
Oct 16 11:20:26 user nova-compute[74683]:     <controller type='ide' index='0'>
Oct 16 11:20:26 user nova-compute[74683]:       <alias name='ide'/>
Oct 16 11:20:26 user nova-compute[74683]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 16 11:20:26 user nova-compute[74683]:     </controller>
Oct 16 11:20:26 user nova-compute[74683]:     <interface type='ethernet'>
Oct 16 11:20:26 user nova-compute[74683]:       <mac address='fa:16:3e:07:96:fd'/>
Oct 16 11:20:26 user nova-compute[74683]:       <target dev='tap84d9dc84-22'/>
Oct 16 11:20:26 user nova-compute[74683]:       <model type='virtio'/>
Oct 16 11:20:26 user nova-compute[74683]:       <mtu size='1442'/>
Oct 16 11:20:26 user nova-compute[74683]:       <alias name='net0'/>
Oct 16 11:20:26 user nova-compute[74683]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 16 11:20:26 user nova-compute[74683]:     </interface>
Oct 16 11:20:26 user nova-compute[74683]:     <serial type='pty'>
Oct 16 11:20:26 user nova-compute[74683]:       <source path='/dev/pts/10'/>
Oct 16 11:20:26 user nova-compute[74683]:       <log file='/opt/stack/data/nova/instances/9ae15ce7-996c-460f-a901-1570a2012af1/console.log' append='off'/>
Oct 16 11:20:26 user nova-compute[74683]:       <target type='isa-serial' port='0'>
Oct 16 11:20:26 user nova-compute[74683]:         <model name='isa-serial'/>
Oct 16 11:20:26 user nova-compute[74683]:       </target>
Oct 16 11:20:26 user nova-compute[74683]:       <alias name='serial0'/>
Oct 16 11:20:26 user nova-compute[74683]:     </serial>
Oct 16 11:20:26 user nova-compute[74683]:     <console type='pty' tty='/dev/pts/10'>
Oct 16 11:20:26 user nova-compute[74683]:       <source path='/dev/pts/10'/>
Oct 16 11:20:26 user nova-compute[74683]:       <log file='/opt/stack/data/nova/instances/9ae15ce7-996c-460f-a901-1570a2012af1/console.log' append='off'/>
Oct 16 11:20:26 user nova-compute[74683]:       <target type='serial' port='0'/>
Oct 16 11:20:26 user nova-compute[74683]:       <alias name='serial0'/>
Oct 16 11:20:26 user nova-compute[74683]:     </console>
Oct 16 11:20:26 user nova-compute[74683]:     <input type='mouse' bus='ps2'>
Oct 16 11:20:26 user nova-compute[74683]:       <alias name='input0'/>
Oct 16 11:20:26 user nova-compute[74683]:     </input>
Oct 16 11:20:26 user nova-compute[74683]:     <input type='keyboard' bus='ps2'>
Oct 16 11:20:26 user nova-compute[74683]:       <alias name='input1'/>
Oct 16 11:20:26 user nova-compute[74683]:     </input>
Oct 16 11:20:26 user nova-compute[74683]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Oct 16 11:20:26 user nova-compute[74683]:       <listen type='address' address='0.0.0.0'/>
Oct 16 11:20:26 user nova-compute[74683]:     </graphics>
Oct 16 11:20:26 user nova-compute[74683]:     <audio id='1' type='none'/>
Oct 16 11:20:26 user nova-compute[74683]:     <video>
Oct 16 11:20:26 user nova-compute[74683]:       <model type='virtio' heads='1' primary='yes'/>
Oct 16 11:20:26 user nova-compute[74683]:       <alias name='video0'/>
Oct 16 11:20:26 user nova-compute[74683]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 16 11:20:26 user nova-compute[74683]:     </video>
Oct 16 11:20:26 user nova-compute[74683]:     <memballoon model='virtio'>
Oct 16 11:20:26 user nova-compute[74683]:       <stats period='10'/>
Oct 16 11:20:26 user nova-compute[74683]:       <alias name='balloon0'/>
Oct 16 11:20:26 user nova-compute[74683]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 16 11:20:26 user nova-compute[74683]:     </memballoon>
Oct 16 11:20:26 user nova-compute[74683]:     <rng model='virtio'>
Oct 16 11:20:26 user nova-compute[74683]:       <backend model='random'>/dev/urandom</backend>
Oct 16 11:20:26 user nova-compute[74683]:       <alias name='rng0'/>
Oct 16 11:20:26 user nova-compute[74683]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 16 11:20:26 user nova-compute[74683]:     </rng>
Oct 16 11:20:26 user nova-compute[74683]:   </devices>
Oct 16 11:20:26 user nova-compute[74683]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 16 11:20:26 user nova-compute[74683]:     <label>libvirt-9ae15ce7-996c-460f-a901-1570a2012af1</label>
Oct 16 11:20:26 user nova-compute[74683]:     <imagelabel>libvirt-9ae15ce7-996c-460f-a901-1570a2012af1</imagelabel>
Oct 16 11:20:26 user nova-compute[74683]:   </seclabel>
Oct 16 11:20:26 user nova-compute[74683]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 16 11:20:26 user nova-compute[74683]:     <label>+64055:+108</label>
Oct 16 11:20:26 user nova-compute[74683]:     <imagelabel>+64055:+108</imagelabel>
Oct 16 11:20:26 user nova-compute[74683]:   </seclabel>
Oct 16 11:20:26 user nova-compute[74683]: </domain>
Oct 16 11:20:26 user nova-compute[74683]:  {{(pid=74683) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 16 11:20:26 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-309b9a64-efde-47c3-a955-c1c2802812b0 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Successfully detached device tapecf30d0f-8f from instance 9ae15ce7-996c-460f-a901-1570a2012af1 from the live domain config.
Oct 16 11:20:26 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-309b9a64-efde-47c3-a955-c1c2802812b0 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T11:17:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-717081521',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-717081521',id=14,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8efJVroKVuigryD4GSp1jU2h74/46LP7zUTBq1YNdoS9sGz/cMTsYXKQK2+Lj6yR1spH3hPAhB6Y4h51NvH2BYFIARH1zI9goHYvZdEeIkuG1XUEV0yYBKVJjNs/qPig==',key_name='tempest-keypair-1457686750',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:17:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5042cdda42b74341b6c592437b6bbdbf',ramdisk_id='',reservation_id='r-ezaz9z78',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2119065928',owner_user_name='tempest-TaggedAttachmentsTest-2119065928-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:17:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ceb56d9dc1b04324adfd4f8d0b1a9766',uuid=9ae15ce7-996c-460f-a901-1570a2012af1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05", "address": "fa:16:3e:61:ea:f6", "network": {"id": "693d56b4-4756-4957-94a4-1f1bca480f12", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-659453574", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5042cdda42b74341b6c592437b6bbdbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecf30d0f-8f", "ovs_interfaceid": "ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:20:26 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-309b9a64-efde-47c3-a955-c1c2802812b0 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Converting VIF {"id": "ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05", "address": "fa:16:3e:61:ea:f6", "network": {"id": "693d56b4-4756-4957-94a4-1f1bca480f12", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-659453574", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5042cdda42b74341b6c592437b6bbdbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecf30d0f-8f", "ovs_interfaceid": "ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:20:26 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-309b9a64-efde-47c3-a955-c1c2802812b0 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:ea:f6,bridge_name='br-int',has_traffic_filtering=True,id=ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05,network=Network(693d56b4-4756-4957-94a4-1f1bca480f12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecf30d0f-8f') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:20:26 user nova-compute[74683]: DEBUG os_vif [None req-309b9a64-efde-47c3-a955-c1c2802812b0 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:ea:f6,bridge_name='br-int',has_traffic_filtering=True,id=ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05,network=Network(693d56b4-4756-4957-94a4-1f1bca480f12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecf30d0f-8f') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:20:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapecf30d0f-8f, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:20:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:20:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3a3e19ac-31c4-4c3c-b921-58dcc2dd9b2d) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:20:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:26 user nova-compute[74683]: INFO os_vif [None req-309b9a64-efde-47c3-a955-c1c2802812b0 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:ea:f6,bridge_name='br-int',has_traffic_filtering=True,id=ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05,network=Network(693d56b4-4756-4957-94a4-1f1bca480f12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecf30d0f-8f')
Oct 16 11:20:26 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-309b9a64-efde-47c3-a955-c1c2802812b0 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:20:26 user nova-compute[74683]:   <nova:package version="0.0.0"/>
Oct 16 11:20:26 user nova-compute[74683]:   <nova:name>tempest-device-tagging-server-717081521</nova:name>
Oct 16 11:20:26 user nova-compute[74683]:   <nova:creationTime>2023-10-16 11:20:26</nova:creationTime>
Oct 16 11:20:26 user nova-compute[74683]:   <nova:flavor name="m1.tiny">
Oct 16 11:20:26 user nova-compute[74683]:     <nova:memory>512</nova:memory>
Oct 16 11:20:26 user nova-compute[74683]:     <nova:disk>1</nova:disk>
Oct 16 11:20:26 user nova-compute[74683]:     <nova:swap>0</nova:swap>
Oct 16 11:20:26 user nova-compute[74683]:     <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:20:26 user nova-compute[74683]:     <nova:vcpus>1</nova:vcpus>
Oct 16 11:20:26 user nova-compute[74683]:   </nova:flavor>
Oct 16 11:20:26 user nova-compute[74683]:   <nova:owner>
Oct 16 11:20:26 user nova-compute[74683]:     <nova:user uuid="ceb56d9dc1b04324adfd4f8d0b1a9766">tempest-TaggedAttachmentsTest-2119065928-project-member</nova:user>
Oct 16 11:20:26 user nova-compute[74683]:     <nova:project uuid="5042cdda42b74341b6c592437b6bbdbf">tempest-TaggedAttachmentsTest-2119065928</nova:project>
Oct 16 11:20:26 user nova-compute[74683]:   </nova:owner>
Oct 16 11:20:26 user nova-compute[74683]:   <nova:root type="image" uuid="0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f"/>
Oct 16 11:20:26 user nova-compute[74683]:   <nova:ports>
Oct 16 11:20:26 user nova-compute[74683]:     <nova:port uuid="84d9dc84-2273-4e6b-a8fe-9a94bddd198c">
Oct 16 11:20:26 user nova-compute[74683]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 16 11:20:26 user nova-compute[74683]:     </nova:port>
Oct 16 11:20:26 user nova-compute[74683]:   </nova:ports>
Oct 16 11:20:26 user nova-compute[74683]: </nova:instance>
Oct 16 11:20:26 user nova-compute[74683]:  {{(pid=74683) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 16 11:20:27 user nova-compute[74683]: DEBUG nova.compute.manager [req-21fd6c94-272a-4faf-b7fa-c5f7fd23ba81 req-0215ef7e-64f0-44f1-a6ce-67877a34a6b1 service nova] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Received event network-vif-deleted-ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:20:27 user nova-compute[74683]: INFO nova.compute.manager [req-21fd6c94-272a-4faf-b7fa-c5f7fd23ba81 req-0215ef7e-64f0-44f1-a6ce-67877a34a6b1 service nova] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Neutron deleted interface ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05; detaching it from the instance and deleting it from the info cache
Oct 16 11:20:27 user nova-compute[74683]: DEBUG nova.network.neutron [req-21fd6c94-272a-4faf-b7fa-c5f7fd23ba81 req-0215ef7e-64f0-44f1-a6ce-67877a34a6b1 service nova] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Updating instance_info_cache with network_info: [{"id": "84d9dc84-2273-4e6b-a8fe-9a94bddd198c", "address": "fa:16:3e:07:96:fd", "network": {"id": "33b6ba99-0d95-497e-a744-1ae84c9d63e1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-240536039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5042cdda42b74341b6c592437b6bbdbf", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d9dc84-22", "ovs_interfaceid": "84d9dc84-2273-4e6b-a8fe-9a94bddd198c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:20:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-309b9a64-efde-47c3-a955-c1c2802812b0 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Acquiring lock "refresh_cache-9ae15ce7-996c-460f-a901-1570a2012af1" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:20:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-309b9a64-efde-47c3-a955-c1c2802812b0 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Acquired lock "refresh_cache-9ae15ce7-996c-460f-a901-1570a2012af1" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:20:27 user nova-compute[74683]: DEBUG nova.network.neutron [None req-309b9a64-efde-47c3-a955-c1c2802812b0 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:20:27 user nova-compute[74683]: DEBUG nova.objects.instance [req-21fd6c94-272a-4faf-b7fa-c5f7fd23ba81 req-0215ef7e-64f0-44f1-a6ce-67877a34a6b1 service nova] Lazy-loading 'system_metadata' on Instance uuid 9ae15ce7-996c-460f-a901-1570a2012af1 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:20:27 user nova-compute[74683]: DEBUG nova.objects.instance [req-21fd6c94-272a-4faf-b7fa-c5f7fd23ba81 req-0215ef7e-64f0-44f1-a6ce-67877a34a6b1 service nova] Lazy-loading 'flavor' on Instance uuid 9ae15ce7-996c-460f-a901-1570a2012af1 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:20:27 user nova-compute[74683]: DEBUG nova.objects.base [req-21fd6c94-272a-4faf-b7fa-c5f7fd23ba81 req-0215ef7e-64f0-44f1-a6ce-67877a34a6b1 service nova] Object Instance<9ae15ce7-996c-460f-a901-1570a2012af1> lazy-loaded attributes: system_metadata,flavor {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:20:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [req-21fd6c94-272a-4faf-b7fa-c5f7fd23ba81 req-0215ef7e-64f0-44f1-a6ce-67877a34a6b1 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T11:17:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-717081521',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-717081521',id=14,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8efJVroKVuigryD4GSp1jU2h74/46LP7zUTBq1YNdoS9sGz/cMTsYXKQK2+Lj6yR1spH3hPAhB6Y4h51NvH2BYFIARH1zI9goHYvZdEeIkuG1XUEV0yYBKVJjNs/qPig==',key_name='tempest-keypair-1457686750',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:17:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5042cdda42b74341b6c592437b6bbdbf',ramdisk_id='',reservation_id='r-ezaz9z78',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2119065928',owner_user_name='tempest-TaggedAttachmentsTest-2119065928-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:17:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ceb56d9dc1b04324adfd4f8d0b1a9766',uuid=9ae15ce7-996c-460f-a901-1570a2012af1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05", "address": "fa:16:3e:61:ea:f6", "network": {"id": "693d56b4-4756-4957-94a4-1f1bca480f12", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-659453574", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5042cdda42b74341b6c592437b6bbdbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecf30d0f-8f", "ovs_interfaceid": "ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:20:27 user nova-compute[74683]: DEBUG nova.network.os_vif_util [req-21fd6c94-272a-4faf-b7fa-c5f7fd23ba81 req-0215ef7e-64f0-44f1-a6ce-67877a34a6b1 service nova] Converting VIF {"id": "ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05", "address": "fa:16:3e:61:ea:f6", "network": {"id": "693d56b4-4756-4957-94a4-1f1bca480f12", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-659453574", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5042cdda42b74341b6c592437b6bbdbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecf30d0f-8f", "ovs_interfaceid": "ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:20:27 user nova-compute[74683]: DEBUG nova.network.os_vif_util [req-21fd6c94-272a-4faf-b7fa-c5f7fd23ba81 req-0215ef7e-64f0-44f1-a6ce-67877a34a6b1 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:ea:f6,bridge_name='br-int',has_traffic_filtering=True,id=ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05,network=Network(693d56b4-4756-4957-94a4-1f1bca480f12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecf30d0f-8f') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:20:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [req-21fd6c94-272a-4faf-b7fa-c5f7fd23ba81 req-0215ef7e-64f0-44f1-a6ce-67877a34a6b1 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:61:ea:f6"/><model type="virtio"/><mtu size="1442"/><target dev="tapecf30d0f-8f"/></interface> {{(pid=74683) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 16 11:20:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [req-21fd6c94-272a-4faf-b7fa-c5f7fd23ba81 req-0215ef7e-64f0-44f1-a6ce-67877a34a6b1 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:61:ea:f6"/><model type="virtio"/><mtu size="1442"/><target dev="tapecf30d0f-8f"/></interface>not found in domain: <domain type='kvm' id='14'>
Oct 16 11:20:27 user nova-compute[74683]:   <name>instance-0000000e</name>
Oct 16 11:20:27 user nova-compute[74683]:   <uuid>9ae15ce7-996c-460f-a901-1570a2012af1</uuid>
Oct 16 11:20:27 user nova-compute[74683]:   <metadata>
Oct 16 11:20:27 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:20:27 user nova-compute[74683]:   <nova:package version="0.0.0"/>
Oct 16 11:20:27 user nova-compute[74683]:   <nova:name>tempest-device-tagging-server-717081521</nova:name>
Oct 16 11:20:27 user nova-compute[74683]:   <nova:creationTime>2023-10-16 11:20:26</nova:creationTime>
Oct 16 11:20:27 user nova-compute[74683]:   <nova:flavor name="m1.tiny">
Oct 16 11:20:27 user nova-compute[74683]:     <nova:memory>512</nova:memory>
Oct 16 11:20:27 user nova-compute[74683]:     <nova:disk>1</nova:disk>
Oct 16 11:20:27 user nova-compute[74683]:     <nova:swap>0</nova:swap>
Oct 16 11:20:27 user nova-compute[74683]:     <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:20:27 user nova-compute[74683]:     <nova:vcpus>1</nova:vcpus>
Oct 16 11:20:27 user nova-compute[74683]:   </nova:flavor>
Oct 16 11:20:27 user nova-compute[74683]:   <nova:owner>
Oct 16 11:20:27 user nova-compute[74683]:     <nova:user uuid="ceb56d9dc1b04324adfd4f8d0b1a9766">tempest-TaggedAttachmentsTest-2119065928-project-member</nova:user>
Oct 16 11:20:27 user nova-compute[74683]:     <nova:project uuid="5042cdda42b74341b6c592437b6bbdbf">tempest-TaggedAttachmentsTest-2119065928</nova:project>
Oct 16 11:20:27 user nova-compute[74683]:   </nova:owner>
Oct 16 11:20:27 user nova-compute[74683]:   <nova:root type="image" uuid="0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f"/>
Oct 16 11:20:27 user nova-compute[74683]:   <nova:ports>
Oct 16 11:20:27 user nova-compute[74683]:     <nova:port uuid="84d9dc84-2273-4e6b-a8fe-9a94bddd198c">
Oct 16 11:20:27 user nova-compute[74683]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 16 11:20:27 user nova-compute[74683]:     </nova:port>
Oct 16 11:20:27 user nova-compute[74683]:   </nova:ports>
Oct 16 11:20:27 user nova-compute[74683]: </nova:instance>
Oct 16 11:20:27 user nova-compute[74683]:   </metadata>
Oct 16 11:20:27 user nova-compute[74683]:   <memory unit='KiB'>524288</memory>
Oct 16 11:20:27 user nova-compute[74683]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 16 11:20:27 user nova-compute[74683]:   <vcpu placement='static'>1</vcpu>
Oct 16 11:20:27 user nova-compute[74683]:   <resource>
Oct 16 11:20:27 user nova-compute[74683]:     <partition>/machine</partition>
Oct 16 11:20:27 user nova-compute[74683]:   </resource>
Oct 16 11:20:27 user nova-compute[74683]:   <sysinfo type='smbios'>
Oct 16 11:20:27 user nova-compute[74683]:     <system>
Oct 16 11:20:27 user nova-compute[74683]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 16 11:20:27 user nova-compute[74683]:       <entry name='product'>OpenStack Nova</entry>
Oct 16 11:20:27 user nova-compute[74683]:       <entry name='version'>0.0.0</entry>
Oct 16 11:20:27 user nova-compute[74683]:       <entry name='serial'>9ae15ce7-996c-460f-a901-1570a2012af1</entry>
Oct 16 11:20:27 user nova-compute[74683]:       <entry name='uuid'>9ae15ce7-996c-460f-a901-1570a2012af1</entry>
Oct 16 11:20:27 user nova-compute[74683]:       <entry name='family'>Virtual Machine</entry>
Oct 16 11:20:27 user nova-compute[74683]:     </system>
Oct 16 11:20:27 user nova-compute[74683]:   </sysinfo>
Oct 16 11:20:27 user nova-compute[74683]:   <os>
Oct 16 11:20:27 user nova-compute[74683]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 16 11:20:27 user nova-compute[74683]:     <boot dev='hd'/>
Oct 16 11:20:27 user nova-compute[74683]:     <smbios mode='sysinfo'/>
Oct 16 11:20:27 user nova-compute[74683]:   </os>
Oct 16 11:20:27 user nova-compute[74683]:   <features>
Oct 16 11:20:27 user nova-compute[74683]:     <acpi/>
Oct 16 11:20:27 user nova-compute[74683]:     <apic/>
Oct 16 11:20:27 user nova-compute[74683]:     <vmcoreinfo state='on'/>
Oct 16 11:20:27 user nova-compute[74683]:   </features>
Oct 16 11:20:27 user nova-compute[74683]:   <cpu mode='custom' match='exact' check='full'>
Oct 16 11:20:27 user nova-compute[74683]:     <model fallback='forbid'>Nehalem</model>
Oct 16 11:20:27 user nova-compute[74683]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 16 11:20:27 user nova-compute[74683]:     <feature policy='require' name='vme'/>
Oct 16 11:20:27 user nova-compute[74683]:     <feature policy='require' name='x2apic'/>
Oct 16 11:20:27 user nova-compute[74683]:     <feature policy='require' name='hypervisor'/>
Oct 16 11:20:27 user nova-compute[74683]:   </cpu>
Oct 16 11:20:27 user nova-compute[74683]:   <clock offset='utc'>
Oct 16 11:20:27 user nova-compute[74683]:     <timer name='pit' tickpolicy='delay'/>
Oct 16 11:20:27 user nova-compute[74683]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 16 11:20:27 user nova-compute[74683]:     <timer name='hpet' present='no'/>
Oct 16 11:20:27 user nova-compute[74683]:   </clock>
Oct 16 11:20:27 user nova-compute[74683]:   <on_poweroff>destroy</on_poweroff>
Oct 16 11:20:27 user nova-compute[74683]:   <on_reboot>restart</on_reboot>
Oct 16 11:20:27 user nova-compute[74683]:   <on_crash>destroy</on_crash>
Oct 16 11:20:27 user nova-compute[74683]:   <devices>
Oct 16 11:20:27 user nova-compute[74683]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 16 11:20:27 user nova-compute[74683]:     <disk type='file' device='disk'>
Oct 16 11:20:27 user nova-compute[74683]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 16 11:20:27 user nova-compute[74683]:       <source file='/opt/stack/data/nova/instances/9ae15ce7-996c-460f-a901-1570a2012af1/disk' index='2'/>
Oct 16 11:20:27 user nova-compute[74683]:       <backingStore type='file' index='3'>
Oct 16 11:20:27 user nova-compute[74683]:         <format type='raw'/>
Oct 16 11:20:27 user nova-compute[74683]:         <source file='/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66'/>
Oct 16 11:20:27 user nova-compute[74683]:         <backingStore/>
Oct 16 11:20:27 user nova-compute[74683]:       </backingStore>
Oct 16 11:20:27 user nova-compute[74683]:       <target dev='vda' bus='virtio'/>
Oct 16 11:20:27 user nova-compute[74683]:       <alias name='virtio-disk0'/>
Oct 16 11:20:27 user nova-compute[74683]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 16 11:20:27 user nova-compute[74683]:     </disk>
Oct 16 11:20:27 user nova-compute[74683]:     <disk type='file' device='cdrom'>
Oct 16 11:20:27 user nova-compute[74683]:       <driver name='qemu' type='raw' cache='none'/>
Oct 16 11:20:27 user nova-compute[74683]:       <source file='/opt/stack/data/nova/instances/9ae15ce7-996c-460f-a901-1570a2012af1/disk.config' index='1'/>
Oct 16 11:20:27 user nova-compute[74683]:       <backingStore/>
Oct 16 11:20:27 user nova-compute[74683]:       <target dev='hda' bus='ide'/>
Oct 16 11:20:27 user nova-compute[74683]:       <readonly/>
Oct 16 11:20:27 user nova-compute[74683]:       <alias name='ide0-0-0'/>
Oct 16 11:20:27 user nova-compute[74683]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 16 11:20:27 user nova-compute[74683]:     </disk>
Oct 16 11:20:27 user nova-compute[74683]:     <controller type='usb' index='0' model='none'>
Oct 16 11:20:27 user nova-compute[74683]:       <alias name='usb'/>
Oct 16 11:20:27 user nova-compute[74683]:     </controller>
Oct 16 11:20:27 user nova-compute[74683]:     <controller type='pci' index='0' model='pci-root'>
Oct 16 11:20:27 user nova-compute[74683]:       <alias name='pci.0'/>
Oct 16 11:20:27 user nova-compute[74683]:     </controller>
Oct 16 11:20:27 user nova-compute[74683]:     <controller type='ide' index='0'>
Oct 16 11:20:27 user nova-compute[74683]:       <alias name='ide'/>
Oct 16 11:20:27 user nova-compute[74683]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 16 11:20:27 user nova-compute[74683]:     </controller>
Oct 16 11:20:27 user nova-compute[74683]:     <interface type='ethernet'>
Oct 16 11:20:27 user nova-compute[74683]:       <mac address='fa:16:3e:07:96:fd'/>
Oct 16 11:20:27 user nova-compute[74683]:       <target dev='tap84d9dc84-22'/>
Oct 16 11:20:27 user nova-compute[74683]:       <model type='virtio'/>
Oct 16 11:20:27 user nova-compute[74683]:       <mtu size='1442'/>
Oct 16 11:20:27 user nova-compute[74683]:       <alias name='net0'/>
Oct 16 11:20:27 user nova-compute[74683]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 16 11:20:27 user nova-compute[74683]:     </interface>
Oct 16 11:20:27 user nova-compute[74683]:     <serial type='pty'>
Oct 16 11:20:27 user nova-compute[74683]:       <source path='/dev/pts/10'/>
Oct 16 11:20:27 user nova-compute[74683]:       <log file='/opt/stack/data/nova/instances/9ae15ce7-996c-460f-a901-1570a2012af1/console.log' append='off'/>
Oct 16 11:20:27 user nova-compute[74683]:       <target type='isa-serial' port='0'>
Oct 16 11:20:27 user nova-compute[74683]:         <model name='isa-serial'/>
Oct 16 11:20:27 user nova-compute[74683]:       </target>
Oct 16 11:20:27 user nova-compute[74683]:       <alias name='serial0'/>
Oct 16 11:20:27 user nova-compute[74683]:     </serial>
Oct 16 11:20:27 user nova-compute[74683]:     <console type='pty' tty='/dev/pts/10'>
Oct 16 11:20:27 user nova-compute[74683]:       <source path='/dev/pts/10'/>
Oct 16 11:20:27 user nova-compute[74683]:       <log file='/opt/stack/data/nova/instances/9ae15ce7-996c-460f-a901-1570a2012af1/console.log' append='off'/>
Oct 16 11:20:27 user nova-compute[74683]:       <target type='serial' port='0'/>
Oct 16 11:20:27 user nova-compute[74683]:       <alias name='serial0'/>
Oct 16 11:20:27 user nova-compute[74683]:     </console>
Oct 16 11:20:27 user nova-compute[74683]:     <input type='mouse' bus='ps2'>
Oct 16 11:20:27 user nova-compute[74683]:       <alias name='input0'/>
Oct 16 11:20:27 user nova-compute[74683]:     </input>
Oct 16 11:20:27 user nova-compute[74683]:     <input type='keyboard' bus='ps2'>
Oct 16 11:20:27 user nova-compute[74683]:       <alias name='input1'/>
Oct 16 11:20:27 user nova-compute[74683]:     </input>
Oct 16 11:20:27 user nova-compute[74683]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Oct 16 11:20:27 user nova-compute[74683]:       <listen type='address' address='0.0.0.0'/>
Oct 16 11:20:27 user nova-compute[74683]:     </graphics>
Oct 16 11:20:27 user nova-compute[74683]:     <audio id='1' type='none'/>
Oct 16 11:20:27 user nova-compute[74683]:     <video>
Oct 16 11:20:27 user nova-compute[74683]:       <model type='virtio' heads='1' primary='yes'/>
Oct 16 11:20:27 user nova-compute[74683]:       <alias name='video0'/>
Oct 16 11:20:27 user nova-compute[74683]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 16 11:20:27 user nova-compute[74683]:     </video>
Oct 16 11:20:27 user nova-compute[74683]:     <memballoon model='virtio'>
Oct 16 11:20:27 user nova-compute[74683]:       <stats period='10'/>
Oct 16 11:20:27 user nova-compute[74683]:       <alias name='balloon0'/>
Oct 16 11:20:27 user nova-compute[74683]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 16 11:20:27 user nova-compute[74683]:     </memballoon>
Oct 16 11:20:27 user nova-compute[74683]:     <rng model='virtio'>
Oct 16 11:20:27 user nova-compute[74683]:       <backend model='random'>/dev/urandom</backend>
Oct 16 11:20:27 user nova-compute[74683]:       <alias name='rng0'/>
Oct 16 11:20:27 user nova-compute[74683]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 16 11:20:27 user nova-compute[74683]:     </rng>
Oct 16 11:20:27 user nova-compute[74683]:   </devices>
Oct 16 11:20:27 user nova-compute[74683]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 16 11:20:27 user nova-compute[74683]:     <label>libvirt-9ae15ce7-996c-460f-a901-1570a2012af1</label>
Oct 16 11:20:27 user nova-compute[74683]:     <imagelabel>libvirt-9ae15ce7-996c-460f-a901-1570a2012af1</imagelabel>
Oct 16 11:20:27 user nova-compute[74683]:   </seclabel>
Oct 16 11:20:27 user nova-compute[74683]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 16 11:20:27 user nova-compute[74683]:     <label>+64055:+108</label>
Oct 16 11:20:27 user nova-compute[74683]:     <imagelabel>+64055:+108</imagelabel>
Oct 16 11:20:27 user nova-compute[74683]:   </seclabel>
Oct 16 11:20:27 user nova-compute[74683]: </domain>
Oct 16 11:20:27 user nova-compute[74683]:  {{(pid=74683) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 16 11:20:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [req-21fd6c94-272a-4faf-b7fa-c5f7fd23ba81 req-0215ef7e-64f0-44f1-a6ce-67877a34a6b1 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:61:ea:f6"/><model type="virtio"/><mtu size="1442"/><target dev="tapecf30d0f-8f"/></interface> {{(pid=74683) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 16 11:20:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [req-21fd6c94-272a-4faf-b7fa-c5f7fd23ba81 req-0215ef7e-64f0-44f1-a6ce-67877a34a6b1 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:61:ea:f6"/><model type="virtio"/><mtu size="1442"/><target dev="tapecf30d0f-8f"/></interface>not found in domain: <domain type='kvm' id='14'>
Oct 16 11:20:27 user nova-compute[74683]:   <name>instance-0000000e</name>
Oct 16 11:20:27 user nova-compute[74683]:   <uuid>9ae15ce7-996c-460f-a901-1570a2012af1</uuid>
Oct 16 11:20:27 user nova-compute[74683]:   <metadata>
Oct 16 11:20:27 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:20:27 user nova-compute[74683]:   <nova:package version="0.0.0"/>
Oct 16 11:20:27 user nova-compute[74683]:   <nova:name>tempest-device-tagging-server-717081521</nova:name>
Oct 16 11:20:27 user nova-compute[74683]:   <nova:creationTime>2023-10-16 11:20:26</nova:creationTime>
Oct 16 11:20:27 user nova-compute[74683]:   <nova:flavor name="m1.tiny">
Oct 16 11:20:27 user nova-compute[74683]:     <nova:memory>512</nova:memory>
Oct 16 11:20:27 user nova-compute[74683]:     <nova:disk>1</nova:disk>
Oct 16 11:20:27 user nova-compute[74683]:     <nova:swap>0</nova:swap>
Oct 16 11:20:27 user nova-compute[74683]:     <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:20:27 user nova-compute[74683]:     <nova:vcpus>1</nova:vcpus>
Oct 16 11:20:27 user nova-compute[74683]:   </nova:flavor>
Oct 16 11:20:27 user nova-compute[74683]:   <nova:owner>
Oct 16 11:20:27 user nova-compute[74683]:     <nova:user uuid="ceb56d9dc1b04324adfd4f8d0b1a9766">tempest-TaggedAttachmentsTest-2119065928-project-member</nova:user>
Oct 16 11:20:27 user nova-compute[74683]:     <nova:project uuid="5042cdda42b74341b6c592437b6bbdbf">tempest-TaggedAttachmentsTest-2119065928</nova:project>
Oct 16 11:20:27 user nova-compute[74683]:   </nova:owner>
Oct 16 11:20:27 user nova-compute[74683]:   <nova:root type="image" uuid="0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f"/>
Oct 16 11:20:27 user nova-compute[74683]:   <nova:ports>
Oct 16 11:20:27 user nova-compute[74683]:     <nova:port uuid="84d9dc84-2273-4e6b-a8fe-9a94bddd198c">
Oct 16 11:20:27 user nova-compute[74683]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 16 11:20:27 user nova-compute[74683]:     </nova:port>
Oct 16 11:20:27 user nova-compute[74683]:   </nova:ports>
Oct 16 11:20:27 user nova-compute[74683]: </nova:instance>
Oct 16 11:20:27 user nova-compute[74683]:   </metadata>
Oct 16 11:20:27 user nova-compute[74683]:   <memory unit='KiB'>524288</memory>
Oct 16 11:20:27 user nova-compute[74683]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 16 11:20:27 user nova-compute[74683]:   <vcpu placement='static'>1</vcpu>
Oct 16 11:20:27 user nova-compute[74683]:   <resource>
Oct 16 11:20:27 user nova-compute[74683]:     <partition>/machine</partition>
Oct 16 11:20:27 user nova-compute[74683]:   </resource>
Oct 16 11:20:27 user nova-compute[74683]:   <sysinfo type='smbios'>
Oct 16 11:20:27 user nova-compute[74683]:     <system>
Oct 16 11:20:27 user nova-compute[74683]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 16 11:20:27 user nova-compute[74683]:       <entry name='product'>OpenStack Nova</entry>
Oct 16 11:20:27 user nova-compute[74683]:       <entry name='version'>0.0.0</entry>
Oct 16 11:20:27 user nova-compute[74683]:       <entry name='serial'>9ae15ce7-996c-460f-a901-1570a2012af1</entry>
Oct 16 11:20:27 user nova-compute[74683]:       <entry name='uuid'>9ae15ce7-996c-460f-a901-1570a2012af1</entry>
Oct 16 11:20:27 user nova-compute[74683]:       <entry name='family'>Virtual Machine</entry>
Oct 16 11:20:27 user nova-compute[74683]:     </system>
Oct 16 11:20:27 user nova-compute[74683]:   </sysinfo>
Oct 16 11:20:27 user nova-compute[74683]:   <os>
Oct 16 11:20:27 user nova-compute[74683]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 16 11:20:27 user nova-compute[74683]:     <boot dev='hd'/>
Oct 16 11:20:27 user nova-compute[74683]:     <smbios mode='sysinfo'/>
Oct 16 11:20:27 user nova-compute[74683]:   </os>
Oct 16 11:20:27 user nova-compute[74683]:   <features>
Oct 16 11:20:27 user nova-compute[74683]:     <acpi/>
Oct 16 11:20:27 user nova-compute[74683]:     <apic/>
Oct 16 11:20:27 user nova-compute[74683]:     <vmcoreinfo state='on'/>
Oct 16 11:20:27 user nova-compute[74683]:   </features>
Oct 16 11:20:27 user nova-compute[74683]:   <cpu mode='custom' match='exact' check='full'>
Oct 16 11:20:27 user nova-compute[74683]:     <model fallback='forbid'>Nehalem</model>
Oct 16 11:20:27 user nova-compute[74683]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 16 11:20:27 user nova-compute[74683]:     <feature policy='require' name='vme'/>
Oct 16 11:20:27 user nova-compute[74683]:     <feature policy='require' name='x2apic'/>
Oct 16 11:20:27 user nova-compute[74683]:     <feature policy='require' name='hypervisor'/>
Oct 16 11:20:27 user nova-compute[74683]:   </cpu>
Oct 16 11:20:27 user nova-compute[74683]:   <clock offset='utc'>
Oct 16 11:20:27 user nova-compute[74683]:     <timer name='pit' tickpolicy='delay'/>
Oct 16 11:20:27 user nova-compute[74683]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 16 11:20:27 user nova-compute[74683]:     <timer name='hpet' present='no'/>
Oct 16 11:20:27 user nova-compute[74683]:   </clock>
Oct 16 11:20:27 user nova-compute[74683]:   <on_poweroff>destroy</on_poweroff>
Oct 16 11:20:27 user nova-compute[74683]:   <on_reboot>restart</on_reboot>
Oct 16 11:20:27 user nova-compute[74683]:   <on_crash>destroy</on_crash>
Oct 16 11:20:27 user nova-compute[74683]:   <devices>
Oct 16 11:20:27 user nova-compute[74683]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 16 11:20:27 user nova-compute[74683]:     <disk type='file' device='disk'>
Oct 16 11:20:27 user nova-compute[74683]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 16 11:20:27 user nova-compute[74683]:       <source file='/opt/stack/data/nova/instances/9ae15ce7-996c-460f-a901-1570a2012af1/disk' index='2'/>
Oct 16 11:20:27 user nova-compute[74683]:       <backingStore type='file' index='3'>
Oct 16 11:20:27 user nova-compute[74683]:         <format type='raw'/>
Oct 16 11:20:27 user nova-compute[74683]:         <source file='/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66'/>
Oct 16 11:20:27 user nova-compute[74683]:         <backingStore/>
Oct 16 11:20:27 user nova-compute[74683]:       </backingStore>
Oct 16 11:20:27 user nova-compute[74683]:       <target dev='vda' bus='virtio'/>
Oct 16 11:20:27 user nova-compute[74683]:       <alias name='virtio-disk0'/>
Oct 16 11:20:27 user nova-compute[74683]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 16 11:20:27 user nova-compute[74683]:     </disk>
Oct 16 11:20:27 user nova-compute[74683]:     <disk type='file' device='cdrom'>
Oct 16 11:20:27 user nova-compute[74683]:       <driver name='qemu' type='raw' cache='none'/>
Oct 16 11:20:27 user nova-compute[74683]:       <source file='/opt/stack/data/nova/instances/9ae15ce7-996c-460f-a901-1570a2012af1/disk.config' index='1'/>
Oct 16 11:20:27 user nova-compute[74683]:       <backingStore/>
Oct 16 11:20:27 user nova-compute[74683]:       <target dev='hda' bus='ide'/>
Oct 16 11:20:27 user nova-compute[74683]:       <readonly/>
Oct 16 11:20:27 user nova-compute[74683]:       <alias name='ide0-0-0'/>
Oct 16 11:20:27 user nova-compute[74683]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 16 11:20:27 user nova-compute[74683]:     </disk>
Oct 16 11:20:27 user nova-compute[74683]:     <controller type='usb' index='0' model='none'>
Oct 16 11:20:27 user nova-compute[74683]:       <alias name='usb'/>
Oct 16 11:20:27 user nova-compute[74683]:     </controller>
Oct 16 11:20:27 user nova-compute[74683]:     <controller type='pci' index='0' model='pci-root'>
Oct 16 11:20:27 user nova-compute[74683]:       <alias name='pci.0'/>
Oct 16 11:20:27 user nova-compute[74683]:     </controller>
Oct 16 11:20:27 user nova-compute[74683]:     <controller type='ide' index='0'>
Oct 16 11:20:27 user nova-compute[74683]:       <alias name='ide'/>
Oct 16 11:20:27 user nova-compute[74683]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 16 11:20:27 user nova-compute[74683]:     </controller>
Oct 16 11:20:27 user nova-compute[74683]:     <interface type='ethernet'>
Oct 16 11:20:27 user nova-compute[74683]:       <mac address='fa:16:3e:07:96:fd'/>
Oct 16 11:20:27 user nova-compute[74683]:       <target dev='tap84d9dc84-22'/>
Oct 16 11:20:27 user nova-compute[74683]:       <model type='virtio'/>
Oct 16 11:20:27 user nova-compute[74683]:       <mtu size='1442'/>
Oct 16 11:20:27 user nova-compute[74683]:       <alias name='net0'/>
Oct 16 11:20:27 user nova-compute[74683]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 16 11:20:27 user nova-compute[74683]:     </interface>
Oct 16 11:20:27 user nova-compute[74683]:     <serial type='pty'>
Oct 16 11:20:27 user nova-compute[74683]:       <source path='/dev/pts/10'/>
Oct 16 11:20:27 user nova-compute[74683]:       <log file='/opt/stack/data/nova/instances/9ae15ce7-996c-460f-a901-1570a2012af1/console.log' append='off'/>
Oct 16 11:20:27 user nova-compute[74683]:       <target type='isa-serial' port='0'>
Oct 16 11:20:27 user nova-compute[74683]:         <model name='isa-serial'/>
Oct 16 11:20:27 user nova-compute[74683]:       </target>
Oct 16 11:20:27 user nova-compute[74683]:       <alias name='serial0'/>
Oct 16 11:20:27 user nova-compute[74683]:     </serial>
Oct 16 11:20:27 user nova-compute[74683]:     <console type='pty' tty='/dev/pts/10'>
Oct 16 11:20:27 user nova-compute[74683]:       <source path='/dev/pts/10'/>
Oct 16 11:20:27 user nova-compute[74683]:       <log file='/opt/stack/data/nova/instances/9ae15ce7-996c-460f-a901-1570a2012af1/console.log' append='off'/>
Oct 16 11:20:27 user nova-compute[74683]:       <target type='serial' port='0'/>
Oct 16 11:20:27 user nova-compute[74683]:       <alias name='serial0'/>
Oct 16 11:20:27 user nova-compute[74683]:     </console>
Oct 16 11:20:27 user nova-compute[74683]:     <input type='mouse' bus='ps2'>
Oct 16 11:20:27 user nova-compute[74683]:       <alias name='input0'/>
Oct 16 11:20:27 user nova-compute[74683]:     </input>
Oct 16 11:20:27 user nova-compute[74683]:     <input type='keyboard' bus='ps2'>
Oct 16 11:20:27 user nova-compute[74683]:       <alias name='input1'/>
Oct 16 11:20:27 user nova-compute[74683]:     </input>
Oct 16 11:20:27 user nova-compute[74683]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Oct 16 11:20:27 user nova-compute[74683]:       <listen type='address' address='0.0.0.0'/>
Oct 16 11:20:27 user nova-compute[74683]:     </graphics>
Oct 16 11:20:27 user nova-compute[74683]:     <audio id='1' type='none'/>
Oct 16 11:20:27 user nova-compute[74683]:     <video>
Oct 16 11:20:27 user nova-compute[74683]:       <model type='virtio' heads='1' primary='yes'/>
Oct 16 11:20:27 user nova-compute[74683]:       <alias name='video0'/>
Oct 16 11:20:27 user nova-compute[74683]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 16 11:20:27 user nova-compute[74683]:     </video>
Oct 16 11:20:27 user nova-compute[74683]:     <memballoon model='virtio'>
Oct 16 11:20:27 user nova-compute[74683]:       <stats period='10'/>
Oct 16 11:20:27 user nova-compute[74683]:       <alias name='balloon0'/>
Oct 16 11:20:27 user nova-compute[74683]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 16 11:20:27 user nova-compute[74683]:     </memballoon>
Oct 16 11:20:27 user nova-compute[74683]:     <rng model='virtio'>
Oct 16 11:20:27 user nova-compute[74683]:       <backend model='random'>/dev/urandom</backend>
Oct 16 11:20:27 user nova-compute[74683]:       <alias name='rng0'/>
Oct 16 11:20:27 user nova-compute[74683]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 16 11:20:27 user nova-compute[74683]:     </rng>
Oct 16 11:20:27 user nova-compute[74683]:   </devices>
Oct 16 11:20:27 user nova-compute[74683]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 16 11:20:27 user nova-compute[74683]:     <label>libvirt-9ae15ce7-996c-460f-a901-1570a2012af1</label>
Oct 16 11:20:27 user nova-compute[74683]:     <imagelabel>libvirt-9ae15ce7-996c-460f-a901-1570a2012af1</imagelabel>
Oct 16 11:20:27 user nova-compute[74683]:   </seclabel>
Oct 16 11:20:27 user nova-compute[74683]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 16 11:20:27 user nova-compute[74683]:     <label>+64055:+108</label>
Oct 16 11:20:27 user nova-compute[74683]:     <imagelabel>+64055:+108</imagelabel>
Oct 16 11:20:27 user nova-compute[74683]:   </seclabel>
Oct 16 11:20:27 user nova-compute[74683]: </domain>
Oct 16 11:20:27 user nova-compute[74683]:  {{(pid=74683) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 16 11:20:27 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [req-21fd6c94-272a-4faf-b7fa-c5f7fd23ba81 req-0215ef7e-64f0-44f1-a6ce-67877a34a6b1 service nova] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Detaching interface fa:16:3e:61:ea:f6 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapecf30d0f-8f' not found.
Oct 16 11:20:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [req-21fd6c94-272a-4faf-b7fa-c5f7fd23ba81 req-0215ef7e-64f0-44f1-a6ce-67877a34a6b1 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T11:17:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-717081521',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-717081521',id=14,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8efJVroKVuigryD4GSp1jU2h74/46LP7zUTBq1YNdoS9sGz/cMTsYXKQK2+Lj6yR1spH3hPAhB6Y4h51NvH2BYFIARH1zI9goHYvZdEeIkuG1XUEV0yYBKVJjNs/qPig==',key_name='tempest-keypair-1457686750',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:17:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5042cdda42b74341b6c592437b6bbdbf',ramdisk_id='',reservation_id='r-ezaz9z78',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2119065928',owner_user_name='tempest-TaggedAttachmentsTest-2119065928-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:17:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ceb56d9dc1b04324adfd4f8d0b1a9766',uuid=9ae15ce7-996c-460f-a901-1570a2012af1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05", "address": "fa:16:3e:61:ea:f6", "network": {"id": "693d56b4-4756-4957-94a4-1f1bca480f12", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-659453574", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5042cdda42b74341b6c592437b6bbdbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecf30d0f-8f", "ovs_interfaceid": "ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:20:27 user nova-compute[74683]: DEBUG nova.network.os_vif_util [req-21fd6c94-272a-4faf-b7fa-c5f7fd23ba81 req-0215ef7e-64f0-44f1-a6ce-67877a34a6b1 service nova] Converting VIF {"id": "ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05", "address": "fa:16:3e:61:ea:f6", "network": {"id": "693d56b4-4756-4957-94a4-1f1bca480f12", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-659453574", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5042cdda42b74341b6c592437b6bbdbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecf30d0f-8f", "ovs_interfaceid": "ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:20:27 user nova-compute[74683]: DEBUG nova.network.os_vif_util [req-21fd6c94-272a-4faf-b7fa-c5f7fd23ba81 req-0215ef7e-64f0-44f1-a6ce-67877a34a6b1 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:ea:f6,bridge_name='br-int',has_traffic_filtering=True,id=ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05,network=Network(693d56b4-4756-4957-94a4-1f1bca480f12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecf30d0f-8f') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:20:27 user nova-compute[74683]: DEBUG os_vif [req-21fd6c94-272a-4faf-b7fa-c5f7fd23ba81 req-0215ef7e-64f0-44f1-a6ce-67877a34a6b1 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:ea:f6,bridge_name='br-int',has_traffic_filtering=True,id=ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05,network=Network(693d56b4-4756-4957-94a4-1f1bca480f12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecf30d0f-8f') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:20:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapecf30d0f-8f, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:20:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:20:27 user nova-compute[74683]: INFO os_vif [req-21fd6c94-272a-4faf-b7fa-c5f7fd23ba81 req-0215ef7e-64f0-44f1-a6ce-67877a34a6b1 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:ea:f6,bridge_name='br-int',has_traffic_filtering=True,id=ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05,network=Network(693d56b4-4756-4957-94a4-1f1bca480f12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecf30d0f-8f')
Oct 16 11:20:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [req-21fd6c94-272a-4faf-b7fa-c5f7fd23ba81 req-0215ef7e-64f0-44f1-a6ce-67877a34a6b1 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:20:27 user nova-compute[74683]:   <nova:package version="0.0.0"/>
Oct 16 11:20:27 user nova-compute[74683]:   <nova:name>tempest-device-tagging-server-717081521</nova:name>
Oct 16 11:20:27 user nova-compute[74683]:   <nova:creationTime>2023-10-16 11:20:27</nova:creationTime>
Oct 16 11:20:27 user nova-compute[74683]:   <nova:flavor name="m1.tiny">
Oct 16 11:20:27 user nova-compute[74683]:     <nova:memory>512</nova:memory>
Oct 16 11:20:27 user nova-compute[74683]:     <nova:disk>1</nova:disk>
Oct 16 11:20:27 user nova-compute[74683]:     <nova:swap>0</nova:swap>
Oct 16 11:20:27 user nova-compute[74683]:     <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:20:27 user nova-compute[74683]:     <nova:vcpus>1</nova:vcpus>
Oct 16 11:20:27 user nova-compute[74683]:   </nova:flavor>
Oct 16 11:20:27 user nova-compute[74683]:   <nova:owner>
Oct 16 11:20:27 user nova-compute[74683]:     <nova:user uuid="ceb56d9dc1b04324adfd4f8d0b1a9766">tempest-TaggedAttachmentsTest-2119065928-project-member</nova:user>
Oct 16 11:20:27 user nova-compute[74683]:     <nova:project uuid="5042cdda42b74341b6c592437b6bbdbf">tempest-TaggedAttachmentsTest-2119065928</nova:project>
Oct 16 11:20:27 user nova-compute[74683]:   </nova:owner>
Oct 16 11:20:27 user nova-compute[74683]:   <nova:root type="image" uuid="0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f"/>
Oct 16 11:20:27 user nova-compute[74683]:   <nova:ports>
Oct 16 11:20:27 user nova-compute[74683]:     <nova:port uuid="84d9dc84-2273-4e6b-a8fe-9a94bddd198c">
Oct 16 11:20:27 user nova-compute[74683]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 16 11:20:27 user nova-compute[74683]:     </nova:port>
Oct 16 11:20:27 user nova-compute[74683]:   </nova:ports>
Oct 16 11:20:27 user nova-compute[74683]: </nova:instance>
Oct 16 11:20:27 user nova-compute[74683]:  {{(pid=74683) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 16 11:20:27 user nova-compute[74683]: DEBUG nova.network.neutron [None req-309b9a64-efde-47c3-a955-c1c2802812b0 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Updating instance_info_cache with network_info: [{"id": "84d9dc84-2273-4e6b-a8fe-9a94bddd198c", "address": "fa:16:3e:07:96:fd", "network": {"id": "33b6ba99-0d95-497e-a744-1ae84c9d63e1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-240536039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5042cdda42b74341b6c592437b6bbdbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d9dc84-22", "ovs_interfaceid": "84d9dc84-2273-4e6b-a8fe-9a94bddd198c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:20:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-309b9a64-efde-47c3-a955-c1c2802812b0 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Releasing lock "refresh_cache-9ae15ce7-996c-460f-a901-1570a2012af1" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:20:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-309b9a64-efde-47c3-a955-c1c2802812b0 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Lock "interface-9ae15ce7-996c-460f-a901-1570a2012af1-ecf30d0f-8fd9-4260-80cf-f2efa7d7ef05" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.575s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:20:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-006efd26-d3cd-4e1e-8486-239f5ebb0758 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Acquiring lock "fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:20:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-006efd26-d3cd-4e1e-8486-239f5ebb0758 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Lock "fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:20:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-006efd26-d3cd-4e1e-8486-239f5ebb0758 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Acquiring lock "fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:20:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-006efd26-d3cd-4e1e-8486-239f5ebb0758 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Lock "fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:20:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-006efd26-d3cd-4e1e-8486-239f5ebb0758 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Lock "fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:20:39 user nova-compute[74683]: INFO nova.compute.manager [None req-006efd26-d3cd-4e1e-8486-239f5ebb0758 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Terminating instance
Oct 16 11:20:39 user nova-compute[74683]: DEBUG nova.compute.manager [None req-006efd26-d3cd-4e1e-8486-239f5ebb0758 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Start destroying the instance on the hypervisor. {{(pid=74683) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 11:20:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:40 user nova-compute[74683]: DEBUG nova.compute.manager [req-efd29e0d-e842-4729-856a-2bfb983c2961 req-967132aa-37f1-45f8-bde2-2c35139124a9 service nova] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Received event network-vif-unplugged-4e82d9f4-a743-4e67-bc9d-e9f7c527b102 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:20:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-efd29e0d-e842-4729-856a-2bfb983c2961 req-967132aa-37f1-45f8-bde2-2c35139124a9 service nova] Acquiring lock "fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:20:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-efd29e0d-e842-4729-856a-2bfb983c2961 req-967132aa-37f1-45f8-bde2-2c35139124a9 service nova] Lock "fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:20:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-efd29e0d-e842-4729-856a-2bfb983c2961 req-967132aa-37f1-45f8-bde2-2c35139124a9 service nova] Lock "fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:20:40 user nova-compute[74683]: DEBUG nova.compute.manager [req-efd29e0d-e842-4729-856a-2bfb983c2961 req-967132aa-37f1-45f8-bde2-2c35139124a9 service nova] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] No waiting events found dispatching network-vif-unplugged-4e82d9f4-a743-4e67-bc9d-e9f7c527b102 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:20:40 user nova-compute[74683]: DEBUG nova.compute.manager [req-efd29e0d-e842-4729-856a-2bfb983c2961 req-967132aa-37f1-45f8-bde2-2c35139124a9 service nova] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Received event network-vif-unplugged-4e82d9f4-a743-4e67-bc9d-e9f7c527b102 for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 11:20:40 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Instance destroyed successfully.
Oct 16 11:20:40 user nova-compute[74683]: DEBUG nova.objects.instance [None req-006efd26-d3cd-4e1e-8486-239f5ebb0758 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Lazy-loading 'resources' on Instance uuid fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:20:40 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-006efd26-d3cd-4e1e-8486-239f5ebb0758 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:13:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-676236564',display_name='tempest-VolumesAdminNegativeTest-server-676236564',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-676236564',id=6,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBALOxjnBjjsOSmQoNLhcslR/cpaTlGXDqbHa1zWyvRLB0VJVnnyy1KuXAxc5L+D/MSzkPXdnPtM+JPZK2n0GL1IuR3TXGA40TfU6MQlW8vKtdRUN/3YmKi7Ef9j0Jj3SUg==',key_name='tempest-keypair-2061755854',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:13:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e03b7938f054e1fadb9f650ac8db1c9',ramdisk_id='',reservation_id='r-gupj191j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-191985547',owner_user_name='tempest-VolumesAdminNegativeTest-191985547-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:13:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77caa7602ea343f4a0932cc033e1fc82',uuid=fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4e82d9f4-a743-4e67-bc9d-e9f7c527b102", "address": "fa:16:3e:5a:7a:f8", "network": {"id": "2bf14a39-69ea-4656-956a-f1578bb1836d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1838676509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e03b7938f054e1fadb9f650ac8db1c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e82d9f4-a7", "ovs_interfaceid": "4e82d9f4-a743-4e67-bc9d-e9f7c527b102", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:20:40 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-006efd26-d3cd-4e1e-8486-239f5ebb0758 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Converting VIF {"id": "4e82d9f4-a743-4e67-bc9d-e9f7c527b102", "address": "fa:16:3e:5a:7a:f8", "network": {"id": "2bf14a39-69ea-4656-956a-f1578bb1836d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1838676509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e03b7938f054e1fadb9f650ac8db1c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e82d9f4-a7", "ovs_interfaceid": "4e82d9f4-a743-4e67-bc9d-e9f7c527b102", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:20:40 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-006efd26-d3cd-4e1e-8486-239f5ebb0758 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5a:7a:f8,bridge_name='br-int',has_traffic_filtering=True,id=4e82d9f4-a743-4e67-bc9d-e9f7c527b102,network=Network(2bf14a39-69ea-4656-956a-f1578bb1836d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e82d9f4-a7') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:20:40 user nova-compute[74683]: DEBUG os_vif [None req-006efd26-d3cd-4e1e-8486-239f5ebb0758 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:7a:f8,bridge_name='br-int',has_traffic_filtering=True,id=4e82d9f4-a743-4e67-bc9d-e9f7c527b102,network=Network(2bf14a39-69ea-4656-956a-f1578bb1836d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e82d9f4-a7') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:20:40 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:40 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4e82d9f4-a7, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:20:40 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:40 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:40 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:40 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1e9f7549-fd76-416f-af4e-5f885a613288) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:20:40 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:40 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:40 user nova-compute[74683]: INFO os_vif [None req-006efd26-d3cd-4e1e-8486-239f5ebb0758 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:7a:f8,bridge_name='br-int',has_traffic_filtering=True,id=4e82d9f4-a743-4e67-bc9d-e9f7c527b102,network=Network(2bf14a39-69ea-4656-956a-f1578bb1836d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e82d9f4-a7')
Oct 16 11:20:40 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-006efd26-d3cd-4e1e-8486-239f5ebb0758 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Deleting instance files /opt/stack/data/nova/instances/fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7_del
Oct 16 11:20:40 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-006efd26-d3cd-4e1e-8486-239f5ebb0758 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Deletion of /opt/stack/data/nova/instances/fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7_del complete
Oct 16 11:20:40 user nova-compute[74683]: INFO nova.compute.manager [None req-006efd26-d3cd-4e1e-8486-239f5ebb0758 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Took 0.91 seconds to destroy the instance on the hypervisor.
Oct 16 11:20:40 user nova-compute[74683]: DEBUG oslo.service.loopingcall [None req-006efd26-d3cd-4e1e-8486-239f5ebb0758 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74683) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 11:20:40 user nova-compute[74683]: DEBUG nova.compute.manager [-] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Deallocating network for instance {{(pid=74683) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 11:20:40 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] deallocate_for_instance() {{(pid=74683) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 11:20:41 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-61d7af8a-acb1-45fd-a7c3-36f9c6730f5e tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 45ca3cbb-53d6-4046-9be3-92cc6b71bfad is timed out.
Oct 16 11:20:41 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-61d7af8a-acb1-45fd-a7c3-36f9c6730f5e tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Successfully detached device vdb from instance 45ca3cbb-53d6-4046-9be3-92cc6b71bfad from the live domain config.
Oct 16 11:20:41 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61d7af8a-acb1-45fd-a7c3-36f9c6730f5e tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] calling os-brick to detach iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 11:20:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d7af8a-acb1-45fd-a7c3-36f9c6730f5e tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, {'target_iqn': 'iqn.2010-10.org.openstack:bc3f1451-b39f-4059-8d9a-0556c9bbef86', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'payvInXx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:20:41 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-61d7af8a-acb1-45fd-a7c3-36f9c6730f5e tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:20:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-61d7af8a-acb1-45fd-a7c3-36f9c6730f5e tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:20:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-61d7af8a-acb1-45fd-a7c3-36f9c6730f5e tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:20:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:41 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5fca1a7-3c36-4adc-8f87-d421e2841fb7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc3f1451-b39f-4059-8d9a-0556c9bbef86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:20:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d7af8a-acb1-45fd-a7c3-36f9c6730f5e tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 11:20:41 user nova-compute[74683]: No targets found.
Oct 16 11:20:41 user nova-compute[74683]: iSNS:
Oct 16 11:20:41 user nova-compute[74683]: No targets found.
Oct 16 11:20:41 user nova-compute[74683]: STATIC:
Oct 16 11:20:41 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb
Oct 16 11:20:41 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:20:41 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:20:41 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:bc3f1451-b39f-4059-8d9a-0556c9bbef86
Oct 16 11:20:41 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:20:41 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:20:41 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b
Oct 16 11:20:41 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:20:41 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:20:41 user nova-compute[74683]: FIRMWARE:
Oct 16 11:20:41 user nova-compute[74683]: No targets found.
Oct 16 11:20:41 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:20:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d7af8a-acb1-45fd-a7c3-36f9c6730f5e tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 11:20:41 user nova-compute[74683]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 11:20:41 user nova-compute[74683]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74683) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 11:20:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d7af8a-acb1-45fd-a7c3-36f9c6730f5e tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc3f1451-b39f-4059-8d9a-0556c9bbef86', 0)] {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 11:20:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:41 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[9521dfb8-1b8d-42f9-b882-6f43e28940a3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc3f1451-b39f-4059-8d9a-0556c9bbef86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:20:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:41 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e14f6b-4999-4e41-987a-f803fb9f6ad2]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc3f1451-b39f-4059-8d9a-0556c9bbef86 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:20:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d7af8a-acb1-45fd-a7c3-36f9c6730f5e tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:20:41 user nova-compute[74683]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)
Oct 16 11:20:41 user nova-compute[74683]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc3f1451-b39f-4059-8d9a-0556c9bbef86 (non-flash)
Oct 16 11:20:41 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:20:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d7af8a-acb1-45fd-a7c3-36f9c6730f5e tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:20:41 user nova-compute[74683]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)
Oct 16 11:20:41 user nova-compute[74683]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc3f1451-b39f-4059-8d9a-0556c9bbef86 (non-flash)
Oct 16 11:20:41 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:20:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d7af8a-acb1-45fd-a7c3-36f9c6730f5e tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda4c7a0820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc3f1451-b39f-4059-8d9a-0556c9bbef86'): ({'sdb'}, set())}) {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 11:20:41 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-61d7af8a-acb1-45fd-a7c3-36f9c6730f5e tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Removing single pathed devices sdb {{(pid=74683) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 11:20:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:41 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dfda3b8-f4c3-4da2-ad24-af4e0251850b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:20:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:41 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[c18e5adc-c2c0-45a6-8531-9cab93d295e2]: (4, ('ok\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:20:41 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-61d7af8a-acb1-45fd-a7c3-36f9c6730f5e tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Flushing IO for device /dev/sdb {{(pid=74683) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 11:20:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9f51d02e-e9c1-4376-8c2d-871b9a3707ec tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Acquiring lock "2f1db5e2-0b25-4d61-9dd3-038811b4eda1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:20:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9f51d02e-e9c1-4376-8c2d-871b9a3707ec tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Lock "2f1db5e2-0b25-4d61-9dd3-038811b4eda1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:20:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9f51d02e-e9c1-4376-8c2d-871b9a3707ec tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Acquiring lock "2f1db5e2-0b25-4d61-9dd3-038811b4eda1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:20:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9f51d02e-e9c1-4376-8c2d-871b9a3707ec tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Lock "2f1db5e2-0b25-4d61-9dd3-038811b4eda1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:20:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9f51d02e-e9c1-4376-8c2d-871b9a3707ec tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Lock "2f1db5e2-0b25-4d61-9dd3-038811b4eda1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:20:41 user nova-compute[74683]: INFO nova.compute.manager [None req-9f51d02e-e9c1-4376-8c2d-871b9a3707ec tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Terminating instance
Oct 16 11:20:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:41 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cac5b95-0440-4d61-b35b-9bfa1a5b98f6]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:20:41 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9f51d02e-e9c1-4376-8c2d-871b9a3707ec tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Start destroying the instance on the hypervisor. {{(pid=74683) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 11:20:41 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-61d7af8a-acb1-45fd-a7c3-36f9c6730f5e tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74683) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 11:20:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:41 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3088d1-8326-40e4-aaea-e139ca37ac0f]: (4, ('1', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:20:41 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-61d7af8a-acb1-45fd-a7c3-36f9c6730f5e tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 11:20:41 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-61d7af8a-acb1-45fd-a7c3-36f9c6730f5e tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] SCSI volumes sdb have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 11:20:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d7af8a-acb1-45fd-a7c3-36f9c6730f5e tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc3f1451-b39f-4059-8d9a-0556c9bbef86')] {{(pid=74683) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 11:20:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc3f1451-b39f-4059-8d9a-0556c9bbef86 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc3f1451-b39f-4059-8d9a-0556c9bbef86 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:41 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f38aca-c1f2-4d91-b4bd-7797f78d0d03]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:20:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d7af8a-acb1-45fd-a7c3-36f9c6730f5e tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:20:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc3f1451-b39f-4059-8d9a-0556c9bbef86 -p 172.16.0.220:3260 --logout {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:41 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:20:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:41 user nova-compute[74683]: DEBUG nova.compute.manager [req-d2999d02-45aa-4425-9950-d535c339974c req-1a7c2d9e-6652-495a-8847-d93c50fe3182 service nova] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Received event network-vif-deleted-4e82d9f4-a743-4e67-bc9d-e9f7c527b102 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:20:41 user nova-compute[74683]: INFO nova.compute.manager [req-d2999d02-45aa-4425-9950-d535c339974c req-1a7c2d9e-6652-495a-8847-d93c50fe3182 service nova] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Neutron deleted interface 4e82d9f4-a743-4e67-bc9d-e9f7c527b102; detaching it from the instance and deleting it from the info cache
Oct 16 11:20:41 user nova-compute[74683]: DEBUG nova.network.neutron [req-d2999d02-45aa-4425-9950-d535c339974c req-1a7c2d9e-6652-495a-8847-d93c50fe3182 service nova] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:20:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc3f1451-b39f-4059-8d9a-0556c9bbef86 -p 172.16.0.220:3260 --logout" returned: 0 in 0.088s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:41 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8b3751-0e32-4cf8-8693-4d09784307fc]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:bc3f1451-b39f-4059-8d9a-0556c9bbef86, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:bc3f1451-b39f-4059-8d9a-0556c9bbef86, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:20:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d7af8a-acb1-45fd-a7c3-36f9c6730f5e tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:bc3f1451-b39f-4059-8d9a-0556c9bbef86, portal: 172.16.0.220,3260]
Oct 16 11:20:41 user nova-compute[74683]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:bc3f1451-b39f-4059-8d9a-0556c9bbef86, portal: 172.16.0.220,3260] successful.
Oct 16 11:20:41 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:20:41 user nova-compute[74683]: INFO nova.compute.manager [-] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Took 1.17 seconds to deallocate network for instance.
Oct 16 11:20:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc3f1451-b39f-4059-8d9a-0556c9bbef86 -p 172.16.0.220:3260 --op delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:41 user nova-compute[74683]: DEBUG nova.compute.manager [req-d2999d02-45aa-4425-9950-d535c339974c req-1a7c2d9e-6652-495a-8847-d93c50fe3182 service nova] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Detach interface failed, port_id=4e82d9f4-a743-4e67-bc9d-e9f7c527b102, reason: Instance fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7 could not be found. {{(pid=74683) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 16 11:20:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc3f1451-b39f-4059-8d9a-0556c9bbef86 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:41 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[7858d653-994f-4ed8-b97c-5a9ecccb4063]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:20:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d7af8a-acb1-45fd-a7c3-36f9c6730f5e tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:20:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-61d7af8a-acb1-45fd-a7c3-36f9c6730f5e tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.390s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:20:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d7af8a-acb1-45fd-a7c3-36f9c6730f5e tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] <== disconnect_volume: return (392ms) None {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:20:41 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61d7af8a-acb1-45fd-a7c3-36f9c6730f5e tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Disconnected iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 11:20:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-006efd26-d3cd-4e1e-8486-239f5ebb0758 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:20:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-006efd26-d3cd-4e1e-8486-239f5ebb0758 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:20:42 user nova-compute[74683]: DEBUG nova.compute.manager [req-3aac66a1-7305-498a-91f9-0d8fd49ccb9d req-5f62b423-ceed-4a64-8c30-f66dbf82da26 service nova] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Received event network-vif-plugged-4e82d9f4-a743-4e67-bc9d-e9f7c527b102 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:20:42 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-3aac66a1-7305-498a-91f9-0d8fd49ccb9d req-5f62b423-ceed-4a64-8c30-f66dbf82da26 service nova] Acquiring lock "fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:20:42 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-3aac66a1-7305-498a-91f9-0d8fd49ccb9d req-5f62b423-ceed-4a64-8c30-f66dbf82da26 service nova] Lock "fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:20:42 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-3aac66a1-7305-498a-91f9-0d8fd49ccb9d req-5f62b423-ceed-4a64-8c30-f66dbf82da26 service nova] Lock "fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:20:42 user nova-compute[74683]: DEBUG nova.compute.manager [req-3aac66a1-7305-498a-91f9-0d8fd49ccb9d req-5f62b423-ceed-4a64-8c30-f66dbf82da26 service nova] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] No waiting events found dispatching network-vif-plugged-4e82d9f4-a743-4e67-bc9d-e9f7c527b102 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:20:42 user nova-compute[74683]: WARNING nova.compute.manager [req-3aac66a1-7305-498a-91f9-0d8fd49ccb9d req-5f62b423-ceed-4a64-8c30-f66dbf82da26 service nova] [instance: fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7] Received unexpected event network-vif-plugged-4e82d9f4-a743-4e67-bc9d-e9f7c527b102 for instance with vm_state deleted and task_state None.
Oct 16 11:20:42 user nova-compute[74683]: DEBUG nova.compute.manager [req-3aac66a1-7305-498a-91f9-0d8fd49ccb9d req-5f62b423-ceed-4a64-8c30-f66dbf82da26 service nova] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Received event network-vif-unplugged-9476563e-0758-43d9-b920-87f412881869 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:20:42 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-3aac66a1-7305-498a-91f9-0d8fd49ccb9d req-5f62b423-ceed-4a64-8c30-f66dbf82da26 service nova] Acquiring lock "2f1db5e2-0b25-4d61-9dd3-038811b4eda1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:20:42 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-3aac66a1-7305-498a-91f9-0d8fd49ccb9d req-5f62b423-ceed-4a64-8c30-f66dbf82da26 service nova] Lock "2f1db5e2-0b25-4d61-9dd3-038811b4eda1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:20:42 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-3aac66a1-7305-498a-91f9-0d8fd49ccb9d req-5f62b423-ceed-4a64-8c30-f66dbf82da26 service nova] Lock "2f1db5e2-0b25-4d61-9dd3-038811b4eda1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:20:42 user nova-compute[74683]: DEBUG nova.compute.manager [req-3aac66a1-7305-498a-91f9-0d8fd49ccb9d req-5f62b423-ceed-4a64-8c30-f66dbf82da26 service nova] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] No waiting events found dispatching network-vif-unplugged-9476563e-0758-43d9-b920-87f412881869 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:20:42 user nova-compute[74683]: DEBUG nova.compute.manager [req-3aac66a1-7305-498a-91f9-0d8fd49ccb9d req-5f62b423-ceed-4a64-8c30-f66dbf82da26 service nova] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Received event network-vif-unplugged-9476563e-0758-43d9-b920-87f412881869 for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 11:20:42 user nova-compute[74683]: DEBUG nova.compute.manager [req-3aac66a1-7305-498a-91f9-0d8fd49ccb9d req-5f62b423-ceed-4a64-8c30-f66dbf82da26 service nova] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Received event network-vif-plugged-9476563e-0758-43d9-b920-87f412881869 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:20:42 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-3aac66a1-7305-498a-91f9-0d8fd49ccb9d req-5f62b423-ceed-4a64-8c30-f66dbf82da26 service nova] Acquiring lock "2f1db5e2-0b25-4d61-9dd3-038811b4eda1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:20:42 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-3aac66a1-7305-498a-91f9-0d8fd49ccb9d req-5f62b423-ceed-4a64-8c30-f66dbf82da26 service nova] Lock "2f1db5e2-0b25-4d61-9dd3-038811b4eda1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:20:42 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-3aac66a1-7305-498a-91f9-0d8fd49ccb9d req-5f62b423-ceed-4a64-8c30-f66dbf82da26 service nova] Lock "2f1db5e2-0b25-4d61-9dd3-038811b4eda1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:20:42 user nova-compute[74683]: DEBUG nova.compute.manager [req-3aac66a1-7305-498a-91f9-0d8fd49ccb9d req-5f62b423-ceed-4a64-8c30-f66dbf82da26 service nova] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] No waiting events found dispatching network-vif-plugged-9476563e-0758-43d9-b920-87f412881869 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:20:42 user nova-compute[74683]: WARNING nova.compute.manager [req-3aac66a1-7305-498a-91f9-0d8fd49ccb9d req-5f62b423-ceed-4a64-8c30-f66dbf82da26 service nova] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Received unexpected event network-vif-plugged-9476563e-0758-43d9-b920-87f412881869 for instance with vm_state active and task_state deleting.
Oct 16 11:20:42 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-006efd26-d3cd-4e1e-8486-239f5ebb0758 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:20:42 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-006efd26-d3cd-4e1e-8486-239f5ebb0758 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:20:42 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-006efd26-d3cd-4e1e-8486-239f5ebb0758 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.424s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:20:42 user nova-compute[74683]: INFO nova.scheduler.client.report [None req-006efd26-d3cd-4e1e-8486-239f5ebb0758 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Deleted allocations for instance fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7
Oct 16 11:20:42 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Instance destroyed successfully.
Oct 16 11:20:42 user nova-compute[74683]: DEBUG nova.objects.instance [None req-9f51d02e-e9c1-4376-8c2d-871b9a3707ec tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Lazy-loading 'resources' on Instance uuid 2f1db5e2-0b25-4d61-9dd3-038811b4eda1 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:20:42 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-9f51d02e-e9c1-4376-8c2d-871b9a3707ec tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:13:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-649264826',display_name='tempest-ServerStableDeviceRescueTest-server-649264826',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-649264826',id=5,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCHdErqSJAuU5ThrpuRLCA7O8N+5e9cKLBRIOiKAgCYrSh7b9cT3Hw2OzejXwPp8CDDvy7DhOF+OR4lwTCUm5XrYVkiD31OBP/Hh7mTFi6YXdpdChJO0Xma5CTcgqFL8LA==',key_name='tempest-keypair-907110681',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:17:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='207a79fe27c042d8b081272246b98245',ramdisk_id='',reservation_id='r-snd9b0xu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-2038287775',owner_user_name='tempest-ServerStableDeviceRescueTest-2038287775-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:19:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da5d2dc55a234fa5a6b09bdc3f489055',uuid=2f1db5e2-0b25-4d61-9dd3-038811b4eda1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9476563e-0758-43d9-b920-87f412881869", "address": "fa:16:3e:18:cc:d6", "network": {"id": "5a04a566-92ef-4300-976b-5c34656ec9c7", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-706076145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "207a79fe27c042d8b081272246b98245", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9476563e-07", "ovs_interfaceid": "9476563e-0758-43d9-b920-87f412881869", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:20:42 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-9f51d02e-e9c1-4376-8c2d-871b9a3707ec tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Converting VIF {"id": "9476563e-0758-43d9-b920-87f412881869", "address": "fa:16:3e:18:cc:d6", "network": {"id": "5a04a566-92ef-4300-976b-5c34656ec9c7", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-706076145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "207a79fe27c042d8b081272246b98245", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9476563e-07", "ovs_interfaceid": "9476563e-0758-43d9-b920-87f412881869", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:20:42 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-9f51d02e-e9c1-4376-8c2d-871b9a3707ec tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:18:cc:d6,bridge_name='br-int',has_traffic_filtering=True,id=9476563e-0758-43d9-b920-87f412881869,network=Network(5a04a566-92ef-4300-976b-5c34656ec9c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9476563e-07') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:20:42 user nova-compute[74683]: DEBUG os_vif [None req-9f51d02e-e9c1-4376-8c2d-871b9a3707ec tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:cc:d6,bridge_name='br-int',has_traffic_filtering=True,id=9476563e-0758-43d9-b920-87f412881869,network=Network(5a04a566-92ef-4300-976b-5c34656ec9c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9476563e-07') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:20:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9476563e-07, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:20:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:20:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=81bd7e0c-7837-4665-a9f2-c278e13fc089) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:20:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:42 user nova-compute[74683]: INFO os_vif [None req-9f51d02e-e9c1-4376-8c2d-871b9a3707ec tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:cc:d6,bridge_name='br-int',has_traffic_filtering=True,id=9476563e-0758-43d9-b920-87f412881869,network=Network(5a04a566-92ef-4300-976b-5c34656ec9c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9476563e-07')
Oct 16 11:20:42 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-9f51d02e-e9c1-4376-8c2d-871b9a3707ec tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Deleting instance files /opt/stack/data/nova/instances/2f1db5e2-0b25-4d61-9dd3-038811b4eda1_del
Oct 16 11:20:42 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-9f51d02e-e9c1-4376-8c2d-871b9a3707ec tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Deletion of /opt/stack/data/nova/instances/2f1db5e2-0b25-4d61-9dd3-038811b4eda1_del complete
Oct 16 11:20:42 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-006efd26-d3cd-4e1e-8486-239f5ebb0758 tempest-VolumesAdminNegativeTest-191985547 tempest-VolumesAdminNegativeTest-191985547-project-member] Lock "fc87d7f1-b2bb-45c8-8054-0566c4c5f7e7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.778s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:20:42 user nova-compute[74683]: INFO nova.compute.manager [None req-9f51d02e-e9c1-4376-8c2d-871b9a3707ec tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Took 0.93 seconds to destroy the instance on the hypervisor.
Oct 16 11:20:42 user nova-compute[74683]: DEBUG oslo.service.loopingcall [None req-9f51d02e-e9c1-4376-8c2d-871b9a3707ec tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74683) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 11:20:42 user nova-compute[74683]: DEBUG nova.compute.manager [-] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Deallocating network for instance {{(pid=74683) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 11:20:42 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] deallocate_for_instance() {{(pid=74683) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 11:20:42 user nova-compute[74683]: DEBUG nova.objects.instance [None req-61d7af8a-acb1-45fd-a7c3-36f9c6730f5e tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lazy-loading 'flavor' on Instance uuid 45ca3cbb-53d6-4046-9be3-92cc6b71bfad {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:20:42 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-61d7af8a-acb1-45fd-a7c3-36f9c6730f5e tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lock "45ca3cbb-53d6-4046-9be3-92cc6b71bfad" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.947s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:20:43 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:20:43 user nova-compute[74683]: INFO nova.compute.manager [-] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Took 0.80 seconds to deallocate network for instance.
Oct 16 11:20:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9f51d02e-e9c1-4376-8c2d-871b9a3707ec tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:20:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9f51d02e-e9c1-4376-8c2d-871b9a3707ec tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:20:43 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-9f51d02e-e9c1-4376-8c2d-871b9a3707ec tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:20:43 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9f51d02e-e9c1-4376-8c2d-871b9a3707ec tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:20:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9f51d02e-e9c1-4376-8c2d-871b9a3707ec tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.319s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:20:43 user nova-compute[74683]: INFO nova.scheduler.client.report [None req-9f51d02e-e9c1-4376-8c2d-871b9a3707ec tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Deleted allocations for instance 2f1db5e2-0b25-4d61-9dd3-038811b4eda1
Oct 16 11:20:43 user nova-compute[74683]: DEBUG nova.compute.manager [req-edbdeabf-dcae-4559-ab62-74e949ecc40a req-1a5fbc47-6739-4bd9-bfb9-dba3a3a178cc service nova] [instance: 2f1db5e2-0b25-4d61-9dd3-038811b4eda1] Received event network-vif-deleted-9476563e-0758-43d9-b920-87f412881869 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:20:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9f51d02e-e9c1-4376-8c2d-871b9a3707ec tempest-ServerStableDeviceRescueTest-2038287775 tempest-ServerStableDeviceRescueTest-2038287775-project-member] Lock "2f1db5e2-0b25-4d61-9dd3-038811b4eda1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.284s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:20:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:49 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Acquiring lock "ddb55617-a6a9-40f9-b2ff-b2b626f149ab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:20:49 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "ddb55617-a6a9-40f9-b2ff-b2b626f149ab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:20:49 user nova-compute[74683]: DEBUG nova.compute.manager [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Starting instance... {{(pid=74683) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 11:20:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:20:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:20:50 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74683) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 11:20:50 user nova-compute[74683]: INFO nova.compute.claims [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Claim successful on node user
Oct 16 11:20:50 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:20:50 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:20:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.351s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:20:50 user nova-compute[74683]: DEBUG nova.compute.manager [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Start building networks asynchronously for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 11:20:50 user nova-compute[74683]: DEBUG nova.compute.manager [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Allocating IP information in the background. {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 11:20:50 user nova-compute[74683]: DEBUG nova.network.neutron [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] allocate_for_instance() {{(pid=74683) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 11:20:50 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 11:20:50 user nova-compute[74683]: DEBUG nova.compute.manager [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Start building block device mappings for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 11:20:50 user nova-compute[74683]: DEBUG nova.policy [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cdc203c025d84efe86e25cfdf75107b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c66aa774134aa6a873eabffc28ec07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74683) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 11:20:50 user nova-compute[74683]: DEBUG nova.compute.manager [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Start spawning the instance on the hypervisor. {{(pid=74683) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 11:20:50 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Creating instance directory {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 11:20:50 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Creating image(s)
Oct 16 11:20:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Acquiring lock "/opt/stack/data/nova/instances/ddb55617-a6a9-40f9-b2ff-b2b626f149ab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:20:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "/opt/stack/data/nova/instances/ddb55617-a6a9-40f9-b2ff-b2b626f149ab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:20:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "/opt/stack/data/nova/instances/ddb55617-a6a9-40f9-b2ff-b2b626f149ab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:20:50 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:50 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.231s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Acquiring lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:20:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:20:50 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:51 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.187s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:51 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/ddb55617-a6a9-40f9-b2ff-b2b626f149ab/disk 1073741824 {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:51 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/ddb55617-a6a9-40f9-b2ff-b2b626f149ab/disk 1073741824" returned: 0 in 0.055s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:51 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:20:51 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:51 user nova-compute[74683]: DEBUG nova.network.neutron [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Successfully created port: 027ef7bc-bc4d-4668-9e74-58cc707b99d8 {{(pid=74683) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 11:20:51 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.184s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:51 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ddb55617-a6a9-40f9-b2ff-b2b626f149ab/disk. size=1073741824 {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 11:20:51 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddb55617-a6a9-40f9-b2ff-b2b626f149ab/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:20:51 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddb55617-a6a9-40f9-b2ff-b2b626f149ab/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:20:51 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Cannot resize image /opt/stack/data/nova/instances/ddb55617-a6a9-40f9-b2ff-b2b626f149ab/disk to a smaller size. {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 11:20:51 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Created local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 11:20:51 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Ensure instance console log exists: /opt/stack/data/nova/instances/ddb55617-a6a9-40f9-b2ff-b2b626f149ab/console.log {{(pid=74683) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 11:20:51 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:20:51 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:20:51 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:20:51 user nova-compute[74683]: DEBUG nova.network.neutron [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Successfully updated port: 027ef7bc-bc4d-4668-9e74-58cc707b99d8 {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:20:51 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Acquiring lock "refresh_cache-ddb55617-a6a9-40f9-b2ff-b2b626f149ab" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:20:51 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Acquired lock "refresh_cache-ddb55617-a6a9-40f9-b2ff-b2b626f149ab" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:20:51 user nova-compute[74683]: DEBUG nova.network.neutron [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:20:51 user nova-compute[74683]: DEBUG nova.compute.manager [req-c6f74c3f-955a-45da-9249-16776f445818 req-06775ccb-c1e5-4293-b812-ec7bec0f9fee service nova] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Received event network-changed-027ef7bc-bc4d-4668-9e74-58cc707b99d8 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:20:51 user nova-compute[74683]: DEBUG nova.compute.manager [req-c6f74c3f-955a-45da-9249-16776f445818 req-06775ccb-c1e5-4293-b812-ec7bec0f9fee service nova] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Refreshing instance network info cache due to event network-changed-027ef7bc-bc4d-4668-9e74-58cc707b99d8. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:20:51 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c6f74c3f-955a-45da-9249-16776f445818 req-06775ccb-c1e5-4293-b812-ec7bec0f9fee service nova] Acquiring lock "refresh_cache-ddb55617-a6a9-40f9-b2ff-b2b626f149ab" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:20:51 user nova-compute[74683]: DEBUG nova.network.neutron [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:20:52 user nova-compute[74683]: DEBUG nova.network.neutron [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Updating instance_info_cache with network_info: [{"id": "027ef7bc-bc4d-4668-9e74-58cc707b99d8", "address": "fa:16:3e:34:9b:23", "network": {"id": "f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-137528169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c66aa774134aa6a873eabffc28ec07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap027ef7bc-bc", "ovs_interfaceid": "027ef7bc-bc4d-4668-9e74-58cc707b99d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:20:52 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Releasing lock "refresh_cache-ddb55617-a6a9-40f9-b2ff-b2b626f149ab" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:20:52 user nova-compute[74683]: DEBUG nova.compute.manager [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Instance network_info: |[{"id": "027ef7bc-bc4d-4668-9e74-58cc707b99d8", "address": "fa:16:3e:34:9b:23", "network": {"id": "f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-137528169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c66aa774134aa6a873eabffc28ec07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap027ef7bc-bc", "ovs_interfaceid": "027ef7bc-bc4d-4668-9e74-58cc707b99d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 11:20:52 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c6f74c3f-955a-45da-9249-16776f445818 req-06775ccb-c1e5-4293-b812-ec7bec0f9fee service nova] Acquired lock "refresh_cache-ddb55617-a6a9-40f9-b2ff-b2b626f149ab" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:20:52 user nova-compute[74683]: DEBUG nova.network.neutron [req-c6f74c3f-955a-45da-9249-16776f445818 req-06775ccb-c1e5-4293-b812-ec7bec0f9fee service nova] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Refreshing network info cache for port 027ef7bc-bc4d-4668-9e74-58cc707b99d8 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:20:52 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Start _get_guest_xml network_info=[{"id": "027ef7bc-bc4d-4668-9e74-58cc707b99d8", "address": "fa:16:3e:34:9b:23", "network": {"id": "f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-137528169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c66aa774134aa6a873eabffc28ec07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap027ef7bc-bc", "ovs_interfaceid": "027ef7bc-bc4d-4668-9e74-58cc707b99d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:20:52 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:20:52 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:20:52 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:20:52 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:20:52 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:20:52 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:20:52 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:20:52 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:20:52 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:20:52 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:20:52 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:20:52 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:20:52 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:20:52 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:20:52 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:20:52 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:20:52 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:20:52 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:20:52 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:20:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-467008345',display_name='tempest-AttachVolumeNegativeTest-server-467008345',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-467008345',id=19,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDu+D6rI4EEeIVo+0j8q2sc/Z3foRziPciTIQsH5ccfIp/5lh01xYiabgBMALsQdUh1Vh08s9YY3GzoSeik+vZXkup2ugwTiDv+6fF5IKsmbUMHCBWP6BpsK1XRjkAvDOg==',key_name='tempest-keypair-524558883',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72c66aa774134aa6a873eabffc28ec07',ramdisk_id='',reservation_id='r-lud73uv8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-845934820',owner_user_name='tempest-AttachVolumeNegativeTest-845934820-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:20:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cdc203c025d84efe86e25cfdf75107b8',uuid=ddb55617-a6a9-40f9-b2ff-b2b626f149ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "027ef7bc-bc4d-4668-9e74-58cc707b99d8", "address": "fa:16:3e:34:9b:23", "network": {"id": "f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-137528169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c66aa774134aa6a873eabffc28ec07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap027ef7bc-bc", "ovs_interfaceid": "027ef7bc-bc4d-4668-9e74-58cc707b99d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:20:52 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Converting VIF {"id": "027ef7bc-bc4d-4668-9e74-58cc707b99d8", "address": "fa:16:3e:34:9b:23", "network": {"id": "f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-137528169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c66aa774134aa6a873eabffc28ec07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap027ef7bc-bc", "ovs_interfaceid": "027ef7bc-bc4d-4668-9e74-58cc707b99d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:20:52 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:9b:23,bridge_name='br-int',has_traffic_filtering=True,id=027ef7bc-bc4d-4668-9e74-58cc707b99d8,network=Network(f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap027ef7bc-bc') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:20:52 user nova-compute[74683]: DEBUG nova.objects.instance [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lazy-loading 'pci_devices' on Instance uuid ddb55617-a6a9-40f9-b2ff-b2b626f149ab {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:20:52 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:20:52 user nova-compute[74683]:   <uuid>ddb55617-a6a9-40f9-b2ff-b2b626f149ab</uuid>
Oct 16 11:20:52 user nova-compute[74683]:   <name>instance-00000013</name>
Oct 16 11:20:52 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:20:52 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:20:52 user nova-compute[74683]:   <metadata>
Oct 16 11:20:52 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:20:52 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:20:52 user nova-compute[74683]:       <nova:name>tempest-AttachVolumeNegativeTest-server-467008345</nova:name>
Oct 16 11:20:52 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:20:52</nova:creationTime>
Oct 16 11:20:52 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:20:52 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:20:52 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:20:52 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:20:52 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:20:52 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:20:52 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:20:52 user nova-compute[74683]:       <nova:owner>
Oct 16 11:20:52 user nova-compute[74683]:         <nova:user uuid="cdc203c025d84efe86e25cfdf75107b8">tempest-AttachVolumeNegativeTest-845934820-project-member</nova:user>
Oct 16 11:20:52 user nova-compute[74683]:         <nova:project uuid="72c66aa774134aa6a873eabffc28ec07">tempest-AttachVolumeNegativeTest-845934820</nova:project>
Oct 16 11:20:52 user nova-compute[74683]:       </nova:owner>
Oct 16 11:20:52 user nova-compute[74683]:       <nova:root type="image" uuid="0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f"/>
Oct 16 11:20:52 user nova-compute[74683]:       <nova:ports>
Oct 16 11:20:52 user nova-compute[74683]:         <nova:port uuid="027ef7bc-bc4d-4668-9e74-58cc707b99d8">
Oct 16 11:20:52 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 16 11:20:52 user nova-compute[74683]:         </nova:port>
Oct 16 11:20:52 user nova-compute[74683]:       </nova:ports>
Oct 16 11:20:52 user nova-compute[74683]:     </nova:instance>
Oct 16 11:20:52 user nova-compute[74683]:   </metadata>
Oct 16 11:20:52 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:20:52 user nova-compute[74683]:     <system>
Oct 16 11:20:52 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:20:52 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:20:52 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:20:52 user nova-compute[74683]:       <entry name="serial">ddb55617-a6a9-40f9-b2ff-b2b626f149ab</entry>
Oct 16 11:20:52 user nova-compute[74683]:       <entry name="uuid">ddb55617-a6a9-40f9-b2ff-b2b626f149ab</entry>
Oct 16 11:20:52 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:20:52 user nova-compute[74683]:     </system>
Oct 16 11:20:52 user nova-compute[74683]:   </sysinfo>
Oct 16 11:20:52 user nova-compute[74683]:   <os>
Oct 16 11:20:52 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:20:52 user nova-compute[74683]:     <boot dev="hd"/>
Oct 16 11:20:52 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:20:52 user nova-compute[74683]:   </os>
Oct 16 11:20:52 user nova-compute[74683]:   <features>
Oct 16 11:20:52 user nova-compute[74683]:     <acpi/>
Oct 16 11:20:52 user nova-compute[74683]:     <apic/>
Oct 16 11:20:52 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:20:52 user nova-compute[74683]:   </features>
Oct 16 11:20:52 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:20:52 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:20:52 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:20:52 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:20:52 user nova-compute[74683]:   </clock>
Oct 16 11:20:52 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:20:52 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:20:52 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:20:52 user nova-compute[74683]:   </cpu>
Oct 16 11:20:52 user nova-compute[74683]:   <devices>
Oct 16 11:20:52 user nova-compute[74683]:     <disk type="file" device="disk">
Oct 16 11:20:52 user nova-compute[74683]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 11:20:52 user nova-compute[74683]:       <source file="/opt/stack/data/nova/instances/ddb55617-a6a9-40f9-b2ff-b2b626f149ab/disk"/>
Oct 16 11:20:52 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:20:52 user nova-compute[74683]:     </disk>
Oct 16 11:20:52 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:20:52 user nova-compute[74683]:       <mac address="fa:16:3e:34:9b:23"/>
Oct 16 11:20:52 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:20:52 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:20:52 user nova-compute[74683]:       <target dev="tap027ef7bc-bc"/>
Oct 16 11:20:52 user nova-compute[74683]:     </interface>
Oct 16 11:20:52 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:20:52 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/ddb55617-a6a9-40f9-b2ff-b2b626f149ab/console.log" append="off"/>
Oct 16 11:20:52 user nova-compute[74683]:     </serial>
Oct 16 11:20:52 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:20:52 user nova-compute[74683]:     <video>
Oct 16 11:20:52 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:20:52 user nova-compute[74683]:     </video>
Oct 16 11:20:52 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:20:52 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:20:52 user nova-compute[74683]:     </rng>
Oct 16 11:20:52 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:20:52 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:20:52 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:20:52 user nova-compute[74683]:     </memballoon>
Oct 16 11:20:52 user nova-compute[74683]:   </devices>
Oct 16 11:20:52 user nova-compute[74683]: </domain>
Oct 16 11:20:52 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:20:52 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:20:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-467008345',display_name='tempest-AttachVolumeNegativeTest-server-467008345',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-467008345',id=19,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDu+D6rI4EEeIVo+0j8q2sc/Z3foRziPciTIQsH5ccfIp/5lh01xYiabgBMALsQdUh1Vh08s9YY3GzoSeik+vZXkup2ugwTiDv+6fF5IKsmbUMHCBWP6BpsK1XRjkAvDOg==',key_name='tempest-keypair-524558883',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72c66aa774134aa6a873eabffc28ec07',ramdisk_id='',reservation_id='r-lud73uv8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-845934820',owner_user_name='tempest-AttachVolumeNegativeTest-845934820-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:20:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cdc203c025d84efe86e25cfdf75107b8',uuid=ddb55617-a6a9-40f9-b2ff-b2b626f149ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "027ef7bc-bc4d-4668-9e74-58cc707b99d8", "address": "fa:16:3e:34:9b:23", "network": {"id": "f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-137528169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c66aa774134aa6a873eabffc28ec07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap027ef7bc-bc", "ovs_interfaceid": "027ef7bc-bc4d-4668-9e74-58cc707b99d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:20:52 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Converting VIF {"id": "027ef7bc-bc4d-4668-9e74-58cc707b99d8", "address": "fa:16:3e:34:9b:23", "network": {"id": "f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-137528169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c66aa774134aa6a873eabffc28ec07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap027ef7bc-bc", "ovs_interfaceid": "027ef7bc-bc4d-4668-9e74-58cc707b99d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:20:52 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:9b:23,bridge_name='br-int',has_traffic_filtering=True,id=027ef7bc-bc4d-4668-9e74-58cc707b99d8,network=Network(f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap027ef7bc-bc') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:20:52 user nova-compute[74683]: DEBUG os_vif [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:9b:23,bridge_name='br-int',has_traffic_filtering=True,id=027ef7bc-bc4d-4668-9e74-58cc707b99d8,network=Network(f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap027ef7bc-bc') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:20:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:20:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:20:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '77c40247-a130-535b-b37b-8533001d172e', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:20:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:20:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap027ef7bc-bc, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:20:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap027ef7bc-bc, col_values=(('qos', UUID('425ca763-12df-40fc-b40d-0fbd129dee37')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:20:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap027ef7bc-bc, col_values=(('external_ids', {'iface-id': '027ef7bc-bc4d-4668-9e74-58cc707b99d8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:9b:23', 'vm-uuid': 'ddb55617-a6a9-40f9-b2ff-b2b626f149ab'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:20:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:20:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:52 user nova-compute[74683]: INFO os_vif [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:9b:23,bridge_name='br-int',has_traffic_filtering=True,id=027ef7bc-bc4d-4668-9e74-58cc707b99d8,network=Network(f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap027ef7bc-bc')
Oct 16 11:20:52 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:20:52 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] No VIF found with MAC fa:16:3e:34:9b:23, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:20:52 user nova-compute[74683]: DEBUG nova.network.neutron [req-c6f74c3f-955a-45da-9249-16776f445818 req-06775ccb-c1e5-4293-b812-ec7bec0f9fee service nova] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Updated VIF entry in instance network info cache for port 027ef7bc-bc4d-4668-9e74-58cc707b99d8. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:20:52 user nova-compute[74683]: DEBUG nova.network.neutron [req-c6f74c3f-955a-45da-9249-16776f445818 req-06775ccb-c1e5-4293-b812-ec7bec0f9fee service nova] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Updating instance_info_cache with network_info: [{"id": "027ef7bc-bc4d-4668-9e74-58cc707b99d8", "address": "fa:16:3e:34:9b:23", "network": {"id": "f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-137528169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c66aa774134aa6a873eabffc28ec07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap027ef7bc-bc", "ovs_interfaceid": "027ef7bc-bc4d-4668-9e74-58cc707b99d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:20:52 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c6f74c3f-955a-45da-9249-16776f445818 req-06775ccb-c1e5-4293-b812-ec7bec0f9fee service nova] Releasing lock "refresh_cache-ddb55617-a6a9-40f9-b2ff-b2b626f149ab" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:20:53 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:53 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:53 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:53 user nova-compute[74683]: DEBUG nova.compute.manager [req-6ea821a6-4bc3-43d2-842a-22bd12e62b00 req-f603d65e-d37c-4d4c-a072-c0ebf9e32124 service nova] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Received event network-vif-plugged-027ef7bc-bc4d-4668-9e74-58cc707b99d8 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:20:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-6ea821a6-4bc3-43d2-842a-22bd12e62b00 req-f603d65e-d37c-4d4c-a072-c0ebf9e32124 service nova] Acquiring lock "ddb55617-a6a9-40f9-b2ff-b2b626f149ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:20:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-6ea821a6-4bc3-43d2-842a-22bd12e62b00 req-f603d65e-d37c-4d4c-a072-c0ebf9e32124 service nova] Lock "ddb55617-a6a9-40f9-b2ff-b2b626f149ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:20:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-6ea821a6-4bc3-43d2-842a-22bd12e62b00 req-f603d65e-d37c-4d4c-a072-c0ebf9e32124 service nova] Lock "ddb55617-a6a9-40f9-b2ff-b2b626f149ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:20:53 user nova-compute[74683]: DEBUG nova.compute.manager [req-6ea821a6-4bc3-43d2-842a-22bd12e62b00 req-f603d65e-d37c-4d4c-a072-c0ebf9e32124 service nova] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] No waiting events found dispatching network-vif-plugged-027ef7bc-bc4d-4668-9e74-58cc707b99d8 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:20:53 user nova-compute[74683]: WARNING nova.compute.manager [req-6ea821a6-4bc3-43d2-842a-22bd12e62b00 req-f603d65e-d37c-4d4c-a072-c0ebf9e32124 service nova] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Received unexpected event network-vif-plugged-027ef7bc-bc4d-4668-9e74-58cc707b99d8 for instance with vm_state building and task_state spawning.
Oct 16 11:20:54 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:54 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:54 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:55 user nova-compute[74683]: DEBUG nova.compute.manager [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Instance event wait completed in 0 seconds for  {{(pid=74683) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 11:20:55 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Guest created on hypervisor {{(pid=74683) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 11:20:55 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Instance spawned successfully.
Oct 16 11:20:55 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 11:20:55 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Found default for hw_cdrom_bus of ide {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:20:55 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Found default for hw_disk_bus of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:20:55 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Found default for hw_input_bus of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:20:55 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Found default for hw_pointer_model of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:20:55 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Found default for hw_video_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:20:55 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Found default for hw_vif_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:20:55 user nova-compute[74683]: INFO nova.compute.manager [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Took 5.36 seconds to spawn the instance on the hypervisor.
Oct 16 11:20:55 user nova-compute[74683]: DEBUG nova.compute.manager [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:20:55 user nova-compute[74683]: DEBUG nova.compute.manager [req-2b6409da-54d3-4958-aa5c-fc970cea2523 req-3b2c2783-f692-4fce-9d12-b1a736a71cd7 service nova] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Received event network-vif-plugged-027ef7bc-bc4d-4668-9e74-58cc707b99d8 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:20:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-2b6409da-54d3-4958-aa5c-fc970cea2523 req-3b2c2783-f692-4fce-9d12-b1a736a71cd7 service nova] Acquiring lock "ddb55617-a6a9-40f9-b2ff-b2b626f149ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:20:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-2b6409da-54d3-4958-aa5c-fc970cea2523 req-3b2c2783-f692-4fce-9d12-b1a736a71cd7 service nova] Lock "ddb55617-a6a9-40f9-b2ff-b2b626f149ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:20:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-2b6409da-54d3-4958-aa5c-fc970cea2523 req-3b2c2783-f692-4fce-9d12-b1a736a71cd7 service nova] Lock "ddb55617-a6a9-40f9-b2ff-b2b626f149ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:20:55 user nova-compute[74683]: DEBUG nova.compute.manager [req-2b6409da-54d3-4958-aa5c-fc970cea2523 req-3b2c2783-f692-4fce-9d12-b1a736a71cd7 service nova] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] No waiting events found dispatching network-vif-plugged-027ef7bc-bc4d-4668-9e74-58cc707b99d8 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:20:55 user nova-compute[74683]: WARNING nova.compute.manager [req-2b6409da-54d3-4958-aa5c-fc970cea2523 req-3b2c2783-f692-4fce-9d12-b1a736a71cd7 service nova] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Received unexpected event network-vif-plugged-027ef7bc-bc4d-4668-9e74-58cc707b99d8 for instance with vm_state building and task_state spawning.
Oct 16 11:20:56 user nova-compute[74683]: INFO nova.compute.manager [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Took 6.03 seconds to build instance.
Oct 16 11:20:56 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-fc744483-5bc1-4981-b4d7-079d1467ea79 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "ddb55617-a6a9-40f9-b2ff-b2b626f149ab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.143s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:20:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f81c8525-cb0a-4053-8901-80b0adc75955 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Acquiring lock "9ae15ce7-996c-460f-a901-1570a2012af1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:20:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f81c8525-cb0a-4053-8901-80b0adc75955 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Lock "9ae15ce7-996c-460f-a901-1570a2012af1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:20:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f81c8525-cb0a-4053-8901-80b0adc75955 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Acquiring lock "9ae15ce7-996c-460f-a901-1570a2012af1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:20:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f81c8525-cb0a-4053-8901-80b0adc75955 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Lock "9ae15ce7-996c-460f-a901-1570a2012af1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:20:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f81c8525-cb0a-4053-8901-80b0adc75955 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Lock "9ae15ce7-996c-460f-a901-1570a2012af1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:20:57 user nova-compute[74683]: INFO nova.compute.manager [None req-f81c8525-cb0a-4053-8901-80b0adc75955 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Terminating instance
Oct 16 11:20:57 user nova-compute[74683]: DEBUG nova.compute.manager [None req-f81c8525-cb0a-4053-8901-80b0adc75955 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Start destroying the instance on the hypervisor. {{(pid=74683) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 11:20:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:57 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Instance destroyed successfully.
Oct 16 11:20:57 user nova-compute[74683]: DEBUG nova.objects.instance [None req-f81c8525-cb0a-4053-8901-80b0adc75955 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Lazy-loading 'resources' on Instance uuid 9ae15ce7-996c-460f-a901-1570a2012af1 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:20:57 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-f81c8525-cb0a-4053-8901-80b0adc75955 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T11:17:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-717081521',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-717081521',id=14,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8efJVroKVuigryD4GSp1jU2h74/46LP7zUTBq1YNdoS9sGz/cMTsYXKQK2+Lj6yR1spH3hPAhB6Y4h51NvH2BYFIARH1zI9goHYvZdEeIkuG1XUEV0yYBKVJjNs/qPig==',key_name='tempest-keypair-1457686750',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:17:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5042cdda42b74341b6c592437b6bbdbf',ramdisk_id='',reservation_id='r-ezaz9z78',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2119065928',owner_user_name='tempest-TaggedAttachmentsTest-2119065928-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:17:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ceb56d9dc1b04324adfd4f8d0b1a9766',uuid=9ae15ce7-996c-460f-a901-1570a2012af1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84d9dc84-2273-4e6b-a8fe-9a94bddd198c", "address": "fa:16:3e:07:96:fd", "network": {"id": "33b6ba99-0d95-497e-a744-1ae84c9d63e1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-240536039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5042cdda42b74341b6c592437b6bbdbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d9dc84-22", "ovs_interfaceid": "84d9dc84-2273-4e6b-a8fe-9a94bddd198c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:20:57 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-f81c8525-cb0a-4053-8901-80b0adc75955 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Converting VIF {"id": "84d9dc84-2273-4e6b-a8fe-9a94bddd198c", "address": "fa:16:3e:07:96:fd", "network": {"id": "33b6ba99-0d95-497e-a744-1ae84c9d63e1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-240536039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5042cdda42b74341b6c592437b6bbdbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d9dc84-22", "ovs_interfaceid": "84d9dc84-2273-4e6b-a8fe-9a94bddd198c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:20:57 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-f81c8525-cb0a-4053-8901-80b0adc75955 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:96:fd,bridge_name='br-int',has_traffic_filtering=True,id=84d9dc84-2273-4e6b-a8fe-9a94bddd198c,network=Network(33b6ba99-0d95-497e-a744-1ae84c9d63e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d9dc84-22') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:20:57 user nova-compute[74683]: DEBUG os_vif [None req-f81c8525-cb0a-4053-8901-80b0adc75955 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:96:fd,bridge_name='br-int',has_traffic_filtering=True,id=84d9dc84-2273-4e6b-a8fe-9a94bddd198c,network=Network(33b6ba99-0d95-497e-a744-1ae84c9d63e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d9dc84-22') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:20:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84d9dc84-22, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:20:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0e407abb-8bb6-454a-b980-eeb680679090) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:20:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:57 user nova-compute[74683]: INFO os_vif [None req-f81c8525-cb0a-4053-8901-80b0adc75955 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:96:fd,bridge_name='br-int',has_traffic_filtering=True,id=84d9dc84-2273-4e6b-a8fe-9a94bddd198c,network=Network(33b6ba99-0d95-497e-a744-1ae84c9d63e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d9dc84-22')
Oct 16 11:20:57 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-f81c8525-cb0a-4053-8901-80b0adc75955 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Deleting instance files /opt/stack/data/nova/instances/9ae15ce7-996c-460f-a901-1570a2012af1_del
Oct 16 11:20:57 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-f81c8525-cb0a-4053-8901-80b0adc75955 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Deletion of /opt/stack/data/nova/instances/9ae15ce7-996c-460f-a901-1570a2012af1_del complete
Oct 16 11:20:57 user nova-compute[74683]: INFO nova.compute.manager [None req-f81c8525-cb0a-4053-8901-80b0adc75955 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Took 0.92 seconds to destroy the instance on the hypervisor.
Oct 16 11:20:57 user nova-compute[74683]: DEBUG oslo.service.loopingcall [None req-f81c8525-cb0a-4053-8901-80b0adc75955 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74683) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 11:20:57 user nova-compute[74683]: DEBUG nova.compute.manager [-] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Deallocating network for instance {{(pid=74683) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 11:20:57 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] deallocate_for_instance() {{(pid=74683) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 11:20:58 user nova-compute[74683]: DEBUG nova.compute.manager [req-180a648c-43c8-407b-9922-a259d21b658b req-c5584d83-1004-47e4-b53a-580de12d8f60 service nova] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Received event network-vif-unplugged-84d9dc84-2273-4e6b-a8fe-9a94bddd198c {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:20:58 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-180a648c-43c8-407b-9922-a259d21b658b req-c5584d83-1004-47e4-b53a-580de12d8f60 service nova] Acquiring lock "9ae15ce7-996c-460f-a901-1570a2012af1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:20:58 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-180a648c-43c8-407b-9922-a259d21b658b req-c5584d83-1004-47e4-b53a-580de12d8f60 service nova] Lock "9ae15ce7-996c-460f-a901-1570a2012af1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:20:58 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-180a648c-43c8-407b-9922-a259d21b658b req-c5584d83-1004-47e4-b53a-580de12d8f60 service nova] Lock "9ae15ce7-996c-460f-a901-1570a2012af1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:20:58 user nova-compute[74683]: DEBUG nova.compute.manager [req-180a648c-43c8-407b-9922-a259d21b658b req-c5584d83-1004-47e4-b53a-580de12d8f60 service nova] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] No waiting events found dispatching network-vif-unplugged-84d9dc84-2273-4e6b-a8fe-9a94bddd198c {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:20:58 user nova-compute[74683]: DEBUG nova.compute.manager [req-180a648c-43c8-407b-9922-a259d21b658b req-c5584d83-1004-47e4-b53a-580de12d8f60 service nova] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Received event network-vif-unplugged-84d9dc84-2273-4e6b-a8fe-9a94bddd198c for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 11:20:58 user nova-compute[74683]: DEBUG nova.compute.manager [req-180a648c-43c8-407b-9922-a259d21b658b req-c5584d83-1004-47e4-b53a-580de12d8f60 service nova] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Received event network-vif-plugged-84d9dc84-2273-4e6b-a8fe-9a94bddd198c {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:20:58 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-180a648c-43c8-407b-9922-a259d21b658b req-c5584d83-1004-47e4-b53a-580de12d8f60 service nova] Acquiring lock "9ae15ce7-996c-460f-a901-1570a2012af1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:20:58 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-180a648c-43c8-407b-9922-a259d21b658b req-c5584d83-1004-47e4-b53a-580de12d8f60 service nova] Lock "9ae15ce7-996c-460f-a901-1570a2012af1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:20:58 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-180a648c-43c8-407b-9922-a259d21b658b req-c5584d83-1004-47e4-b53a-580de12d8f60 service nova] Lock "9ae15ce7-996c-460f-a901-1570a2012af1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:20:58 user nova-compute[74683]: DEBUG nova.compute.manager [req-180a648c-43c8-407b-9922-a259d21b658b req-c5584d83-1004-47e4-b53a-580de12d8f60 service nova] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] No waiting events found dispatching network-vif-plugged-84d9dc84-2273-4e6b-a8fe-9a94bddd198c {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:20:58 user nova-compute[74683]: WARNING nova.compute.manager [req-180a648c-43c8-407b-9922-a259d21b658b req-c5584d83-1004-47e4-b53a-580de12d8f60 service nova] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Received unexpected event network-vif-plugged-84d9dc84-2273-4e6b-a8fe-9a94bddd198c for instance with vm_state active and task_state deleting.
Oct 16 11:20:58 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:20:58 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:20:58 user nova-compute[74683]: INFO nova.compute.manager [-] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Took 0.89 seconds to deallocate network for instance.
Oct 16 11:20:58 user nova-compute[74683]: DEBUG nova.compute.manager [req-c743dda6-2461-45e6-9ae3-e85538e35871 req-456e6ab6-a6a2-4152-a91a-9e99544b56ca service nova] [instance: 9ae15ce7-996c-460f-a901-1570a2012af1] Received event network-vif-deleted-84d9dc84-2273-4e6b-a8fe-9a94bddd198c {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:20:58 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f81c8525-cb0a-4053-8901-80b0adc75955 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:20:58 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f81c8525-cb0a-4053-8901-80b0adc75955 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:20:59 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-f81c8525-cb0a-4053-8901-80b0adc75955 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:20:59 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-f81c8525-cb0a-4053-8901-80b0adc75955 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:20:59 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f81c8525-cb0a-4053-8901-80b0adc75955 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.294s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:20:59 user nova-compute[74683]: INFO nova.scheduler.client.report [None req-f81c8525-cb0a-4053-8901-80b0adc75955 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Deleted allocations for instance 9ae15ce7-996c-460f-a901-1570a2012af1
Oct 16 11:20:59 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f81c8525-cb0a-4053-8901-80b0adc75955 tempest-TaggedAttachmentsTest-2119065928 tempest-TaggedAttachmentsTest-2119065928-project-member] Lock "9ae15ce7-996c-460f-a901-1570a2012af1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.322s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:21:01 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:06 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:21:06 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:21:06 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:21:06 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:21:06 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:21:06 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Starting heal instance info cache {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 11:21:06 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Rebuilding the list of instances to heal {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 11:21:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "refresh_cache-18a77385-fab9-4ea0-8aa6-666cf7e798a6" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:21:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquired lock "refresh_cache-18a77385-fab9-4ea0-8aa6-666cf7e798a6" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:21:06 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Forcefully refreshing network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 11:21:06 user nova-compute[74683]: DEBUG nova.objects.instance [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lazy-loading 'info_cache' on Instance uuid 18a77385-fab9-4ea0-8aa6-666cf7e798a6 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:21:07 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Updating instance_info_cache with network_info: [{"id": "fab663e7-134f-4cde-8cf1-2ccb1c83a812", "address": "fa:16:3e:8c:d5:b1", "network": {"id": "4d43cc12-d2cd-4552-90a4-884a0ff3dc66", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-825513246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6e0046017b4bba85caf2a39d1c67b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfab663e7-13", "ovs_interfaceid": "fab663e7-134f-4cde-8cf1-2ccb1c83a812", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:21:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Releasing lock "refresh_cache-18a77385-fab9-4ea0-8aa6-666cf7e798a6" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:21:07 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Updated the network info_cache for instance {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 11:21:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:07 user nova-compute[74683]: DEBUG nova.compute.manager [req-7ff80895-c7ef-40d8-9042-8deaa6c19ff1 req-e88eb7cc-03e3-4eee-93eb-849b91db260e service nova] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Received event network-changed-f57bee45-4d7d-4d93-ab04-0777c2d47ec2 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:21:07 user nova-compute[74683]: DEBUG nova.compute.manager [req-7ff80895-c7ef-40d8-9042-8deaa6c19ff1 req-e88eb7cc-03e3-4eee-93eb-849b91db260e service nova] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Refreshing instance network info cache due to event network-changed-f57bee45-4d7d-4d93-ab04-0777c2d47ec2. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:21:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-7ff80895-c7ef-40d8-9042-8deaa6c19ff1 req-e88eb7cc-03e3-4eee-93eb-849b91db260e service nova] Acquiring lock "refresh_cache-e84bb680-a542-4cb2-b0c5-67a210c25e9e" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:21:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-7ff80895-c7ef-40d8-9042-8deaa6c19ff1 req-e88eb7cc-03e3-4eee-93eb-849b91db260e service nova] Acquired lock "refresh_cache-e84bb680-a542-4cb2-b0c5-67a210c25e9e" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:21:07 user nova-compute[74683]: DEBUG nova.network.neutron [req-7ff80895-c7ef-40d8-9042-8deaa6c19ff1 req-e88eb7cc-03e3-4eee-93eb-849b91db260e service nova] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Refreshing network info cache for port f57bee45-4d7d-4d93-ab04-0777c2d47ec2 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:21:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b549dfa5-bf25-4b44-8c02-a923e193cd77 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Acquiring lock "e84bb680-a542-4cb2-b0c5-67a210c25e9e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:21:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b549dfa5-bf25-4b44-8c02-a923e193cd77 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Lock "e84bb680-a542-4cb2-b0c5-67a210c25e9e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:21:08 user nova-compute[74683]: DEBUG nova.objects.instance [None req-b549dfa5-bf25-4b44-8c02-a923e193cd77 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Lazy-loading 'flavor' on Instance uuid e84bb680-a542-4cb2-b0c5-67a210c25e9e {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:21:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b549dfa5-bf25-4b44-8c02-a923e193cd77 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Lock "e84bb680-a542-4cb2-b0c5-67a210c25e9e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:21:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b549dfa5-bf25-4b44-8c02-a923e193cd77 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Acquiring lock "e84bb680-a542-4cb2-b0c5-67a210c25e9e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:21:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b549dfa5-bf25-4b44-8c02-a923e193cd77 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Lock "e84bb680-a542-4cb2-b0c5-67a210c25e9e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:21:08 user nova-compute[74683]: INFO nova.compute.manager [None req-b549dfa5-bf25-4b44-8c02-a923e193cd77 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Attaching volume 25c3b8d2-beea-4362-8602-5134c21ac2ff to /dev/vdb
Oct 16 11:21:08 user nova-compute[74683]: DEBUG os_brick.utils [None req-b549dfa5-bf25-4b44-8c02-a923e193cd77 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:21:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:21:08 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e7254e-a259-4282-81de-1c107825081b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:70b9d336ab7d\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:21:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:21:08 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c0ede8-fcc6-45e5-8b2d-1a0f882a6301]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:21:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:21:08 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1040adf-3f02-4866-817e-25f265d12a07]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:21:08 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[116eae27-062f-49ad-ba51-c7a2aba5f957]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:21:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b549dfa5-bf25-4b44-8c02-a923e193cd77 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Running cmd (subprocess): nvme version {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b549dfa5-bf25-4b44-8c02-a923e193cd77 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] 'nvme version' failed. Not Retrying. {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:21:08 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b549dfa5-bf25-4b44-8c02-a923e193cd77 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] nvme not present on system {{(pid=74683) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 11:21:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:21:08 user nova-compute[74683]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 11:21:08 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5f8247-a908-4a35-8611-1cec61f47ffe]: (4, '') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:21:08 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-b549dfa5-bf25-4b44-8c02-a923e193cd77 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74683) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 11:21:08 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-b549dfa5-bf25-4b44-8c02-a923e193cd77 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 11:21:08 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-b549dfa5-bf25-4b44-8c02-a923e193cd77 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] LIGHTOS: no hostnqn found. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 11:21:08 user nova-compute[74683]: DEBUG os_brick.utils [None req-b549dfa5-bf25-4b44-8c02-a923e193cd77 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:70b9d336ab7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:21:08 user nova-compute[74683]: DEBUG nova.virt.block_device [None req-b549dfa5-bf25-4b44-8c02-a923e193cd77 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Updating existing volume attachment record: c249bd07-d9c0-4202-a68f-1e5c8e92bde4 {{(pid=74683) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 11:21:08 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:21:08 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:21:08 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:21:08 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74683) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 11:21:08 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:21:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:21:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:21:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:21:08 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Auditing locally available compute resources for user (node: user) {{(pid=74683) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 11:21:08 user nova-compute[74683]: DEBUG nova.network.neutron [req-7ff80895-c7ef-40d8-9042-8deaa6c19ff1 req-e88eb7cc-03e3-4eee-93eb-849b91db260e service nova] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Updated VIF entry in instance network info cache for port f57bee45-4d7d-4d93-ab04-0777c2d47ec2. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:21:08 user nova-compute[74683]: DEBUG nova.network.neutron [req-7ff80895-c7ef-40d8-9042-8deaa6c19ff1 req-e88eb7cc-03e3-4eee-93eb-849b91db260e service nova] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Updating instance_info_cache with network_info: [{"id": "f57bee45-4d7d-4d93-ab04-0777c2d47ec2", "address": "fa:16:3e:80:bd:6c", "network": {"id": "9fca81bc-e1d4-4e04-83d3-e2a85af3b114", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1394655085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae0f6604619241b798a0043f73efd6df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf57bee45-4d", "ovs_interfaceid": "f57bee45-4d7d-4d93-ab04-0777c2d47ec2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:21:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-7ff80895-c7ef-40d8-9042-8deaa6c19ff1 req-e88eb7cc-03e3-4eee-93eb-849b91db260e service nova] Releasing lock "refresh_cache-e84bb680-a542-4cb2-b0c5-67a210c25e9e" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:21:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:21:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:21:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:21:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:21:09 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:21:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84bb680-a542-4cb2-b0c5-67a210c25e9e/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84bb680-a542-4cb2-b0c5-67a210c25e9e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:21:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84bb680-a542-4cb2-b0c5-67a210c25e9e/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84bb680-a542-4cb2-b0c5-67a210c25e9e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:21:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddb55617-a6a9-40f9-b2ff-b2b626f149ab/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddb55617-a6a9-40f9-b2ff-b2b626f149ab/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:21:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddb55617-a6a9-40f9-b2ff-b2b626f149ab/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddb55617-a6a9-40f9-b2ff-b2b626f149ab/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:21:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45ca3cbb-53d6-4046-9be3-92cc6b71bfad/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45ca3cbb-53d6-4046-9be3-92cc6b71bfad/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:21:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45ca3cbb-53d6-4046-9be3-92cc6b71bfad/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45ca3cbb-53d6-4046-9be3-92cc6b71bfad/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:21:10 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:21:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:21:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:21:11 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:11 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:21:11 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:21:11 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Hypervisor/Node resource view: name=user free_ram=7852MB free_disk=25.391204833984375GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74683) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 11:21:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:21:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:21:11 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 18a77385-fab9-4ea0-8aa6-666cf7e798a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:21:11 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance d5e55361-d9ed-4d07-91b0-ec4d08b2e817 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:21:11 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance f192d1ec-311d-4a30-9766-361b27a8dae8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:21:11 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 45ca3cbb-53d6-4046-9be3-92cc6b71bfad actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:21:11 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance e84bb680-a542-4cb2-b0c5-67a210c25e9e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:21:11 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance edd01413-1f8a-49e3-aa3c-ecb19c62afae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:21:11 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance ddb55617-a6a9-40f9-b2ff-b2b626f149ab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:21:11 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 11:21:11 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 11:21:12 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:21:12 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:21:12 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Compute_service record updated for user:user {{(pid=74683) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 11:21:12 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.387s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:21:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:13 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:21:16 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:21 user nova-compute[74683]: DEBUG nova.compute.manager [None req-166a5472-1ea7-4cf5-b7fb-383762efdf37 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:21:21 user nova-compute[74683]: INFO nova.compute.manager [None req-166a5472-1ea7-4cf5-b7fb-383762efdf37 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] instance snapshotting
Oct 16 11:21:21 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-166a5472-1ea7-4cf5-b7fb-383762efdf37 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Beginning live snapshot process
Oct 16 11:21:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-166a5472-1ea7-4cf5-b7fb-383762efdf37 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45ca3cbb-53d6-4046-9be3-92cc6b71bfad/disk --force-share --output=json -f qcow2 {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-166a5472-1ea7-4cf5-b7fb-383762efdf37 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45ca3cbb-53d6-4046-9be3-92cc6b71bfad/disk --force-share --output=json -f qcow2" returned: 0 in 0.212s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:21:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-166a5472-1ea7-4cf5-b7fb-383762efdf37 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45ca3cbb-53d6-4046-9be3-92cc6b71bfad/disk --force-share --output=json -f qcow2 {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-166a5472-1ea7-4cf5-b7fb-383762efdf37 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45ca3cbb-53d6-4046-9be3-92cc6b71bfad/disk --force-share --output=json -f qcow2" returned: 0 in 0.191s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:21:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-166a5472-1ea7-4cf5-b7fb-383762efdf37 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-166a5472-1ea7-4cf5-b7fb-383762efdf37 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.176s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:21:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-166a5472-1ea7-4cf5-b7fb-383762efdf37 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp4z_ngxcg/0e691c97884243908155bd847924bdd6.delta 1073741824 {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-166a5472-1ea7-4cf5-b7fb-383762efdf37 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp4z_ngxcg/0e691c97884243908155bd847924bdd6.delta 1073741824" returned: 0 in 0.053s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:21:22 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-166a5472-1ea7-4cf5-b7fb-383762efdf37 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 16 11:21:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:23 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-166a5472-1ea7-4cf5-b7fb-383762efdf37 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74683) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 11:21:23 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-166a5472-1ea7-4cf5-b7fb-383762efdf37 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74683) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 11:21:23 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-166a5472-1ea7-4cf5-b7fb-383762efdf37 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 16 11:21:24 user nova-compute[74683]: DEBUG nova.privsep.utils [None req-166a5472-1ea7-4cf5-b7fb-383762efdf37 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74683) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 11:21:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-166a5472-1ea7-4cf5-b7fb-383762efdf37 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp4z_ngxcg/0e691c97884243908155bd847924bdd6.delta /opt/stack/data/nova/instances/snapshots/tmp4z_ngxcg/0e691c97884243908155bd847924bdd6 {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-166a5472-1ea7-4cf5-b7fb-383762efdf37 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp4z_ngxcg/0e691c97884243908155bd847924bdd6.delta /opt/stack/data/nova/instances/snapshots/tmp4z_ngxcg/0e691c97884243908155bd847924bdd6" returned: 0 in 0.724s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:21:24 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-166a5472-1ea7-4cf5-b7fb-383762efdf37 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Snapshot extracted, beginning image upload
Oct 16 11:21:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:27 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-166a5472-1ea7-4cf5-b7fb-383762efdf37 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Snapshot image upload complete
Oct 16 11:21:27 user nova-compute[74683]: INFO nova.compute.manager [None req-166a5472-1ea7-4cf5-b7fb-383762efdf37 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Took 5.54 seconds to snapshot the instance on the hypervisor.
Oct 16 11:21:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:28 user nova-compute[74683]: DEBUG nova.compute.manager [req-d231fa8b-3097-4458-8248-716e96c0f6b8 req-c51a0c7a-dbe8-4314-85b8-a3f61efde69b service nova] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Received event network-changed-7ba36bb4-91c7-42ee-b592-6653e63a1d50 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:21:28 user nova-compute[74683]: DEBUG nova.compute.manager [req-d231fa8b-3097-4458-8248-716e96c0f6b8 req-c51a0c7a-dbe8-4314-85b8-a3f61efde69b service nova] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Refreshing instance network info cache due to event network-changed-7ba36bb4-91c7-42ee-b592-6653e63a1d50. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:21:28 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-d231fa8b-3097-4458-8248-716e96c0f6b8 req-c51a0c7a-dbe8-4314-85b8-a3f61efde69b service nova] Acquiring lock "refresh_cache-edd01413-1f8a-49e3-aa3c-ecb19c62afae" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:21:28 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-d231fa8b-3097-4458-8248-716e96c0f6b8 req-c51a0c7a-dbe8-4314-85b8-a3f61efde69b service nova] Acquired lock "refresh_cache-edd01413-1f8a-49e3-aa3c-ecb19c62afae" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:21:28 user nova-compute[74683]: DEBUG nova.network.neutron [req-d231fa8b-3097-4458-8248-716e96c0f6b8 req-c51a0c7a-dbe8-4314-85b8-a3f61efde69b service nova] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Refreshing network info cache for port 7ba36bb4-91c7-42ee-b592-6653e63a1d50 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:21:29 user nova-compute[74683]: DEBUG nova.network.neutron [req-d231fa8b-3097-4458-8248-716e96c0f6b8 req-c51a0c7a-dbe8-4314-85b8-a3f61efde69b service nova] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Updated VIF entry in instance network info cache for port 7ba36bb4-91c7-42ee-b592-6653e63a1d50. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:21:29 user nova-compute[74683]: DEBUG nova.network.neutron [req-d231fa8b-3097-4458-8248-716e96c0f6b8 req-c51a0c7a-dbe8-4314-85b8-a3f61efde69b service nova] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Updating instance_info_cache with network_info: [{"id": "7ba36bb4-91c7-42ee-b592-6653e63a1d50", "address": "fa:16:3e:b4:d6:37", "network": {"id": "cd8cf08c-d79c-4d2e-b849-640c440e1498", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1091743670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcb8da41d6584a689e9b50155288aa5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba36bb4-91", "ovs_interfaceid": "7ba36bb4-91c7-42ee-b592-6653e63a1d50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:21:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-d231fa8b-3097-4458-8248-716e96c0f6b8 req-c51a0c7a-dbe8-4314-85b8-a3f61efde69b service nova] Releasing lock "refresh_cache-edd01413-1f8a-49e3-aa3c-ecb19c62afae" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:21:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Acquiring lock "7ced47a3-311d-4083-94e1-b2d42326e24d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:21:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lock "7ced47a3-311d-4083-94e1-b2d42326e24d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:21:29 user nova-compute[74683]: DEBUG nova.compute.manager [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Starting instance... {{(pid=74683) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 11:21:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:21:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:21:30 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74683) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 11:21:30 user nova-compute[74683]: INFO nova.compute.claims [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Claim successful on node user
Oct 16 11:21:30 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:21:30 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:21:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.563s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:21:30 user nova-compute[74683]: DEBUG nova.compute.manager [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Start building networks asynchronously for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 11:21:30 user nova-compute[74683]: DEBUG nova.compute.manager [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Allocating IP information in the background. {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 11:21:30 user nova-compute[74683]: DEBUG nova.network.neutron [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] allocate_for_instance() {{(pid=74683) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 11:21:30 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 11:21:30 user nova-compute[74683]: DEBUG nova.compute.manager [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Start building block device mappings for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 11:21:30 user nova-compute[74683]: DEBUG nova.policy [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ff1b11c3ed3b4ffdbe6a3feada64f5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377cd8de2ae042938a9072f64567a911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74683) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 11:21:30 user nova-compute[74683]: DEBUG nova.compute.manager [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Start spawning the instance on the hypervisor. {{(pid=74683) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 11:21:30 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Creating instance directory {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 11:21:30 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Creating image(s)
Oct 16 11:21:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Acquiring lock "/opt/stack/data/nova/instances/7ced47a3-311d-4083-94e1-b2d42326e24d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:21:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lock "/opt/stack/data/nova/instances/7ced47a3-311d-4083-94e1-b2d42326e24d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:21:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lock "/opt/stack/data/nova/instances/7ced47a3-311d-4083-94e1-b2d42326e24d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:21:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Acquiring lock "2183d85fa54afd2afaec3f5017aa7aba864f1ecf" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:21:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lock "2183d85fa54afd2afaec3f5017aa7aba864f1ecf" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:21:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:32 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2183d85fa54afd2afaec3f5017aa7aba864f1ecf.part --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:32 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquiring lock "b8b4a8e2-2c42-423d-954e-cab381506ca7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:21:32 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "b8b4a8e2-2c42-423d-954e-cab381506ca7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:21:32 user nova-compute[74683]: DEBUG nova.network.neutron [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Successfully created port: a94c53f7-4f4c-42e6-b121-9d309544dae8 {{(pid=74683) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 11:21:32 user nova-compute[74683]: DEBUG nova.compute.manager [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] Starting instance... {{(pid=74683) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 11:21:32 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2183d85fa54afd2afaec3f5017aa7aba864f1ecf.part --force-share --output=json" returned: 0 in 0.205s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:21:32 user nova-compute[74683]: DEBUG nova.virt.images [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] cd8467ed-4eb3-4557-be1f-e9de42bea9f9 was qcow2, converting to raw {{(pid=74683) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 16 11:21:32 user nova-compute[74683]: DEBUG nova.privsep.utils [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74683) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 11:21:32 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2183d85fa54afd2afaec3f5017aa7aba864f1ecf.part /opt/stack/data/nova/instances/_base/2183d85fa54afd2afaec3f5017aa7aba864f1ecf.converted {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:32 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:21:32 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:21:32 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74683) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 11:21:32 user nova-compute[74683]: INFO nova.compute.claims [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] Claim successful on node user
Oct 16 11:21:32 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2183d85fa54afd2afaec3f5017aa7aba864f1ecf.part /opt/stack/data/nova/instances/_base/2183d85fa54afd2afaec3f5017aa7aba864f1ecf.converted" returned: 0 in 0.277s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:21:32 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2183d85fa54afd2afaec3f5017aa7aba864f1ecf.converted --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2183d85fa54afd2afaec3f5017aa7aba864f1ecf.converted --force-share --output=json" returned: 0 in 0.201s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lock "2183d85fa54afd2afaec3f5017aa7aba864f1ecf" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.074s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2183d85fa54afd2afaec3f5017aa7aba864f1ecf --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG nova.network.neutron [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Successfully updated port: a94c53f7-4f4c-42e6-b121-9d309544dae8 {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Acquiring lock "refresh_cache-7ced47a3-311d-4083-94e1-b2d42326e24d" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Acquired lock "refresh_cache-7ced47a3-311d-4083-94e1-b2d42326e24d" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG nova.network.neutron [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.664s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG nova.compute.manager [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] Start building networks asynchronously for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG nova.compute.manager [req-5bfdb603-a31c-4bd5-8555-b20db98c7e02 req-436e47d0-0cef-4267-9dc1-a579864cdf69 service nova] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Received event network-changed-a94c53f7-4f4c-42e6-b121-9d309544dae8 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG nova.compute.manager [req-5bfdb603-a31c-4bd5-8555-b20db98c7e02 req-436e47d0-0cef-4267-9dc1-a579864cdf69 service nova] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Refreshing instance network info cache due to event network-changed-a94c53f7-4f4c-42e6-b121-9d309544dae8. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-5bfdb603-a31c-4bd5-8555-b20db98c7e02 req-436e47d0-0cef-4267-9dc1-a579864cdf69 service nova] Acquiring lock "refresh_cache-7ced47a3-311d-4083-94e1-b2d42326e24d" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG nova.network.neutron [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2183d85fa54afd2afaec3f5017aa7aba864f1ecf --force-share --output=json" returned: 0 in 0.246s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Acquiring lock "2183d85fa54afd2afaec3f5017aa7aba864f1ecf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lock "2183d85fa54afd2afaec3f5017aa7aba864f1ecf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2183d85fa54afd2afaec3f5017aa7aba864f1ecf --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG nova.compute.manager [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] Allocating IP information in the background. {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG nova.network.neutron [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] allocate_for_instance() {{(pid=74683) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 11:21:33 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 11:21:33 user nova-compute[74683]: DEBUG nova.compute.manager [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] Start building block device mappings for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG nova.policy [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a463a84e332543dfbc03b81518f82be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefabef9e42412f8309f490dcfecc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74683) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 11:21:33 user nova-compute[74683]: INFO nova.virt.block_device [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] Booting with volume snapshot 97e5caa1-ff57-4161-90be-6bda332927ec at /dev/vda
Oct 16 11:21:33 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2183d85fa54afd2afaec3f5017aa7aba864f1ecf --force-share --output=json" returned: 0 in 0.182s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2183d85fa54afd2afaec3f5017aa7aba864f1ecf,backing_fmt=raw /opt/stack/data/nova/instances/7ced47a3-311d-4083-94e1-b2d42326e24d/disk 1073741824 {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2183d85fa54afd2afaec3f5017aa7aba864f1ecf,backing_fmt=raw /opt/stack/data/nova/instances/7ced47a3-311d-4083-94e1-b2d42326e24d/disk 1073741824" returned: 0 in 0.064s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lock "2183d85fa54afd2afaec3f5017aa7aba864f1ecf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2183d85fa54afd2afaec3f5017aa7aba864f1ecf --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG nova.network.neutron [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Updating instance_info_cache with network_info: [{"id": "a94c53f7-4f4c-42e6-b121-9d309544dae8", "address": "fa:16:3e:33:b2:31", "network": {"id": "76ba31b5-c467-45e4-ae9a-111f41fd62a3", "bridge": "br-int", "label": "tempest-TestStampPattern-2049888281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "377cd8de2ae042938a9072f64567a911", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa94c53f7-4f", "ovs_interfaceid": "a94c53f7-4f4c-42e6-b121-9d309544dae8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Releasing lock "refresh_cache-7ced47a3-311d-4083-94e1-b2d42326e24d" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG nova.compute.manager [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Instance network_info: |[{"id": "a94c53f7-4f4c-42e6-b121-9d309544dae8", "address": "fa:16:3e:33:b2:31", "network": {"id": "76ba31b5-c467-45e4-ae9a-111f41fd62a3", "bridge": "br-int", "label": "tempest-TestStampPattern-2049888281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "377cd8de2ae042938a9072f64567a911", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa94c53f7-4f", "ovs_interfaceid": "a94c53f7-4f4c-42e6-b121-9d309544dae8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-5bfdb603-a31c-4bd5-8555-b20db98c7e02 req-436e47d0-0cef-4267-9dc1-a579864cdf69 service nova] Acquired lock "refresh_cache-7ced47a3-311d-4083-94e1-b2d42326e24d" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG nova.network.neutron [req-5bfdb603-a31c-4bd5-8555-b20db98c7e02 req-436e47d0-0cef-4267-9dc1-a579864cdf69 service nova] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Refreshing network info cache for port a94c53f7-4f4c-42e6-b121-9d309544dae8 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2183d85fa54afd2afaec3f5017aa7aba864f1ecf --force-share --output=json" returned: 0 in 0.197s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Created local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Ensure instance console log exists: /opt/stack/data/nova/instances/7ced47a3-311d-4083-94e1-b2d42326e24d/console.log {{(pid=74683) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Start _get_guest_xml network_info=[{"id": "a94c53f7-4f4c-42e6-b121-9d309544dae8", "address": "fa:16:3e:33:b2:31", "network": {"id": "76ba31b5-c467-45e4-ae9a-111f41fd62a3", "bridge": "br-int", "label": "tempest-TestStampPattern-2049888281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "377cd8de2ae042938a9072f64567a911", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa94c53f7-4f", "ovs_interfaceid": "a94c53f7-4f4c-42e6-b121-9d309544dae8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='eed8caa3591dbbc09a860f22a419003d',container_format='bare',created_at=2023-10-16T11:21:22Z,direct_url=<?>,disk_format='qcow2',id=cd8467ed-4eb3-4557-be1f-e9de42bea9f9,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1386454788',owner='377cd8de2ae042938a9072f64567a911',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-16T11:21:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': 'cd8467ed-4eb3-4557-be1f-e9de42bea9f9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:21:33 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:21:33 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:21:33 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='eed8caa3591dbbc09a860f22a419003d',container_format='bare',created_at=2023-10-16T11:21:22Z,direct_url=<?>,disk_format='qcow2',id=cd8467ed-4eb3-4557-be1f-e9de42bea9f9,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1386454788',owner='377cd8de2ae042938a9072f64567a911',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-16T11:21:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:21:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-537257495',display_name='tempest-TestStampPattern-server-537257495',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-537257495',id=20,image_ref='cd8467ed-4eb3-4557-be1f-e9de42bea9f9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFV+ROpInHshi5FjeDxPiEyFZ7Qvi9jeJ0//dAB7L9KvmXxPyMWLDkzIIO+4mTNqVHH1o36yJrMR626Ju/qnnIOZjnMoP87MpQ3Ptrg2AmfvntWHi+q/nHH1XQPsx2j/Gw==',key_name='tempest-TestStampPattern-1014736713',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='377cd8de2ae042938a9072f64567a911',ramdisk_id='',reservation_id='r-bv00xcgp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='45ca3cbb-53d6-4046-9be3-92cc6b71bfad',image_min_disk='1',image_min_ram='0',image_owner_id='377cd8de2ae042938a9072f64567a911',image_owner_project_name='tempest-TestStampPattern-1657953611',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1657953611-project-member',image_user_id='ff1b11c3ed3b4ffdbe6a3feada64f5ec',network_allocated='True',owner_project_name='tempest-TestStampPattern-1657953611',owner_user_name='tempest-TestStampPattern-1657953611-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:21:31Z,user_data=None,user_id='ff1b11c3ed3b4ffdbe6a3feada64f5ec',uuid=7ced47a3-311d-4083-94e1-b2d42326e24d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a94c53f7-4f4c-42e6-b121-9d309544dae8", "address": "fa:16:3e:33:b2:31", "network": {"id": "76ba31b5-c467-45e4-ae9a-111f41fd62a3", "bridge": "br-int", "label": "tempest-TestStampPattern-2049888281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "377cd8de2ae042938a9072f64567a911", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa94c53f7-4f", "ovs_interfaceid": "a94c53f7-4f4c-42e6-b121-9d309544dae8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Converting VIF {"id": "a94c53f7-4f4c-42e6-b121-9d309544dae8", "address": "fa:16:3e:33:b2:31", "network": {"id": "76ba31b5-c467-45e4-ae9a-111f41fd62a3", "bridge": "br-int", "label": "tempest-TestStampPattern-2049888281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "377cd8de2ae042938a9072f64567a911", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa94c53f7-4f", "ovs_interfaceid": "a94c53f7-4f4c-42e6-b121-9d309544dae8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:b2:31,bridge_name='br-int',has_traffic_filtering=True,id=a94c53f7-4f4c-42e6-b121-9d309544dae8,network=Network(76ba31b5-c467-45e4-ae9a-111f41fd62a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa94c53f7-4f') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG nova.objects.instance [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lazy-loading 'pci_devices' on Instance uuid 7ced47a3-311d-4083-94e1-b2d42326e24d {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:21:33 user nova-compute[74683]:   <uuid>7ced47a3-311d-4083-94e1-b2d42326e24d</uuid>
Oct 16 11:21:33 user nova-compute[74683]:   <name>instance-00000014</name>
Oct 16 11:21:33 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:21:33 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:21:33 user nova-compute[74683]:   <metadata>
Oct 16 11:21:33 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:21:33 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:21:33 user nova-compute[74683]:       <nova:name>tempest-TestStampPattern-server-537257495</nova:name>
Oct 16 11:21:33 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:21:33</nova:creationTime>
Oct 16 11:21:33 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:21:33 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:21:33 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:21:33 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:21:33 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:21:33 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:21:33 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:21:33 user nova-compute[74683]:       <nova:owner>
Oct 16 11:21:33 user nova-compute[74683]:         <nova:user uuid="ff1b11c3ed3b4ffdbe6a3feada64f5ec">tempest-TestStampPattern-1657953611-project-member</nova:user>
Oct 16 11:21:33 user nova-compute[74683]:         <nova:project uuid="377cd8de2ae042938a9072f64567a911">tempest-TestStampPattern-1657953611</nova:project>
Oct 16 11:21:33 user nova-compute[74683]:       </nova:owner>
Oct 16 11:21:33 user nova-compute[74683]:       <nova:root type="image" uuid="cd8467ed-4eb3-4557-be1f-e9de42bea9f9"/>
Oct 16 11:21:33 user nova-compute[74683]:       <nova:ports>
Oct 16 11:21:33 user nova-compute[74683]:         <nova:port uuid="a94c53f7-4f4c-42e6-b121-9d309544dae8">
Oct 16 11:21:33 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 16 11:21:33 user nova-compute[74683]:         </nova:port>
Oct 16 11:21:33 user nova-compute[74683]:       </nova:ports>
Oct 16 11:21:33 user nova-compute[74683]:     </nova:instance>
Oct 16 11:21:33 user nova-compute[74683]:   </metadata>
Oct 16 11:21:33 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:21:33 user nova-compute[74683]:     <system>
Oct 16 11:21:33 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:21:33 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:21:33 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:21:33 user nova-compute[74683]:       <entry name="serial">7ced47a3-311d-4083-94e1-b2d42326e24d</entry>
Oct 16 11:21:33 user nova-compute[74683]:       <entry name="uuid">7ced47a3-311d-4083-94e1-b2d42326e24d</entry>
Oct 16 11:21:33 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:21:33 user nova-compute[74683]:     </system>
Oct 16 11:21:33 user nova-compute[74683]:   </sysinfo>
Oct 16 11:21:33 user nova-compute[74683]:   <os>
Oct 16 11:21:33 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:21:33 user nova-compute[74683]:     <boot dev="hd"/>
Oct 16 11:21:33 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:21:33 user nova-compute[74683]:   </os>
Oct 16 11:21:33 user nova-compute[74683]:   <features>
Oct 16 11:21:33 user nova-compute[74683]:     <acpi/>
Oct 16 11:21:33 user nova-compute[74683]:     <apic/>
Oct 16 11:21:33 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:21:33 user nova-compute[74683]:   </features>
Oct 16 11:21:33 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:21:33 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:21:33 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:21:33 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:21:33 user nova-compute[74683]:   </clock>
Oct 16 11:21:33 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:21:33 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:21:33 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:21:33 user nova-compute[74683]:   </cpu>
Oct 16 11:21:33 user nova-compute[74683]:   <devices>
Oct 16 11:21:33 user nova-compute[74683]:     <disk type="file" device="disk">
Oct 16 11:21:33 user nova-compute[74683]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 11:21:33 user nova-compute[74683]:       <source file="/opt/stack/data/nova/instances/7ced47a3-311d-4083-94e1-b2d42326e24d/disk"/>
Oct 16 11:21:33 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:21:33 user nova-compute[74683]:     </disk>
Oct 16 11:21:33 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:21:33 user nova-compute[74683]:       <mac address="fa:16:3e:33:b2:31"/>
Oct 16 11:21:33 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:21:33 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:21:33 user nova-compute[74683]:       <target dev="tapa94c53f7-4f"/>
Oct 16 11:21:33 user nova-compute[74683]:     </interface>
Oct 16 11:21:33 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:21:33 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/7ced47a3-311d-4083-94e1-b2d42326e24d/console.log" append="off"/>
Oct 16 11:21:33 user nova-compute[74683]:     </serial>
Oct 16 11:21:33 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:21:33 user nova-compute[74683]:     <video>
Oct 16 11:21:33 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:21:33 user nova-compute[74683]:     </video>
Oct 16 11:21:33 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:21:33 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:21:33 user nova-compute[74683]:     </rng>
Oct 16 11:21:33 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:21:33 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:21:33 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:21:33 user nova-compute[74683]:     </memballoon>
Oct 16 11:21:33 user nova-compute[74683]:   </devices>
Oct 16 11:21:33 user nova-compute[74683]: </domain>
Oct 16 11:21:33 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:21:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-537257495',display_name='tempest-TestStampPattern-server-537257495',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-537257495',id=20,image_ref='cd8467ed-4eb3-4557-be1f-e9de42bea9f9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFV+ROpInHshi5FjeDxPiEyFZ7Qvi9jeJ0//dAB7L9KvmXxPyMWLDkzIIO+4mTNqVHH1o36yJrMR626Ju/qnnIOZjnMoP87MpQ3Ptrg2AmfvntWHi+q/nHH1XQPsx2j/Gw==',key_name='tempest-TestStampPattern-1014736713',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='377cd8de2ae042938a9072f64567a911',ramdisk_id='',reservation_id='r-bv00xcgp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='45ca3cbb-53d6-4046-9be3-92cc6b71bfad',image_min_disk='1',image_min_ram='0',image_owner_id='377cd8de2ae042938a9072f64567a911',image_owner_project_name='tempest-TestStampPattern-1657953611',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1657953611-project-member',image_user_id='ff1b11c3ed3b4ffdbe6a3feada64f5ec',network_allocated='True',owner_project_name='tempest-TestStampPattern-1657953611',owner_user_name='tempest-TestStampPattern-1657953611-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:21:31Z,user_data=None,user_id='ff1b11c3ed3b4ffdbe6a3feada64f5ec',uuid=7ced47a3-311d-4083-94e1-b2d42326e24d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a94c53f7-4f4c-42e6-b121-9d309544dae8", "address": "fa:16:3e:33:b2:31", "network": {"id": "76ba31b5-c467-45e4-ae9a-111f41fd62a3", "bridge": "br-int", "label": "tempest-TestStampPattern-2049888281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "377cd8de2ae042938a9072f64567a911", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa94c53f7-4f", "ovs_interfaceid": "a94c53f7-4f4c-42e6-b121-9d309544dae8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Converting VIF {"id": "a94c53f7-4f4c-42e6-b121-9d309544dae8", "address": "fa:16:3e:33:b2:31", "network": {"id": "76ba31b5-c467-45e4-ae9a-111f41fd62a3", "bridge": "br-int", "label": "tempest-TestStampPattern-2049888281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "377cd8de2ae042938a9072f64567a911", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa94c53f7-4f", "ovs_interfaceid": "a94c53f7-4f4c-42e6-b121-9d309544dae8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:b2:31,bridge_name='br-int',has_traffic_filtering=True,id=a94c53f7-4f4c-42e6-b121-9d309544dae8,network=Network(76ba31b5-c467-45e4-ae9a-111f41fd62a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa94c53f7-4f') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG os_vif [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:b2:31,bridge_name='br-int',has_traffic_filtering=True,id=a94c53f7-4f4c-42e6-b121-9d309544dae8,network=Network(76ba31b5-c467-45e4-ae9a-111f41fd62a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa94c53f7-4f') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f9049671-fe43-5036-9113-89384b1246b6', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa94c53f7-4f, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa94c53f7-4f, col_values=(('qos', UUID('3d2433b6-66fc-4d56-b290-c9fb9fab37fe')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa94c53f7-4f, col_values=(('external_ids', {'iface-id': 'a94c53f7-4f4c-42e6-b121-9d309544dae8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:b2:31', 'vm-uuid': '7ced47a3-311d-4083-94e1-b2d42326e24d'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:21:33 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:33 user nova-compute[74683]: INFO os_vif [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:b2:31,bridge_name='br-int',has_traffic_filtering=True,id=a94c53f7-4f4c-42e6-b121-9d309544dae8,network=Network(76ba31b5-c467-45e4-ae9a-111f41fd62a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa94c53f7-4f')
Oct 16 11:21:34 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:21:34 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] No VIF found with MAC fa:16:3e:33:b2:31, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:21:34 user nova-compute[74683]: DEBUG nova.network.neutron [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] Successfully created port: 4e53b899-a596-47a3-8e17-88748f58e737 {{(pid=74683) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 11:21:34 user nova-compute[74683]: DEBUG nova.network.neutron [req-5bfdb603-a31c-4bd5-8555-b20db98c7e02 req-436e47d0-0cef-4267-9dc1-a579864cdf69 service nova] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Updated VIF entry in instance network info cache for port a94c53f7-4f4c-42e6-b121-9d309544dae8. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:21:34 user nova-compute[74683]: DEBUG nova.network.neutron [req-5bfdb603-a31c-4bd5-8555-b20db98c7e02 req-436e47d0-0cef-4267-9dc1-a579864cdf69 service nova] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Updating instance_info_cache with network_info: [{"id": "a94c53f7-4f4c-42e6-b121-9d309544dae8", "address": "fa:16:3e:33:b2:31", "network": {"id": "76ba31b5-c467-45e4-ae9a-111f41fd62a3", "bridge": "br-int", "label": "tempest-TestStampPattern-2049888281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "377cd8de2ae042938a9072f64567a911", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa94c53f7-4f", "ovs_interfaceid": "a94c53f7-4f4c-42e6-b121-9d309544dae8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:21:34 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-5bfdb603-a31c-4bd5-8555-b20db98c7e02 req-436e47d0-0cef-4267-9dc1-a579864cdf69 service nova] Releasing lock "refresh_cache-7ced47a3-311d-4083-94e1-b2d42326e24d" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:21:34 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:34 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b549dfa5-bf25-4b44-8c02-a923e193cd77 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Calling os-brick to attach iSCSI Volume {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 11:21:34 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b549dfa5-bf25-4b44-8c02-a923e193cd77 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:25c3b8d2-beea-4362-8602-5134c21ac2ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UOlJhXVD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:21:34 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-b549dfa5-bf25-4b44-8c02-a923e193cd77 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:21:34 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-b549dfa5-bf25-4b44-8c02-a923e193cd77 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:21:34 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-b549dfa5-bf25-4b44-8c02-a923e193cd77 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:21:34 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-b549dfa5-bf25-4b44-8c02-a923e193cd77 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:21:34 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-b549dfa5-bf25-4b44-8c02-a923e193cd77 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25c3b8d2-beea-4362-8602-5134c21ac2ff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:21:34 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-b549dfa5-bf25-4b44-8c02-a923e193cd77 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25c3b8d2-beea-4362-8602-5134c21ac2ff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:21:34 user nova-compute[74683]: INFO os_brick.initiator.connectors.iscsi [None req-b549dfa5-bf25-4b44-8c02-a923e193cd77 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 11:21:34 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25c3b8d2-beea-4362-8602-5134c21ac2ff -p 172.16.0.220:3260 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:34 user nova-compute[74683]: DEBUG nova.network.neutron [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] Successfully updated port: 4e53b899-a596-47a3-8e17-88748f58e737 {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:21:34 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquiring lock "refresh_cache-b8b4a8e2-2c42-423d-954e-cab381506ca7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:21:34 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquired lock "refresh_cache-b8b4a8e2-2c42-423d-954e-cab381506ca7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:21:34 user nova-compute[74683]: DEBUG nova.network.neutron [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:21:34 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25c3b8d2-beea-4362-8602-5134c21ac2ff -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:21:34 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[411a143d-f82f-4c86-9665-7932caf44758]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:21:34 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b549dfa5-bf25-4b44-8c02-a923e193cd77 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 11:21:34 user nova-compute[74683]:  {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:21:34 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25c3b8d2-beea-4362-8602-5134c21ac2ff -p 172.16.0.220:3260 --interface default --op new {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:34 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25c3b8d2-beea-4362-8602-5134c21ac2ff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:21:34 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d32e572-4bda-44b4-aad5-5bb21d87e51f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:25c3b8d2-beea-4362-8602-5134c21ac2ff] added\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:21:34 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b549dfa5-bf25-4b44-8c02-a923e193cd77 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:25c3b8d2-beea-4362-8602-5134c21ac2ff] added
Oct 16 11:21:34 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:21:34 user nova-compute[74683]: DEBUG nova.compute.manager [req-822b9461-344f-4b5f-b015-da465acff092 req-653f6bac-b8d9-444b-ae16-3ccce12b759e service nova] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] Received event network-changed-4e53b899-a596-47a3-8e17-88748f58e737 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:21:34 user nova-compute[74683]: DEBUG nova.compute.manager [req-822b9461-344f-4b5f-b015-da465acff092 req-653f6bac-b8d9-444b-ae16-3ccce12b759e service nova] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] Refreshing instance network info cache due to event network-changed-4e53b899-a596-47a3-8e17-88748f58e737. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:21:34 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-822b9461-344f-4b5f-b015-da465acff092 req-653f6bac-b8d9-444b-ae16-3ccce12b759e service nova] Acquiring lock "refresh_cache-b8b4a8e2-2c42-423d-954e-cab381506ca7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:21:34 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25c3b8d2-beea-4362-8602-5134c21ac2ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:34 user nova-compute[74683]: DEBUG nova.network.neutron [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:21:34 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25c3b8d2-beea-4362-8602-5134c21ac2ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:21:34 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[5833143a-6b2d-4eb4-b719-5c573bb7174c]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:21:34 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b549dfa5-bf25-4b44-8c02-a923e193cd77 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:21:34 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25c3b8d2-beea-4362-8602-5134c21ac2ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:35 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25c3b8d2-beea-4362-8602-5134c21ac2ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:21:35 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f4f35f-fd85-4a6a-848b-f2c932e28474]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:21:35 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b549dfa5-bf25-4b44-8c02-a923e193cd77 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:21:35 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25c3b8d2-beea-4362-8602-5134c21ac2ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UOlJhXVD {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:35 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25c3b8d2-beea-4362-8602-5134c21ac2ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UOlJhXVD" returned: 0 in 0.032s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:21:35 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f592d25c-cea4-4afd-bebb-025cb21c77e7]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:21:35 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b549dfa5-bf25-4b44-8c02-a923e193cd77 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UOlJhXVD'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:21:35 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25c3b8d2-beea-4362-8602-5134c21ac2ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:35 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25c3b8d2-beea-4362-8602-5134c21ac2ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:21:35 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb36b41-278e-45da-ad2a-fe632c2e9b04]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:21:35 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b549dfa5-bf25-4b44-8c02-a923e193cd77 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:21:35 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:35 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.056s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:21:35 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35be0be-fae0-49f1-86b4-3bf874bdb160]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:21:35 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b549dfa5-bf25-4b44-8c02-a923e193cd77 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:21:35 user nova-compute[74683]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)
Oct 16 11:21:35 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:21:35 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b549dfa5-bf25-4b44-8c02-a923e193cd77 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:21:35 user nova-compute[74683]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)
Oct 16 11:21:35 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:21:35 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25c3b8d2-beea-4362-8602-5134c21ac2ff -p 172.16.0.220:3260 --login {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:35 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25c3b8d2-beea-4362-8602-5134c21ac2ff -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:21:35 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf200d7-4f8f-4d1b-85e6-96c3a04c2bc6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:25c3b8d2-beea-4362-8602-5134c21ac2ff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:25c3b8d2-beea-4362-8602-5134c21ac2ff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:21:35 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b549dfa5-bf25-4b44-8c02-a923e193cd77 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:25c3b8d2-beea-4362-8602-5134c21ac2ff, portal: 172.16.0.220,3260]
Oct 16 11:21:35 user nova-compute[74683]: Login to [iface: default, target: iqn.2010-10.org.openstack:25c3b8d2-beea-4362-8602-5134c21ac2ff, portal: 172.16.0.220,3260] successful.
Oct 16 11:21:35 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:21:35 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25c3b8d2-beea-4362-8602-5134c21ac2ff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:35 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25c3b8d2-beea-4362-8602-5134c21ac2ff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:21:35 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d5ddc1-4a8f-4280-a77c-12c3f8075ec9]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:21:35 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b549dfa5-bf25-4b44-8c02-a923e193cd77 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:21:35 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:35 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:21:35 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9805bf3-21d9-4ba5-a90f-a1588e23e934]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3b8d2-beea-4362-8602-5134c21ac2ff (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:21:35 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b549dfa5-bf25-4b44-8c02-a923e193cd77 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:21:35 user nova-compute[74683]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)
Oct 16 11:21:35 user nova-compute[74683]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3b8d2-beea-4362-8602-5134c21ac2ff (non-flash)
Oct 16 11:21:35 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:21:35 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b549dfa5-bf25-4b44-8c02-a923e193cd77 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:21:35 user nova-compute[74683]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)
Oct 16 11:21:35 user nova-compute[74683]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3b8d2-beea-4362-8602-5134c21ac2ff (non-flash)
Oct 16 11:21:35 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:21:35 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-b549dfa5-bf25-4b44-8c02-a923e193cd77 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25c3b8d2-beea-4362-8602-5134c21ac2ff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.374s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:21:35 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b549dfa5-bf25-4b44-8c02-a923e193cd77 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Connected to 172.16.0.220:3260 {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 11:21:35 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-b549dfa5-bf25-4b44-8c02-a923e193cd77 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=74683) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 11:21:35 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-b549dfa5-bf25-4b44-8c02-a923e193cd77 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74683) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 11:21:35 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:35 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:21:35 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d359fb6e-ba7e-47ba-91c0-dc6b6d133cf3]: (4, ('- - 0', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:21:35 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-b549dfa5-bf25-4b44-8c02-a923e193cd77 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:21:35 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b549dfa5-bf25-4b44-8c02-a923e193cd77 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:25c3b8d2-beea-4362-8602-5134c21ac2ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UOlJhXVD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 11:21:35 user nova-compute[74683]: DEBUG nova.network.neutron [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] Updating instance_info_cache with network_info: [{"id": "4e53b899-a596-47a3-8e17-88748f58e737", "address": "fa:16:3e:05:6b:b7", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e53b899-a5", "ovs_interfaceid": "4e53b899-a596-47a3-8e17-88748f58e737", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:21:35 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Releasing lock "refresh_cache-b8b4a8e2-2c42-423d-954e-cab381506ca7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:21:35 user nova-compute[74683]: DEBUG nova.compute.manager [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] Instance network_info: |[{"id": "4e53b899-a596-47a3-8e17-88748f58e737", "address": "fa:16:3e:05:6b:b7", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e53b899-a5", "ovs_interfaceid": "4e53b899-a596-47a3-8e17-88748f58e737", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 11:21:35 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-822b9461-344f-4b5f-b015-da465acff092 req-653f6bac-b8d9-444b-ae16-3ccce12b759e service nova] Acquired lock "refresh_cache-b8b4a8e2-2c42-423d-954e-cab381506ca7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:21:35 user nova-compute[74683]: DEBUG nova.network.neutron [req-822b9461-344f-4b5f-b015-da465acff092 req-653f6bac-b8d9-444b-ae16-3ccce12b759e service nova] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] Refreshing network info cache for port 4e53b899-a596-47a3-8e17-88748f58e737 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:21:35 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:35 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:35 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:35 user nova-compute[74683]: DEBUG nova.network.neutron [req-822b9461-344f-4b5f-b015-da465acff092 req-653f6bac-b8d9-444b-ae16-3ccce12b759e service nova] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] Updated VIF entry in instance network info cache for port 4e53b899-a596-47a3-8e17-88748f58e737. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:21:35 user nova-compute[74683]: DEBUG nova.network.neutron [req-822b9461-344f-4b5f-b015-da465acff092 req-653f6bac-b8d9-444b-ae16-3ccce12b759e service nova] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] Updating instance_info_cache with network_info: [{"id": "4e53b899-a596-47a3-8e17-88748f58e737", "address": "fa:16:3e:05:6b:b7", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e53b899-a5", "ovs_interfaceid": "4e53b899-a596-47a3-8e17-88748f58e737", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:21:35 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:35 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:35 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-822b9461-344f-4b5f-b015-da465acff092 req-653f6bac-b8d9-444b-ae16-3ccce12b759e service nova] Releasing lock "refresh_cache-b8b4a8e2-2c42-423d-954e-cab381506ca7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:21:36 user nova-compute[74683]: DEBUG nova.compute.manager [req-c1b9a7af-709e-43d9-836a-7c1552eae2f8 req-b1aa4bff-9a1e-45d8-90af-e6e93b3c534c service nova] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Received event network-vif-plugged-a94c53f7-4f4c-42e6-b121-9d309544dae8 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:21:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c1b9a7af-709e-43d9-836a-7c1552eae2f8 req-b1aa4bff-9a1e-45d8-90af-e6e93b3c534c service nova] Acquiring lock "7ced47a3-311d-4083-94e1-b2d42326e24d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:21:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c1b9a7af-709e-43d9-836a-7c1552eae2f8 req-b1aa4bff-9a1e-45d8-90af-e6e93b3c534c service nova] Lock "7ced47a3-311d-4083-94e1-b2d42326e24d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:21:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c1b9a7af-709e-43d9-836a-7c1552eae2f8 req-b1aa4bff-9a1e-45d8-90af-e6e93b3c534c service nova] Lock "7ced47a3-311d-4083-94e1-b2d42326e24d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:21:36 user nova-compute[74683]: DEBUG nova.compute.manager [req-c1b9a7af-709e-43d9-836a-7c1552eae2f8 req-b1aa4bff-9a1e-45d8-90af-e6e93b3c534c service nova] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] No waiting events found dispatching network-vif-plugged-a94c53f7-4f4c-42e6-b121-9d309544dae8 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:21:36 user nova-compute[74683]: WARNING nova.compute.manager [req-c1b9a7af-709e-43d9-836a-7c1552eae2f8 req-b1aa4bff-9a1e-45d8-90af-e6e93b3c534c service nova] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Received unexpected event network-vif-plugged-a94c53f7-4f4c-42e6-b121-9d309544dae8 for instance with vm_state building and task_state spawning.
Oct 16 11:21:36 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-b549dfa5-bf25-4b44-8c02-a923e193cd77 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.415s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:21:36 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b549dfa5-bf25-4b44-8c02-a923e193cd77 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] <== connect_volume: return (1418ms) {'type': 'block', 'scsi_wwn': '26666323438623338', 'path': '/dev/sdb'} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:21:36 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b549dfa5-bf25-4b44-8c02-a923e193cd77 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26666323438623338', 'path': '/dev/sdb'} {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 11:21:36 user nova-compute[74683]: DEBUG nova.objects.instance [None req-b549dfa5-bf25-4b44-8c02-a923e193cd77 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Lazy-loading 'flavor' on Instance uuid e84bb680-a542-4cb2-b0c5-67a210c25e9e {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:21:36 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-b549dfa5-bf25-4b44-8c02-a923e193cd77 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 11:21:36 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:21:36 user nova-compute[74683]:   <source dev="/dev/sdb"/>
Oct 16 11:21:36 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:21:36 user nova-compute[74683]:   <serial>25c3b8d2-beea-4362-8602-5134c21ac2ff</serial>
Oct 16 11:21:36 user nova-compute[74683]: </disk>
Oct 16 11:21:36 user nova-compute[74683]:  {{(pid=74683) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 11:21:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:36 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b549dfa5-bf25-4b44-8c02-a923e193cd77 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:21:36 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b549dfa5-bf25-4b44-8c02-a923e193cd77 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:21:36 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b549dfa5-bf25-4b44-8c02-a923e193cd77 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] No VIF found with MAC fa:16:3e:80:bd:6c, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:21:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b549dfa5-bf25-4b44-8c02-a923e193cd77 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Lock "e84bb680-a542-4cb2-b0c5-67a210c25e9e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.562s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:21:37 user nova-compute[74683]: DEBUG nova.compute.manager [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Instance event wait completed in 0 seconds for  {{(pid=74683) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 11:21:37 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Guest created on hypervisor {{(pid=74683) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 11:21:37 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Instance spawned successfully.
Oct 16 11:21:37 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 11:21:37 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Found default for hw_input_bus of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:21:37 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Found default for hw_pointer_model of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:21:37 user nova-compute[74683]: INFO nova.compute.manager [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Took 7.00 seconds to spawn the instance on the hypervisor.
Oct 16 11:21:37 user nova-compute[74683]: DEBUG nova.compute.manager [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:21:38 user nova-compute[74683]: INFO nova.compute.manager [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Took 8.06 seconds to build instance.
Oct 16 11:21:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-78711dae-7da1-494d-a884-5500f0c8a9b5 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lock "7ced47a3-311d-4083-94e1-b2d42326e24d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.187s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:21:38 user nova-compute[74683]: DEBUG nova.compute.manager [req-b72c33ce-6829-42b3-8bf1-242ceb161fe0 req-5287ba4b-db29-4fc4-a7f5-bd39122dc1c6 service nova] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Received event network-vif-plugged-a94c53f7-4f4c-42e6-b121-9d309544dae8 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:21:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b72c33ce-6829-42b3-8bf1-242ceb161fe0 req-5287ba4b-db29-4fc4-a7f5-bd39122dc1c6 service nova] Acquiring lock "7ced47a3-311d-4083-94e1-b2d42326e24d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:21:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b72c33ce-6829-42b3-8bf1-242ceb161fe0 req-5287ba4b-db29-4fc4-a7f5-bd39122dc1c6 service nova] Lock "7ced47a3-311d-4083-94e1-b2d42326e24d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:21:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b72c33ce-6829-42b3-8bf1-242ceb161fe0 req-5287ba4b-db29-4fc4-a7f5-bd39122dc1c6 service nova] Lock "7ced47a3-311d-4083-94e1-b2d42326e24d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:21:38 user nova-compute[74683]: DEBUG nova.compute.manager [req-b72c33ce-6829-42b3-8bf1-242ceb161fe0 req-5287ba4b-db29-4fc4-a7f5-bd39122dc1c6 service nova] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] No waiting events found dispatching network-vif-plugged-a94c53f7-4f4c-42e6-b121-9d309544dae8 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:21:38 user nova-compute[74683]: WARNING nova.compute.manager [req-b72c33ce-6829-42b3-8bf1-242ceb161fe0 req-5287ba4b-db29-4fc4-a7f5-bd39122dc1c6 service nova] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Received unexpected event network-vif-plugged-a94c53f7-4f4c-42e6-b121-9d309544dae8 for instance with vm_state active and task_state None.
Oct 16 11:21:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] Acquiring lock "e84bb680-a542-4cb2-b0c5-67a210c25e9e" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:21:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] Lock "e84bb680-a542-4cb2-b0c5-67a210c25e9e" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:21:38 user nova-compute[74683]: DEBUG os_brick.utils [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:21:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:21:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[91cb82cb-3c9f-41a8-9e40-b471880250d8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:70b9d336ab7d\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:21:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:21:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f0446b-29d8-4e67-acb7-36cb7ea3874a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:21:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:21:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74a84e3-39ba-4243-87c9-63288bca9b8f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:21:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53c4907-5cba-4775-9513-4369f6f2477c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:21:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] Running cmd (subprocess): nvme version {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:21:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.nvmeof [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] nvme not present on system {{(pid=74683) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 11:21:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:21:38 user nova-compute[74683]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 11:21:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cfb3847-966e-4984-9d46-ae3d5a04ccef]: (4, '') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:21:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74683) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 11:21:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 11:21:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] LIGHTOS: no hostnqn found. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 11:21:38 user nova-compute[74683]: DEBUG os_brick.utils [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:70b9d336ab7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:21:38 user nova-compute[74683]: INFO nova.compute.manager [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Swapping volume 25c3b8d2-beea-4362-8602-5134c21ac2ff for 83717834-0a00-4b2d-a2a7-7aeaa3d84cee
Oct 16 11:21:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:39 user nova-compute[74683]: DEBUG os_brick.utils [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:21:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:21:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf381b7-2a36-4da9-b273-c8ad9843f072]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:70b9d336ab7d\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:21:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:21:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24bb92f-3eb9-4a98-b272-cfd95d5df5f1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:21:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:21:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[761f8be4-e8a7-4dbb-a0ad-db952efc8c1c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:21:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ddec936-f098-413f-aec6-3a807691b45a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:21:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Running cmd (subprocess): nvme version {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] 'nvme version' failed. Not Retrying. {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:21:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.nvmeof [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] nvme not present on system {{(pid=74683) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 11:21:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:21:39 user nova-compute[74683]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 11:21:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[77df99ad-e47c-494d-beb1-9e84922cc08b]: (4, '') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:21:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74683) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 11:21:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 11:21:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] LIGHTOS: no hostnqn found. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 11:21:39 user nova-compute[74683]: DEBUG os_brick.utils [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:70b9d336ab7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:21:39 user nova-compute[74683]: DEBUG nova.virt.block_device [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] Updating existing volume attachment record: 1fe756f2-df0d-4086-88f5-8872a9ad5bb6 {{(pid=74683) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 11:21:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:42 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Acquiring lock "6c9fc5a9-8659-497c-bb07-af52fe2e1761" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:21:42 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "6c9fc5a9-8659-497c-bb07-af52fe2e1761" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:21:42 user nova-compute[74683]: DEBUG nova.compute.manager [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] Starting instance... {{(pid=74683) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 11:21:42 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:21:42 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:21:42 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74683) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 11:21:42 user nova-compute[74683]: INFO nova.compute.claims [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] Claim successful on node user
Oct 16 11:21:43 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:21:43 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:21:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.648s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:21:43 user nova-compute[74683]: DEBUG nova.compute.manager [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] Start building networks asynchronously for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 11:21:43 user nova-compute[74683]: DEBUG nova.compute.manager [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] Allocating IP information in the background. {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 11:21:43 user nova-compute[74683]: DEBUG nova.network.neutron [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] allocate_for_instance() {{(pid=74683) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 11:21:43 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 11:21:43 user nova-compute[74683]: DEBUG nova.compute.manager [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] Start building block device mappings for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 11:21:43 user nova-compute[74683]: DEBUG nova.policy [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '76a41804541e4a259771702727d9993e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6e0046017b4bba85caf2a39d1c67b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74683) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 11:21:43 user nova-compute[74683]: DEBUG nova.compute.manager [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] Start spawning the instance on the hypervisor. {{(pid=74683) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 11:21:43 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] Creating instance directory {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 11:21:43 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] Creating image(s)
Oct 16 11:21:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Acquiring lock "/opt/stack/data/nova/instances/6c9fc5a9-8659-497c-bb07-af52fe2e1761/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:21:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "/opt/stack/data/nova/instances/6c9fc5a9-8659-497c-bb07-af52fe2e1761/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:21:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "/opt/stack/data/nova/instances/6c9fc5a9-8659-497c-bb07-af52fe2e1761/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:21:43 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:44 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.265s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:21:44 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Acquiring lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:21:44 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:21:44 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:44 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.223s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:21:44 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/6c9fc5a9-8659-497c-bb07-af52fe2e1761/disk 1073741824 {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:44 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/6c9fc5a9-8659-497c-bb07-af52fe2e1761/disk 1073741824" returned: 0 in 0.070s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:21:44 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.304s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:21:44 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:44 user nova-compute[74683]: DEBUG nova.network.neutron [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] Successfully created port: c1c13166-923d-4839-963a-434a9ba38d94 {{(pid=74683) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 11:21:44 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.215s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:21:44 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6c9fc5a9-8659-497c-bb07-af52fe2e1761/disk. size=1073741824 {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 11:21:44 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9fc5a9-8659-497c-bb07-af52fe2e1761/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:44 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9fc5a9-8659-497c-bb07-af52fe2e1761/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:21:44 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Cannot resize image /opt/stack/data/nova/instances/6c9fc5a9-8659-497c-bb07-af52fe2e1761/disk to a smaller size. {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 11:21:44 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] Created local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 11:21:44 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] Ensure instance console log exists: /opt/stack/data/nova/instances/6c9fc5a9-8659-497c-bb07-af52fe2e1761/console.log {{(pid=74683) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 11:21:44 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:21:44 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:21:44 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:21:45 user nova-compute[74683]: DEBUG nova.network.neutron [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] Successfully updated port: c1c13166-923d-4839-963a-434a9ba38d94 {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:21:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Acquiring lock "refresh_cache-6c9fc5a9-8659-497c-bb07-af52fe2e1761" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:21:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Acquired lock "refresh_cache-6c9fc5a9-8659-497c-bb07-af52fe2e1761" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:21:45 user nova-compute[74683]: DEBUG nova.network.neutron [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:21:45 user nova-compute[74683]: DEBUG nova.compute.manager [req-612ab3c1-271f-4b76-9be5-7c4e55a3d80d req-ca6e0132-7fe5-457f-b0ed-672fd3fb72b3 service nova] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] Received event network-changed-c1c13166-923d-4839-963a-434a9ba38d94 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:21:45 user nova-compute[74683]: DEBUG nova.compute.manager [req-612ab3c1-271f-4b76-9be5-7c4e55a3d80d req-ca6e0132-7fe5-457f-b0ed-672fd3fb72b3 service nova] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] Refreshing instance network info cache due to event network-changed-c1c13166-923d-4839-963a-434a9ba38d94. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:21:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-612ab3c1-271f-4b76-9be5-7c4e55a3d80d req-ca6e0132-7fe5-457f-b0ed-672fd3fb72b3 service nova] Acquiring lock "refresh_cache-6c9fc5a9-8659-497c-bb07-af52fe2e1761" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:21:45 user nova-compute[74683]: DEBUG nova.network.neutron [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:21:45 user nova-compute[74683]: DEBUG nova.network.neutron [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] Updating instance_info_cache with network_info: [{"id": "c1c13166-923d-4839-963a-434a9ba38d94", "address": "fa:16:3e:d3:0f:d5", "network": {"id": "4d43cc12-d2cd-4552-90a4-884a0ff3dc66", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-825513246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6e0046017b4bba85caf2a39d1c67b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1c13166-92", "ovs_interfaceid": "c1c13166-923d-4839-963a-434a9ba38d94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:21:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Releasing lock "refresh_cache-6c9fc5a9-8659-497c-bb07-af52fe2e1761" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:21:45 user nova-compute[74683]: DEBUG nova.compute.manager [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] Instance network_info: |[{"id": "c1c13166-923d-4839-963a-434a9ba38d94", "address": "fa:16:3e:d3:0f:d5", "network": {"id": "4d43cc12-d2cd-4552-90a4-884a0ff3dc66", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-825513246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6e0046017b4bba85caf2a39d1c67b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1c13166-92", "ovs_interfaceid": "c1c13166-923d-4839-963a-434a9ba38d94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 11:21:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-612ab3c1-271f-4b76-9be5-7c4e55a3d80d req-ca6e0132-7fe5-457f-b0ed-672fd3fb72b3 service nova] Acquired lock "refresh_cache-6c9fc5a9-8659-497c-bb07-af52fe2e1761" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:21:45 user nova-compute[74683]: DEBUG nova.network.neutron [req-612ab3c1-271f-4b76-9be5-7c4e55a3d80d req-ca6e0132-7fe5-457f-b0ed-672fd3fb72b3 service nova] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] Refreshing network info cache for port c1c13166-923d-4839-963a-434a9ba38d94 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:21:45 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] Start _get_guest_xml network_info=[{"id": "c1c13166-923d-4839-963a-434a9ba38d94", "address": "fa:16:3e:d3:0f:d5", "network": {"id": "4d43cc12-d2cd-4552-90a4-884a0ff3dc66", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-825513246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6e0046017b4bba85caf2a39d1c67b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1c13166-92", "ovs_interfaceid": "c1c13166-923d-4839-963a-434a9ba38d94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:21:45 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:21:45 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:21:45 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:21:45 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:21:45 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:21:45 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:21:45 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:21:45 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:21:45 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:21:45 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:21:45 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:21:45 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:21:45 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:21:45 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:21:45 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:21:45 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:21:45 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:21:45 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:21:45 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:21:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1879852068',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1879852068',id=22,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d6e0046017b4bba85caf2a39d1c67b3',ramdisk_id='',reservation_id='r-q5i6enbj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1787816377',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:21:44Z,user_data=None,user_id='76a41804541e4a259771702727d9993e',uuid=6c9fc5a9-8659-497c-bb07-af52fe2e1761,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1c13166-923d-4839-963a-434a9ba38d94", "address": "fa:16:3e:d3:0f:d5", "network": {"id": "4d43cc12-d2cd-4552-90a4-884a0ff3dc66", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-825513246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6e0046017b4bba85caf2a39d1c67b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1c13166-92", "ovs_interfaceid": "c1c13166-923d-4839-963a-434a9ba38d94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:21:45 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Converting VIF {"id": "c1c13166-923d-4839-963a-434a9ba38d94", "address": "fa:16:3e:d3:0f:d5", "network": {"id": "4d43cc12-d2cd-4552-90a4-884a0ff3dc66", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-825513246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6e0046017b4bba85caf2a39d1c67b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1c13166-92", "ovs_interfaceid": "c1c13166-923d-4839-963a-434a9ba38d94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:21:45 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:0f:d5,bridge_name='br-int',has_traffic_filtering=True,id=c1c13166-923d-4839-963a-434a9ba38d94,network=Network(4d43cc12-d2cd-4552-90a4-884a0ff3dc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1c13166-92') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:21:45 user nova-compute[74683]: DEBUG nova.objects.instance [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lazy-loading 'pci_devices' on Instance uuid 6c9fc5a9-8659-497c-bb07-af52fe2e1761 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:21:45 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:21:45 user nova-compute[74683]:   <uuid>6c9fc5a9-8659-497c-bb07-af52fe2e1761</uuid>
Oct 16 11:21:45 user nova-compute[74683]:   <name>instance-00000016</name>
Oct 16 11:21:45 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:21:45 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:21:45 user nova-compute[74683]:   <metadata>
Oct 16 11:21:45 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:21:45 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:21:45 user nova-compute[74683]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1879852068</nova:name>
Oct 16 11:21:45 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:21:45</nova:creationTime>
Oct 16 11:21:45 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:21:45 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:21:45 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:21:45 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:21:45 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:21:45 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:21:45 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:21:45 user nova-compute[74683]:       <nova:owner>
Oct 16 11:21:45 user nova-compute[74683]:         <nova:user uuid="76a41804541e4a259771702727d9993e">tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member</nova:user>
Oct 16 11:21:45 user nova-compute[74683]:         <nova:project uuid="4d6e0046017b4bba85caf2a39d1c67b3">tempest-ServerBootFromVolumeStableRescueTest-1787816377</nova:project>
Oct 16 11:21:45 user nova-compute[74683]:       </nova:owner>
Oct 16 11:21:45 user nova-compute[74683]:       <nova:root type="image" uuid="0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f"/>
Oct 16 11:21:45 user nova-compute[74683]:       <nova:ports>
Oct 16 11:21:45 user nova-compute[74683]:         <nova:port uuid="c1c13166-923d-4839-963a-434a9ba38d94">
Oct 16 11:21:45 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 16 11:21:45 user nova-compute[74683]:         </nova:port>
Oct 16 11:21:45 user nova-compute[74683]:       </nova:ports>
Oct 16 11:21:45 user nova-compute[74683]:     </nova:instance>
Oct 16 11:21:45 user nova-compute[74683]:   </metadata>
Oct 16 11:21:45 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:21:45 user nova-compute[74683]:     <system>
Oct 16 11:21:45 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:21:45 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:21:45 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:21:45 user nova-compute[74683]:       <entry name="serial">6c9fc5a9-8659-497c-bb07-af52fe2e1761</entry>
Oct 16 11:21:45 user nova-compute[74683]:       <entry name="uuid">6c9fc5a9-8659-497c-bb07-af52fe2e1761</entry>
Oct 16 11:21:45 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:21:45 user nova-compute[74683]:     </system>
Oct 16 11:21:45 user nova-compute[74683]:   </sysinfo>
Oct 16 11:21:45 user nova-compute[74683]:   <os>
Oct 16 11:21:45 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:21:45 user nova-compute[74683]:     <boot dev="hd"/>
Oct 16 11:21:45 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:21:45 user nova-compute[74683]:   </os>
Oct 16 11:21:45 user nova-compute[74683]:   <features>
Oct 16 11:21:45 user nova-compute[74683]:     <acpi/>
Oct 16 11:21:45 user nova-compute[74683]:     <apic/>
Oct 16 11:21:45 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:21:45 user nova-compute[74683]:   </features>
Oct 16 11:21:45 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:21:45 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:21:45 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:21:45 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:21:45 user nova-compute[74683]:   </clock>
Oct 16 11:21:45 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:21:45 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:21:45 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:21:45 user nova-compute[74683]:   </cpu>
Oct 16 11:21:45 user nova-compute[74683]:   <devices>
Oct 16 11:21:45 user nova-compute[74683]:     <disk type="file" device="disk">
Oct 16 11:21:45 user nova-compute[74683]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 11:21:45 user nova-compute[74683]:       <source file="/opt/stack/data/nova/instances/6c9fc5a9-8659-497c-bb07-af52fe2e1761/disk"/>
Oct 16 11:21:45 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:21:45 user nova-compute[74683]:     </disk>
Oct 16 11:21:45 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:21:45 user nova-compute[74683]:       <mac address="fa:16:3e:d3:0f:d5"/>
Oct 16 11:21:45 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:21:45 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:21:45 user nova-compute[74683]:       <target dev="tapc1c13166-92"/>
Oct 16 11:21:45 user nova-compute[74683]:     </interface>
Oct 16 11:21:45 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:21:45 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/6c9fc5a9-8659-497c-bb07-af52fe2e1761/console.log" append="off"/>
Oct 16 11:21:45 user nova-compute[74683]:     </serial>
Oct 16 11:21:45 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:21:45 user nova-compute[74683]:     <video>
Oct 16 11:21:45 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:21:45 user nova-compute[74683]:     </video>
Oct 16 11:21:45 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:21:45 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:21:45 user nova-compute[74683]:     </rng>
Oct 16 11:21:45 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:21:45 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:21:45 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:21:45 user nova-compute[74683]:     </memballoon>
Oct 16 11:21:45 user nova-compute[74683]:   </devices>
Oct 16 11:21:45 user nova-compute[74683]: </domain>
Oct 16 11:21:45 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:21:45 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:21:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1879852068',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1879852068',id=22,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d6e0046017b4bba85caf2a39d1c67b3',ramdisk_id='',reservation_id='r-q5i6enbj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1787816377',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:21:44Z,user_data=None,user_id='76a41804541e4a259771702727d9993e',uuid=6c9fc5a9-8659-497c-bb07-af52fe2e1761,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1c13166-923d-4839-963a-434a9ba38d94", "address": "fa:16:3e:d3:0f:d5", "network": {"id": "4d43cc12-d2cd-4552-90a4-884a0ff3dc66", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-825513246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6e0046017b4bba85caf2a39d1c67b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1c13166-92", "ovs_interfaceid": "c1c13166-923d-4839-963a-434a9ba38d94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:21:45 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Converting VIF {"id": "c1c13166-923d-4839-963a-434a9ba38d94", "address": "fa:16:3e:d3:0f:d5", "network": {"id": "4d43cc12-d2cd-4552-90a4-884a0ff3dc66", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-825513246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6e0046017b4bba85caf2a39d1c67b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1c13166-92", "ovs_interfaceid": "c1c13166-923d-4839-963a-434a9ba38d94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:21:45 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:0f:d5,bridge_name='br-int',has_traffic_filtering=True,id=c1c13166-923d-4839-963a-434a9ba38d94,network=Network(4d43cc12-d2cd-4552-90a4-884a0ff3dc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1c13166-92') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:21:45 user nova-compute[74683]: DEBUG os_vif [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:0f:d5,bridge_name='br-int',has_traffic_filtering=True,id=c1c13166-923d-4839-963a-434a9ba38d94,network=Network(4d43cc12-d2cd-4552-90a4-884a0ff3dc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1c13166-92') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:21:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:21:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:21:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3004ac2b-a94b-5315-8a57-7d7b1a8650d7', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:21:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:21:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc1c13166-92, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:21:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc1c13166-92, col_values=(('qos', UUID('4a72af7b-5cbb-4608-8a3f-3b47510733d6')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:21:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc1c13166-92, col_values=(('external_ids', {'iface-id': 'c1c13166-923d-4839-963a-434a9ba38d94', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:0f:d5', 'vm-uuid': '6c9fc5a9-8659-497c-bb07-af52fe2e1761'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:21:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:21:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:45 user nova-compute[74683]: INFO os_vif [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:0f:d5,bridge_name='br-int',has_traffic_filtering=True,id=c1c13166-923d-4839-963a-434a9ba38d94,network=Network(4d43cc12-d2cd-4552-90a4-884a0ff3dc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1c13166-92')
Oct 16 11:21:46 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:21:46 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] No VIF found with MAC fa:16:3e:d3:0f:d5, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:21:46 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:46 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:46 user nova-compute[74683]: DEBUG nova.network.neutron [req-612ab3c1-271f-4b76-9be5-7c4e55a3d80d req-ca6e0132-7fe5-457f-b0ed-672fd3fb72b3 service nova] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] Updated VIF entry in instance network info cache for port c1c13166-923d-4839-963a-434a9ba38d94. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:21:46 user nova-compute[74683]: DEBUG nova.network.neutron [req-612ab3c1-271f-4b76-9be5-7c4e55a3d80d req-ca6e0132-7fe5-457f-b0ed-672fd3fb72b3 service nova] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] Updating instance_info_cache with network_info: [{"id": "c1c13166-923d-4839-963a-434a9ba38d94", "address": "fa:16:3e:d3:0f:d5", "network": {"id": "4d43cc12-d2cd-4552-90a4-884a0ff3dc66", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-825513246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6e0046017b4bba85caf2a39d1c67b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1c13166-92", "ovs_interfaceid": "c1c13166-923d-4839-963a-434a9ba38d94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:21:46 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-612ab3c1-271f-4b76-9be5-7c4e55a3d80d req-ca6e0132-7fe5-457f-b0ed-672fd3fb72b3 service nova] Releasing lock "refresh_cache-6c9fc5a9-8659-497c-bb07-af52fe2e1761" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:21:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:48 user nova-compute[74683]: DEBUG nova.compute.manager [req-5251c221-9e6c-4999-8ad4-82e93cc7ffc2 req-c65c5fee-1b8b-4147-8727-937c6351a481 service nova] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] Received event network-vif-plugged-c1c13166-923d-4839-963a-434a9ba38d94 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:21:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-5251c221-9e6c-4999-8ad4-82e93cc7ffc2 req-c65c5fee-1b8b-4147-8727-937c6351a481 service nova] Acquiring lock "6c9fc5a9-8659-497c-bb07-af52fe2e1761-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:21:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-5251c221-9e6c-4999-8ad4-82e93cc7ffc2 req-c65c5fee-1b8b-4147-8727-937c6351a481 service nova] Lock "6c9fc5a9-8659-497c-bb07-af52fe2e1761-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:21:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-5251c221-9e6c-4999-8ad4-82e93cc7ffc2 req-c65c5fee-1b8b-4147-8727-937c6351a481 service nova] Lock "6c9fc5a9-8659-497c-bb07-af52fe2e1761-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:21:48 user nova-compute[74683]: DEBUG nova.compute.manager [req-5251c221-9e6c-4999-8ad4-82e93cc7ffc2 req-c65c5fee-1b8b-4147-8727-937c6351a481 service nova] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] No waiting events found dispatching network-vif-plugged-c1c13166-923d-4839-963a-434a9ba38d94 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:21:48 user nova-compute[74683]: WARNING nova.compute.manager [req-5251c221-9e6c-4999-8ad4-82e93cc7ffc2 req-c65c5fee-1b8b-4147-8727-937c6351a481 service nova] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] Received unexpected event network-vif-plugged-c1c13166-923d-4839-963a-434a9ba38d94 for instance with vm_state building and task_state spawning.
Oct 16 11:21:50 user nova-compute[74683]: DEBUG nova.compute.manager [req-08330133-5179-4c7c-87d8-a981a6d536e7 req-a5e57998-b928-43e9-bc61-6f20d568a3e0 service nova] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] Received event network-vif-plugged-c1c13166-923d-4839-963a-434a9ba38d94 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:21:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-08330133-5179-4c7c-87d8-a981a6d536e7 req-a5e57998-b928-43e9-bc61-6f20d568a3e0 service nova] Acquiring lock "6c9fc5a9-8659-497c-bb07-af52fe2e1761-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:21:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-08330133-5179-4c7c-87d8-a981a6d536e7 req-a5e57998-b928-43e9-bc61-6f20d568a3e0 service nova] Lock "6c9fc5a9-8659-497c-bb07-af52fe2e1761-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:21:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-08330133-5179-4c7c-87d8-a981a6d536e7 req-a5e57998-b928-43e9-bc61-6f20d568a3e0 service nova] Lock "6c9fc5a9-8659-497c-bb07-af52fe2e1761-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:21:50 user nova-compute[74683]: DEBUG nova.compute.manager [req-08330133-5179-4c7c-87d8-a981a6d536e7 req-a5e57998-b928-43e9-bc61-6f20d568a3e0 service nova] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] No waiting events found dispatching network-vif-plugged-c1c13166-923d-4839-963a-434a9ba38d94 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:21:50 user nova-compute[74683]: WARNING nova.compute.manager [req-08330133-5179-4c7c-87d8-a981a6d536e7 req-a5e57998-b928-43e9-bc61-6f20d568a3e0 service nova] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] Received unexpected event network-vif-plugged-c1c13166-923d-4839-963a-434a9ba38d94 for instance with vm_state building and task_state spawning.
Oct 16 11:21:50 user nova-compute[74683]: DEBUG nova.compute.manager [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] Instance event wait completed in 0 seconds for  {{(pid=74683) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 11:21:50 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] Guest created on hypervisor {{(pid=74683) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 11:21:50 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] Instance spawned successfully.
Oct 16 11:21:50 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 11:21:50 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] Found default for hw_cdrom_bus of ide {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:21:50 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] Found default for hw_disk_bus of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:21:50 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] Found default for hw_input_bus of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:21:50 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] Found default for hw_pointer_model of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:21:50 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] Found default for hw_video_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:21:50 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] Found default for hw_vif_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:21:50 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:50 user nova-compute[74683]: INFO nova.compute.manager [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] Took 6.88 seconds to spawn the instance on the hypervisor.
Oct 16 11:21:50 user nova-compute[74683]: DEBUG nova.compute.manager [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:21:50 user nova-compute[74683]: INFO nova.compute.manager [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] Took 8.01 seconds to build instance.
Oct 16 11:21:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-929a1eb2-59dd-4628-84ed-a3974e7dfbf4 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "6c9fc5a9-8659-497c-bb07-af52fe2e1761" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.142s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:21:50 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:51 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:52 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Acquiring lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:21:52 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.005s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:21:52 user nova-compute[74683]: DEBUG nova.compute.manager [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Starting instance... {{(pid=74683) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 11:21:52 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:21:52 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.016s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:21:52 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74683) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 11:21:52 user nova-compute[74683]: INFO nova.compute.claims [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Claim successful on node user
Oct 16 11:21:52 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:21:52 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:21:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.596s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:21:53 user nova-compute[74683]: DEBUG nova.compute.manager [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Start building networks asynchronously for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 11:21:53 user nova-compute[74683]: DEBUG nova.compute.manager [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Allocating IP information in the background. {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 11:21:53 user nova-compute[74683]: DEBUG nova.network.neutron [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] allocate_for_instance() {{(pid=74683) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 11:21:53 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 11:21:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Acquiring lock "b91af786-36e3-4815-811f-fb3c055e758d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:21:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "b91af786-36e3-4815-811f-fb3c055e758d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:21:53 user nova-compute[74683]: DEBUG nova.compute.manager [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Starting instance... {{(pid=74683) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 11:21:53 user nova-compute[74683]: DEBUG nova.compute.manager [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Start building block device mappings for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 11:21:53 user nova-compute[74683]: DEBUG nova.policy [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3436197c787446d4a03fb7697d7999a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a49078f1240bd88207e487dd4951e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74683) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 11:21:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:21:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:21:53 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74683) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 11:21:53 user nova-compute[74683]: INFO nova.compute.claims [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Claim successful on node user
Oct 16 11:21:53 user nova-compute[74683]: DEBUG nova.compute.manager [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Start spawning the instance on the hypervisor. {{(pid=74683) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 11:21:53 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Creating instance directory {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 11:21:53 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Creating image(s)
Oct 16 11:21:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Acquiring lock "/opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:21:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "/opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:21:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "/opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:21:53 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:53 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.256s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:21:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Acquiring lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:21:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:21:53 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:53 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.274s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:21:53 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk 1073741824 {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:54 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk 1073741824" returned: 0 in 0.074s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:21:54 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.368s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:21:54 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:54 user nova-compute[74683]: DEBUG nova.network.neutron [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Successfully created port: ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 {{(pid=74683) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 11:21:54 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:21:54 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:21:54 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.200s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:21:54 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk. size=1073741824 {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 11:21:54 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:54 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.917s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:21:54 user nova-compute[74683]: DEBUG nova.compute.manager [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Start building networks asynchronously for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 11:21:54 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:54 user nova-compute[74683]: DEBUG nova.compute.manager [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Allocating IP information in the background. {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 11:21:54 user nova-compute[74683]: DEBUG nova.network.neutron [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: b91af786-36e3-4815-811f-fb3c055e758d] allocate_for_instance() {{(pid=74683) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 11:21:54 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 11:21:54 user nova-compute[74683]: DEBUG nova.compute.manager [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Start building block device mappings for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 11:21:54 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:21:54 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Cannot resize image /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk to a smaller size. {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 11:21:54 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Created local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 11:21:54 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Ensure instance console log exists: /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/console.log {{(pid=74683) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 11:21:54 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:21:54 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:21:54 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:21:54 user nova-compute[74683]: DEBUG nova.compute.manager [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Start spawning the instance on the hypervisor. {{(pid=74683) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 11:21:54 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Creating instance directory {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 11:21:54 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Creating image(s)
Oct 16 11:21:54 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Acquiring lock "/opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:21:54 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "/opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:21:54 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "/opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:21:54 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:54 user nova-compute[74683]: DEBUG nova.policy [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3436197c787446d4a03fb7697d7999a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a49078f1240bd88207e487dd4951e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74683) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 11:21:54 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.257s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:21:54 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Acquiring lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:21:54 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:21:54 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:55 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.207s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:21:55 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk 1073741824 {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:55 user nova-compute[74683]: DEBUG nova.network.neutron [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Successfully updated port: ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:21:55 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk 1073741824" returned: 0 in 0.067s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:21:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:21:55 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:55 user nova-compute[74683]: DEBUG nova.compute.manager [req-0a6086fd-2e3a-4345-909d-ab1f139ad7d2 req-7f772d50-e368-4f9e-b9cc-5f39fb2b2542 service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Received event network-changed-ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:21:55 user nova-compute[74683]: DEBUG nova.compute.manager [req-0a6086fd-2e3a-4345-909d-ab1f139ad7d2 req-7f772d50-e368-4f9e-b9cc-5f39fb2b2542 service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Refreshing instance network info cache due to event network-changed-ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:21:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-0a6086fd-2e3a-4345-909d-ab1f139ad7d2 req-7f772d50-e368-4f9e-b9cc-5f39fb2b2542 service nova] Acquiring lock "refresh_cache-9b8ba94f-43cc-4f06-bcd9-83935ccbe117" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:21:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-0a6086fd-2e3a-4345-909d-ab1f139ad7d2 req-7f772d50-e368-4f9e-b9cc-5f39fb2b2542 service nova] Acquired lock "refresh_cache-9b8ba94f-43cc-4f06-bcd9-83935ccbe117" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:21:55 user nova-compute[74683]: DEBUG nova.network.neutron [req-0a6086fd-2e3a-4345-909d-ab1f139ad7d2 req-7f772d50-e368-4f9e-b9cc-5f39fb2b2542 service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Refreshing network info cache for port ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:21:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Acquiring lock "refresh_cache-9b8ba94f-43cc-4f06-bcd9-83935ccbe117" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:21:55 user nova-compute[74683]: DEBUG nova.network.neutron [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Successfully created port: abc9cf45-e4f5-4a33-9ffc-dab110e73398 {{(pid=74683) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 11:21:55 user nova-compute[74683]: DEBUG nova.network.neutron [req-0a6086fd-2e3a-4345-909d-ab1f139ad7d2 req-7f772d50-e368-4f9e-b9cc-5f39fb2b2542 service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:21:55 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.234s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:21:55 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk. size=1073741824 {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 11:21:55 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:21:55 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:21:55 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Cannot resize image /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk to a smaller size. {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 11:21:55 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Created local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 11:21:55 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Ensure instance console log exists: /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/console.log {{(pid=74683) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 11:21:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:21:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:21:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:21:55 user nova-compute[74683]: DEBUG nova.network.neutron [req-0a6086fd-2e3a-4345-909d-ab1f139ad7d2 req-7f772d50-e368-4f9e-b9cc-5f39fb2b2542 service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:21:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-0a6086fd-2e3a-4345-909d-ab1f139ad7d2 req-7f772d50-e368-4f9e-b9cc-5f39fb2b2542 service nova] Releasing lock "refresh_cache-9b8ba94f-43cc-4f06-bcd9-83935ccbe117" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:21:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Acquired lock "refresh_cache-9b8ba94f-43cc-4f06-bcd9-83935ccbe117" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:21:55 user nova-compute[74683]: DEBUG nova.network.neutron [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:21:55 user nova-compute[74683]: DEBUG nova.network.neutron [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:21:55 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG nova.network.neutron [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Updating instance_info_cache with network_info: [{"id": "ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665", "address": "fa:16:3e:d4:56:40", "network": {"id": "fa128ba8-cd2f-4621-ac04-ecc21569bb68", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321708612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66a49078f1240bd88207e487dd4951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff8b53f2-e6", "ovs_interfaceid": "ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Releasing lock "refresh_cache-9b8ba94f-43cc-4f06-bcd9-83935ccbe117" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG nova.compute.manager [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Instance network_info: |[{"id": "ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665", "address": "fa:16:3e:d4:56:40", "network": {"id": "fa128ba8-cd2f-4621-ac04-ecc21569bb68", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321708612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66a49078f1240bd88207e487dd4951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff8b53f2-e6", "ovs_interfaceid": "ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Start _get_guest_xml network_info=[{"id": "ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665", "address": "fa:16:3e:d4:56:40", "network": {"id": "fa128ba8-cd2f-4621-ac04-ecc21569bb68", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321708612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66a49078f1240bd88207e487dd4951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff8b53f2-e6", "ovs_interfaceid": "ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:21:56 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:21:56 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:21:56 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:21:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-75769581',display_name='tempest-ServerRescueNegativeTestJSON-server-75769581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-75769581',id=23,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e66a49078f1240bd88207e487dd4951e',ramdisk_id='',reservation_id='r-eju2vrqd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1690011355',owner_user_name='tempest-ServerRescueNegativeTestJSON-1690011355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:21:53Z,user_data=None,user_id='3436197c787446d4a03fb7697d7999a1',uuid=9b8ba94f-43cc-4f06-bcd9-83935ccbe117,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665", "address": "fa:16:3e:d4:56:40", "network": {"id": "fa128ba8-cd2f-4621-ac04-ecc21569bb68", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321708612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66a49078f1240bd88207e487dd4951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff8b53f2-e6", "ovs_interfaceid": "ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Converting VIF {"id": "ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665", "address": "fa:16:3e:d4:56:40", "network": {"id": "fa128ba8-cd2f-4621-ac04-ecc21569bb68", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321708612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66a49078f1240bd88207e487dd4951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff8b53f2-e6", "ovs_interfaceid": "ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:56:40,bridge_name='br-int',has_traffic_filtering=True,id=ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665,network=Network(fa128ba8-cd2f-4621-ac04-ecc21569bb68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff8b53f2-e6') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG nova.objects.instance [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lazy-loading 'pci_devices' on Instance uuid 9b8ba94f-43cc-4f06-bcd9-83935ccbe117 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:21:56 user nova-compute[74683]:   <uuid>9b8ba94f-43cc-4f06-bcd9-83935ccbe117</uuid>
Oct 16 11:21:56 user nova-compute[74683]:   <name>instance-00000017</name>
Oct 16 11:21:56 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:21:56 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:21:56 user nova-compute[74683]:   <metadata>
Oct 16 11:21:56 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:21:56 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:21:56 user nova-compute[74683]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-75769581</nova:name>
Oct 16 11:21:56 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:21:56</nova:creationTime>
Oct 16 11:21:56 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:21:56 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:21:56 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:21:56 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:21:56 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:21:56 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:21:56 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:21:56 user nova-compute[74683]:       <nova:owner>
Oct 16 11:21:56 user nova-compute[74683]:         <nova:user uuid="3436197c787446d4a03fb7697d7999a1">tempest-ServerRescueNegativeTestJSON-1690011355-project-member</nova:user>
Oct 16 11:21:56 user nova-compute[74683]:         <nova:project uuid="e66a49078f1240bd88207e487dd4951e">tempest-ServerRescueNegativeTestJSON-1690011355</nova:project>
Oct 16 11:21:56 user nova-compute[74683]:       </nova:owner>
Oct 16 11:21:56 user nova-compute[74683]:       <nova:root type="image" uuid="0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f"/>
Oct 16 11:21:56 user nova-compute[74683]:       <nova:ports>
Oct 16 11:21:56 user nova-compute[74683]:         <nova:port uuid="ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665">
Oct 16 11:21:56 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 16 11:21:56 user nova-compute[74683]:         </nova:port>
Oct 16 11:21:56 user nova-compute[74683]:       </nova:ports>
Oct 16 11:21:56 user nova-compute[74683]:     </nova:instance>
Oct 16 11:21:56 user nova-compute[74683]:   </metadata>
Oct 16 11:21:56 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:21:56 user nova-compute[74683]:     <system>
Oct 16 11:21:56 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:21:56 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:21:56 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:21:56 user nova-compute[74683]:       <entry name="serial">9b8ba94f-43cc-4f06-bcd9-83935ccbe117</entry>
Oct 16 11:21:56 user nova-compute[74683]:       <entry name="uuid">9b8ba94f-43cc-4f06-bcd9-83935ccbe117</entry>
Oct 16 11:21:56 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:21:56 user nova-compute[74683]:     </system>
Oct 16 11:21:56 user nova-compute[74683]:   </sysinfo>
Oct 16 11:21:56 user nova-compute[74683]:   <os>
Oct 16 11:21:56 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:21:56 user nova-compute[74683]:     <boot dev="hd"/>
Oct 16 11:21:56 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:21:56 user nova-compute[74683]:   </os>
Oct 16 11:21:56 user nova-compute[74683]:   <features>
Oct 16 11:21:56 user nova-compute[74683]:     <acpi/>
Oct 16 11:21:56 user nova-compute[74683]:     <apic/>
Oct 16 11:21:56 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:21:56 user nova-compute[74683]:   </features>
Oct 16 11:21:56 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:21:56 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:21:56 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:21:56 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:21:56 user nova-compute[74683]:   </clock>
Oct 16 11:21:56 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:21:56 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:21:56 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:21:56 user nova-compute[74683]:   </cpu>
Oct 16 11:21:56 user nova-compute[74683]:   <devices>
Oct 16 11:21:56 user nova-compute[74683]:     <disk type="file" device="disk">
Oct 16 11:21:56 user nova-compute[74683]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 11:21:56 user nova-compute[74683]:       <source file="/opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk"/>
Oct 16 11:21:56 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:21:56 user nova-compute[74683]:     </disk>
Oct 16 11:21:56 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:21:56 user nova-compute[74683]:       <mac address="fa:16:3e:d4:56:40"/>
Oct 16 11:21:56 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:21:56 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:21:56 user nova-compute[74683]:       <target dev="tapff8b53f2-e6"/>
Oct 16 11:21:56 user nova-compute[74683]:     </interface>
Oct 16 11:21:56 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:21:56 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/console.log" append="off"/>
Oct 16 11:21:56 user nova-compute[74683]:     </serial>
Oct 16 11:21:56 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:21:56 user nova-compute[74683]:     <video>
Oct 16 11:21:56 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:21:56 user nova-compute[74683]:     </video>
Oct 16 11:21:56 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:21:56 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:21:56 user nova-compute[74683]:     </rng>
Oct 16 11:21:56 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:21:56 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:21:56 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:21:56 user nova-compute[74683]:     </memballoon>
Oct 16 11:21:56 user nova-compute[74683]:   </devices>
Oct 16 11:21:56 user nova-compute[74683]: </domain>
Oct 16 11:21:56 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:21:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-75769581',display_name='tempest-ServerRescueNegativeTestJSON-server-75769581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-75769581',id=23,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e66a49078f1240bd88207e487dd4951e',ramdisk_id='',reservation_id='r-eju2vrqd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1690011355',owner_user_name='tempest-ServerRescueNegativeTestJSON-1690011355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:21:53Z,user_data=None,user_id='3436197c787446d4a03fb7697d7999a1',uuid=9b8ba94f-43cc-4f06-bcd9-83935ccbe117,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665", "address": "fa:16:3e:d4:56:40", "network": {"id": "fa128ba8-cd2f-4621-ac04-ecc21569bb68", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321708612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66a49078f1240bd88207e487dd4951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff8b53f2-e6", "ovs_interfaceid": "ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Converting VIF {"id": "ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665", "address": "fa:16:3e:d4:56:40", "network": {"id": "fa128ba8-cd2f-4621-ac04-ecc21569bb68", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321708612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66a49078f1240bd88207e487dd4951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff8b53f2-e6", "ovs_interfaceid": "ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:56:40,bridge_name='br-int',has_traffic_filtering=True,id=ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665,network=Network(fa128ba8-cd2f-4621-ac04-ecc21569bb68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff8b53f2-e6') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG os_vif [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:56:40,bridge_name='br-int',has_traffic_filtering=True,id=ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665,network=Network(fa128ba8-cd2f-4621-ac04-ecc21569bb68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff8b53f2-e6') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dcdbe97a-003c-51e0-b42f-73d13c4d386f', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff8b53f2-e6, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapff8b53f2-e6, col_values=(('qos', UUID('0cf0b200-7a48-4762-8325-cae88d5adf2d')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapff8b53f2-e6, col_values=(('external_ids', {'iface-id': 'ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:56:40', 'vm-uuid': '9b8ba94f-43cc-4f06-bcd9-83935ccbe117'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG nova.network.neutron [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Successfully updated port: abc9cf45-e4f5-4a33-9ffc-dab110e73398 {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:56 user nova-compute[74683]: INFO os_vif [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:56:40,bridge_name='br-int',has_traffic_filtering=True,id=ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665,network=Network(fa128ba8-cd2f-4621-ac04-ecc21569bb68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff8b53f2-e6')
Oct 16 11:21:56 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Acquiring lock "refresh_cache-b91af786-36e3-4815-811f-fb3c055e758d" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Acquired lock "refresh_cache-b91af786-36e3-4815-811f-fb3c055e758d" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG nova.network.neutron [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG nova.compute.manager [req-12912645-c2c2-40ad-b450-a9064ee54e8c req-88abdae1-0ad5-487f-8363-38afe339c9f6 service nova] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Received event network-changed-abc9cf45-e4f5-4a33-9ffc-dab110e73398 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG nova.compute.manager [req-12912645-c2c2-40ad-b450-a9064ee54e8c req-88abdae1-0ad5-487f-8363-38afe339c9f6 service nova] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Refreshing instance network info cache due to event network-changed-abc9cf45-e4f5-4a33-9ffc-dab110e73398. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-12912645-c2c2-40ad-b450-a9064ee54e8c req-88abdae1-0ad5-487f-8363-38afe339c9f6 service nova] Acquiring lock "refresh_cache-b91af786-36e3-4815-811f-fb3c055e758d" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] No VIF found with MAC fa:16:3e:d4:56:40, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG nova.network.neutron [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG nova.network.neutron [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Updating instance_info_cache with network_info: [{"id": "abc9cf45-e4f5-4a33-9ffc-dab110e73398", "address": "fa:16:3e:03:03:02", "network": {"id": "fa128ba8-cd2f-4621-ac04-ecc21569bb68", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321708612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66a49078f1240bd88207e487dd4951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc9cf45-e4", "ovs_interfaceid": "abc9cf45-e4f5-4a33-9ffc-dab110e73398", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Releasing lock "refresh_cache-b91af786-36e3-4815-811f-fb3c055e758d" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG nova.compute.manager [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Instance network_info: |[{"id": "abc9cf45-e4f5-4a33-9ffc-dab110e73398", "address": "fa:16:3e:03:03:02", "network": {"id": "fa128ba8-cd2f-4621-ac04-ecc21569bb68", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321708612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66a49078f1240bd88207e487dd4951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc9cf45-e4", "ovs_interfaceid": "abc9cf45-e4f5-4a33-9ffc-dab110e73398", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-12912645-c2c2-40ad-b450-a9064ee54e8c req-88abdae1-0ad5-487f-8363-38afe339c9f6 service nova] Acquired lock "refresh_cache-b91af786-36e3-4815-811f-fb3c055e758d" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG nova.network.neutron [req-12912645-c2c2-40ad-b450-a9064ee54e8c req-88abdae1-0ad5-487f-8363-38afe339c9f6 service nova] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Refreshing network info cache for port abc9cf45-e4f5-4a33-9ffc-dab110e73398 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Start _get_guest_xml network_info=[{"id": "abc9cf45-e4f5-4a33-9ffc-dab110e73398", "address": "fa:16:3e:03:03:02", "network": {"id": "fa128ba8-cd2f-4621-ac04-ecc21569bb68", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321708612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66a49078f1240bd88207e487dd4951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc9cf45-e4", "ovs_interfaceid": "abc9cf45-e4f5-4a33-9ffc-dab110e73398", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:21:56 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:21:56 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:21:56 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:21:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-311629692',display_name='tempest-ServerRescueNegativeTestJSON-server-311629692',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-311629692',id=24,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e66a49078f1240bd88207e487dd4951e',ramdisk_id='',reservation_id='r-d5sue84g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1690011355',owner_user_name='tempest-ServerRescueNegativeTestJSON-1690011355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:21:54Z,user_data=None,user_id='3436197c787446d4a03fb7697d7999a1',uuid=b91af786-36e3-4815-811f-fb3c055e758d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "abc9cf45-e4f5-4a33-9ffc-dab110e73398", "address": "fa:16:3e:03:03:02", "network": {"id": "fa128ba8-cd2f-4621-ac04-ecc21569bb68", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321708612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66a49078f1240bd88207e487dd4951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc9cf45-e4", "ovs_interfaceid": "abc9cf45-e4f5-4a33-9ffc-dab110e73398", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Converting VIF {"id": "abc9cf45-e4f5-4a33-9ffc-dab110e73398", "address": "fa:16:3e:03:03:02", "network": {"id": "fa128ba8-cd2f-4621-ac04-ecc21569bb68", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321708612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66a49078f1240bd88207e487dd4951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc9cf45-e4", "ovs_interfaceid": "abc9cf45-e4f5-4a33-9ffc-dab110e73398", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:03:02,bridge_name='br-int',has_traffic_filtering=True,id=abc9cf45-e4f5-4a33-9ffc-dab110e73398,network=Network(fa128ba8-cd2f-4621-ac04-ecc21569bb68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabc9cf45-e4') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG nova.objects.instance [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lazy-loading 'pci_devices' on Instance uuid b91af786-36e3-4815-811f-fb3c055e758d {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: b91af786-36e3-4815-811f-fb3c055e758d] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:21:56 user nova-compute[74683]:   <uuid>b91af786-36e3-4815-811f-fb3c055e758d</uuid>
Oct 16 11:21:56 user nova-compute[74683]:   <name>instance-00000018</name>
Oct 16 11:21:56 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:21:56 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:21:56 user nova-compute[74683]:   <metadata>
Oct 16 11:21:56 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:21:56 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:21:56 user nova-compute[74683]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-311629692</nova:name>
Oct 16 11:21:56 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:21:56</nova:creationTime>
Oct 16 11:21:56 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:21:56 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:21:56 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:21:56 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:21:56 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:21:56 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:21:56 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:21:56 user nova-compute[74683]:       <nova:owner>
Oct 16 11:21:56 user nova-compute[74683]:         <nova:user uuid="3436197c787446d4a03fb7697d7999a1">tempest-ServerRescueNegativeTestJSON-1690011355-project-member</nova:user>
Oct 16 11:21:56 user nova-compute[74683]:         <nova:project uuid="e66a49078f1240bd88207e487dd4951e">tempest-ServerRescueNegativeTestJSON-1690011355</nova:project>
Oct 16 11:21:56 user nova-compute[74683]:       </nova:owner>
Oct 16 11:21:56 user nova-compute[74683]:       <nova:root type="image" uuid="0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f"/>
Oct 16 11:21:56 user nova-compute[74683]:       <nova:ports>
Oct 16 11:21:56 user nova-compute[74683]:         <nova:port uuid="abc9cf45-e4f5-4a33-9ffc-dab110e73398">
Oct 16 11:21:56 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 16 11:21:56 user nova-compute[74683]:         </nova:port>
Oct 16 11:21:56 user nova-compute[74683]:       </nova:ports>
Oct 16 11:21:56 user nova-compute[74683]:     </nova:instance>
Oct 16 11:21:56 user nova-compute[74683]:   </metadata>
Oct 16 11:21:56 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:21:56 user nova-compute[74683]:     <system>
Oct 16 11:21:56 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:21:56 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:21:56 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:21:56 user nova-compute[74683]:       <entry name="serial">b91af786-36e3-4815-811f-fb3c055e758d</entry>
Oct 16 11:21:56 user nova-compute[74683]:       <entry name="uuid">b91af786-36e3-4815-811f-fb3c055e758d</entry>
Oct 16 11:21:56 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:21:56 user nova-compute[74683]:     </system>
Oct 16 11:21:56 user nova-compute[74683]:   </sysinfo>
Oct 16 11:21:56 user nova-compute[74683]:   <os>
Oct 16 11:21:56 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:21:56 user nova-compute[74683]:     <boot dev="hd"/>
Oct 16 11:21:56 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:21:56 user nova-compute[74683]:   </os>
Oct 16 11:21:56 user nova-compute[74683]:   <features>
Oct 16 11:21:56 user nova-compute[74683]:     <acpi/>
Oct 16 11:21:56 user nova-compute[74683]:     <apic/>
Oct 16 11:21:56 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:21:56 user nova-compute[74683]:   </features>
Oct 16 11:21:56 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:21:56 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:21:56 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:21:56 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:21:56 user nova-compute[74683]:   </clock>
Oct 16 11:21:56 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:21:56 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:21:56 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:21:56 user nova-compute[74683]:   </cpu>
Oct 16 11:21:56 user nova-compute[74683]:   <devices>
Oct 16 11:21:56 user nova-compute[74683]:     <disk type="file" device="disk">
Oct 16 11:21:56 user nova-compute[74683]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 11:21:56 user nova-compute[74683]:       <source file="/opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk"/>
Oct 16 11:21:56 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:21:56 user nova-compute[74683]:     </disk>
Oct 16 11:21:56 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:21:56 user nova-compute[74683]:       <mac address="fa:16:3e:03:03:02"/>
Oct 16 11:21:56 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:21:56 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:21:56 user nova-compute[74683]:       <target dev="tapabc9cf45-e4"/>
Oct 16 11:21:56 user nova-compute[74683]:     </interface>
Oct 16 11:21:56 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:21:56 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/console.log" append="off"/>
Oct 16 11:21:56 user nova-compute[74683]:     </serial>
Oct 16 11:21:56 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:21:56 user nova-compute[74683]:     <video>
Oct 16 11:21:56 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:21:56 user nova-compute[74683]:     </video>
Oct 16 11:21:56 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:21:56 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:21:56 user nova-compute[74683]:     </rng>
Oct 16 11:21:56 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:21:56 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:21:56 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:21:56 user nova-compute[74683]:     </memballoon>
Oct 16 11:21:56 user nova-compute[74683]:   </devices>
Oct 16 11:21:56 user nova-compute[74683]: </domain>
Oct 16 11:21:56 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:21:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-311629692',display_name='tempest-ServerRescueNegativeTestJSON-server-311629692',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-311629692',id=24,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e66a49078f1240bd88207e487dd4951e',ramdisk_id='',reservation_id='r-d5sue84g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1690011355',owner_user_name='tempest-ServerRescueNegativeTestJSON-1690011355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:21:54Z,user_data=None,user_id='3436197c787446d4a03fb7697d7999a1',uuid=b91af786-36e3-4815-811f-fb3c055e758d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "abc9cf45-e4f5-4a33-9ffc-dab110e73398", "address": "fa:16:3e:03:03:02", "network": {"id": "fa128ba8-cd2f-4621-ac04-ecc21569bb68", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321708612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66a49078f1240bd88207e487dd4951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc9cf45-e4", "ovs_interfaceid": "abc9cf45-e4f5-4a33-9ffc-dab110e73398", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Converting VIF {"id": "abc9cf45-e4f5-4a33-9ffc-dab110e73398", "address": "fa:16:3e:03:03:02", "network": {"id": "fa128ba8-cd2f-4621-ac04-ecc21569bb68", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321708612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66a49078f1240bd88207e487dd4951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc9cf45-e4", "ovs_interfaceid": "abc9cf45-e4f5-4a33-9ffc-dab110e73398", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:03:02,bridge_name='br-int',has_traffic_filtering=True,id=abc9cf45-e4f5-4a33-9ffc-dab110e73398,network=Network(fa128ba8-cd2f-4621-ac04-ecc21569bb68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabc9cf45-e4') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG os_vif [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:03:02,bridge_name='br-int',has_traffic_filtering=True,id=abc9cf45-e4f5-4a33-9ffc-dab110e73398,network=Network(fa128ba8-cd2f-4621-ac04-ecc21569bb68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabc9cf45-e4') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '882424cf-56a6-5f25-b7f1-7f1be1016a84', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapabc9cf45-e4, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapabc9cf45-e4, col_values=(('qos', UUID('78e142f0-131f-495d-a779-728e94305086')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapabc9cf45-e4, col_values=(('external_ids', {'iface-id': 'abc9cf45-e4f5-4a33-9ffc-dab110e73398', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:03:02', 'vm-uuid': 'b91af786-36e3-4815-811f-fb3c055e758d'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:56 user nova-compute[74683]: INFO os_vif [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:03:02,bridge_name='br-int',has_traffic_filtering=True,id=abc9cf45-e4f5-4a33-9ffc-dab110e73398,network=Network(fa128ba8-cd2f-4621-ac04-ecc21569bb68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabc9cf45-e4')
Oct 16 11:21:56 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:21:56 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] No VIF found with MAC fa:16:3e:03:03:02, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:21:57 user nova-compute[74683]: DEBUG nova.network.neutron [req-12912645-c2c2-40ad-b450-a9064ee54e8c req-88abdae1-0ad5-487f-8363-38afe339c9f6 service nova] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Updated VIF entry in instance network info cache for port abc9cf45-e4f5-4a33-9ffc-dab110e73398. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:21:57 user nova-compute[74683]: DEBUG nova.network.neutron [req-12912645-c2c2-40ad-b450-a9064ee54e8c req-88abdae1-0ad5-487f-8363-38afe339c9f6 service nova] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Updating instance_info_cache with network_info: [{"id": "abc9cf45-e4f5-4a33-9ffc-dab110e73398", "address": "fa:16:3e:03:03:02", "network": {"id": "fa128ba8-cd2f-4621-ac04-ecc21569bb68", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321708612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66a49078f1240bd88207e487dd4951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc9cf45-e4", "ovs_interfaceid": "abc9cf45-e4f5-4a33-9ffc-dab110e73398", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:21:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-12912645-c2c2-40ad-b450-a9064ee54e8c req-88abdae1-0ad5-487f-8363-38afe339c9f6 service nova] Releasing lock "refresh_cache-b91af786-36e3-4815-811f-fb3c055e758d" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:21:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:58 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:58 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:58 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:58 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:58 user nova-compute[74683]: DEBUG nova.compute.manager [req-ce33d4bc-d04c-4288-92f0-fda043b11d5a req-bd8d7ea9-6413-4c85-998e-5bb76587ac4e service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Received event network-vif-plugged-ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:21:58 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-ce33d4bc-d04c-4288-92f0-fda043b11d5a req-bd8d7ea9-6413-4c85-998e-5bb76587ac4e service nova] Acquiring lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:21:58 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-ce33d4bc-d04c-4288-92f0-fda043b11d5a req-bd8d7ea9-6413-4c85-998e-5bb76587ac4e service nova] Lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:21:58 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-ce33d4bc-d04c-4288-92f0-fda043b11d5a req-bd8d7ea9-6413-4c85-998e-5bb76587ac4e service nova] Lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:21:58 user nova-compute[74683]: DEBUG nova.compute.manager [req-ce33d4bc-d04c-4288-92f0-fda043b11d5a req-bd8d7ea9-6413-4c85-998e-5bb76587ac4e service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] No waiting events found dispatching network-vif-plugged-ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:21:58 user nova-compute[74683]: WARNING nova.compute.manager [req-ce33d4bc-d04c-4288-92f0-fda043b11d5a req-bd8d7ea9-6413-4c85-998e-5bb76587ac4e service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Received unexpected event network-vif-plugged-ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 for instance with vm_state building and task_state spawning.
Oct 16 11:21:59 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:59 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:59 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:59 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:59 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:59 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Acquiring lock "0b79d385-e512-4297-9aa4-2b9bb0cac23c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:21:59 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Lock "0b79d385-e512-4297-9aa4-2b9bb0cac23c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:21:59 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:59 user nova-compute[74683]: DEBUG nova.compute.manager [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Starting instance... {{(pid=74683) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 11:21:59 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:59 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:59 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:59 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:21:59 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:21:59 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74683) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 11:21:59 user nova-compute[74683]: INFO nova.compute.claims [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Claim successful on node user
Oct 16 11:21:59 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:21:59 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:22:00 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:22:00 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:22:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.612s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:22:00 user nova-compute[74683]: DEBUG nova.compute.manager [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Start building networks asynchronously for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 11:22:00 user nova-compute[74683]: DEBUG nova.compute.manager [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Allocating IP information in the background. {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 11:22:00 user nova-compute[74683]: DEBUG nova.network.neutron [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] allocate_for_instance() {{(pid=74683) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 11:22:00 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 11:22:00 user nova-compute[74683]: DEBUG nova.compute.manager [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Start building block device mappings for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 11:22:00 user nova-compute[74683]: DEBUG nova.policy [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c9a0c7b02744e87885fe8d252e88d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adfa96f9deab4c4eb584876b48e804e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74683) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 11:22:00 user nova-compute[74683]: DEBUG nova.compute.manager [req-e6f42faa-9034-4fe9-adc7-871188e54d7a req-4a6ede6f-6780-4bef-87f0-827d5aaccc83 service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Received event network-vif-plugged-ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:22:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e6f42faa-9034-4fe9-adc7-871188e54d7a req-4a6ede6f-6780-4bef-87f0-827d5aaccc83 service nova] Acquiring lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:22:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e6f42faa-9034-4fe9-adc7-871188e54d7a req-4a6ede6f-6780-4bef-87f0-827d5aaccc83 service nova] Lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:22:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e6f42faa-9034-4fe9-adc7-871188e54d7a req-4a6ede6f-6780-4bef-87f0-827d5aaccc83 service nova] Lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:22:00 user nova-compute[74683]: DEBUG nova.compute.manager [req-e6f42faa-9034-4fe9-adc7-871188e54d7a req-4a6ede6f-6780-4bef-87f0-827d5aaccc83 service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] No waiting events found dispatching network-vif-plugged-ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:22:00 user nova-compute[74683]: WARNING nova.compute.manager [req-e6f42faa-9034-4fe9-adc7-871188e54d7a req-4a6ede6f-6780-4bef-87f0-827d5aaccc83 service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Received unexpected event network-vif-plugged-ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 for instance with vm_state building and task_state spawning.
Oct 16 11:22:00 user nova-compute[74683]: DEBUG nova.compute.manager [req-e6f42faa-9034-4fe9-adc7-871188e54d7a req-4a6ede6f-6780-4bef-87f0-827d5aaccc83 service nova] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Received event network-vif-plugged-abc9cf45-e4f5-4a33-9ffc-dab110e73398 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:22:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e6f42faa-9034-4fe9-adc7-871188e54d7a req-4a6ede6f-6780-4bef-87f0-827d5aaccc83 service nova] Acquiring lock "b91af786-36e3-4815-811f-fb3c055e758d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:22:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e6f42faa-9034-4fe9-adc7-871188e54d7a req-4a6ede6f-6780-4bef-87f0-827d5aaccc83 service nova] Lock "b91af786-36e3-4815-811f-fb3c055e758d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:22:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e6f42faa-9034-4fe9-adc7-871188e54d7a req-4a6ede6f-6780-4bef-87f0-827d5aaccc83 service nova] Lock "b91af786-36e3-4815-811f-fb3c055e758d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:22:00 user nova-compute[74683]: DEBUG nova.compute.manager [req-e6f42faa-9034-4fe9-adc7-871188e54d7a req-4a6ede6f-6780-4bef-87f0-827d5aaccc83 service nova] [instance: b91af786-36e3-4815-811f-fb3c055e758d] No waiting events found dispatching network-vif-plugged-abc9cf45-e4f5-4a33-9ffc-dab110e73398 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:22:00 user nova-compute[74683]: WARNING nova.compute.manager [req-e6f42faa-9034-4fe9-adc7-871188e54d7a req-4a6ede6f-6780-4bef-87f0-827d5aaccc83 service nova] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Received unexpected event network-vif-plugged-abc9cf45-e4f5-4a33-9ffc-dab110e73398 for instance with vm_state building and task_state spawning.
Oct 16 11:22:00 user nova-compute[74683]: DEBUG nova.compute.manager [req-e6f42faa-9034-4fe9-adc7-871188e54d7a req-4a6ede6f-6780-4bef-87f0-827d5aaccc83 service nova] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Received event network-vif-plugged-abc9cf45-e4f5-4a33-9ffc-dab110e73398 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:22:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e6f42faa-9034-4fe9-adc7-871188e54d7a req-4a6ede6f-6780-4bef-87f0-827d5aaccc83 service nova] Acquiring lock "b91af786-36e3-4815-811f-fb3c055e758d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:22:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e6f42faa-9034-4fe9-adc7-871188e54d7a req-4a6ede6f-6780-4bef-87f0-827d5aaccc83 service nova] Lock "b91af786-36e3-4815-811f-fb3c055e758d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:22:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e6f42faa-9034-4fe9-adc7-871188e54d7a req-4a6ede6f-6780-4bef-87f0-827d5aaccc83 service nova] Lock "b91af786-36e3-4815-811f-fb3c055e758d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:22:00 user nova-compute[74683]: DEBUG nova.compute.manager [req-e6f42faa-9034-4fe9-adc7-871188e54d7a req-4a6ede6f-6780-4bef-87f0-827d5aaccc83 service nova] [instance: b91af786-36e3-4815-811f-fb3c055e758d] No waiting events found dispatching network-vif-plugged-abc9cf45-e4f5-4a33-9ffc-dab110e73398 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:22:00 user nova-compute[74683]: WARNING nova.compute.manager [req-e6f42faa-9034-4fe9-adc7-871188e54d7a req-4a6ede6f-6780-4bef-87f0-827d5aaccc83 service nova] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Received unexpected event network-vif-plugged-abc9cf45-e4f5-4a33-9ffc-dab110e73398 for instance with vm_state building and task_state spawning.
Oct 16 11:22:00 user nova-compute[74683]: DEBUG nova.compute.manager [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Start spawning the instance on the hypervisor. {{(pid=74683) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 11:22:00 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Creating instance directory {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 11:22:00 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Creating image(s)
Oct 16 11:22:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Acquiring lock "/opt/stack/data/nova/instances/0b79d385-e512-4297-9aa4-2b9bb0cac23c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:22:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Lock "/opt/stack/data/nova/instances/0b79d385-e512-4297-9aa4-2b9bb0cac23c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:22:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Lock "/opt/stack/data/nova/instances/0b79d385-e512-4297-9aa4-2b9bb0cac23c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:22:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.197s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Acquiring lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:22:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:22:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG nova.compute.manager [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] Start spawning the instance on the hypervisor. {{(pid=74683) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] Creating instance directory {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 11:22:01 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] Creating image(s)
Oct 16 11:22:01 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] Did not create local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] Ensure instance console log exists: /opt/stack/data/nova/instances/b8b4a8e2-2c42-423d-954e-cab381506ca7/console.log {{(pid=74683) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] Start _get_guest_xml network_info=[{"id": "4e53b899-a596-47a3-8e17-88748f58e737", "address": "fa:16:3e:05:6b:b7", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e53b899-a5", "ovs_interfaceid": "4e53b899-a596-47a3-8e17-88748f58e737", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oBQkGHsL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b8b4a8e2-2c42-423d-954e-cab381506ca7', 'attached_at': '', 'detached_at': '', 'volume_id': '7e532f21-699f-4800-92ab-2d7ddef102ea', 'serial': '7e532f21-699f-4800-92ab-2d7ddef102ea'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': '1fe756f2-df0d-4086-88f5-8872a9ad5bb6', 'volume_type': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:22:01 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:22:01 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:22:01 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] Calling os-brick to attach iSCSI Volume {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oBQkGHsL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:22:01 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:22:01 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:22:01 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:22:01 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:22:01 user nova-compute[74683]: INFO os_brick.initiator.connectors.iscsi [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 11:22:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea -p 172.16.0.220:3260 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6d0460-c76f-454c-8865-78a081824205]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 11:22:01 user nova-compute[74683]:  {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea -p 172.16.0.220:3260 --interface default --op new {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[6796d2bc-9183-4e80-bef9-88357d5cbd63]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea] added\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea] added
Oct 16 11:22:01 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.189s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/0b79d385-e512-4297-9aa4-2b9bb0cac23c/disk 1073741824 {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72c4515-2554-4faf-9247-0bf604ae763d]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/0b79d385-e512-4297-9aa4-2b9bb0cac23c/disk 1073741824" returned: 0 in 0.059s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce30b280-872d-4c80-8f70-5115e2a19af3]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oBQkGHsL {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG nova.network.neutron [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Successfully created port: c8345df8-9a3f-4261-a04c-59a0653140d0 {{(pid=74683) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oBQkGHsL" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[25485210-24d5-494e-8532-5357fadcdba7]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oBQkGHsL'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd70191-b0f9-4c33-88a0-644c5e0cd6db]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5c6d3a-a678-42e2-8929-2208c9943199]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3b8d2-beea-4362-8602-5134c21ac2ff (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:22:01 user nova-compute[74683]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)
Oct 16 11:22:01 user nova-compute[74683]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3b8d2-beea-4362-8602-5134c21ac2ff (non-flash)
Oct 16 11:22:01 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:22:01 user nova-compute[74683]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)
Oct 16 11:22:01 user nova-compute[74683]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3b8d2-beea-4362-8602-5134c21ac2ff (non-flash)
Oct 16 11:22:01 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea -p 172.16.0.220:3260 --login {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.184s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0b79d385-e512-4297-9aa4-2b9bb0cac23c/disk. size=1073741824 {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b79d385-e512-4297-9aa4-2b9bb0cac23c/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea -p 172.16.0.220:3260 --login" returned: 0 in 0.102s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61ec65a-e150-43be-a398-617bd21633f4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea, portal: 172.16.0.220,3260]
Oct 16 11:22:01 user nova-compute[74683]: Login to [iface: default, target: iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea, portal: 172.16.0.220,3260] successful.
Oct 16 11:22:01 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6b0cee-dbc4-41f6-bf0e-e17c31d33fb7]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d6ee3f-f68e-4e5d-af06-7458c5ee1d5f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3b8d2-beea-4362-8602-5134c21ac2ff (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:22:01 user nova-compute[74683]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)
Oct 16 11:22:01 user nova-compute[74683]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3b8d2-beea-4362-8602-5134c21ac2ff (non-flash)
Oct 16 11:22:01 user nova-compute[74683]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea (non-flash)
Oct 16 11:22:01 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:22:01 user nova-compute[74683]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)
Oct 16 11:22:01 user nova-compute[74683]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3b8d2-beea-4362-8602-5134c21ac2ff (non-flash)
Oct 16 11:22:01 user nova-compute[74683]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea (non-flash)
Oct 16 11:22:01 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.441s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Connected to 172.16.0.220:3260 {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] HCTL ('35', '-', '-', 0) found on session 21 with lun 0 {{(pid=74683) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74683) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1cba0f-28c6-4595-9305-2fbbd7d8997e]: (4, ('- - 0', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oBQkGHsL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b79d385-e512-4297-9aa4-2b9bb0cac23c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Cannot resize image /opt/stack/data/nova/instances/0b79d385-e512-4297-9aa4-2b9bb0cac23c/disk to a smaller size. {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Created local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Ensure instance console log exists: /opt/stack/data/nova/instances/0b79d385-e512-4297-9aa4-2b9bb0cac23c/console.log {{(pid=74683) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG nova.compute.manager [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Instance event wait completed in 0 seconds for  {{(pid=74683) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Guest created on hypervisor {{(pid=74683) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG nova.network.neutron [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Successfully updated port: c8345df8-9a3f-4261-a04c-59a0653140d0 {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:22:01 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Instance spawned successfully.
Oct 16 11:22:01 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG nova.compute.manager [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Instance event wait completed in 0 seconds for  {{(pid=74683) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Guest created on hypervisor {{(pid=74683) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Acquiring lock "refresh_cache-0b79d385-e512-4297-9aa4-2b9bb0cac23c" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Acquired lock "refresh_cache-0b79d385-e512-4297-9aa4-2b9bb0cac23c" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG nova.network.neutron [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:22:01 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Instance spawned successfully.
Oct 16 11:22:01 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Found default for hw_cdrom_bus of ide {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Found default for hw_disk_bus of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Found default for hw_input_bus of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Found default for hw_pointer_model of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Found default for hw_video_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:22:01 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Found default for hw_vif_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Found default for hw_cdrom_bus of ide {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Found default for hw_disk_bus of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Found default for hw_input_bus of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Found default for hw_pointer_model of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Found default for hw_video_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Found default for hw_vif_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG nova.network.neutron [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:22:02 user nova-compute[74683]: INFO nova.compute.manager [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Took 8.71 seconds to spawn the instance on the hypervisor.
Oct 16 11:22:02 user nova-compute[74683]: DEBUG nova.compute.manager [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:22:02 user nova-compute[74683]: INFO nova.compute.manager [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Took 7.59 seconds to spawn the instance on the hypervisor.
Oct 16 11:22:02 user nova-compute[74683]: DEBUG nova.compute.manager [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:22:02 user nova-compute[74683]: INFO nova.compute.manager [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Took 9.87 seconds to build instance.
Oct 16 11:22:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b10910d8-6e3e-4d2a-acd4-1b25b4fa9dfa tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.015s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:22:02 user nova-compute[74683]: INFO nova.compute.manager [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Took 9.02 seconds to build instance.
Oct 16 11:22:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f78d1e30-21a0-4027-ad1d-4d4c6b03172b tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "b91af786-36e3-4815-811f-fb3c055e758d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.186s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG nova.network.neutron [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Updating instance_info_cache with network_info: [{"id": "c8345df8-9a3f-4261-a04c-59a0653140d0", "address": "fa:16:3e:27:e5:1e", "network": {"id": "acc0dc8b-0dc9-47ad-8630-d9e91dd67dbc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-679008794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adfa96f9deab4c4eb584876b48e804e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8345df8-9a", "ovs_interfaceid": "c8345df8-9a3f-4261-a04c-59a0653140d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Releasing lock "refresh_cache-0b79d385-e512-4297-9aa4-2b9bb0cac23c" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG nova.compute.manager [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Instance network_info: |[{"id": "c8345df8-9a3f-4261-a04c-59a0653140d0", "address": "fa:16:3e:27:e5:1e", "network": {"id": "acc0dc8b-0dc9-47ad-8630-d9e91dd67dbc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-679008794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adfa96f9deab4c4eb584876b48e804e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8345df8-9a", "ovs_interfaceid": "c8345df8-9a3f-4261-a04c-59a0653140d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Start _get_guest_xml network_info=[{"id": "c8345df8-9a3f-4261-a04c-59a0653140d0", "address": "fa:16:3e:27:e5:1e", "network": {"id": "acc0dc8b-0dc9-47ad-8630-d9e91dd67dbc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-679008794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adfa96f9deab4c4eb584876b48e804e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8345df8-9a", "ovs_interfaceid": "c8345df8-9a3f-4261-a04c-59a0653140d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:22:02 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:22:02 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:22:02 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:21:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-237246197',display_name='tempest-ServersNegativeTestJSON-server-237246197',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-237246197',id=25,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='adfa96f9deab4c4eb584876b48e804e0',ramdisk_id='',reservation_id='r-jbap9cn6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-282145638',owner_user_name='tempest-ServersNegativeTestJSON-282145638-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:22:01Z,user_data=None,user_id='0c9a0c7b02744e87885fe8d252e88d1c',uuid=0b79d385-e512-4297-9aa4-2b9bb0cac23c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8345df8-9a3f-4261-a04c-59a0653140d0", "address": "fa:16:3e:27:e5:1e", "network": {"id": "acc0dc8b-0dc9-47ad-8630-d9e91dd67dbc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-679008794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adfa96f9deab4c4eb584876b48e804e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8345df8-9a", "ovs_interfaceid": "c8345df8-9a3f-4261-a04c-59a0653140d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Converting VIF {"id": "c8345df8-9a3f-4261-a04c-59a0653140d0", "address": "fa:16:3e:27:e5:1e", "network": {"id": "acc0dc8b-0dc9-47ad-8630-d9e91dd67dbc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-679008794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adfa96f9deab4c4eb584876b48e804e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8345df8-9a", "ovs_interfaceid": "c8345df8-9a3f-4261-a04c-59a0653140d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:e5:1e,bridge_name='br-int',has_traffic_filtering=True,id=c8345df8-9a3f-4261-a04c-59a0653140d0,network=Network(acc0dc8b-0dc9-47ad-8630-d9e91dd67dbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8345df8-9a') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG nova.objects.instance [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Lazy-loading 'pci_devices' on Instance uuid 0b79d385-e512-4297-9aa4-2b9bb0cac23c {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:22:02 user nova-compute[74683]:   <uuid>0b79d385-e512-4297-9aa4-2b9bb0cac23c</uuid>
Oct 16 11:22:02 user nova-compute[74683]:   <name>instance-00000019</name>
Oct 16 11:22:02 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:22:02 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:22:02 user nova-compute[74683]:   <metadata>
Oct 16 11:22:02 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:22:02 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:22:02 user nova-compute[74683]:       <nova:name>tempest-ServersNegativeTestJSON-server-237246197</nova:name>
Oct 16 11:22:02 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:22:02</nova:creationTime>
Oct 16 11:22:02 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:22:02 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:22:02 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:22:02 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:22:02 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:22:02 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:22:02 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:22:02 user nova-compute[74683]:       <nova:owner>
Oct 16 11:22:02 user nova-compute[74683]:         <nova:user uuid="0c9a0c7b02744e87885fe8d252e88d1c">tempest-ServersNegativeTestJSON-282145638-project-member</nova:user>
Oct 16 11:22:02 user nova-compute[74683]:         <nova:project uuid="adfa96f9deab4c4eb584876b48e804e0">tempest-ServersNegativeTestJSON-282145638</nova:project>
Oct 16 11:22:02 user nova-compute[74683]:       </nova:owner>
Oct 16 11:22:02 user nova-compute[74683]:       <nova:root type="image" uuid="0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f"/>
Oct 16 11:22:02 user nova-compute[74683]:       <nova:ports>
Oct 16 11:22:02 user nova-compute[74683]:         <nova:port uuid="c8345df8-9a3f-4261-a04c-59a0653140d0">
Oct 16 11:22:02 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 16 11:22:02 user nova-compute[74683]:         </nova:port>
Oct 16 11:22:02 user nova-compute[74683]:       </nova:ports>
Oct 16 11:22:02 user nova-compute[74683]:     </nova:instance>
Oct 16 11:22:02 user nova-compute[74683]:   </metadata>
Oct 16 11:22:02 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:22:02 user nova-compute[74683]:     <system>
Oct 16 11:22:02 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:22:02 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:22:02 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:22:02 user nova-compute[74683]:       <entry name="serial">0b79d385-e512-4297-9aa4-2b9bb0cac23c</entry>
Oct 16 11:22:02 user nova-compute[74683]:       <entry name="uuid">0b79d385-e512-4297-9aa4-2b9bb0cac23c</entry>
Oct 16 11:22:02 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:22:02 user nova-compute[74683]:     </system>
Oct 16 11:22:02 user nova-compute[74683]:   </sysinfo>
Oct 16 11:22:02 user nova-compute[74683]:   <os>
Oct 16 11:22:02 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:22:02 user nova-compute[74683]:     <boot dev="hd"/>
Oct 16 11:22:02 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:22:02 user nova-compute[74683]:   </os>
Oct 16 11:22:02 user nova-compute[74683]:   <features>
Oct 16 11:22:02 user nova-compute[74683]:     <acpi/>
Oct 16 11:22:02 user nova-compute[74683]:     <apic/>
Oct 16 11:22:02 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:22:02 user nova-compute[74683]:   </features>
Oct 16 11:22:02 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:22:02 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:22:02 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:22:02 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:22:02 user nova-compute[74683]:   </clock>
Oct 16 11:22:02 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:22:02 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:22:02 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:22:02 user nova-compute[74683]:   </cpu>
Oct 16 11:22:02 user nova-compute[74683]:   <devices>
Oct 16 11:22:02 user nova-compute[74683]:     <disk type="file" device="disk">
Oct 16 11:22:02 user nova-compute[74683]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 11:22:02 user nova-compute[74683]:       <source file="/opt/stack/data/nova/instances/0b79d385-e512-4297-9aa4-2b9bb0cac23c/disk"/>
Oct 16 11:22:02 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:22:02 user nova-compute[74683]:     </disk>
Oct 16 11:22:02 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:22:02 user nova-compute[74683]:       <mac address="fa:16:3e:27:e5:1e"/>
Oct 16 11:22:02 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:22:02 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:22:02 user nova-compute[74683]:       <target dev="tapc8345df8-9a"/>
Oct 16 11:22:02 user nova-compute[74683]:     </interface>
Oct 16 11:22:02 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:22:02 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/0b79d385-e512-4297-9aa4-2b9bb0cac23c/console.log" append="off"/>
Oct 16 11:22:02 user nova-compute[74683]:     </serial>
Oct 16 11:22:02 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:22:02 user nova-compute[74683]:     <video>
Oct 16 11:22:02 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:22:02 user nova-compute[74683]:     </video>
Oct 16 11:22:02 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:22:02 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:22:02 user nova-compute[74683]:     </rng>
Oct 16 11:22:02 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:22:02 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:22:02 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:22:02 user nova-compute[74683]:     </memballoon>
Oct 16 11:22:02 user nova-compute[74683]:   </devices>
Oct 16 11:22:02 user nova-compute[74683]: </domain>
Oct 16 11:22:02 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:21:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-237246197',display_name='tempest-ServersNegativeTestJSON-server-237246197',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-237246197',id=25,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='adfa96f9deab4c4eb584876b48e804e0',ramdisk_id='',reservation_id='r-jbap9cn6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-282145638',owner_user_name='tempest-ServersNegativeTestJSON-282145638-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:22:01Z,user_data=None,user_id='0c9a0c7b02744e87885fe8d252e88d1c',uuid=0b79d385-e512-4297-9aa4-2b9bb0cac23c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8345df8-9a3f-4261-a04c-59a0653140d0", "address": "fa:16:3e:27:e5:1e", "network": {"id": "acc0dc8b-0dc9-47ad-8630-d9e91dd67dbc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-679008794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adfa96f9deab4c4eb584876b48e804e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8345df8-9a", "ovs_interfaceid": "c8345df8-9a3f-4261-a04c-59a0653140d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Converting VIF {"id": "c8345df8-9a3f-4261-a04c-59a0653140d0", "address": "fa:16:3e:27:e5:1e", "network": {"id": "acc0dc8b-0dc9-47ad-8630-d9e91dd67dbc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-679008794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adfa96f9deab4c4eb584876b48e804e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8345df8-9a", "ovs_interfaceid": "c8345df8-9a3f-4261-a04c-59a0653140d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:e5:1e,bridge_name='br-int',has_traffic_filtering=True,id=c8345df8-9a3f-4261-a04c-59a0653140d0,network=Network(acc0dc8b-0dc9-47ad-8630-d9e91dd67dbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8345df8-9a') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG os_vif [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:e5:1e,bridge_name='br-int',has_traffic_filtering=True,id=c8345df8-9a3f-4261-a04c-59a0653140d0,network=Network(acc0dc8b-0dc9-47ad-8630-d9e91dd67dbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8345df8-9a') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.496s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] <== connect_volume: return (1498ms) {'type': 'block', 'scsi_wwn': '23465373435666634', 'path': '/dev/sdd'} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23465373435666634', 'path': '/dev/sdd'} {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '32ed3973-abb3-5944-ac57-813e0ff166a2', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc8345df8-9a, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc8345df8-9a, col_values=(('qos', UUID('bbb00c2d-4c2c-4be5-a37e-b18fce00e162')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc8345df8-9a, col_values=(('external_ids', {'iface-id': 'c8345df8-9a3f-4261-a04c-59a0653140d0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:e5:1e', 'vm-uuid': '0b79d385-e512-4297-9aa4-2b9bb0cac23c'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:21:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-625562605',display_name='tempest-TestVolumeBootPattern-server-625562605',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-625562605',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2aefabef9e42412f8309f490dcfecc79',ramdisk_id='',reservation_id='r-0jqg2ikk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-953001121',owner_user_name='tempest-TestVolumeBootPattern-953001121-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:21:33Z,user_data=None,user_id='a463a84e332543dfbc03b81518f82be1',uuid=b8b4a8e2-2c42-423d-954e-cab381506ca7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e53b899-a596-47a3-8e17-88748f58e737", "address": "fa:16:3e:05:6b:b7", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e53b899-a5", "ovs_interfaceid": "4e53b899-a596-47a3-8e17-88748f58e737", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Converting VIF {"id": "4e53b899-a596-47a3-8e17-88748f58e737", "address": "fa:16:3e:05:6b:b7", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e53b899-a5", "ovs_interfaceid": "4e53b899-a596-47a3-8e17-88748f58e737", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:6b:b7,bridge_name='br-int',has_traffic_filtering=True,id=4e53b899-a596-47a3-8e17-88748f58e737,network=Network(00883fc4-0b74-4afd-9043-82e2933faab3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e53b899-a5') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG nova.objects.instance [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lazy-loading 'pci_devices' on Instance uuid b8b4a8e2-2c42-423d-954e-cab381506ca7 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:22:02 user nova-compute[74683]: INFO os_vif [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:e5:1e,bridge_name='br-int',has_traffic_filtering=True,id=c8345df8-9a3f-4261-a04c-59a0653140d0,network=Network(acc0dc8b-0dc9-47ad-8630-d9e91dd67dbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8345df8-9a')
Oct 16 11:22:02 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:22:02 user nova-compute[74683]:   <uuid>b8b4a8e2-2c42-423d-954e-cab381506ca7</uuid>
Oct 16 11:22:02 user nova-compute[74683]:   <name>instance-00000015</name>
Oct 16 11:22:02 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:22:02 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:22:02 user nova-compute[74683]:   <metadata>
Oct 16 11:22:02 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:22:02 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:22:02 user nova-compute[74683]:       <nova:name>tempest-TestVolumeBootPattern-server-625562605</nova:name>
Oct 16 11:22:02 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:22:01</nova:creationTime>
Oct 16 11:22:02 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:22:02 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:22:02 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:22:02 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:22:02 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:22:02 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:22:02 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:22:02 user nova-compute[74683]:       <nova:owner>
Oct 16 11:22:02 user nova-compute[74683]:         <nova:user uuid="a463a84e332543dfbc03b81518f82be1">tempest-TestVolumeBootPattern-953001121-project-member</nova:user>
Oct 16 11:22:02 user nova-compute[74683]:         <nova:project uuid="2aefabef9e42412f8309f490dcfecc79">tempest-TestVolumeBootPattern-953001121</nova:project>
Oct 16 11:22:02 user nova-compute[74683]:       </nova:owner>
Oct 16 11:22:02 user nova-compute[74683]:       <nova:ports>
Oct 16 11:22:02 user nova-compute[74683]:         <nova:port uuid="4e53b899-a596-47a3-8e17-88748f58e737">
Oct 16 11:22:02 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 16 11:22:02 user nova-compute[74683]:         </nova:port>
Oct 16 11:22:02 user nova-compute[74683]:       </nova:ports>
Oct 16 11:22:02 user nova-compute[74683]:     </nova:instance>
Oct 16 11:22:02 user nova-compute[74683]:   </metadata>
Oct 16 11:22:02 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:22:02 user nova-compute[74683]:     <system>
Oct 16 11:22:02 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:22:02 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:22:02 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:22:02 user nova-compute[74683]:       <entry name="serial">b8b4a8e2-2c42-423d-954e-cab381506ca7</entry>
Oct 16 11:22:02 user nova-compute[74683]:       <entry name="uuid">b8b4a8e2-2c42-423d-954e-cab381506ca7</entry>
Oct 16 11:22:02 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:22:02 user nova-compute[74683]:     </system>
Oct 16 11:22:02 user nova-compute[74683]:   </sysinfo>
Oct 16 11:22:02 user nova-compute[74683]:   <os>
Oct 16 11:22:02 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:22:02 user nova-compute[74683]:     <boot dev="hd"/>
Oct 16 11:22:02 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:22:02 user nova-compute[74683]:   </os>
Oct 16 11:22:02 user nova-compute[74683]:   <features>
Oct 16 11:22:02 user nova-compute[74683]:     <acpi/>
Oct 16 11:22:02 user nova-compute[74683]:     <apic/>
Oct 16 11:22:02 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:22:02 user nova-compute[74683]:   </features>
Oct 16 11:22:02 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:22:02 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:22:02 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:22:02 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:22:02 user nova-compute[74683]:   </clock>
Oct 16 11:22:02 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:22:02 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:22:02 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:22:02 user nova-compute[74683]:   </cpu>
Oct 16 11:22:02 user nova-compute[74683]:   <devices>
Oct 16 11:22:02 user nova-compute[74683]:     <disk type="block" device="disk">
Oct 16 11:22:02 user nova-compute[74683]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:22:02 user nova-compute[74683]:       <source dev="/dev/sdd"/>
Oct 16 11:22:02 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:22:02 user nova-compute[74683]:       <serial>7e532f21-699f-4800-92ab-2d7ddef102ea</serial>
Oct 16 11:22:02 user nova-compute[74683]:     </disk>
Oct 16 11:22:02 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:22:02 user nova-compute[74683]:       <mac address="fa:16:3e:05:6b:b7"/>
Oct 16 11:22:02 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:22:02 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:22:02 user nova-compute[74683]:       <target dev="tap4e53b899-a5"/>
Oct 16 11:22:02 user nova-compute[74683]:     </interface>
Oct 16 11:22:02 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:22:02 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/b8b4a8e2-2c42-423d-954e-cab381506ca7/console.log" append="off"/>
Oct 16 11:22:02 user nova-compute[74683]:     </serial>
Oct 16 11:22:02 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:22:02 user nova-compute[74683]:     <video>
Oct 16 11:22:02 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:22:02 user nova-compute[74683]:     </video>
Oct 16 11:22:02 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:22:02 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:22:02 user nova-compute[74683]:     </rng>
Oct 16 11:22:02 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:22:02 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:22:02 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:22:02 user nova-compute[74683]:     </memballoon>
Oct 16 11:22:02 user nova-compute[74683]:   </devices>
Oct 16 11:22:02 user nova-compute[74683]: </domain>
Oct 16 11:22:02 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:21:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-625562605',display_name='tempest-TestVolumeBootPattern-server-625562605',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-625562605',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2aefabef9e42412f8309f490dcfecc79',ramdisk_id='',reservation_id='r-0jqg2ikk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-953001121',owner_user_name='tempest-TestVolumeBootPattern-953001121-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:21:33Z,user_data=None,user_id='a463a84e332543dfbc03b81518f82be1',uuid=b8b4a8e2-2c42-423d-954e-cab381506ca7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e53b899-a596-47a3-8e17-88748f58e737", "address": "fa:16:3e:05:6b:b7", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e53b899-a5", "ovs_interfaceid": "4e53b899-a596-47a3-8e17-88748f58e737", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Converting VIF {"id": "4e53b899-a596-47a3-8e17-88748f58e737", "address": "fa:16:3e:05:6b:b7", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e53b899-a5", "ovs_interfaceid": "4e53b899-a596-47a3-8e17-88748f58e737", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:6b:b7,bridge_name='br-int',has_traffic_filtering=True,id=4e53b899-a596-47a3-8e17-88748f58e737,network=Network(00883fc4-0b74-4afd-9043-82e2933faab3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e53b899-a5') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG os_vif [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:6b:b7,bridge_name='br-int',has_traffic_filtering=True,id=4e53b899-a596-47a3-8e17-88748f58e737,network=Network(00883fc4-0b74-4afd-9043-82e2933faab3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e53b899-a5') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a6a22e1a-f8b8-57d5-b9fb-0ced03279642', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4e53b899-a5, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4e53b899-a5, col_values=(('qos', UUID('a655c500-3414-43e5-ac0b-d569445c26a2')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4e53b899-a5, col_values=(('external_ids', {'iface-id': '4e53b899-a596-47a3-8e17-88748f58e737', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:6b:b7', 'vm-uuid': 'b8b4a8e2-2c42-423d-954e-cab381506ca7'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:22:02 user nova-compute[74683]: INFO os_vif [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:6b:b7,bridge_name='br-int',has_traffic_filtering=True,id=4e53b899-a596-47a3-8e17-88748f58e737,network=Network(00883fc4-0b74-4afd-9043-82e2933faab3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e53b899-a5')
Oct 16 11:22:02 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] No VIF found with MAC fa:16:3e:27:e5:1e, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG nova.compute.manager [req-d646d6cb-c64f-4d2b-bacb-54e56c2d998e req-b7fe862a-4587-4059-b991-fbf5cf13ab85 service nova] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Received event network-changed-c8345df8-9a3f-4261-a04c-59a0653140d0 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG nova.compute.manager [req-d646d6cb-c64f-4d2b-bacb-54e56c2d998e req-b7fe862a-4587-4059-b991-fbf5cf13ab85 service nova] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Refreshing instance network info cache due to event network-changed-c8345df8-9a3f-4261-a04c-59a0653140d0. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-d646d6cb-c64f-4d2b-bacb-54e56c2d998e req-b7fe862a-4587-4059-b991-fbf5cf13ab85 service nova] Acquiring lock "refresh_cache-0b79d385-e512-4297-9aa4-2b9bb0cac23c" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-d646d6cb-c64f-4d2b-bacb-54e56c2d998e req-b7fe862a-4587-4059-b991-fbf5cf13ab85 service nova] Acquired lock "refresh_cache-0b79d385-e512-4297-9aa4-2b9bb0cac23c" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG nova.network.neutron [req-d646d6cb-c64f-4d2b-bacb-54e56c2d998e req-b7fe862a-4587-4059-b991-fbf5cf13ab85 service nova] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Refreshing network info cache for port c8345df8-9a3f-4261-a04c-59a0653140d0 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:22:02 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] No VIF found with MAC fa:16:3e:05:6b:b7, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:22:03 user nova-compute[74683]: DEBUG nova.network.neutron [req-d646d6cb-c64f-4d2b-bacb-54e56c2d998e req-b7fe862a-4587-4059-b991-fbf5cf13ab85 service nova] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Updated VIF entry in instance network info cache for port c8345df8-9a3f-4261-a04c-59a0653140d0. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:22:03 user nova-compute[74683]: DEBUG nova.network.neutron [req-d646d6cb-c64f-4d2b-bacb-54e56c2d998e req-b7fe862a-4587-4059-b991-fbf5cf13ab85 service nova] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Updating instance_info_cache with network_info: [{"id": "c8345df8-9a3f-4261-a04c-59a0653140d0", "address": "fa:16:3e:27:e5:1e", "network": {"id": "acc0dc8b-0dc9-47ad-8630-d9e91dd67dbc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-679008794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adfa96f9deab4c4eb584876b48e804e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8345df8-9a", "ovs_interfaceid": "c8345df8-9a3f-4261-a04c-59a0653140d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:22:03 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-d646d6cb-c64f-4d2b-bacb-54e56c2d998e req-b7fe862a-4587-4059-b991-fbf5cf13ab85 service nova] Releasing lock "refresh_cache-0b79d385-e512-4297-9aa4-2b9bb0cac23c" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:22:03 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:22:05 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:22:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:22:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:22:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:22:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:22:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:22:06 user nova-compute[74683]: DEBUG nova.compute.manager [req-7aa95718-0221-4c84-8041-7457e2420105 req-ef9ab75e-6143-42ba-8ebe-cb64059adad4 service nova] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] Received event network-vif-plugged-4e53b899-a596-47a3-8e17-88748f58e737 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:22:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-7aa95718-0221-4c84-8041-7457e2420105 req-ef9ab75e-6143-42ba-8ebe-cb64059adad4 service nova] Acquiring lock "b8b4a8e2-2c42-423d-954e-cab381506ca7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:22:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-7aa95718-0221-4c84-8041-7457e2420105 req-ef9ab75e-6143-42ba-8ebe-cb64059adad4 service nova] Lock "b8b4a8e2-2c42-423d-954e-cab381506ca7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:22:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-7aa95718-0221-4c84-8041-7457e2420105 req-ef9ab75e-6143-42ba-8ebe-cb64059adad4 service nova] Lock "b8b4a8e2-2c42-423d-954e-cab381506ca7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:22:06 user nova-compute[74683]: DEBUG nova.compute.manager [req-7aa95718-0221-4c84-8041-7457e2420105 req-ef9ab75e-6143-42ba-8ebe-cb64059adad4 service nova] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] No waiting events found dispatching network-vif-plugged-4e53b899-a596-47a3-8e17-88748f58e737 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:22:06 user nova-compute[74683]: WARNING nova.compute.manager [req-7aa95718-0221-4c84-8041-7457e2420105 req-ef9ab75e-6143-42ba-8ebe-cb64059adad4 service nova] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] Received unexpected event network-vif-plugged-4e53b899-a596-47a3-8e17-88748f58e737 for instance with vm_state building and task_state spawning.
Oct 16 11:22:06 user nova-compute[74683]: DEBUG nova.compute.manager [req-03e57e8f-20b2-4e95-81e1-7e0a04ca8bf0 req-d9b3f456-77e2-4bd2-ba86-9cb8416c7eb8 service nova] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Received event network-vif-plugged-c8345df8-9a3f-4261-a04c-59a0653140d0 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:22:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-03e57e8f-20b2-4e95-81e1-7e0a04ca8bf0 req-d9b3f456-77e2-4bd2-ba86-9cb8416c7eb8 service nova] Acquiring lock "0b79d385-e512-4297-9aa4-2b9bb0cac23c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:22:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-03e57e8f-20b2-4e95-81e1-7e0a04ca8bf0 req-d9b3f456-77e2-4bd2-ba86-9cb8416c7eb8 service nova] Lock "0b79d385-e512-4297-9aa4-2b9bb0cac23c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:22:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-03e57e8f-20b2-4e95-81e1-7e0a04ca8bf0 req-d9b3f456-77e2-4bd2-ba86-9cb8416c7eb8 service nova] Lock "0b79d385-e512-4297-9aa4-2b9bb0cac23c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:22:06 user nova-compute[74683]: DEBUG nova.compute.manager [req-03e57e8f-20b2-4e95-81e1-7e0a04ca8bf0 req-d9b3f456-77e2-4bd2-ba86-9cb8416c7eb8 service nova] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] No waiting events found dispatching network-vif-plugged-c8345df8-9a3f-4261-a04c-59a0653140d0 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:22:06 user nova-compute[74683]: WARNING nova.compute.manager [req-03e57e8f-20b2-4e95-81e1-7e0a04ca8bf0 req-d9b3f456-77e2-4bd2-ba86-9cb8416c7eb8 service nova] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Received unexpected event network-vif-plugged-c8345df8-9a3f-4261-a04c-59a0653140d0 for instance with vm_state building and task_state spawning.
Oct 16 11:22:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:22:06 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:22:06 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Starting heal instance info cache {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 11:22:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "refresh_cache-f192d1ec-311d-4a30-9766-361b27a8dae8" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:22:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquired lock "refresh_cache-f192d1ec-311d-4a30-9766-361b27a8dae8" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:22:06 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Forcefully refreshing network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 11:22:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:22:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:22:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:22:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:22:07 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Updating instance_info_cache with network_info: [{"id": "dbbeadad-745e-4d28-a242-577b3197b079", "address": "fa:16:3e:2b:14:bf", "network": {"id": "33f5edce-0901-42ea-b07a-47da2819b133", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-117849665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d7573bebfe47e3989f8eedd90dee6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbbeadad-74", "ovs_interfaceid": "dbbeadad-745e-4d28-a242-577b3197b079", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:22:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Releasing lock "refresh_cache-f192d1ec-311d-4a30-9766-361b27a8dae8" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:22:07 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Updated the network info_cache for instance {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 11:22:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:22:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:22:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:22:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:22:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:22:08 user nova-compute[74683]: DEBUG nova.compute.manager [req-d687ce4e-ad2d-428f-a18d-083fb662f4e2 req-19f9849e-7a74-49e5-8e04-0fcf9b19067f service nova] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] Received event network-vif-plugged-4e53b899-a596-47a3-8e17-88748f58e737 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:22:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-d687ce4e-ad2d-428f-a18d-083fb662f4e2 req-19f9849e-7a74-49e5-8e04-0fcf9b19067f service nova] Acquiring lock "b8b4a8e2-2c42-423d-954e-cab381506ca7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:22:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-d687ce4e-ad2d-428f-a18d-083fb662f4e2 req-19f9849e-7a74-49e5-8e04-0fcf9b19067f service nova] Lock "b8b4a8e2-2c42-423d-954e-cab381506ca7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:22:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-d687ce4e-ad2d-428f-a18d-083fb662f4e2 req-19f9849e-7a74-49e5-8e04-0fcf9b19067f service nova] Lock "b8b4a8e2-2c42-423d-954e-cab381506ca7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:22:08 user nova-compute[74683]: DEBUG nova.compute.manager [req-d687ce4e-ad2d-428f-a18d-083fb662f4e2 req-19f9849e-7a74-49e5-8e04-0fcf9b19067f service nova] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] No waiting events found dispatching network-vif-plugged-4e53b899-a596-47a3-8e17-88748f58e737 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:22:08 user nova-compute[74683]: WARNING nova.compute.manager [req-d687ce4e-ad2d-428f-a18d-083fb662f4e2 req-19f9849e-7a74-49e5-8e04-0fcf9b19067f service nova] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] Received unexpected event network-vif-plugged-4e53b899-a596-47a3-8e17-88748f58e737 for instance with vm_state building and task_state spawning.
Oct 16 11:22:08 user nova-compute[74683]: DEBUG nova.compute.manager [req-c23e6063-77d2-4643-8ee7-f97e1f34e35a req-9505aef2-f447-4522-b818-fbe334607118 service nova] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Received event network-vif-plugged-c8345df8-9a3f-4261-a04c-59a0653140d0 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:22:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c23e6063-77d2-4643-8ee7-f97e1f34e35a req-9505aef2-f447-4522-b818-fbe334607118 service nova] Acquiring lock "0b79d385-e512-4297-9aa4-2b9bb0cac23c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:22:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c23e6063-77d2-4643-8ee7-f97e1f34e35a req-9505aef2-f447-4522-b818-fbe334607118 service nova] Lock "0b79d385-e512-4297-9aa4-2b9bb0cac23c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:22:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c23e6063-77d2-4643-8ee7-f97e1f34e35a req-9505aef2-f447-4522-b818-fbe334607118 service nova] Lock "0b79d385-e512-4297-9aa4-2b9bb0cac23c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:22:08 user nova-compute[74683]: DEBUG nova.compute.manager [req-c23e6063-77d2-4643-8ee7-f97e1f34e35a req-9505aef2-f447-4522-b818-fbe334607118 service nova] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] No waiting events found dispatching network-vif-plugged-c8345df8-9a3f-4261-a04c-59a0653140d0 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:22:08 user nova-compute[74683]: WARNING nova.compute.manager [req-c23e6063-77d2-4643-8ee7-f97e1f34e35a req-9505aef2-f447-4522-b818-fbe334607118 service nova] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Received unexpected event network-vif-plugged-c8345df8-9a3f-4261-a04c-59a0653140d0 for instance with vm_state building and task_state spawning.
Oct 16 11:22:08 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:22:08 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:22:08 user nova-compute[74683]: DEBUG nova.compute.manager [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] Instance event wait completed in 0 seconds for  {{(pid=74683) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 11:22:08 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] Guest created on hypervisor {{(pid=74683) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 11:22:08 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] Instance spawned successfully.
Oct 16 11:22:08 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 11:22:08 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] Found default for hw_cdrom_bus of ide {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:22:08 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] Found default for hw_disk_bus of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:22:08 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] Found default for hw_input_bus of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:22:08 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] Found default for hw_pointer_model of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:22:08 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] Found default for hw_video_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:22:08 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] Found default for hw_vif_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:22:09 user nova-compute[74683]: INFO nova.compute.manager [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] Took 8.13 seconds to spawn the instance on the hypervisor.
Oct 16 11:22:09 user nova-compute[74683]: DEBUG nova.compute.manager [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG nova.compute.manager [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HPFkpWLi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e84bb680-a542-4cb2-b0c5-67a210c25e9e', 'attached_at': '', 'detached_at': '', 'volume_id': '83717834-0a00-4b2d-a2a7-7aeaa3d84cee', 'serial': '83717834-0a00-4b2d-a2a7-7aeaa3d84cee'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:25c3b8d2-beea-4362-8602-5134c21ac2ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UOlJhXVD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'e84bb680-a542-4cb2-b0c5-67a210c25e9e', 'attached_at': '', 'detached_at': '', 'volume_id': '25c3b8d2-beea-4362-8602-5134c21ac2ff', 'serial'} {{(pid=74683) _swap_volume /opt/stack/nova/nova/compute/manager.py:7781}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG nova.compute.manager [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Instance event wait completed in 0 seconds for  {{(pid=74683) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Guest created on hypervisor {{(pid=74683) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Calling os-brick to attach iSCSI Volume {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HPFkpWLi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:22:09 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:22:09 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:22:09 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:22:09 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:22:09 user nova-compute[74683]: INFO os_brick.initiator.connectors.iscsi [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 11:22:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee -p 172.16.0.220:3260 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:09 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Instance spawned successfully.
Oct 16 11:22:09 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b98b559-d84d-4fba-b1d0-696899c95eea]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 11:22:09 user nova-compute[74683]:  {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee -p 172.16.0.220:3260 --interface default --op new {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[009a9aa9-1326-4155-a9da-8adf75b963ce]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee] added\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee] added
Oct 16 11:22:09 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:09 user nova-compute[74683]: INFO nova.compute.manager [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] Took 36.77 seconds to build instance.
Oct 16 11:22:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1f5e0a-6a3e-434d-b7bf-9e55f6b4c05b]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Found default for hw_cdrom_bus of ide {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Found default for hw_disk_bus of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Found default for hw_input_bus of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Found default for hw_pointer_model of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Found default for hw_video_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Found default for hw_vif_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-895d161b-4675-4522-8399-b26ee9270d44 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "b8b4a8e2-2c42-423d-954e-cab381506ca7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 36.940s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ecdf50-a30c-4c6e-b0b4-7765cc7e3b7c]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HPFkpWLi {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HPFkpWLi" returned: 0 in 0.023s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c8083e-9233-465b-a255-f043dcad7131]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HPFkpWLi'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e8abf5-1368-4354-bca6-e29a29de2ede]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:09 user nova-compute[74683]: INFO nova.compute.manager [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Took 8.65 seconds to spawn the instance on the hypervisor.
Oct 16 11:22:09 user nova-compute[74683]: DEBUG nova.compute.manager [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac4a712-732e-4638-8bc7-3f03f84e4b54]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3b8d2-beea-4362-8602-5134c21ac2ff (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:22:09 user nova-compute[74683]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)
Oct 16 11:22:09 user nova-compute[74683]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3b8d2-beea-4362-8602-5134c21ac2ff (non-flash)
Oct 16 11:22:09 user nova-compute[74683]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea (non-flash)
Oct 16 11:22:09 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:22:09 user nova-compute[74683]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)
Oct 16 11:22:09 user nova-compute[74683]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3b8d2-beea-4362-8602-5134c21ac2ff (non-flash)
Oct 16 11:22:09 user nova-compute[74683]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea (non-flash)
Oct 16 11:22:09 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee -p 172.16.0.220:3260 --login {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:09 user nova-compute[74683]: INFO nova.compute.manager [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Took 9.74 seconds to build instance.
Oct 16 11:22:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee -p 172.16.0.220:3260 --login" returned: 0 in 0.115s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4e68cc-5000-4a68-9185-6bc7699e67a8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee, portal: 172.16.0.220,3260]
Oct 16 11:22:09 user nova-compute[74683]: Login to [iface: default, target: iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee, portal: 172.16.0.220,3260] successful.
Oct 16 11:22:09 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-24a7858f-6d50-4249-8c46-fa9eb0503104 tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Lock "0b79d385-e512-4297-9aa4-2b9bb0cac23c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.900s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a24778e-a552-4a89-9838-81f560f0d846]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced489ac-ed94-4330-ad57-bbbd04b5e36b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3b8d2-beea-4362-8602-5134c21ac2ff (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:22:09 user nova-compute[74683]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)
Oct 16 11:22:09 user nova-compute[74683]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3b8d2-beea-4362-8602-5134c21ac2ff (non-flash)
Oct 16 11:22:09 user nova-compute[74683]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea (non-flash)
Oct 16 11:22:09 user nova-compute[74683]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee (non-flash)
Oct 16 11:22:09 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:22:09 user nova-compute[74683]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)
Oct 16 11:22:09 user nova-compute[74683]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3b8d2-beea-4362-8602-5134c21ac2ff (non-flash)
Oct 16 11:22:09 user nova-compute[74683]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea (non-flash)
Oct 16 11:22:09 user nova-compute[74683]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee (non-flash)
Oct 16 11:22:09 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.431s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] Connected to 172.16.0.220:3260 {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] HCTL ('36', '-', '-', 0) found on session 22 with lun 0 {{(pid=74683) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=74683) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad14d21-1dcc-4d06-8e37-12a51dfaafb0]: (4, ('- - 0', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] Searching for a device in session 22 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HPFkpWLi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74683) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:22:09 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Auditing locally available compute resources for user (node: user) {{(pid=74683) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 11:22:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json" returned: 0 in 0.316s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9fc5a9-8659-497c-bb07-af52fe2e1761/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:10 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.477s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:22:10 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] <== connect_volume: return (1481ms) {'type': 'block', 'scsi_wwn': '26432666464656132', 'path': '/dev/sde'} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:22:10 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26432666464656132', 'path': '/dev/sde'} {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 11:22:10 user nova-compute[74683]: DEBUG nova.objects.instance [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] Lazy-loading 'flavor' on Instance uuid e84bb680-a542-4cb2-b0c5-67a210c25e9e {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:22:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9fc5a9-8659-497c-bb07-af52fe2e1761/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9fc5a9-8659-497c-bb07-af52fe2e1761/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9fc5a9-8659-497c-bb07-af52fe2e1761/disk --force-share --output=json" returned: 0 in 0.290s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:11 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] COPY block job progress, current cursor: 15728640 final cursor: 1073741824 {{(pid=74683) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 11:22:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:11 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:22:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:11 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:22:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:11 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] COPY block job progress, current cursor: 154140672 final cursor: 1073741824 {{(pid=74683) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 11:22:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:12 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json" returned: 0 in 0.306s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:12 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84bb680-a542-4cb2-b0c5-67a210c25e9e/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:12 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] COPY block job progress, current cursor: 269484032 final cursor: 1073741824 {{(pid=74683) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 11:22:12 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84bb680-a542-4cb2-b0c5-67a210c25e9e/disk --force-share --output=json" returned: 0 in 0.306s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:12 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84bb680-a542-4cb2-b0c5-67a210c25e9e/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:22:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:22:12 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84bb680-a542-4cb2-b0c5-67a210c25e9e/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:12 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:22:12 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddb55617-a6a9-40f9-b2ff-b2b626f149ab/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:12 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] COPY block job progress, current cursor: 421527552 final cursor: 1073741824 {{(pid=74683) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 11:22:13 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddb55617-a6a9-40f9-b2ff-b2b626f149ab/disk --force-share --output=json" returned: 0 in 0.307s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:13 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddb55617-a6a9-40f9-b2ff-b2b626f149ab/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:13 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] COPY block job progress, current cursor: 557842432 final cursor: 1073741824 {{(pid=74683) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 11:22:13 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddb55617-a6a9-40f9-b2ff-b2b626f149ab/disk --force-share --output=json" returned: 0 in 0.291s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:13 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45ca3cbb-53d6-4046-9be3-92cc6b71bfad/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:13 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45ca3cbb-53d6-4046-9be3-92cc6b71bfad/disk --force-share --output=json" returned: 0 in 0.319s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:13 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45ca3cbb-53d6-4046-9be3-92cc6b71bfad/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:13 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] COPY block job progress, current cursor: 683671552 final cursor: 1073741824 {{(pid=74683) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 11:22:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45ca3cbb-53d6-4046-9be3-92cc6b71bfad/disk --force-share --output=json" returned: 0 in 0.300s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b79d385-e512-4297-9aa4-2b9bb0cac23c/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b79d385-e512-4297-9aa4-2b9bb0cac23c/disk --force-share --output=json" returned: 0 in 0.325s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b79d385-e512-4297-9aa4-2b9bb0cac23c/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:14 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] COPY block job progress, current cursor: 810549248 final cursor: 1073741824 {{(pid=74683) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 11:22:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b79d385-e512-4297-9aa4-2b9bb0cac23c/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:14 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:22:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ced47a3-311d-4083-94e1-b2d42326e24d/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:15 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] COPY block job progress, current cursor: 920649728 final cursor: 1073741824 {{(pid=74683) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 11:22:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ced47a3-311d-4083-94e1-b2d42326e24d/disk --force-share --output=json" returned: 0 in 0.330s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ced47a3-311d-4083-94e1-b2d42326e24d/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ced47a3-311d-4083-94e1-b2d42326e24d/disk --force-share --output=json" returned: 0 in 0.333s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:15 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] COPY block job progress, current cursor: 1016070144 final cursor: 1073741824 {{(pid=74683) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 11:22:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:16 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74683) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 11:22:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:16 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] calling os-brick to detach iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 11:22:16 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, {'target_iqn': 'iqn.2010-10.org.openstack:25c3b8d2-beea-4362-8602-5134c21ac2ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UOlJhXVD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:22:16 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:22:16 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:22:16 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:22:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:16 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2edbdd8-57d5-49e5-ae69-a46f10b22dc2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:25c3b8d2-beea-4362-8602-5134c21ac2ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:22:16 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 11:22:16 user nova-compute[74683]: No targets found.
Oct 16 11:22:16 user nova-compute[74683]: iSNS:
Oct 16 11:22:16 user nova-compute[74683]: No targets found.
Oct 16 11:22:16 user nova-compute[74683]: STATIC:
Oct 16 11:22:16 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea
Oct 16 11:22:16 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:22:16 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:22:16 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:25c3b8d2-beea-4362-8602-5134c21ac2ff
Oct 16 11:22:16 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:22:16 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:22:16 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb
Oct 16 11:22:16 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:22:16 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:22:16 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b
Oct 16 11:22:16 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:22:16 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:22:16 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee
Oct 16 11:22:16 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:22:16 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:22:16 user nova-compute[74683]: FIRMWARE:
Oct 16 11:22:16 user nova-compute[74683]: No targets found.
Oct 16 11:22:16 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:22:16 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 11:22:16 user nova-compute[74683]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 11:22:16 user nova-compute[74683]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74683) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 11:22:16 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25c3b8d2-beea-4362-8602-5134c21ac2ff', 0)] {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 11:22:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:16 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1570cd-97a4-45d9-8e1a-066826aafaaa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25c3b8d2-beea-4362-8602-5134c21ac2ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:22:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:16 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[042d0786-3bf3-4a6e-878a-44c3968a2597]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3b8d2-beea-4362-8602-5134c21ac2ff (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:22:16 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:22:16 user nova-compute[74683]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)
Oct 16 11:22:16 user nova-compute[74683]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3b8d2-beea-4362-8602-5134c21ac2ff (non-flash)
Oct 16 11:22:16 user nova-compute[74683]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea (non-flash)
Oct 16 11:22:16 user nova-compute[74683]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee (non-flash)
Oct 16 11:22:16 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:22:16 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:22:16 user nova-compute[74683]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)
Oct 16 11:22:16 user nova-compute[74683]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3b8d2-beea-4362-8602-5134c21ac2ff (non-flash)
Oct 16 11:22:16 user nova-compute[74683]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea (non-flash)
Oct 16 11:22:16 user nova-compute[74683]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee (non-flash)
Oct 16 11:22:16 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:22:16 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda4c616e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25c3b8d2-beea-4362-8602-5134c21ac2ff'): ({'sdb'}, set())}) {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 11:22:16 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] Removing single pathed devices sdb {{(pid=74683) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 11:22:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:16 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ab4f05-ae6c-4769-af89-f35f0282306e]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:22:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:16 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:22:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.033s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:16 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[531ae2da-d94a-4e7b-9dc4-9c0a2691b644]: (4, ('ok\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:22:16 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] Flushing IO for device /dev/sdb {{(pid=74683) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 11:22:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:16 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2439a4-dd60-4f64-98b5-6b38bd9c8c2a]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:22:17 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74683) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 11:22:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:22:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:17 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:22:17 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:22:17 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Hypervisor/Node resource view: name=user free_ram=7609MB free_disk=25.17477798461914GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74683) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 11:22:17 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:22:17 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:22:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:17 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e11958-0720-4a2c-a18e-605eb7da9fe0]: (4, ('1', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:22:17 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 11:22:17 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] SCSI volumes sdb have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 11:22:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25c3b8d2-beea-4362-8602-5134c21ac2ff')] {{(pid=74683) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 11:22:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25c3b8d2-beea-4362-8602-5134c21ac2ff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25c3b8d2-beea-4362-8602-5134c21ac2ff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:17 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e375d373-2003-4eb2-9e12-fc8e0caeac5b]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:22:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:22:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25c3b8d2-beea-4362-8602-5134c21ac2ff -p 172.16.0.220:3260 --logout {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25c3b8d2-beea-4362-8602-5134c21ac2ff -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:17 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[21aac71c-572c-42b1-bf87-e0cebd65ec82]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:25c3b8d2-beea-4362-8602-5134c21ac2ff, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:25c3b8d2-beea-4362-8602-5134c21ac2ff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:22:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:25c3b8d2-beea-4362-8602-5134c21ac2ff, portal: 172.16.0.220,3260]
Oct 16 11:22:17 user nova-compute[74683]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:25c3b8d2-beea-4362-8602-5134c21ac2ff, portal: 172.16.0.220,3260] successful.
Oct 16 11:22:17 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:22:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25c3b8d2-beea-4362-8602-5134c21ac2ff -p 172.16.0.220:3260 --op delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:17 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 18a77385-fab9-4ea0-8aa6-666cf7e798a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:22:17 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance d5e55361-d9ed-4d07-91b0-ec4d08b2e817 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:22:17 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance f192d1ec-311d-4a30-9766-361b27a8dae8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:22:17 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 45ca3cbb-53d6-4046-9be3-92cc6b71bfad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:22:17 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance e84bb680-a542-4cb2-b0c5-67a210c25e9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:22:17 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance edd01413-1f8a-49e3-aa3c-ecb19c62afae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:22:17 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance ddb55617-a6a9-40f9-b2ff-b2b626f149ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:22:17 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 7ced47a3-311d-4083-94e1-b2d42326e24d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:22:17 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance b8b4a8e2-2c42-423d-954e-cab381506ca7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:22:17 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 6c9fc5a9-8659-497c-bb07-af52fe2e1761 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:22:17 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 9b8ba94f-43cc-4f06-bcd9-83935ccbe117 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:22:17 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance b91af786-36e3-4815-811f-fb3c055e758d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:22:17 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 0b79d385-e512-4297-9aa4-2b9bb0cac23c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:22:17 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 11:22:17 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 11:22:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25c3b8d2-beea-4362-8602-5134c21ac2ff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:17 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a529bf70-94dd-4a95-b494-a83b3fcf903f]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:22:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:22:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 1.030s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:22:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] <== disconnect_volume: return (1032ms) None {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:22:17 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Disconnected iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 11:22:17 user nova-compute[74683]: DEBUG nova.compute.manager [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HPFkpWLi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'e84bb680-a542-4cb2-b0c5-67a210c25e9e', 'attached_at': '', 'detached_at': '', 'volume_id': '83717834-0a00-4b2d-a2a7-7aeaa3d84cee', 'serial'} {{(pid=74683) _swap_volume /opt/stack/nova/nova/compute/manager.py:7790}}
Oct 16 11:22:17 user nova-compute[74683]: DEBUG nova.compute.manager [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] swap_volume: removing Cinder connection for volume 25c3b8d2-beea-4362-8602-5134c21ac2ff {{(pid=74683) _swap_volume /opt/stack/nova/nova/compute/manager.py:7835}}
Oct 16 11:22:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:22:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:22:17 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:22:17 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:22:17 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Compute_service record updated for user:user {{(pid=74683) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 11:22:17 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.844s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:22:18 user nova-compute[74683]: DEBUG nova.compute.manager [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] swap_volume: Updating volume 25c3b8d2-beea-4362-8602-5134c21ac2ff BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "HPFkpWLi", "auth_password": "KS4b8506FH9Mto", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sde", "volume_id": "83717834-0a00-4b2d-a2a7-7aeaa3d84cee"}, "status": "reserved", "instance": "e84bb680-a542-4cb2-b0c5-67a210c25e9e", "attached_at": "", "detached_at": "", "volume_id": "83717834-0a00-4b2d-a2a7-7aeaa3d84cee", "serial": "83717834-0a00-4b2d-a2a7-7aeaa3d84cee"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '83717834-0a00-4b2d-a2a7-7aeaa3d84cee', 'no_device': None, 'attachment_id': '2c22eb92-4c09-4d7d-9727-fee57d0169ff'} {{(pid=74683) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7983}}
Oct 16 11:22:18 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-01482349-e206-425d-ad2d-03bdfa26e816 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] Lock "e84bb680-a542-4cb2-b0c5-67a210c25e9e" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 40.041s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:22:19 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-af6fc2a1-2483-4f3d-a47e-6d862f038f02 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] Acquiring lock "e84bb680-a542-4cb2-b0c5-67a210c25e9e" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:22:19 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-af6fc2a1-2483-4f3d-a47e-6d862f038f02 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] Lock "e84bb680-a542-4cb2-b0c5-67a210c25e9e" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:22:20 user nova-compute[74683]: DEBUG os_brick.utils [None req-af6fc2a1-2483-4f3d-a47e-6d862f038f02 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:22:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:20 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7058c85-43d5-4a64-8dc3-2f063c1d1795]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:70b9d336ab7d\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:22:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:20 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d00a69-6483-4871-a103-50aa8c9fbcf5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:22:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:20 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[9acd5933-b819-4abe-b246-f63e39f2b56c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:22:20 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[80fa678f-6fc3-4b5f-b008-90664539dfac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:22:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-af6fc2a1-2483-4f3d-a47e-6d862f038f02 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] Running cmd (subprocess): nvme version {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-af6fc2a1-2483-4f3d-a47e-6d862f038f02 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:22:20 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.nvmeof [None req-af6fc2a1-2483-4f3d-a47e-6d862f038f02 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] nvme not present on system {{(pid=74683) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 11:22:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:22:20 user nova-compute[74683]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 11:22:20 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[403ed889-3f7a-453d-bee6-7b69dde94400]: (4, '') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:22:20 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-af6fc2a1-2483-4f3d-a47e-6d862f038f02 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74683) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 11:22:20 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-af6fc2a1-2483-4f3d-a47e-6d862f038f02 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 11:22:20 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-af6fc2a1-2483-4f3d-a47e-6d862f038f02 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] LIGHTOS: no hostnqn found. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 11:22:20 user nova-compute[74683]: DEBUG os_brick.utils [None req-af6fc2a1-2483-4f3d-a47e-6d862f038f02 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:70b9d336ab7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:22:20 user nova-compute[74683]: INFO nova.compute.manager [None req-af6fc2a1-2483-4f3d-a47e-6d862f038f02 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Swapping volume 83717834-0a00-4b2d-a2a7-7aeaa3d84cee for 25c3b8d2-beea-4362-8602-5134c21ac2ff
Oct 16 11:22:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:22:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:22:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:22:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:22:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-a828215a-4998-4c28-962f-4205641ee07d tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Acquiring lock "f192d1ec-311d-4a30-9766-361b27a8dae8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:22:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-a828215a-4998-4c28-962f-4205641ee07d tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Lock "f192d1ec-311d-4a30-9766-361b27a8dae8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:22:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-a828215a-4998-4c28-962f-4205641ee07d tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Acquiring lock "f192d1ec-311d-4a30-9766-361b27a8dae8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:22:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-a828215a-4998-4c28-962f-4205641ee07d tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Lock "f192d1ec-311d-4a30-9766-361b27a8dae8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:22:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-a828215a-4998-4c28-962f-4205641ee07d tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Lock "f192d1ec-311d-4a30-9766-361b27a8dae8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:22:29 user nova-compute[74683]: INFO nova.compute.manager [None req-a828215a-4998-4c28-962f-4205641ee07d tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Terminating instance
Oct 16 11:22:29 user nova-compute[74683]: DEBUG nova.compute.manager [None req-a828215a-4998-4c28-962f-4205641ee07d tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Start destroying the instance on the hypervisor. {{(pid=74683) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 11:22:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:22:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:22:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:22:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:22:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:22:29 user nova-compute[74683]: DEBUG nova.compute.manager [req-db7777d3-27d3-4132-8028-56a9f1701cdf req-dbbf1986-daf1-45f3-a379-d6769124c429 service nova] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Received event network-vif-unplugged-dbbeadad-745e-4d28-a242-577b3197b079 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:22:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-db7777d3-27d3-4132-8028-56a9f1701cdf req-dbbf1986-daf1-45f3-a379-d6769124c429 service nova] Acquiring lock "f192d1ec-311d-4a30-9766-361b27a8dae8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:22:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-db7777d3-27d3-4132-8028-56a9f1701cdf req-dbbf1986-daf1-45f3-a379-d6769124c429 service nova] Lock "f192d1ec-311d-4a30-9766-361b27a8dae8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:22:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-db7777d3-27d3-4132-8028-56a9f1701cdf req-dbbf1986-daf1-45f3-a379-d6769124c429 service nova] Lock "f192d1ec-311d-4a30-9766-361b27a8dae8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:22:29 user nova-compute[74683]: DEBUG nova.compute.manager [req-db7777d3-27d3-4132-8028-56a9f1701cdf req-dbbf1986-daf1-45f3-a379-d6769124c429 service nova] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] No waiting events found dispatching network-vif-unplugged-dbbeadad-745e-4d28-a242-577b3197b079 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:22:29 user nova-compute[74683]: DEBUG nova.compute.manager [req-db7777d3-27d3-4132-8028-56a9f1701cdf req-dbbf1986-daf1-45f3-a379-d6769124c429 service nova] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Received event network-vif-unplugged-dbbeadad-745e-4d28-a242-577b3197b079 for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 11:22:30 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Instance destroyed successfully.
Oct 16 11:22:30 user nova-compute[74683]: DEBUG nova.objects.instance [None req-a828215a-4998-4c28-962f-4205641ee07d tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Lazy-loading 'resources' on Instance uuid f192d1ec-311d-4a30-9766-361b27a8dae8 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:22:30 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-a828215a-4998-4c28-962f-4205641ee07d tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:13:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-983209770',display_name='tempest-ServerActionsTestOtherB-server-983209770',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-983209770',id=4,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9H9XkO3ueDaPVFedHBs8IBjQP+O3m5MP98XnfC/J6UPNHq/d/RZvz6o5PlZR6OTg+H3cDaV7C6HUM8WearORwrzPoJ/Wxd8/4rMuBZ4j1C0aE5FLDGnbq9yp0LqlVHBQ==',key_name='tempest-keypair-650579759',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:20:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e1d7573bebfe47e3989f8eedd90dee6c',ramdisk_id='',reservation_id='r-wwd9qybu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1241350688',owner_user_name='tempest-ServerActionsTestOtherB-1241350688-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:20:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fc0a33378424a9080c747d4f78528a5',uuid=f192d1ec-311d-4a30-9766-361b27a8dae8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dbbeadad-745e-4d28-a242-577b3197b079", "address": "fa:16:3e:2b:14:bf", "network": {"id": "33f5edce-0901-42ea-b07a-47da2819b133", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-117849665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d7573bebfe47e3989f8eedd90dee6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbbeadad-74", "ovs_interfaceid": "dbbeadad-745e-4d28-a242-577b3197b079", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:22:30 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-a828215a-4998-4c28-962f-4205641ee07d tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Converting VIF {"id": "dbbeadad-745e-4d28-a242-577b3197b079", "address": "fa:16:3e:2b:14:bf", "network": {"id": "33f5edce-0901-42ea-b07a-47da2819b133", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-117849665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d7573bebfe47e3989f8eedd90dee6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbbeadad-74", "ovs_interfaceid": "dbbeadad-745e-4d28-a242-577b3197b079", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:22:30 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-a828215a-4998-4c28-962f-4205641ee07d tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2b:14:bf,bridge_name='br-int',has_traffic_filtering=True,id=dbbeadad-745e-4d28-a242-577b3197b079,network=Network(33f5edce-0901-42ea-b07a-47da2819b133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbbeadad-74') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:22:30 user nova-compute[74683]: DEBUG os_vif [None req-a828215a-4998-4c28-962f-4205641ee07d tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:14:bf,bridge_name='br-int',has_traffic_filtering=True,id=dbbeadad-745e-4d28-a242-577b3197b079,network=Network(33f5edce-0901-42ea-b07a-47da2819b133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbbeadad-74') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:22:30 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:22:30 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdbbeadad-74, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:22:30 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:22:30 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:22:30 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:22:30 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=36012291-90a0-4546-a827-707030f2b87e) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:22:30 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:22:30 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:22:30 user nova-compute[74683]: INFO os_vif [None req-a828215a-4998-4c28-962f-4205641ee07d tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:14:bf,bridge_name='br-int',has_traffic_filtering=True,id=dbbeadad-745e-4d28-a242-577b3197b079,network=Network(33f5edce-0901-42ea-b07a-47da2819b133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbbeadad-74')
Oct 16 11:22:30 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a828215a-4998-4c28-962f-4205641ee07d tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] calling os-brick to detach iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 11:22:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a828215a-4998-4c28-962f-4205641ee07d tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, {'target_iqn': 'iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nGRHmKco', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:22:30 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-a828215a-4998-4c28-962f-4205641ee07d tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:22:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-a828215a-4998-4c28-962f-4205641ee07d tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:22:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-a828215a-4998-4c28-962f-4205641ee07d tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:22:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f8699f-6c9f-4ef9-94b2-58a209d4ddaa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:22:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a828215a-4998-4c28-962f-4205641ee07d tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 11:22:30 user nova-compute[74683]: No targets found.
Oct 16 11:22:30 user nova-compute[74683]: iSNS:
Oct 16 11:22:30 user nova-compute[74683]: No targets found.
Oct 16 11:22:30 user nova-compute[74683]: STATIC:
Oct 16 11:22:30 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea
Oct 16 11:22:30 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:22:30 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:22:30 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb
Oct 16 11:22:30 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:22:30 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:22:30 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b
Oct 16 11:22:30 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:22:30 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:22:30 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee
Oct 16 11:22:30 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:22:30 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:22:30 user nova-compute[74683]: FIRMWARE:
Oct 16 11:22:30 user nova-compute[74683]: No targets found.
Oct 16 11:22:30 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:22:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a828215a-4998-4c28-962f-4205641ee07d tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 11:22:30 user nova-compute[74683]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 11:22:30 user nova-compute[74683]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74683) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 11:22:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a828215a-4998-4c28-962f-4205641ee07d tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b', 0)] {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 11:22:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54b2649-a144-4f24-9ae6-b913689d3699]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:22:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da07989-c842-4df2-abe6-d952ae403941]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:22:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a828215a-4998-4c28-962f-4205641ee07d tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:22:30 user nova-compute[74683]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)
Oct 16 11:22:30 user nova-compute[74683]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea (non-flash)
Oct 16 11:22:30 user nova-compute[74683]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee (non-flash)
Oct 16 11:22:30 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:22:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a828215a-4998-4c28-962f-4205641ee07d tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:22:30 user nova-compute[74683]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b (non-flash)
Oct 16 11:22:30 user nova-compute[74683]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea (non-flash)
Oct 16 11:22:30 user nova-compute[74683]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee (non-flash)
Oct 16 11:22:30 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:22:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a828215a-4998-4c28-962f-4205641ee07d tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda6c56dea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b'): ({'sdc'}, set())}) {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 11:22:30 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-a828215a-4998-4c28-962f-4205641ee07d tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Removing single pathed devices sdc {{(pid=74683) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 11:22:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d244ea-3409-456e-bda7-6878baf82ad3]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:22:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[2620ed4e-d45b-4756-8a0d-62477e181c83]: (4, ('ok\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:22:30 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-a828215a-4998-4c28-962f-4205641ee07d tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Flushing IO for device /dev/sdc {{(pid=74683) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 11:22:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb4a9bd-85cd-4fb3-ac29-225037865dd9]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:22:30 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-a828215a-4998-4c28-962f-4205641ee07d tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74683) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 11:22:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b19836d-6d00-474b-8ab9-efcfdfc6e409]: (4, ('1', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:22:30 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-a828215a-4998-4c28-962f-4205641ee07d tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 11:22:30 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-a828215a-4998-4c28-962f-4205641ee07d tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] SCSI volumes sdc have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 11:22:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a828215a-4998-4c28-962f-4205641ee07d tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b')] {{(pid=74683) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 11:22:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59fb1c1-085d-464a-b1b9-7cf633ce1237]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:22:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a828215a-4998-4c28-962f-4205641ee07d tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:22:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260 --logout {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9df0c14-551e-4974-8d08-45b2c3e23e28]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:22:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a828215a-4998-4c28-962f-4205641ee07d tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b, portal: 172.16.0.220,3260]
Oct 16 11:22:30 user nova-compute[74683]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b, portal: 172.16.0.220,3260] successful.
Oct 16 11:22:30 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:22:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260 --op delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e131a45e-40cb-4f47-b1ce-20e2bb3d7f7b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e48be6-d587-4ae7-9a56-969f8a169231]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:22:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a828215a-4998-4c28-962f-4205641ee07d tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:22:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-a828215a-4998-4c28-962f-4205641ee07d tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:22:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a828215a-4998-4c28-962f-4205641ee07d tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] <== disconnect_volume: return (329ms) None {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:22:30 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a828215a-4998-4c28-962f-4205641ee07d tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Disconnected iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 11:22:30 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-a828215a-4998-4c28-962f-4205641ee07d tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Deleting instance files /opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8_del
Oct 16 11:22:30 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-a828215a-4998-4c28-962f-4205641ee07d tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Deletion of /opt/stack/data/nova/instances/f192d1ec-311d-4a30-9766-361b27a8dae8_del complete
Oct 16 11:22:30 user nova-compute[74683]: INFO nova.compute.manager [None req-a828215a-4998-4c28-962f-4205641ee07d tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Took 1.27 seconds to destroy the instance on the hypervisor.
Oct 16 11:22:30 user nova-compute[74683]: DEBUG oslo.service.loopingcall [None req-a828215a-4998-4c28-962f-4205641ee07d tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74683) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 11:22:30 user nova-compute[74683]: DEBUG nova.compute.manager [-] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Deallocating network for instance {{(pid=74683) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 11:22:30 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] deallocate_for_instance() {{(pid=74683) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 11:22:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:22:31 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:22:31 user nova-compute[74683]: INFO nova.compute.manager [-] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Took 0.83 seconds to deallocate network for instance.
Oct 16 11:22:31 user nova-compute[74683]: DEBUG nova.compute.manager [req-a6f48fbe-8192-42e7-8ca5-abf81019887f req-6a440c4f-259b-4cf5-8ce7-e0471889b794 service nova] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Received event network-vif-deleted-dbbeadad-745e-4d28-a242-577b3197b079 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:22:31 user nova-compute[74683]: DEBUG nova.compute.manager [req-b62b7bb5-d071-4456-a6ef-8fb1fb927f70 req-ab7dfa1e-af51-463f-b635-2548b71c5e95 service nova] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Received event network-vif-plugged-dbbeadad-745e-4d28-a242-577b3197b079 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:22:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b62b7bb5-d071-4456-a6ef-8fb1fb927f70 req-ab7dfa1e-af51-463f-b635-2548b71c5e95 service nova] Acquiring lock "f192d1ec-311d-4a30-9766-361b27a8dae8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:22:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b62b7bb5-d071-4456-a6ef-8fb1fb927f70 req-ab7dfa1e-af51-463f-b635-2548b71c5e95 service nova] Lock "f192d1ec-311d-4a30-9766-361b27a8dae8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:22:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b62b7bb5-d071-4456-a6ef-8fb1fb927f70 req-ab7dfa1e-af51-463f-b635-2548b71c5e95 service nova] Lock "f192d1ec-311d-4a30-9766-361b27a8dae8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:22:31 user nova-compute[74683]: DEBUG nova.compute.manager [req-b62b7bb5-d071-4456-a6ef-8fb1fb927f70 req-ab7dfa1e-af51-463f-b635-2548b71c5e95 service nova] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] No waiting events found dispatching network-vif-plugged-dbbeadad-745e-4d28-a242-577b3197b079 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:22:31 user nova-compute[74683]: WARNING nova.compute.manager [req-b62b7bb5-d071-4456-a6ef-8fb1fb927f70 req-ab7dfa1e-af51-463f-b635-2548b71c5e95 service nova] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Received unexpected event network-vif-plugged-dbbeadad-745e-4d28-a242-577b3197b079 for instance with vm_state active and task_state deleting.
Oct 16 11:22:32 user nova-compute[74683]: INFO nova.compute.manager [None req-a828215a-4998-4c28-962f-4205641ee07d tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] [instance: f192d1ec-311d-4a30-9766-361b27a8dae8] Took 0.83 seconds to detach 1 volumes for instance.
Oct 16 11:22:32 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-a828215a-4998-4c28-962f-4205641ee07d tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:22:32 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-a828215a-4998-4c28-962f-4205641ee07d tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:22:32 user nova-compute[74683]: ERROR nova.volume.cinder [None req-af6fc2a1-2483-4f3d-a47e-6d862f038f02 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] Update attachment failed for attachment d19ca062-95cf-4b85-ab0c-41833b5c1251. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-e4a31c39-98a2-4782-8948-03296db5a57c) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-e4a31c39-98a2-4782-8948-03296db5a57c)
Oct 16 11:22:32 user nova-compute[74683]: ERROR nova.compute.manager [None req-af6fc2a1-2483-4f3d-a47e-6d862f038f02 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Failed to connect to volume 25c3b8d2-beea-4362-8602-5134c21ac2ff with volume at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-e4a31c39-98a2-4782-8948-03296db5a57c)
Oct 16 11:22:32 user nova-compute[74683]: ERROR nova.compute.manager [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Traceback (most recent call last):
Oct 16 11:22:32 user nova-compute[74683]: ERROR nova.compute.manager [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e]   File "/opt/stack/nova/nova/compute/manager.py", line 7769, in _swap_volume
Oct 16 11:22:32 user nova-compute[74683]: ERROR nova.compute.manager [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e]     old_cinfo, new_cinfo = self._init_volume_connection(
Oct 16 11:22:32 user nova-compute[74683]: ERROR nova.compute.manager [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e]   File "/opt/stack/nova/nova/compute/manager.py", line 7742, in _init_volume_connection
Oct 16 11:22:32 user nova-compute[74683]: ERROR nova.compute.manager [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e]     new_cinfo = self.volume_api.attachment_update(
Oct 16 11:22:32 user nova-compute[74683]: ERROR nova.compute.manager [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 16 11:22:32 user nova-compute[74683]: ERROR nova.compute.manager [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e]     res = method(self, ctx, *args, **kwargs)
Oct 16 11:22:32 user nova-compute[74683]: ERROR nova.compute.manager [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 16 11:22:32 user nova-compute[74683]: ERROR nova.compute.manager [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e]     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 16 11:22:32 user nova-compute[74683]: ERROR nova.compute.manager [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 16 11:22:32 user nova-compute[74683]: ERROR nova.compute.manager [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e]     with excutils.save_and_reraise_exception():
Oct 16 11:22:32 user nova-compute[74683]: ERROR nova.compute.manager [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 16 11:22:32 user nova-compute[74683]: ERROR nova.compute.manager [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e]     self.force_reraise()
Oct 16 11:22:32 user nova-compute[74683]: ERROR nova.compute.manager [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 16 11:22:32 user nova-compute[74683]: ERROR nova.compute.manager [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e]     raise self.value
Oct 16 11:22:32 user nova-compute[74683]: ERROR nova.compute.manager [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 16 11:22:32 user nova-compute[74683]: ERROR nova.compute.manager [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e]     context, '3.44', skip_version_check=True).attachments.update(
Oct 16 11:22:32 user nova-compute[74683]: ERROR nova.compute.manager [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 16 11:22:32 user nova-compute[74683]: ERROR nova.compute.manager [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e]     return method.func(obj, *args, **kwargs)
Oct 16 11:22:32 user nova-compute[74683]: ERROR nova.compute.manager [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 16 11:22:32 user nova-compute[74683]: ERROR nova.compute.manager [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e]     resp = self._update('/attachments/%s' % id, body)
Oct 16 11:22:32 user nova-compute[74683]: ERROR nova.compute.manager [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 16 11:22:32 user nova-compute[74683]: ERROR nova.compute.manager [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e]     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 16 11:22:32 user nova-compute[74683]: ERROR nova.compute.manager [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 16 11:22:32 user nova-compute[74683]: ERROR nova.compute.manager [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e]     return self._cs_request(url, 'PUT', **kwargs)
Oct 16 11:22:32 user nova-compute[74683]: ERROR nova.compute.manager [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 16 11:22:32 user nova-compute[74683]: ERROR nova.compute.manager [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e]     return self.request(url, method, **kwargs)
Oct 16 11:22:32 user nova-compute[74683]: ERROR nova.compute.manager [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 16 11:22:32 user nova-compute[74683]: ERROR nova.compute.manager [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e]     raise exceptions.from_response(resp, body)
Oct 16 11:22:32 user nova-compute[74683]: ERROR nova.compute.manager [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-e4a31c39-98a2-4782-8948-03296db5a57c)
Oct 16 11:22:32 user nova-compute[74683]: ERROR nova.compute.manager [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] 
Oct 16 11:22:32 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-af6fc2a1-2483-4f3d-a47e-6d862f038f02 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] Lock "e84bb680-a542-4cb2-b0c5-67a210c25e9e" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 12.906s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:22:32 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-a828215a-4998-4c28-962f-4205641ee07d tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:22:32 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-a828215a-4998-4c28-962f-4205641ee07d tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server [None req-af6fc2a1-2483-4f3d-a47e-6d862f038f02 tempest-TestVolumeSwap-142787919 tempest-TestVolumeSwap-142787919-project-admin] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-e4a31c39-98a2-4782-8948-03296db5a57c)
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7902, in swap_volume
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     _do_locked_swap_volume(context, old_volume_id, new_volume_id, instance,
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7900, in _do_locked_swap_volume
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     self._do_swap_volume(context, old_volume_id, new_volume_id,
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7944, in _do_swap_volume
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     comp_ret, new_cinfo = self._swap_volume(context,
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7793, in _swap_volume
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7769, in _swap_volume
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     old_cinfo, new_cinfo = self._init_volume_connection(
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7742, in _init_volume_connection
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     new_cinfo = self.volume_api.attachment_update(
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-e4a31c39-98a2-4782-8948-03296db5a57c)
Oct 16 11:22:32 user nova-compute[74683]: ERROR oslo_messaging.rpc.server 
Oct 16 11:22:32 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-a828215a-4998-4c28-962f-4205641ee07d tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.458s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:22:33 user nova-compute[74683]: INFO nova.scheduler.client.report [None req-a828215a-4998-4c28-962f-4205641ee07d tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Deleted allocations for instance f192d1ec-311d-4a30-9766-361b27a8dae8
Oct 16 11:22:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-a828215a-4998-4c28-962f-4205641ee07d tempest-ServerActionsTestOtherB-1241350688 tempest-ServerActionsTestOtherB-1241350688-project-member] Lock "f192d1ec-311d-4a30-9766-361b27a8dae8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.605s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:22:35 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:22:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:22:40 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:22:40 user nova-compute[74683]: DEBUG nova.compute.manager [req-38ddf482-376d-41a9-9c09-3815fb567c6b req-0c974361-c25e-412e-aed2-4279793dc461 service nova] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Received event network-changed-027ef7bc-bc4d-4668-9e74-58cc707b99d8 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:22:40 user nova-compute[74683]: DEBUG nova.compute.manager [req-38ddf482-376d-41a9-9c09-3815fb567c6b req-0c974361-c25e-412e-aed2-4279793dc461 service nova] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Refreshing instance network info cache due to event network-changed-027ef7bc-bc4d-4668-9e74-58cc707b99d8. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:22:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-38ddf482-376d-41a9-9c09-3815fb567c6b req-0c974361-c25e-412e-aed2-4279793dc461 service nova] Acquiring lock "refresh_cache-ddb55617-a6a9-40f9-b2ff-b2b626f149ab" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:22:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-38ddf482-376d-41a9-9c09-3815fb567c6b req-0c974361-c25e-412e-aed2-4279793dc461 service nova] Acquired lock "refresh_cache-ddb55617-a6a9-40f9-b2ff-b2b626f149ab" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:22:40 user nova-compute[74683]: DEBUG nova.network.neutron [req-38ddf482-376d-41a9-9c09-3815fb567c6b req-0c974361-c25e-412e-aed2-4279793dc461 service nova] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Refreshing network info cache for port 027ef7bc-bc4d-4668-9e74-58cc707b99d8 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:22:41 user nova-compute[74683]: DEBUG nova.network.neutron [req-38ddf482-376d-41a9-9c09-3815fb567c6b req-0c974361-c25e-412e-aed2-4279793dc461 service nova] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Updated VIF entry in instance network info cache for port 027ef7bc-bc4d-4668-9e74-58cc707b99d8. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:22:41 user nova-compute[74683]: DEBUG nova.network.neutron [req-38ddf482-376d-41a9-9c09-3815fb567c6b req-0c974361-c25e-412e-aed2-4279793dc461 service nova] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Updating instance_info_cache with network_info: [{"id": "027ef7bc-bc4d-4668-9e74-58cc707b99d8", "address": "fa:16:3e:34:9b:23", "network": {"id": "f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-137528169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c66aa774134aa6a873eabffc28ec07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap027ef7bc-bc", "ovs_interfaceid": "027ef7bc-bc4d-4668-9e74-58cc707b99d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:22:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-38ddf482-376d-41a9-9c09-3815fb567c6b req-0c974361-c25e-412e-aed2-4279793dc461 service nova] Releasing lock "refresh_cache-ddb55617-a6a9-40f9-b2ff-b2b626f149ab" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:22:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:22:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:22:46 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:22:46 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-de4d6422-2954-453d-bc98-f15b9f5bd2c2 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Acquiring lock "ddb55617-a6a9-40f9-b2ff-b2b626f149ab" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:22:46 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-de4d6422-2954-453d-bc98-f15b9f5bd2c2 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "ddb55617-a6a9-40f9-b2ff-b2b626f149ab" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:22:46 user nova-compute[74683]: DEBUG nova.objects.instance [None req-de4d6422-2954-453d-bc98-f15b9f5bd2c2 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lazy-loading 'flavor' on Instance uuid ddb55617-a6a9-40f9-b2ff-b2b626f149ab {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:22:46 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-de4d6422-2954-453d-bc98-f15b9f5bd2c2 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "ddb55617-a6a9-40f9-b2ff-b2b626f149ab" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:22:46 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-de4d6422-2954-453d-bc98-f15b9f5bd2c2 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Acquiring lock "ddb55617-a6a9-40f9-b2ff-b2b626f149ab" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:22:46 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-de4d6422-2954-453d-bc98-f15b9f5bd2c2 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "ddb55617-a6a9-40f9-b2ff-b2b626f149ab" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:22:46 user nova-compute[74683]: INFO nova.compute.manager [None req-de4d6422-2954-453d-bc98-f15b9f5bd2c2 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Attaching volume d50e9628-1be3-4147-9d4f-042f22fa6b4a to /dev/vdb
Oct 16 11:22:46 user nova-compute[74683]: DEBUG os_brick.utils [None req-de4d6422-2954-453d-bc98-f15b9f5bd2c2 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:22:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:46 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a4a908-1219-4f24-aba6-042fedf3b5fa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:70b9d336ab7d\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:22:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:46 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb8d895-5d76-463e-bd7e-245126c6d5a2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:22:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:47 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:22:47 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2da277-fa19-48c9-9044-2ce5bfd1e94e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:22:47 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[194d4ad3-5820-439e-add0-50b4243cdf82]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:22:47 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-de4d6422-2954-453d-bc98-f15b9f5bd2c2 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Running cmd (subprocess): nvme version {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:47 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-de4d6422-2954-453d-bc98-f15b9f5bd2c2 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] 'nvme version' failed. Not Retrying. {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:22:47 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.nvmeof [None req-de4d6422-2954-453d-bc98-f15b9f5bd2c2 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] nvme not present on system {{(pid=74683) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 11:22:47 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:22:47 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:22:47 user nova-compute[74683]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 11:22:47 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[669d9483-1569-4acc-b58b-6a0b364bd5e0]: (4, '') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:22:47 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-de4d6422-2954-453d-bc98-f15b9f5bd2c2 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74683) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 11:22:47 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-de4d6422-2954-453d-bc98-f15b9f5bd2c2 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 11:22:47 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-de4d6422-2954-453d-bc98-f15b9f5bd2c2 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] LIGHTOS: no hostnqn found. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 11:22:47 user nova-compute[74683]: DEBUG os_brick.utils [None req-de4d6422-2954-453d-bc98-f15b9f5bd2c2 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:70b9d336ab7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:22:47 user nova-compute[74683]: DEBUG nova.virt.block_device [None req-de4d6422-2954-453d-bc98-f15b9f5bd2c2 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Updating existing volume attachment record: 5e530563-0c8e-48cf-b97c-c3d69ca06541 {{(pid=74683) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 11:22:50 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:22:51 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:22:55 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:22:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:22:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:00 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de4d6422-2954-453d-bc98-f15b9f5bd2c2 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Calling os-brick to attach iSCSI Volume {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 11:23:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4d6422-2954-453d-bc98-f15b9f5bd2c2 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d50e9628-1be3-4147-9d4f-042f22fa6b4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gZMScAka', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:23:04 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-de4d6422-2954-453d-bc98-f15b9f5bd2c2 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:23:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-de4d6422-2954-453d-bc98-f15b9f5bd2c2 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:23:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-de4d6422-2954-453d-bc98-f15b9f5bd2c2 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:23:04 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-de4d6422-2954-453d-bc98-f15b9f5bd2c2 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:23:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-de4d6422-2954-453d-bc98-f15b9f5bd2c2 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d50e9628-1be3-4147-9d4f-042f22fa6b4a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:23:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-de4d6422-2954-453d-bc98-f15b9f5bd2c2 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d50e9628-1be3-4147-9d4f-042f22fa6b4a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:23:04 user nova-compute[74683]: INFO os_brick.initiator.connectors.iscsi [None req-de4d6422-2954-453d-bc98-f15b9f5bd2c2 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 11:23:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d50e9628-1be3-4147-9d4f-042f22fa6b4a -p 172.16.0.220:3260 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d50e9628-1be3-4147-9d4f-042f22fa6b4a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6bac551-9b0b-44d6-ab7a-0612bc377726]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:23:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4d6422-2954-453d-bc98-f15b9f5bd2c2 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 11:23:04 user nova-compute[74683]:  {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:23:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d50e9628-1be3-4147-9d4f-042f22fa6b4a -p 172.16.0.220:3260 --interface default --op new {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d50e9628-1be3-4147-9d4f-042f22fa6b4a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6708e4a-0aa8-4d1c-bc47-cc37b7726a93]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d50e9628-1be3-4147-9d4f-042f22fa6b4a] added\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:23:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4d6422-2954-453d-bc98-f15b9f5bd2c2 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d50e9628-1be3-4147-9d4f-042f22fa6b4a] added
Oct 16 11:23:04 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:23:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d50e9628-1be3-4147-9d4f-042f22fa6b4a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d50e9628-1be3-4147-9d4f-042f22fa6b4a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.124s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8184d35-50a0-4a09-b23f-8d54ca89fe47]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:23:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4d6422-2954-453d-bc98-f15b9f5bd2c2 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:23:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d50e9628-1be3-4147-9d4f-042f22fa6b4a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d50e9628-1be3-4147-9d4f-042f22fa6b4a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda495c2-72b2-4a4d-a535-0cc5d292d634]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:23:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4d6422-2954-453d-bc98-f15b9f5bd2c2 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:23:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d50e9628-1be3-4147-9d4f-042f22fa6b4a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gZMScAka {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d50e9628-1be3-4147-9d4f-042f22fa6b4a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gZMScAka" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9c026b-a98a-4f35-b8fc-9163e41141df]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:23:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4d6422-2954-453d-bc98-f15b9f5bd2c2 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gZMScAka'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:23:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d50e9628-1be3-4147-9d4f-042f22fa6b4a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d50e9628-1be3-4147-9d4f-042f22fa6b4a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[0edd32bc-e162-4868-9775-42b2ba3367c7]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:23:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4d6422-2954-453d-bc98-f15b9f5bd2c2 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:23:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34e651a-d487-4c83-b692-4aa9e3cc1c72]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:23:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4d6422-2954-453d-bc98-f15b9f5bd2c2 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:23:04 user nova-compute[74683]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea (non-flash)
Oct 16 11:23:04 user nova-compute[74683]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee (non-flash)
Oct 16 11:23:04 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:23:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4d6422-2954-453d-bc98-f15b9f5bd2c2 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:23:04 user nova-compute[74683]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea (non-flash)
Oct 16 11:23:04 user nova-compute[74683]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee (non-flash)
Oct 16 11:23:04 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:23:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d50e9628-1be3-4147-9d4f-042f22fa6b4a -p 172.16.0.220:3260 --login {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d50e9628-1be3-4147-9d4f-042f22fa6b4a -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e861e692-3e85-4692-a620-87da2b7cfbcc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d50e9628-1be3-4147-9d4f-042f22fa6b4a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d50e9628-1be3-4147-9d4f-042f22fa6b4a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:23:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4d6422-2954-453d-bc98-f15b9f5bd2c2 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d50e9628-1be3-4147-9d4f-042f22fa6b4a, portal: 172.16.0.220,3260]
Oct 16 11:23:04 user nova-compute[74683]: Login to [iface: default, target: iqn.2010-10.org.openstack:d50e9628-1be3-4147-9d4f-042f22fa6b4a, portal: 172.16.0.220,3260] successful.
Oct 16 11:23:04 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:23:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d50e9628-1be3-4147-9d4f-042f22fa6b4a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d50e9628-1be3-4147-9d4f-042f22fa6b4a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4413fdc-c704-4bdc-a203-4a625949af37]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:23:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4d6422-2954-453d-bc98-f15b9f5bd2c2 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:23:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f072742-c82a-4a06-8ddf-4287369dc69b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d50e9628-1be3-4147-9d4f-042f22fa6b4a (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:23:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4d6422-2954-453d-bc98-f15b9f5bd2c2 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:23:04 user nova-compute[74683]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea (non-flash)
Oct 16 11:23:04 user nova-compute[74683]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee (non-flash)
Oct 16 11:23:04 user nova-compute[74683]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d50e9628-1be3-4147-9d4f-042f22fa6b4a (non-flash)
Oct 16 11:23:04 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:23:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4d6422-2954-453d-bc98-f15b9f5bd2c2 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:23:04 user nova-compute[74683]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea (non-flash)
Oct 16 11:23:04 user nova-compute[74683]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee (non-flash)
Oct 16 11:23:04 user nova-compute[74683]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d50e9628-1be3-4147-9d4f-042f22fa6b4a (non-flash)
Oct 16 11:23:04 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:23:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-de4d6422-2954-453d-bc98-f15b9f5bd2c2 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d50e9628-1be3-4147-9d4f-042f22fa6b4a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.384s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:23:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4d6422-2954-453d-bc98-f15b9f5bd2c2 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Connected to 172.16.0.220:3260 {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 11:23:04 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-de4d6422-2954-453d-bc98-f15b9f5bd2c2 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] HCTL ('33', '-', '-', 0) found on session 23 with lun 0 {{(pid=74683) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 11:23:04 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-de4d6422-2954-453d-bc98-f15b9f5bd2c2 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74683) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 11:23:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[8932c9c9-057d-4c1c-86fd-5aad38c58110]: (4, ('- - 0', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:23:04 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-de4d6422-2954-453d-bc98-f15b9f5bd2c2 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: None {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:23:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:23:05 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-de4d6422-2954-453d-bc98-f15b9f5bd2c2 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:23:05 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4d6422-2954-453d-bc98-f15b9f5bd2c2 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d50e9628-1be3-4147-9d4f-042f22fa6b4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gZMScAka', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 11:23:05 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-de4d6422-2954-453d-bc98-f15b9f5bd2c2 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.413s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:23:05 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4d6422-2954-453d-bc98-f15b9f5bd2c2 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] <== connect_volume: return (1414ms) {'type': 'block', 'scsi_wwn': '26437353063323163', 'path': '/dev/sdb'} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:23:05 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de4d6422-2954-453d-bc98-f15b9f5bd2c2 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26437353063323163', 'path': '/dev/sdb'} {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 11:23:05 user nova-compute[74683]: DEBUG nova.objects.instance [None req-de4d6422-2954-453d-bc98-f15b9f5bd2c2 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lazy-loading 'flavor' on Instance uuid ddb55617-a6a9-40f9-b2ff-b2b626f149ab {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:23:05 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-de4d6422-2954-453d-bc98-f15b9f5bd2c2 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 11:23:05 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:23:05 user nova-compute[74683]:   <source dev="/dev/sdb"/>
Oct 16 11:23:05 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:23:05 user nova-compute[74683]:   <serial>d50e9628-1be3-4147-9d4f-042f22fa6b4a</serial>
Oct 16 11:23:05 user nova-compute[74683]: </disk>
Oct 16 11:23:05 user nova-compute[74683]:  {{(pid=74683) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 11:23:06 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-de4d6422-2954-453d-bc98-f15b9f5bd2c2 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:23:06 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-de4d6422-2954-453d-bc98-f15b9f5bd2c2 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:23:06 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-de4d6422-2954-453d-bc98-f15b9f5bd2c2 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] No VIF found with MAC fa:16:3e:34:9b:23, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:23:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-de4d6422-2954-453d-bc98-f15b9f5bd2c2 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "ddb55617-a6a9-40f9-b2ff-b2b626f149ab" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.677s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:23:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-5311cf4f-10ea-4d1b-a811-9b09012c2b18 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Acquiring lock "ddb55617-a6a9-40f9-b2ff-b2b626f149ab" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:23:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-5311cf4f-10ea-4d1b-a811-9b09012c2b18 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "ddb55617-a6a9-40f9-b2ff-b2b626f149ab" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:23:07 user nova-compute[74683]: INFO nova.compute.manager [None req-5311cf4f-10ea-4d1b-a811-9b09012c2b18 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Detaching volume d50e9628-1be3-4147-9d4f-042f22fa6b4a
Oct 16 11:23:08 user nova-compute[74683]: INFO nova.virt.block_device [None req-5311cf4f-10ea-4d1b-a811-9b09012c2b18 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Attempting to driver detach volume d50e9628-1be3-4147-9d4f-042f22fa6b4a from mountpoint /dev/vdb
Oct 16 11:23:08 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-5311cf4f-10ea-4d1b-a811-9b09012c2b18 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Attempting to detach device vdb from instance ddb55617-a6a9-40f9-b2ff-b2b626f149ab from the persistent domain config. {{(pid=74683) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 11:23:08 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-5311cf4f-10ea-4d1b-a811-9b09012c2b18 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 11:23:08 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:23:08 user nova-compute[74683]:   <source dev="/dev/sdb"/>
Oct 16 11:23:08 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:23:08 user nova-compute[74683]:   <serial>d50e9628-1be3-4147-9d4f-042f22fa6b4a</serial>
Oct 16 11:23:08 user nova-compute[74683]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 11:23:08 user nova-compute[74683]: </disk>
Oct 16 11:23:08 user nova-compute[74683]:  {{(pid=74683) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 11:23:08 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-5311cf4f-10ea-4d1b-a811-9b09012c2b18 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Successfully detached device vdb from instance ddb55617-a6a9-40f9-b2ff-b2b626f149ab from the persistent domain config.
Oct 16 11:23:08 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-5311cf4f-10ea-4d1b-a811-9b09012c2b18 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ddb55617-a6a9-40f9-b2ff-b2b626f149ab from the live domain config. {{(pid=74683) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 11:23:08 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-5311cf4f-10ea-4d1b-a811-9b09012c2b18 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 11:23:08 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:23:08 user nova-compute[74683]:   <source dev="/dev/sdb"/>
Oct 16 11:23:08 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:23:08 user nova-compute[74683]:   <serial>d50e9628-1be3-4147-9d4f-042f22fa6b4a</serial>
Oct 16 11:23:08 user nova-compute[74683]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 11:23:08 user nova-compute[74683]: </disk>
Oct 16 11:23:08 user nova-compute[74683]:  {{(pid=74683) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 11:23:08 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-5311cf4f-10ea-4d1b-a811-9b09012c2b18 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ddb55617-a6a9-40f9-b2ff-b2b626f149ab {{(pid=74683) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 11:23:10 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:23:12 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:23:12 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:23:12 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:23:12 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Starting heal instance info cache {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 11:23:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "refresh_cache-d5e55361-d9ed-4d07-91b0-ec4d08b2e817" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:23:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquired lock "refresh_cache-d5e55361-d9ed-4d07-91b0-ec4d08b2e817" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:23:13 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Forcefully refreshing network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 11:23:13 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Updating instance_info_cache with network_info: [{"id": "ade44b63-49bb-4dbc-b0f9-95156f4fd6db", "address": "fa:16:3e:ad:0a:5c", "network": {"id": "4d43cc12-d2cd-4552-90a4-884a0ff3dc66", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-825513246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6e0046017b4bba85caf2a39d1c67b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade44b63-49", "ovs_interfaceid": "ade44b63-49bb-4dbc-b0f9-95156f4fd6db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:23:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Releasing lock "refresh_cache-d5e55361-d9ed-4d07-91b0-ec4d08b2e817" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:23:13 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Updated the network info_cache for instance {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 11:23:13 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:23:13 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:23:13 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:23:13 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:23:13 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:23:13 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:23:13 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74683) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 11:23:13 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:23:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:23:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:23:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:23:13 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Auditing locally available compute resources for user (node: user) {{(pid=74683) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 11:23:13 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:13 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:13 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9fc5a9-8659-497c-bb07-af52fe2e1761/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9fc5a9-8659-497c-bb07-af52fe2e1761/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9fc5a9-8659-497c-bb07-af52fe2e1761/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9fc5a9-8659-497c-bb07-af52fe2e1761/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84bb680-a542-4cb2-b0c5-67a210c25e9e/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84bb680-a542-4cb2-b0c5-67a210c25e9e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84bb680-a542-4cb2-b0c5-67a210c25e9e/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84bb680-a542-4cb2-b0c5-67a210c25e9e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:15 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:23:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddb55617-a6a9-40f9-b2ff-b2b626f149ab/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:15 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:23:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddb55617-a6a9-40f9-b2ff-b2b626f149ab/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddb55617-a6a9-40f9-b2ff-b2b626f149ab/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddb55617-a6a9-40f9-b2ff-b2b626f149ab/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45ca3cbb-53d6-4046-9be3-92cc6b71bfad/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45ca3cbb-53d6-4046-9be3-92cc6b71bfad/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45ca3cbb-53d6-4046-9be3-92cc6b71bfad/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45ca3cbb-53d6-4046-9be3-92cc6b71bfad/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b79d385-e512-4297-9aa4-2b9bb0cac23c/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b79d385-e512-4297-9aa4-2b9bb0cac23c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b79d385-e512-4297-9aa4-2b9bb0cac23c/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b79d385-e512-4297-9aa4-2b9bb0cac23c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:16 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:23:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ced47a3-311d-4083-94e1-b2d42326e24d/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:16 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ced47a3-311d-4083-94e1-b2d42326e24d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ced47a3-311d-4083-94e1-b2d42326e24d/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ced47a3-311d-4083-94e1-b2d42326e24d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:17 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:23:17 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:23:17 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:23:17 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Hypervisor/Node resource view: name=user free_ram=7209MB free_disk=25.105792999267578GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74683) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 11:23:17 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:23:17 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:23:18 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 18a77385-fab9-4ea0-8aa6-666cf7e798a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:23:18 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance d5e55361-d9ed-4d07-91b0-ec4d08b2e817 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:23:18 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 45ca3cbb-53d6-4046-9be3-92cc6b71bfad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:23:18 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance e84bb680-a542-4cb2-b0c5-67a210c25e9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:23:18 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance edd01413-1f8a-49e3-aa3c-ecb19c62afae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:23:18 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance ddb55617-a6a9-40f9-b2ff-b2b626f149ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:23:18 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 7ced47a3-311d-4083-94e1-b2d42326e24d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:23:18 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance b8b4a8e2-2c42-423d-954e-cab381506ca7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:23:18 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 6c9fc5a9-8659-497c-bb07-af52fe2e1761 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:23:18 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 9b8ba94f-43cc-4f06-bcd9-83935ccbe117 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:23:18 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance b91af786-36e3-4815-811f-fb3c055e758d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:23:18 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 0b79d385-e512-4297-9aa4-2b9bb0cac23c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:23:18 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 11:23:18 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 11:23:18 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:23:18 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:23:18 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Compute_service record updated for user:user {{(pid=74683) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 11:23:18 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.520s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:23:20 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ac5011bc-06f6-43f6-8a58-fda4956c7e97 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquiring lock "b8b4a8e2-2c42-423d-954e-cab381506ca7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:23:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ac5011bc-06f6-43f6-8a58-fda4956c7e97 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "b8b4a8e2-2c42-423d-954e-cab381506ca7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:23:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ac5011bc-06f6-43f6-8a58-fda4956c7e97 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquiring lock "b8b4a8e2-2c42-423d-954e-cab381506ca7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:23:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ac5011bc-06f6-43f6-8a58-fda4956c7e97 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "b8b4a8e2-2c42-423d-954e-cab381506ca7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:23:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ac5011bc-06f6-43f6-8a58-fda4956c7e97 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "b8b4a8e2-2c42-423d-954e-cab381506ca7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:23:22 user nova-compute[74683]: INFO nova.compute.manager [None req-ac5011bc-06f6-43f6-8a58-fda4956c7e97 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] Terminating instance
Oct 16 11:23:22 user nova-compute[74683]: DEBUG nova.compute.manager [None req-ac5011bc-06f6-43f6-8a58-fda4956c7e97 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] Start destroying the instance on the hypervisor. {{(pid=74683) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 11:23:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:22 user nova-compute[74683]: DEBUG nova.compute.manager [req-988e79ea-511e-4caa-a19d-280833b13c45 req-aff54b71-597c-4647-9a72-ae7691c0f63f service nova] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Received event network-changed-a94c53f7-4f4c-42e6-b121-9d309544dae8 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:23:22 user nova-compute[74683]: DEBUG nova.compute.manager [req-988e79ea-511e-4caa-a19d-280833b13c45 req-aff54b71-597c-4647-9a72-ae7691c0f63f service nova] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Refreshing instance network info cache due to event network-changed-a94c53f7-4f4c-42e6-b121-9d309544dae8. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:23:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-988e79ea-511e-4caa-a19d-280833b13c45 req-aff54b71-597c-4647-9a72-ae7691c0f63f service nova] Acquiring lock "refresh_cache-7ced47a3-311d-4083-94e1-b2d42326e24d" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:23:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-988e79ea-511e-4caa-a19d-280833b13c45 req-aff54b71-597c-4647-9a72-ae7691c0f63f service nova] Acquired lock "refresh_cache-7ced47a3-311d-4083-94e1-b2d42326e24d" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:23:22 user nova-compute[74683]: DEBUG nova.network.neutron [req-988e79ea-511e-4caa-a19d-280833b13c45 req-aff54b71-597c-4647-9a72-ae7691c0f63f service nova] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Refreshing network info cache for port a94c53f7-4f4c-42e6-b121-9d309544dae8 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:23:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-374f616e-b464-489c-82d5-e1b6b4a92705 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Acquiring lock "7ced47a3-311d-4083-94e1-b2d42326e24d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:23:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-374f616e-b464-489c-82d5-e1b6b4a92705 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lock "7ced47a3-311d-4083-94e1-b2d42326e24d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:23:22 user nova-compute[74683]: DEBUG nova.objects.instance [None req-374f616e-b464-489c-82d5-e1b6b4a92705 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lazy-loading 'flavor' on Instance uuid 7ced47a3-311d-4083-94e1-b2d42326e24d {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:23:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-374f616e-b464-489c-82d5-e1b6b4a92705 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lock "7ced47a3-311d-4083-94e1-b2d42326e24d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.098s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:23:22 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] Instance destroyed successfully.
Oct 16 11:23:22 user nova-compute[74683]: DEBUG nova.objects.instance [None req-ac5011bc-06f6-43f6-8a58-fda4956c7e97 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lazy-loading 'resources' on Instance uuid b8b4a8e2-2c42-423d-954e-cab381506ca7 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-ac5011bc-06f6-43f6-8a58-fda4956c7e97 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:21:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-625562605',display_name='tempest-TestVolumeBootPattern-server-625562605',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-625562605',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:22:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2aefabef9e42412f8309f490dcfecc79',ramdisk_id='',reservation_id='r-0jqg2ikk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-953001121',owner_user_name='tempest-TestVolumeBootPattern-953001121-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:22:09Z,user_data=None,user_id='a463a84e332543dfbc03b81518f82be1',uuid=b8b4a8e2-2c42-423d-954e-cab381506ca7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4e53b899-a596-47a3-8e17-88748f58e737", "address": "fa:16:3e:05:6b:b7", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e53b899-a5", "ovs_interfaceid": "4e53b899-a596-47a3-8e17-88748f58e737", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-ac5011bc-06f6-43f6-8a58-fda4956c7e97 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Converting VIF {"id": "4e53b899-a596-47a3-8e17-88748f58e737", "address": "fa:16:3e:05:6b:b7", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e53b899-a5", "ovs_interfaceid": "4e53b899-a596-47a3-8e17-88748f58e737", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-ac5011bc-06f6-43f6-8a58-fda4956c7e97 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:6b:b7,bridge_name='br-int',has_traffic_filtering=True,id=4e53b899-a596-47a3-8e17-88748f58e737,network=Network(00883fc4-0b74-4afd-9043-82e2933faab3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e53b899-a5') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG os_vif [None req-ac5011bc-06f6-43f6-8a58-fda4956c7e97 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:6b:b7,bridge_name='br-int',has_traffic_filtering=True,id=4e53b899-a596-47a3-8e17-88748f58e737,network=Network(00883fc4-0b74-4afd-9043-82e2933faab3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e53b899-a5') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4e53b899-a5, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a655c500-3414-43e5-ac0b-d569445c26a2) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:23 user nova-compute[74683]: INFO os_vif [None req-ac5011bc-06f6-43f6-8a58-fda4956c7e97 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:6b:b7,bridge_name='br-int',has_traffic_filtering=True,id=4e53b899-a596-47a3-8e17-88748f58e737,network=Network(00883fc4-0b74-4afd-9043-82e2933faab3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e53b899-a5')
Oct 16 11:23:23 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac5011bc-06f6-43f6-8a58-fda4956c7e97 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] calling os-brick to detach iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5011bc-06f6-43f6-8a58-fda4956c7e97 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, {'target_iqn': 'iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oBQkGHsL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:23:23 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-ac5011bc-06f6-43f6-8a58-fda4956c7e97 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:23:23 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-ac5011bc-06f6-43f6-8a58-fda4956c7e97 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-ac5011bc-06f6-43f6-8a58-fda4956c7e97 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[180b2f35-080c-4991-a712-5c5f07692e64]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d50e9628-1be3-4147-9d4f-042f22fa6b4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5011bc-06f6-43f6-8a58-fda4956c7e97 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 11:23:23 user nova-compute[74683]: No targets found.
Oct 16 11:23:23 user nova-compute[74683]: iSNS:
Oct 16 11:23:23 user nova-compute[74683]: No targets found.
Oct 16 11:23:23 user nova-compute[74683]: STATIC:
Oct 16 11:23:23 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea
Oct 16 11:23:23 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:23:23 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:23:23 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:d50e9628-1be3-4147-9d4f-042f22fa6b4a
Oct 16 11:23:23 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:23:23 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:23:23 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb
Oct 16 11:23:23 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:23:23 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:23:23 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee
Oct 16 11:23:23 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:23:23 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:23:23 user nova-compute[74683]: FIRMWARE:
Oct 16 11:23:23 user nova-compute[74683]: No targets found.
Oct 16 11:23:23 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5011bc-06f6-43f6-8a58-fda4956c7e97 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 11:23:23 user nova-compute[74683]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 11:23:23 user nova-compute[74683]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74683) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5011bc-06f6-43f6-8a58-fda4956c7e97 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea', 0)] {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG nova.network.neutron [req-988e79ea-511e-4caa-a19d-280833b13c45 req-aff54b71-597c-4647-9a72-ae7691c0f63f service nova] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Updated VIF entry in instance network info cache for port a94c53f7-4f4c-42e6-b121-9d309544dae8. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG nova.network.neutron [req-988e79ea-511e-4caa-a19d-280833b13c45 req-aff54b71-597c-4647-9a72-ae7691c0f63f service nova] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Updating instance_info_cache with network_info: [{"id": "a94c53f7-4f4c-42e6-b121-9d309544dae8", "address": "fa:16:3e:33:b2:31", "network": {"id": "76ba31b5-c467-45e4-ae9a-111f41fd62a3", "bridge": "br-int", "label": "tempest-TestStampPattern-2049888281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "377cd8de2ae042938a9072f64567a911", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa94c53f7-4f", "ovs_interfaceid": "a94c53f7-4f4c-42e6-b121-9d309544dae8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a714de2-fb3a-4582-afb0-21b66b8c8dca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d50e9628-1be3-4147-9d4f-042f22fa6b4a\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-988e79ea-511e-4caa-a19d-280833b13c45 req-aff54b71-597c-4647-9a72-ae7691c0f63f service nova] Releasing lock "refresh_cache-7ced47a3-311d-4083-94e1-b2d42326e24d" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4881092-45f9-42f4-82bc-81dc34aeb3d3]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d50e9628-1be3-4147-9d4f-042f22fa6b4a (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5011bc-06f6-43f6-8a58-fda4956c7e97 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:23:23 user nova-compute[74683]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea (non-flash)
Oct 16 11:23:23 user nova-compute[74683]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee (non-flash)
Oct 16 11:23:23 user nova-compute[74683]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d50e9628-1be3-4147-9d4f-042f22fa6b4a (non-flash)
Oct 16 11:23:23 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5011bc-06f6-43f6-8a58-fda4956c7e97 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:23:23 user nova-compute[74683]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea (non-flash)
Oct 16 11:23:23 user nova-compute[74683]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee (non-flash)
Oct 16 11:23:23 user nova-compute[74683]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d50e9628-1be3-4147-9d4f-042f22fa6b4a (non-flash)
Oct 16 11:23:23 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5011bc-06f6-43f6-8a58-fda4956c7e97 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda4c7c7490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea'): ({'sdd'}, set())}) {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-ac5011bc-06f6-43f6-8a58-fda4956c7e97 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Removing single pathed devices sdd {{(pid=74683) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[5439f461-b999-482c-9dcb-e04e205fddc1]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[42119f7e-4056-430c-8605-12e810dc25fd]: (4, ('ok\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-ac5011bc-06f6-43f6-8a58-fda4956c7e97 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Flushing IO for device /dev/sdd {{(pid=74683) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[755152ee-eb71-4cb0-a190-3c8938e40a47]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-ac5011bc-06f6-43f6-8a58-fda4956c7e97 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74683) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-374f616e-b464-489c-82d5-e1b6b4a92705 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Acquiring lock "7ced47a3-311d-4083-94e1-b2d42326e24d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-374f616e-b464-489c-82d5-e1b6b4a92705 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lock "7ced47a3-311d-4083-94e1-b2d42326e24d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:23:23 user nova-compute[74683]: INFO nova.compute.manager [None req-374f616e-b464-489c-82d5-e1b6b4a92705 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Attaching volume 007698a6-0222-4002-8253-d70f69189955 to /dev/vdb
Oct 16 11:23:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.098s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[39893829-e3f6-4c9c-958c-a14dac0f736d]: (4, ('1', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-ac5011bc-06f6-43f6-8a58-fda4956c7e97 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-ac5011bc-06f6-43f6-8a58-fda4956c7e97 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] SCSI volumes sdd have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5011bc-06f6-43f6-8a58-fda4956c7e97 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea')] {{(pid=74683) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[5554d1c6-30a9-4a45-ae05-ecf9e41043f0]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5011bc-06f6-43f6-8a58-fda4956c7e97 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea -p 172.16.0.220:3260 --logout {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG os_brick.utils [None req-374f616e-b464-489c-82d5-e1b6b4a92705 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a103b1-581b-48d4-821a-619243769933]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:70b9d336ab7d\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45bb993-6211-40dd-86d7-e1d2b97d8362]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5011bc-06f6-43f6-8a58-fda4956c7e97 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea, portal: 172.16.0.220,3260]
Oct 16 11:23:23 user nova-compute[74683]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea, portal: 172.16.0.220,3260] successful.
Oct 16 11:23:23 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea -p 172.16.0.220:3260 --op delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d459e1-4101-4420-b9cf-b88cfcf17bbc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[225aca31-b16d-4619-90fc-2ddff5eef29c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e532f21-699f-4800-92ab-2d7ddef102ea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c30337d-ea9f-4f43-a1f0-13dae9b18a14]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5011bc-06f6-43f6-8a58-fda4956c7e97 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-ac5011bc-06f6-43f6-8a58-fda4956c7e97 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.435s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5011bc-06f6-43f6-8a58-fda4956c7e97 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] <== disconnect_volume: return (437ms) None {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac5011bc-06f6-43f6-8a58-fda4956c7e97 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] Disconnected iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 11:23:23 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-ac5011bc-06f6-43f6-8a58-fda4956c7e97 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] Deleting instance files /opt/stack/data/nova/instances/b8b4a8e2-2c42-423d-954e-cab381506ca7_del
Oct 16 11:23:23 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-ac5011bc-06f6-43f6-8a58-fda4956c7e97 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] Deletion of /opt/stack/data/nova/instances/b8b4a8e2-2c42-423d-954e-cab381506ca7_del complete
Oct 16 11:23:23 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[2167ba58-728d-4f70-999e-655be6581603]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-374f616e-b464-489c-82d5-e1b6b4a92705 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Running cmd (subprocess): nvme version {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-374f616e-b464-489c-82d5-e1b6b4a92705 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] 'nvme version' failed. Not Retrying. {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.nvmeof [None req-374f616e-b464-489c-82d5-e1b6b4a92705 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] nvme not present on system {{(pid=74683) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:23:23 user nova-compute[74683]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 11:23:23 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[33bed713-d4a1-458d-8564-63bbb78b4530]: (4, '') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-374f616e-b464-489c-82d5-e1b6b4a92705 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74683) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-374f616e-b464-489c-82d5-e1b6b4a92705 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-374f616e-b464-489c-82d5-e1b6b4a92705 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] LIGHTOS: no hostnqn found. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG os_brick.utils [None req-374f616e-b464-489c-82d5-e1b6b4a92705 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:70b9d336ab7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG nova.virt.block_device [None req-374f616e-b464-489c-82d5-e1b6b4a92705 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Updating existing volume attachment record: de7d2714-ac22-4a18-9961-c74bcaeb3252 {{(pid=74683) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 11:23:23 user nova-compute[74683]: INFO nova.compute.manager [None req-ac5011bc-06f6-43f6-8a58-fda4956c7e97 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] Took 1.44 seconds to destroy the instance on the hypervisor.
Oct 16 11:23:23 user nova-compute[74683]: DEBUG oslo.service.loopingcall [None req-ac5011bc-06f6-43f6-8a58-fda4956c7e97 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74683) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG nova.compute.manager [-] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] Deallocating network for instance {{(pid=74683) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 11:23:23 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] deallocate_for_instance() {{(pid=74683) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 11:23:24 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:23:24 user nova-compute[74683]: INFO nova.compute.manager [-] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] Took 0.84 seconds to deallocate network for instance.
Oct 16 11:23:24 user nova-compute[74683]: DEBUG nova.compute.manager [req-ee2b97a0-51a0-42bd-9c3c-0ca038a761d1 req-09f87c4e-3ef7-4cbe-8cb5-081bedec6755 service nova] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] Received event network-vif-unplugged-4e53b899-a596-47a3-8e17-88748f58e737 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:23:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-ee2b97a0-51a0-42bd-9c3c-0ca038a761d1 req-09f87c4e-3ef7-4cbe-8cb5-081bedec6755 service nova] Acquiring lock "b8b4a8e2-2c42-423d-954e-cab381506ca7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:23:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-ee2b97a0-51a0-42bd-9c3c-0ca038a761d1 req-09f87c4e-3ef7-4cbe-8cb5-081bedec6755 service nova] Lock "b8b4a8e2-2c42-423d-954e-cab381506ca7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:23:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-ee2b97a0-51a0-42bd-9c3c-0ca038a761d1 req-09f87c4e-3ef7-4cbe-8cb5-081bedec6755 service nova] Lock "b8b4a8e2-2c42-423d-954e-cab381506ca7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:23:24 user nova-compute[74683]: DEBUG nova.compute.manager [req-ee2b97a0-51a0-42bd-9c3c-0ca038a761d1 req-09f87c4e-3ef7-4cbe-8cb5-081bedec6755 service nova] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] No waiting events found dispatching network-vif-unplugged-4e53b899-a596-47a3-8e17-88748f58e737 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:23:24 user nova-compute[74683]: DEBUG nova.compute.manager [req-ee2b97a0-51a0-42bd-9c3c-0ca038a761d1 req-09f87c4e-3ef7-4cbe-8cb5-081bedec6755 service nova] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] Received event network-vif-unplugged-4e53b899-a596-47a3-8e17-88748f58e737 for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 11:23:24 user nova-compute[74683]: DEBUG nova.compute.manager [req-ee2b97a0-51a0-42bd-9c3c-0ca038a761d1 req-09f87c4e-3ef7-4cbe-8cb5-081bedec6755 service nova] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] Received event network-vif-plugged-4e53b899-a596-47a3-8e17-88748f58e737 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:23:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-ee2b97a0-51a0-42bd-9c3c-0ca038a761d1 req-09f87c4e-3ef7-4cbe-8cb5-081bedec6755 service nova] Acquiring lock "b8b4a8e2-2c42-423d-954e-cab381506ca7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:23:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-ee2b97a0-51a0-42bd-9c3c-0ca038a761d1 req-09f87c4e-3ef7-4cbe-8cb5-081bedec6755 service nova] Lock "b8b4a8e2-2c42-423d-954e-cab381506ca7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:23:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-ee2b97a0-51a0-42bd-9c3c-0ca038a761d1 req-09f87c4e-3ef7-4cbe-8cb5-081bedec6755 service nova] Lock "b8b4a8e2-2c42-423d-954e-cab381506ca7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:23:24 user nova-compute[74683]: DEBUG nova.compute.manager [req-ee2b97a0-51a0-42bd-9c3c-0ca038a761d1 req-09f87c4e-3ef7-4cbe-8cb5-081bedec6755 service nova] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] No waiting events found dispatching network-vif-plugged-4e53b899-a596-47a3-8e17-88748f58e737 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:23:24 user nova-compute[74683]: WARNING nova.compute.manager [req-ee2b97a0-51a0-42bd-9c3c-0ca038a761d1 req-09f87c4e-3ef7-4cbe-8cb5-081bedec6755 service nova] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] Received unexpected event network-vif-plugged-4e53b899-a596-47a3-8e17-88748f58e737 for instance with vm_state active and task_state deleting.
Oct 16 11:23:24 user nova-compute[74683]: DEBUG nova.compute.manager [req-ee2b97a0-51a0-42bd-9c3c-0ca038a761d1 req-09f87c4e-3ef7-4cbe-8cb5-081bedec6755 service nova] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] Received event network-vif-deleted-4e53b899-a596-47a3-8e17-88748f58e737 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:23:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Acquiring lock "4b4eaccb-e068-4e8a-9084-16229815b1d7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:23:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "4b4eaccb-e068-4e8a-9084-16229815b1d7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:23:24 user nova-compute[74683]: DEBUG nova.compute.manager [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Starting instance... {{(pid=74683) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 11:23:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:23:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:23:24 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74683) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 11:23:24 user nova-compute[74683]: INFO nova.compute.claims [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Claim successful on node user
Oct 16 11:23:25 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:23:25 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:23:25 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.597s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:23:25 user nova-compute[74683]: DEBUG nova.compute.manager [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Start building networks asynchronously for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 11:23:25 user nova-compute[74683]: DEBUG nova.compute.manager [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Allocating IP information in the background. {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 11:23:25 user nova-compute[74683]: DEBUG nova.network.neutron [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] allocate_for_instance() {{(pid=74683) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 11:23:25 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 11:23:25 user nova-compute[74683]: DEBUG nova.compute.manager [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Start building block device mappings for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 11:23:25 user nova-compute[74683]: DEBUG nova.policy [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6a55641a42b142ea9fb6c6c1fdb9963e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb8da41d6584a689e9b50155288aa5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74683) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 11:23:25 user nova-compute[74683]: DEBUG nova.compute.manager [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Start spawning the instance on the hypervisor. {{(pid=74683) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 11:23:25 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Creating instance directory {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 11:23:25 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Creating image(s)
Oct 16 11:23:25 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Acquiring lock "/opt/stack/data/nova/instances/4b4eaccb-e068-4e8a-9084-16229815b1d7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:23:25 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "/opt/stack/data/nova/instances/4b4eaccb-e068-4e8a-9084-16229815b1d7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:23:25 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "/opt/stack/data/nova/instances/4b4eaccb-e068-4e8a-9084-16229815b1d7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:23:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.216s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Acquiring lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:23:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:23:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.183s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/4b4eaccb-e068-4e8a-9084-16229815b1d7/disk 1073741824 {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/4b4eaccb-e068-4e8a-9084-16229815b1d7/disk 1073741824" returned: 0 in 0.056s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:23:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:26 user nova-compute[74683]: DEBUG nova.network.neutron [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Successfully created port: 51406244-8351-4ada-b266-d5ec85d5f5b7 {{(pid=74683) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 11:23:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.218s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:26 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4b4eaccb-e068-4e8a-9084-16229815b1d7/disk. size=1073741824 {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 11:23:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b4eaccb-e068-4e8a-9084-16229815b1d7/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b4eaccb-e068-4e8a-9084-16229815b1d7/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:26 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Cannot resize image /opt/stack/data/nova/instances/4b4eaccb-e068-4e8a-9084-16229815b1d7/disk to a smaller size. {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 11:23:26 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Created local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 11:23:26 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Ensure instance console log exists: /opt/stack/data/nova/instances/4b4eaccb-e068-4e8a-9084-16229815b1d7/console.log {{(pid=74683) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 11:23:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:23:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:23:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:23:27 user nova-compute[74683]: DEBUG nova.network.neutron [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Successfully updated port: 51406244-8351-4ada-b266-d5ec85d5f5b7 {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:23:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Acquiring lock "refresh_cache-4b4eaccb-e068-4e8a-9084-16229815b1d7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:23:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Acquired lock "refresh_cache-4b4eaccb-e068-4e8a-9084-16229815b1d7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:23:27 user nova-compute[74683]: DEBUG nova.network.neutron [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:23:27 user nova-compute[74683]: DEBUG nova.compute.manager [req-8de5f22b-6c83-4f48-89fd-f308f1eee16e req-8e43768d-8489-415a-8ff2-0fe0c83ec32e service nova] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Received event network-changed-51406244-8351-4ada-b266-d5ec85d5f5b7 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:23:27 user nova-compute[74683]: DEBUG nova.compute.manager [req-8de5f22b-6c83-4f48-89fd-f308f1eee16e req-8e43768d-8489-415a-8ff2-0fe0c83ec32e service nova] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Refreshing instance network info cache due to event network-changed-51406244-8351-4ada-b266-d5ec85d5f5b7. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:23:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-8de5f22b-6c83-4f48-89fd-f308f1eee16e req-8e43768d-8489-415a-8ff2-0fe0c83ec32e service nova] Acquiring lock "refresh_cache-4b4eaccb-e068-4e8a-9084-16229815b1d7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:23:27 user nova-compute[74683]: DEBUG nova.network.neutron [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:23:27 user nova-compute[74683]: DEBUG nova.network.neutron [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Updating instance_info_cache with network_info: [{"id": "51406244-8351-4ada-b266-d5ec85d5f5b7", "address": "fa:16:3e:34:af:5c", "network": {"id": "cd8cf08c-d79c-4d2e-b849-640c440e1498", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1091743670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcb8da41d6584a689e9b50155288aa5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51406244-83", "ovs_interfaceid": "51406244-8351-4ada-b266-d5ec85d5f5b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:23:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Releasing lock "refresh_cache-4b4eaccb-e068-4e8a-9084-16229815b1d7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:23:27 user nova-compute[74683]: DEBUG nova.compute.manager [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Instance network_info: |[{"id": "51406244-8351-4ada-b266-d5ec85d5f5b7", "address": "fa:16:3e:34:af:5c", "network": {"id": "cd8cf08c-d79c-4d2e-b849-640c440e1498", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1091743670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcb8da41d6584a689e9b50155288aa5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51406244-83", "ovs_interfaceid": "51406244-8351-4ada-b266-d5ec85d5f5b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 11:23:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-8de5f22b-6c83-4f48-89fd-f308f1eee16e req-8e43768d-8489-415a-8ff2-0fe0c83ec32e service nova] Acquired lock "refresh_cache-4b4eaccb-e068-4e8a-9084-16229815b1d7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:23:27 user nova-compute[74683]: DEBUG nova.network.neutron [req-8de5f22b-6c83-4f48-89fd-f308f1eee16e req-8e43768d-8489-415a-8ff2-0fe0c83ec32e service nova] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Refreshing network info cache for port 51406244-8351-4ada-b266-d5ec85d5f5b7 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:23:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Start _get_guest_xml network_info=[{"id": "51406244-8351-4ada-b266-d5ec85d5f5b7", "address": "fa:16:3e:34:af:5c", "network": {"id": "cd8cf08c-d79c-4d2e-b849-640c440e1498", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1091743670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcb8da41d6584a689e9b50155288aa5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51406244-83", "ovs_interfaceid": "51406244-8351-4ada-b266-d5ec85d5f5b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:23:27 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:23:27 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:23:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:23:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:23:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:23:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:23:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:23:27 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:23:27 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:23:27 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:23:27 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:23:27 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:23:27 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:23:27 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:23:27 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:23:27 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:23:27 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:23:27 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:23:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:23:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-27181934',display_name='tempest-tempest.common.compute-instance-27181934',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-27181934',id=26,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMU+0jl/Xpsr5n/olRAHKpCazthU2XJrlviTrSAY+9fnhEiSM0bM3IXfiYZZbkmWCD8gh75QX0AR7OUJ2tlcTCQ4BWG951YpMlhxtAMVD+xs3A2NaoWBXrnOjvkdTqz3aw==',key_name='tempest-keypair-1161073936',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fcb8da41d6584a689e9b50155288aa5e',ramdisk_id='',reservation_id='r-ze6eely5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-327072564',owner_user_name='tempest-ServerActionsTestOtherA-327072564-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:23:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a55641a42b142ea9fb6c6c1fdb9963e',uuid=4b4eaccb-e068-4e8a-9084-16229815b1d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51406244-8351-4ada-b266-d5ec85d5f5b7", "address": "fa:16:3e:34:af:5c", "network": {"id": "cd8cf08c-d79c-4d2e-b849-640c440e1498", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1091743670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcb8da41d6584a689e9b50155288aa5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51406244-83", "ovs_interfaceid": "51406244-8351-4ada-b266-d5ec85d5f5b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:23:27 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Converting VIF {"id": "51406244-8351-4ada-b266-d5ec85d5f5b7", "address": "fa:16:3e:34:af:5c", "network": {"id": "cd8cf08c-d79c-4d2e-b849-640c440e1498", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1091743670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcb8da41d6584a689e9b50155288aa5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51406244-83", "ovs_interfaceid": "51406244-8351-4ada-b266-d5ec85d5f5b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:23:27 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:af:5c,bridge_name='br-int',has_traffic_filtering=True,id=51406244-8351-4ada-b266-d5ec85d5f5b7,network=Network(cd8cf08c-d79c-4d2e-b849-640c440e1498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51406244-83') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:23:27 user nova-compute[74683]: DEBUG nova.objects.instance [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lazy-loading 'pci_devices' on Instance uuid 4b4eaccb-e068-4e8a-9084-16229815b1d7 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:23:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:23:27 user nova-compute[74683]:   <uuid>4b4eaccb-e068-4e8a-9084-16229815b1d7</uuid>
Oct 16 11:23:27 user nova-compute[74683]:   <name>instance-0000001a</name>
Oct 16 11:23:27 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:23:27 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:23:27 user nova-compute[74683]:   <metadata>
Oct 16 11:23:27 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:23:27 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:23:27 user nova-compute[74683]:       <nova:name>tempest-tempest.common.compute-instance-27181934</nova:name>
Oct 16 11:23:27 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:23:27</nova:creationTime>
Oct 16 11:23:27 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:23:27 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:23:27 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:23:27 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:23:27 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:23:27 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:23:27 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:23:27 user nova-compute[74683]:       <nova:owner>
Oct 16 11:23:27 user nova-compute[74683]:         <nova:user uuid="6a55641a42b142ea9fb6c6c1fdb9963e">tempest-ServerActionsTestOtherA-327072564-project-member</nova:user>
Oct 16 11:23:27 user nova-compute[74683]:         <nova:project uuid="fcb8da41d6584a689e9b50155288aa5e">tempest-ServerActionsTestOtherA-327072564</nova:project>
Oct 16 11:23:27 user nova-compute[74683]:       </nova:owner>
Oct 16 11:23:27 user nova-compute[74683]:       <nova:root type="image" uuid="0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f"/>
Oct 16 11:23:27 user nova-compute[74683]:       <nova:ports>
Oct 16 11:23:27 user nova-compute[74683]:         <nova:port uuid="51406244-8351-4ada-b266-d5ec85d5f5b7">
Oct 16 11:23:27 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 16 11:23:27 user nova-compute[74683]:         </nova:port>
Oct 16 11:23:27 user nova-compute[74683]:       </nova:ports>
Oct 16 11:23:27 user nova-compute[74683]:     </nova:instance>
Oct 16 11:23:27 user nova-compute[74683]:   </metadata>
Oct 16 11:23:27 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:23:27 user nova-compute[74683]:     <system>
Oct 16 11:23:27 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:23:27 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:23:27 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:23:27 user nova-compute[74683]:       <entry name="serial">4b4eaccb-e068-4e8a-9084-16229815b1d7</entry>
Oct 16 11:23:27 user nova-compute[74683]:       <entry name="uuid">4b4eaccb-e068-4e8a-9084-16229815b1d7</entry>
Oct 16 11:23:27 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:23:27 user nova-compute[74683]:     </system>
Oct 16 11:23:27 user nova-compute[74683]:   </sysinfo>
Oct 16 11:23:27 user nova-compute[74683]:   <os>
Oct 16 11:23:27 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:23:27 user nova-compute[74683]:     <boot dev="hd"/>
Oct 16 11:23:27 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:23:27 user nova-compute[74683]:   </os>
Oct 16 11:23:27 user nova-compute[74683]:   <features>
Oct 16 11:23:27 user nova-compute[74683]:     <acpi/>
Oct 16 11:23:27 user nova-compute[74683]:     <apic/>
Oct 16 11:23:27 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:23:27 user nova-compute[74683]:   </features>
Oct 16 11:23:27 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:23:27 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:23:27 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:23:27 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:23:27 user nova-compute[74683]:   </clock>
Oct 16 11:23:27 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:23:27 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:23:27 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:23:27 user nova-compute[74683]:   </cpu>
Oct 16 11:23:27 user nova-compute[74683]:   <devices>
Oct 16 11:23:27 user nova-compute[74683]:     <disk type="file" device="disk">
Oct 16 11:23:27 user nova-compute[74683]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 11:23:27 user nova-compute[74683]:       <source file="/opt/stack/data/nova/instances/4b4eaccb-e068-4e8a-9084-16229815b1d7/disk"/>
Oct 16 11:23:27 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:23:27 user nova-compute[74683]:     </disk>
Oct 16 11:23:27 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:23:27 user nova-compute[74683]:       <mac address="fa:16:3e:34:af:5c"/>
Oct 16 11:23:27 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:23:27 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:23:27 user nova-compute[74683]:       <target dev="tap51406244-83"/>
Oct 16 11:23:27 user nova-compute[74683]:     </interface>
Oct 16 11:23:27 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:23:27 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/4b4eaccb-e068-4e8a-9084-16229815b1d7/console.log" append="off"/>
Oct 16 11:23:27 user nova-compute[74683]:     </serial>
Oct 16 11:23:27 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:23:27 user nova-compute[74683]:     <video>
Oct 16 11:23:27 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:23:27 user nova-compute[74683]:     </video>
Oct 16 11:23:27 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:23:27 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:23:27 user nova-compute[74683]:     </rng>
Oct 16 11:23:27 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:23:27 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:23:27 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:23:27 user nova-compute[74683]:     </memballoon>
Oct 16 11:23:27 user nova-compute[74683]:   </devices>
Oct 16 11:23:27 user nova-compute[74683]: </domain>
Oct 16 11:23:27 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:23:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:23:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-27181934',display_name='tempest-tempest.common.compute-instance-27181934',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-27181934',id=26,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMU+0jl/Xpsr5n/olRAHKpCazthU2XJrlviTrSAY+9fnhEiSM0bM3IXfiYZZbkmWCD8gh75QX0AR7OUJ2tlcTCQ4BWG951YpMlhxtAMVD+xs3A2NaoWBXrnOjvkdTqz3aw==',key_name='tempest-keypair-1161073936',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fcb8da41d6584a689e9b50155288aa5e',ramdisk_id='',reservation_id='r-ze6eely5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-327072564',owner_user_name='tempest-ServerActionsTestOtherA-327072564-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:23:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a55641a42b142ea9fb6c6c1fdb9963e',uuid=4b4eaccb-e068-4e8a-9084-16229815b1d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51406244-8351-4ada-b266-d5ec85d5f5b7", "address": "fa:16:3e:34:af:5c", "network": {"id": "cd8cf08c-d79c-4d2e-b849-640c440e1498", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1091743670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcb8da41d6584a689e9b50155288aa5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51406244-83", "ovs_interfaceid": "51406244-8351-4ada-b266-d5ec85d5f5b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:23:27 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Converting VIF {"id": "51406244-8351-4ada-b266-d5ec85d5f5b7", "address": "fa:16:3e:34:af:5c", "network": {"id": "cd8cf08c-d79c-4d2e-b849-640c440e1498", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1091743670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcb8da41d6584a689e9b50155288aa5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51406244-83", "ovs_interfaceid": "51406244-8351-4ada-b266-d5ec85d5f5b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:23:27 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:af:5c,bridge_name='br-int',has_traffic_filtering=True,id=51406244-8351-4ada-b266-d5ec85d5f5b7,network=Network(cd8cf08c-d79c-4d2e-b849-640c440e1498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51406244-83') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:23:27 user nova-compute[74683]: DEBUG os_vif [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:af:5c,bridge_name='br-int',has_traffic_filtering=True,id=51406244-8351-4ada-b266-d5ec85d5f5b7,network=Network(cd8cf08c-d79c-4d2e-b849-640c440e1498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51406244-83') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:23:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:23:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:23:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1c1f1343-cad0-5396-abf5-2233838d69d1', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:23:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap51406244-83, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:23:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap51406244-83, col_values=(('qos', UUID('eeae4a1e-33b6-4669-a69b-f30f9a8c8c21')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:23:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap51406244-83, col_values=(('external_ids', {'iface-id': '51406244-8351-4ada-b266-d5ec85d5f5b7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:af:5c', 'vm-uuid': '4b4eaccb-e068-4e8a-9084-16229815b1d7'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:23:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:23:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:27 user nova-compute[74683]: INFO os_vif [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:af:5c,bridge_name='br-int',has_traffic_filtering=True,id=51406244-8351-4ada-b266-d5ec85d5f5b7,network=Network(cd8cf08c-d79c-4d2e-b849-640c440e1498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51406244-83')
Oct 16 11:23:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:23:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] No VIF found with MAC fa:16:3e:34:af:5c, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:23:28 user nova-compute[74683]: DEBUG nova.network.neutron [req-8de5f22b-6c83-4f48-89fd-f308f1eee16e req-8e43768d-8489-415a-8ff2-0fe0c83ec32e service nova] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Updated VIF entry in instance network info cache for port 51406244-8351-4ada-b266-d5ec85d5f5b7. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:23:28 user nova-compute[74683]: DEBUG nova.network.neutron [req-8de5f22b-6c83-4f48-89fd-f308f1eee16e req-8e43768d-8489-415a-8ff2-0fe0c83ec32e service nova] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Updating instance_info_cache with network_info: [{"id": "51406244-8351-4ada-b266-d5ec85d5f5b7", "address": "fa:16:3e:34:af:5c", "network": {"id": "cd8cf08c-d79c-4d2e-b849-640c440e1498", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1091743670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcb8da41d6584a689e9b50155288aa5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51406244-83", "ovs_interfaceid": "51406244-8351-4ada-b266-d5ec85d5f5b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:23:28 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-8de5f22b-6c83-4f48-89fd-f308f1eee16e req-8e43768d-8489-415a-8ff2-0fe0c83ec32e service nova] Releasing lock "refresh_cache-4b4eaccb-e068-4e8a-9084-16229815b1d7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:23:28 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-5311cf4f-10ea-4d1b-a811-9b09012c2b18 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ddb55617-a6a9-40f9-b2ff-b2b626f149ab is timed out.
Oct 16 11:23:28 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-5311cf4f-10ea-4d1b-a811-9b09012c2b18 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Successfully detached device vdb from instance ddb55617-a6a9-40f9-b2ff-b2b626f149ab from the live domain config.
Oct 16 11:23:28 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5311cf4f-10ea-4d1b-a811-9b09012c2b18 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] calling os-brick to detach iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 11:23:28 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-5311cf4f-10ea-4d1b-a811-9b09012c2b18 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, {'target_iqn': 'iqn.2010-10.org.openstack:d50e9628-1be3-4147-9d4f-042f22fa6b4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gZMScAka', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:23:28 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-5311cf4f-10ea-4d1b-a811-9b09012c2b18 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:23:28 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-5311cf4f-10ea-4d1b-a811-9b09012c2b18 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:23:28 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-5311cf4f-10ea-4d1b-a811-9b09012c2b18 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:23:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:28 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91f5c4a-f80d-4962-be61-51d67e049d27]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d50e9628-1be3-4147-9d4f-042f22fa6b4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:23:28 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-5311cf4f-10ea-4d1b-a811-9b09012c2b18 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 11:23:28 user nova-compute[74683]: No targets found.
Oct 16 11:23:28 user nova-compute[74683]: iSNS:
Oct 16 11:23:28 user nova-compute[74683]: No targets found.
Oct 16 11:23:28 user nova-compute[74683]: STATIC:
Oct 16 11:23:28 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:d50e9628-1be3-4147-9d4f-042f22fa6b4a
Oct 16 11:23:28 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:23:28 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:23:28 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb
Oct 16 11:23:28 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:23:28 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:23:28 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee
Oct 16 11:23:28 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:23:28 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:23:28 user nova-compute[74683]: FIRMWARE:
Oct 16 11:23:28 user nova-compute[74683]: No targets found.
Oct 16 11:23:28 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:23:28 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-5311cf4f-10ea-4d1b-a811-9b09012c2b18 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 11:23:28 user nova-compute[74683]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 11:23:28 user nova-compute[74683]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74683) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 11:23:28 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-5311cf4f-10ea-4d1b-a811-9b09012c2b18 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d50e9628-1be3-4147-9d4f-042f22fa6b4a', 0)] {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 11:23:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:28 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5a6392-0437-4b63-903d-0ceb7f298f23]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d50e9628-1be3-4147-9d4f-042f22fa6b4a\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:23:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:28 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41f7375-7c0e-4f28-bac6-b69358fac527]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d50e9628-1be3-4147-9d4f-042f22fa6b4a (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:23:28 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-5311cf4f-10ea-4d1b-a811-9b09012c2b18 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:23:28 user nova-compute[74683]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee (non-flash)
Oct 16 11:23:28 user nova-compute[74683]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d50e9628-1be3-4147-9d4f-042f22fa6b4a (non-flash)
Oct 16 11:23:28 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:23:28 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-5311cf4f-10ea-4d1b-a811-9b09012c2b18 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:23:28 user nova-compute[74683]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee (non-flash)
Oct 16 11:23:28 user nova-compute[74683]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d50e9628-1be3-4147-9d4f-042f22fa6b4a (non-flash)
Oct 16 11:23:28 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:23:28 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-5311cf4f-10ea-4d1b-a811-9b09012c2b18 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda4c522200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d50e9628-1be3-4147-9d4f-042f22fa6b4a'): ({'sdb'}, set())}) {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 11:23:28 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-5311cf4f-10ea-4d1b-a811-9b09012c2b18 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Removing single pathed devices sdb {{(pid=74683) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 11:23:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:28 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[96059a56-a08d-4867-8226-670c293c4110]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:23:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:28 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[18914c71-4dba-46ab-85a6-fea1eadb78ce]: (4, ('ok\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:23:28 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-5311cf4f-10ea-4d1b-a811-9b09012c2b18 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Flushing IO for device /dev/sdb {{(pid=74683) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 11:23:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:28 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5266179-9990-480e-b40e-a0b8de06871a]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:23:28 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-5311cf4f-10ea-4d1b-a811-9b09012c2b18 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74683) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 11:23:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:28 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0da038-27b4-4d8b-9b36-069c2c729b0c]: (4, ('1', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:23:28 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-5311cf4f-10ea-4d1b-a811-9b09012c2b18 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 11:23:28 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-5311cf4f-10ea-4d1b-a811-9b09012c2b18 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] SCSI volumes sdb have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 11:23:28 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-5311cf4f-10ea-4d1b-a811-9b09012c2b18 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d50e9628-1be3-4147-9d4f-042f22fa6b4a')] {{(pid=74683) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 11:23:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d50e9628-1be3-4147-9d4f-042f22fa6b4a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d50e9628-1be3-4147-9d4f-042f22fa6b4a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:28 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[658963b7-188a-423a-ae47-43b9e76a9014]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:23:28 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-5311cf4f-10ea-4d1b-a811-9b09012c2b18 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:23:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d50e9628-1be3-4147-9d4f-042f22fa6b4a -p 172.16.0.220:3260 --logout {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d50e9628-1be3-4147-9d4f-042f22fa6b4a -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:28 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ae1b4f-0045-48cd-bbd2-a080aa3747cd]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:d50e9628-1be3-4147-9d4f-042f22fa6b4a, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:d50e9628-1be3-4147-9d4f-042f22fa6b4a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:23:28 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-5311cf4f-10ea-4d1b-a811-9b09012c2b18 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:d50e9628-1be3-4147-9d4f-042f22fa6b4a, portal: 172.16.0.220,3260]
Oct 16 11:23:28 user nova-compute[74683]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:d50e9628-1be3-4147-9d4f-042f22fa6b4a, portal: 172.16.0.220,3260] successful.
Oct 16 11:23:28 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:23:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d50e9628-1be3-4147-9d4f-042f22fa6b4a -p 172.16.0.220:3260 --op delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d50e9628-1be3-4147-9d4f-042f22fa6b4a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:28 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8451cb3-7061-412c-86f5-b99bbbc24f32]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:23:28 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-5311cf4f-10ea-4d1b-a811-9b09012c2b18 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:23:28 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-5311cf4f-10ea-4d1b-a811-9b09012c2b18 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:23:28 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-5311cf4f-10ea-4d1b-a811-9b09012c2b18 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] <== disconnect_volume: return (358ms) None {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:23:28 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5311cf4f-10ea-4d1b-a811-9b09012c2b18 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Disconnected iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 11:23:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:29 user nova-compute[74683]: DEBUG nova.compute.manager [req-b8c7ff2e-6346-4f78-81f7-82aa7a079b2f req-52181f9b-e8ea-47eb-89af-695538823914 service nova] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Received event network-vif-plugged-51406244-8351-4ada-b266-d5ec85d5f5b7 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:23:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b8c7ff2e-6346-4f78-81f7-82aa7a079b2f req-52181f9b-e8ea-47eb-89af-695538823914 service nova] Acquiring lock "4b4eaccb-e068-4e8a-9084-16229815b1d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:23:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b8c7ff2e-6346-4f78-81f7-82aa7a079b2f req-52181f9b-e8ea-47eb-89af-695538823914 service nova] Lock "4b4eaccb-e068-4e8a-9084-16229815b1d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:23:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b8c7ff2e-6346-4f78-81f7-82aa7a079b2f req-52181f9b-e8ea-47eb-89af-695538823914 service nova] Lock "4b4eaccb-e068-4e8a-9084-16229815b1d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:23:29 user nova-compute[74683]: DEBUG nova.compute.manager [req-b8c7ff2e-6346-4f78-81f7-82aa7a079b2f req-52181f9b-e8ea-47eb-89af-695538823914 service nova] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] No waiting events found dispatching network-vif-plugged-51406244-8351-4ada-b266-d5ec85d5f5b7 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:23:29 user nova-compute[74683]: WARNING nova.compute.manager [req-b8c7ff2e-6346-4f78-81f7-82aa7a079b2f req-52181f9b-e8ea-47eb-89af-695538823914 service nova] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Received unexpected event network-vif-plugged-51406244-8351-4ada-b266-d5ec85d5f5b7 for instance with vm_state building and task_state spawning.
Oct 16 11:23:30 user nova-compute[74683]: INFO nova.compute.manager [None req-ac5011bc-06f6-43f6-8a58-fda4956c7e97 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] Took 6.32 seconds to detach 1 volumes for instance.
Oct 16 11:23:30 user nova-compute[74683]: DEBUG nova.compute.manager [None req-ac5011bc-06f6-43f6-8a58-fda4956c7e97 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: b8b4a8e2-2c42-423d-954e-cab381506ca7] Deleting volume: 7e532f21-699f-4800-92ab-2d7ddef102ea {{(pid=74683) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 16 11:23:31 user nova-compute[74683]: DEBUG nova.objects.instance [None req-5311cf4f-10ea-4d1b-a811-9b09012c2b18 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lazy-loading 'flavor' on Instance uuid ddb55617-a6a9-40f9-b2ff-b2b626f149ab {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:23:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ac5011bc-06f6-43f6-8a58-fda4956c7e97 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:23:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ac5011bc-06f6-43f6-8a58-fda4956c7e97 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:23:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-5311cf4f-10ea-4d1b-a811-9b09012c2b18 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "ddb55617-a6a9-40f9-b2ff-b2b626f149ab" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.168s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:23:31 user nova-compute[74683]: DEBUG nova.compute.manager [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Instance event wait completed in 0 seconds for  {{(pid=74683) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 11:23:31 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Guest created on hypervisor {{(pid=74683) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 11:23:31 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Instance spawned successfully.
Oct 16 11:23:31 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 11:23:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:31 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Found default for hw_cdrom_bus of ide {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:23:31 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Found default for hw_disk_bus of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:23:31 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Found default for hw_input_bus of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:23:31 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Found default for hw_pointer_model of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:23:31 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Found default for hw_video_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:23:31 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Found default for hw_vif_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:23:31 user nova-compute[74683]: INFO nova.compute.manager [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Took 5.76 seconds to spawn the instance on the hypervisor.
Oct 16 11:23:31 user nova-compute[74683]: DEBUG nova.compute.manager [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:23:31 user nova-compute[74683]: DEBUG nova.compute.manager [req-0a4c38ee-de8a-451a-9e97-1c779f192522 req-5c18765c-2db7-46f5-a9ed-773716e26fe2 service nova] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Received event network-vif-plugged-51406244-8351-4ada-b266-d5ec85d5f5b7 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:23:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-0a4c38ee-de8a-451a-9e97-1c779f192522 req-5c18765c-2db7-46f5-a9ed-773716e26fe2 service nova] Acquiring lock "4b4eaccb-e068-4e8a-9084-16229815b1d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:23:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-0a4c38ee-de8a-451a-9e97-1c779f192522 req-5c18765c-2db7-46f5-a9ed-773716e26fe2 service nova] Lock "4b4eaccb-e068-4e8a-9084-16229815b1d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:23:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-0a4c38ee-de8a-451a-9e97-1c779f192522 req-5c18765c-2db7-46f5-a9ed-773716e26fe2 service nova] Lock "4b4eaccb-e068-4e8a-9084-16229815b1d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:23:31 user nova-compute[74683]: DEBUG nova.compute.manager [req-0a4c38ee-de8a-451a-9e97-1c779f192522 req-5c18765c-2db7-46f5-a9ed-773716e26fe2 service nova] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] No waiting events found dispatching network-vif-plugged-51406244-8351-4ada-b266-d5ec85d5f5b7 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:23:31 user nova-compute[74683]: WARNING nova.compute.manager [req-0a4c38ee-de8a-451a-9e97-1c779f192522 req-5c18765c-2db7-46f5-a9ed-773716e26fe2 service nova] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Received unexpected event network-vif-plugged-51406244-8351-4ada-b266-d5ec85d5f5b7 for instance with vm_state building and task_state spawning.
Oct 16 11:23:31 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-ac5011bc-06f6-43f6-8a58-fda4956c7e97 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:23:31 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-ac5011bc-06f6-43f6-8a58-fda4956c7e97 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:23:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ac5011bc-06f6-43f6-8a58-fda4956c7e97 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.588s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:23:31 user nova-compute[74683]: INFO nova.compute.manager [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Took 6.80 seconds to build instance.
Oct 16 11:23:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2c6299a7-b8f0-477d-ae87-d2b6df4b1ca1 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "4b4eaccb-e068-4e8a-9084-16229815b1d7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.908s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:23:31 user nova-compute[74683]: INFO nova.scheduler.client.report [None req-ac5011bc-06f6-43f6-8a58-fda4956c7e97 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Deleted allocations for instance b8b4a8e2-2c42-423d-954e-cab381506ca7
Oct 16 11:23:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ac5011bc-06f6-43f6-8a58-fda4956c7e97 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "b8b4a8e2-2c42-423d-954e-cab381506ca7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.734s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:23:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:34 user nova-compute[74683]: DEBUG nova.compute.manager [None req-25811cec-db04-4145-9ea1-a397e9fc201b tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:23:34 user nova-compute[74683]: INFO nova.compute.manager [None req-25811cec-db04-4145-9ea1-a397e9fc201b tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] instance snapshotting
Oct 16 11:23:34 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-25811cec-db04-4145-9ea1-a397e9fc201b tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] Beginning live snapshot process
Oct 16 11:23:34 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-25811cec-db04-4145-9ea1-a397e9fc201b tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9fc5a9-8659-497c-bb07-af52fe2e1761/disk --force-share --output=json -f qcow2 {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:34 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-25811cec-db04-4145-9ea1-a397e9fc201b tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9fc5a9-8659-497c-bb07-af52fe2e1761/disk --force-share --output=json -f qcow2" returned: 0 in 0.232s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:34 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-25811cec-db04-4145-9ea1-a397e9fc201b tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9fc5a9-8659-497c-bb07-af52fe2e1761/disk --force-share --output=json -f qcow2 {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:35 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-25811cec-db04-4145-9ea1-a397e9fc201b tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9fc5a9-8659-497c-bb07-af52fe2e1761/disk --force-share --output=json -f qcow2" returned: 0 in 0.210s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:35 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-25811cec-db04-4145-9ea1-a397e9fc201b tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:35 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-25811cec-db04-4145-9ea1-a397e9fc201b tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.190s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:35 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-25811cec-db04-4145-9ea1-a397e9fc201b tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpwl09kic4/2d1333ef08604521af4326798ddf8ae5.delta 1073741824 {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:35 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-25811cec-db04-4145-9ea1-a397e9fc201b tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpwl09kic4/2d1333ef08604521af4326798ddf8ae5.delta 1073741824" returned: 0 in 0.056s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:35 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-25811cec-db04-4145-9ea1-a397e9fc201b tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 16 11:23:35 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:36 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-25811cec-db04-4145-9ea1-a397e9fc201b tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74683) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 11:23:36 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-25811cec-db04-4145-9ea1-a397e9fc201b tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74683) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 11:23:36 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-25811cec-db04-4145-9ea1-a397e9fc201b tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 16 11:23:36 user nova-compute[74683]: DEBUG nova.privsep.utils [None req-25811cec-db04-4145-9ea1-a397e9fc201b tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74683) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 11:23:36 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-25811cec-db04-4145-9ea1-a397e9fc201b tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpwl09kic4/2d1333ef08604521af4326798ddf8ae5.delta /opt/stack/data/nova/instances/snapshots/tmpwl09kic4/2d1333ef08604521af4326798ddf8ae5 {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-25811cec-db04-4145-9ea1-a397e9fc201b tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpwl09kic4/2d1333ef08604521af4326798ddf8ae5.delta /opt/stack/data/nova/instances/snapshots/tmpwl09kic4/2d1333ef08604521af4326798ddf8ae5" returned: 0 in 0.578s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:37 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-25811cec-db04-4145-9ea1-a397e9fc201b tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] Snapshot extracted, beginning image upload
Oct 16 11:23:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:40 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-25811cec-db04-4145-9ea1-a397e9fc201b tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] Snapshot image upload complete
Oct 16 11:23:40 user nova-compute[74683]: INFO nova.compute.manager [None req-25811cec-db04-4145-9ea1-a397e9fc201b tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] Took 6.61 seconds to snapshot the instance on the hypervisor.
Oct 16 11:23:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:43 user nova-compute[74683]: INFO nova.compute.manager [None req-7bb0fd3d-2629-4fb7-a378-007bf9ca0a76 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Rescuing
Oct 16 11:23:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-7bb0fd3d-2629-4fb7-a378-007bf9ca0a76 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Acquiring lock "refresh_cache-b91af786-36e3-4815-811f-fb3c055e758d" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:23:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-7bb0fd3d-2629-4fb7-a378-007bf9ca0a76 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Acquired lock "refresh_cache-b91af786-36e3-4815-811f-fb3c055e758d" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:23:43 user nova-compute[74683]: DEBUG nova.network.neutron [None req-7bb0fd3d-2629-4fb7-a378-007bf9ca0a76 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:23:43 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-374f616e-b464-489c-82d5-e1b6b4a92705 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Calling os-brick to attach iSCSI Volume {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 11:23:43 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-374f616e-b464-489c-82d5-e1b6b4a92705 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:007698a6-0222-4002-8253-d70f69189955', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NijLguCU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:23:43 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-374f616e-b464-489c-82d5-e1b6b4a92705 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:23:43 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-374f616e-b464-489c-82d5-e1b6b4a92705 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:23:43 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-374f616e-b464-489c-82d5-e1b6b4a92705 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:23:43 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-374f616e-b464-489c-82d5-e1b6b4a92705 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:23:43 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-374f616e-b464-489c-82d5-e1b6b4a92705 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:007698a6-0222-4002-8253-d70f69189955" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:23:43 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-374f616e-b464-489c-82d5-e1b6b4a92705 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:007698a6-0222-4002-8253-d70f69189955" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:23:43 user nova-compute[74683]: INFO os_brick.initiator.connectors.iscsi [None req-374f616e-b464-489c-82d5-e1b6b4a92705 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 11:23:43 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:007698a6-0222-4002-8253-d70f69189955 -p 172.16.0.220:3260 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:43 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:007698a6-0222-4002-8253-d70f69189955 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:43 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8db86f0-e3a0-4135-b83a-6383f3709492]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:23:43 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-374f616e-b464-489c-82d5-e1b6b4a92705 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 11:23:43 user nova-compute[74683]:  {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:23:43 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:007698a6-0222-4002-8253-d70f69189955 -p 172.16.0.220:3260 --interface default --op new {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:43 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:007698a6-0222-4002-8253-d70f69189955 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:43 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a2f5c3-d6a1-4e1f-9efe-b5d8ece65dbe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:007698a6-0222-4002-8253-d70f69189955] added\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:23:43 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-374f616e-b464-489c-82d5-e1b6b4a92705 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:007698a6-0222-4002-8253-d70f69189955] added
Oct 16 11:23:43 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:23:43 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:007698a6-0222-4002-8253-d70f69189955 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:43 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:007698a6-0222-4002-8253-d70f69189955 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:43 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[40fbece7-d67c-43c5-88eb-b0725355cc75]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:23:43 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-374f616e-b464-489c-82d5-e1b6b4a92705 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:23:43 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:007698a6-0222-4002-8253-d70f69189955 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:43 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:007698a6-0222-4002-8253-d70f69189955 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:43 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[8521690a-3742-4591-91a6-4c48fa20da76]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:23:43 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-374f616e-b464-489c-82d5-e1b6b4a92705 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:23:43 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:007698a6-0222-4002-8253-d70f69189955 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NijLguCU {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:43 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:007698a6-0222-4002-8253-d70f69189955 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NijLguCU" returned: 0 in 0.024s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:43 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[26fe2228-b14f-4bd0-a72e-08d738384f73]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:23:43 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-374f616e-b464-489c-82d5-e1b6b4a92705 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NijLguCU'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:23:43 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:007698a6-0222-4002-8253-d70f69189955 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:43 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:007698a6-0222-4002-8253-d70f69189955 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:43 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6ca7ef-6527-40f7-80c1-c9f0ec5e4f12]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:23:43 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-374f616e-b464-489c-82d5-e1b6b4a92705 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:23:43 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:43 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:43 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c803e9f-cfa1-4896-b1ae-a521b6bb2332]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:23:43 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-374f616e-b464-489c-82d5-e1b6b4a92705 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:23:43 user nova-compute[74683]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee (non-flash)
Oct 16 11:23:43 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:23:43 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-374f616e-b464-489c-82d5-e1b6b4a92705 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:23:43 user nova-compute[74683]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee (non-flash)
Oct 16 11:23:43 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:23:43 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:007698a6-0222-4002-8253-d70f69189955 -p 172.16.0.220:3260 --login {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:43 user nova-compute[74683]: DEBUG nova.network.neutron [None req-7bb0fd3d-2629-4fb7-a378-007bf9ca0a76 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Updating instance_info_cache with network_info: [{"id": "abc9cf45-e4f5-4a33-9ffc-dab110e73398", "address": "fa:16:3e:03:03:02", "network": {"id": "fa128ba8-cd2f-4621-ac04-ecc21569bb68", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321708612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66a49078f1240bd88207e487dd4951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc9cf45-e4", "ovs_interfaceid": "abc9cf45-e4f5-4a33-9ffc-dab110e73398", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:23:44 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-7bb0fd3d-2629-4fb7-a378-007bf9ca0a76 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Releasing lock "refresh_cache-b91af786-36e3-4815-811f-fb3c055e758d" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:23:44 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:007698a6-0222-4002-8253-d70f69189955 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:44 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7be7636-ef94-4423-a519-3fc0050acf38]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:007698a6-0222-4002-8253-d70f69189955, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:007698a6-0222-4002-8253-d70f69189955, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:23:44 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-374f616e-b464-489c-82d5-e1b6b4a92705 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:007698a6-0222-4002-8253-d70f69189955, portal: 172.16.0.220,3260]
Oct 16 11:23:44 user nova-compute[74683]: Login to [iface: default, target: iqn.2010-10.org.openstack:007698a6-0222-4002-8253-d70f69189955, portal: 172.16.0.220,3260] successful.
Oct 16 11:23:44 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:23:44 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:007698a6-0222-4002-8253-d70f69189955 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:44 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:007698a6-0222-4002-8253-d70f69189955 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:44 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[797762dc-9206-4d03-8840-bced4f7eb571]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:23:44 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-374f616e-b464-489c-82d5-e1b6b4a92705 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:23:44 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:44 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:44 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[84896380-9cca-44ca-bf75-941a5396414b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:007698a6-0222-4002-8253-d70f69189955 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:23:44 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-374f616e-b464-489c-82d5-e1b6b4a92705 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:23:44 user nova-compute[74683]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee (non-flash)
Oct 16 11:23:44 user nova-compute[74683]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:007698a6-0222-4002-8253-d70f69189955 (non-flash)
Oct 16 11:23:44 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:23:44 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-374f616e-b464-489c-82d5-e1b6b4a92705 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:23:44 user nova-compute[74683]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee (non-flash)
Oct 16 11:23:44 user nova-compute[74683]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:007698a6-0222-4002-8253-d70f69189955 (non-flash)
Oct 16 11:23:44 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:23:44 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-374f616e-b464-489c-82d5-e1b6b4a92705 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:007698a6-0222-4002-8253-d70f69189955" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.368s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:23:44 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-374f616e-b464-489c-82d5-e1b6b4a92705 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Connected to 172.16.0.220:3260 {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 11:23:44 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-374f616e-b464-489c-82d5-e1b6b4a92705 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] HCTL ('33', '-', '-', 0) found on session 24 with lun 0 {{(pid=74683) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 11:23:44 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-374f616e-b464-489c-82d5-e1b6b4a92705 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74683) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 11:23:44 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:44 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.061s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:44 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[52cbea38-b523-4de4-9e3e-2e720ba87312]: (4, ('- - 0', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:23:44 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-374f616e-b464-489c-82d5-e1b6b4a92705 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: None {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:23:44 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:44 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:44 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:44 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:44 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:44 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Instance destroyed successfully.
Oct 16 11:23:44 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-7bb0fd3d-2629-4fb7-a378-007bf9ca0a76 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Attempting rescue
Oct 16 11:23:44 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-7bb0fd3d-2629-4fb7-a378-007bf9ca0a76 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74683) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 16 11:23:44 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-7bb0fd3d-2629-4fb7-a378-007bf9ca0a76 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Instance directory exists: not creating {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 16 11:23:44 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-7bb0fd3d-2629-4fb7-a378-007bf9ca0a76 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Creating image(s)
Oct 16 11:23:44 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-7bb0fd3d-2629-4fb7-a378-007bf9ca0a76 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Acquiring lock "/opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:23:44 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-7bb0fd3d-2629-4fb7-a378-007bf9ca0a76 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "/opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:23:44 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-7bb0fd3d-2629-4fb7-a378-007bf9ca0a76 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "/opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:23:44 user nova-compute[74683]: DEBUG nova.objects.instance [None req-7bb0fd3d-2629-4fb7-a378-007bf9ca0a76 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lazy-loading 'trusted_certs' on Instance uuid b91af786-36e3-4815-811f-fb3c055e758d {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:23:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-7bb0fd3d-2629-4fb7-a378-007bf9ca0a76 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Acquiring lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:23:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-7bb0fd3d-2629-4fb7-a378-007bf9ca0a76 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:23:45 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-7bb0fd3d-2629-4fb7-a378-007bf9ca0a76 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:45 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-374f616e-b464-489c-82d5-e1b6b4a92705 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:23:45 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-374f616e-b464-489c-82d5-e1b6b4a92705 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:007698a6-0222-4002-8253-d70f69189955', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NijLguCU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 11:23:45 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-374f616e-b464-489c-82d5-e1b6b4a92705 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.449s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:23:45 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-374f616e-b464-489c-82d5-e1b6b4a92705 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] <== connect_volume: return (1451ms) {'type': 'block', 'scsi_wwn': '23866383130653236', 'path': '/dev/sdb'} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:23:45 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-374f616e-b464-489c-82d5-e1b6b4a92705 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866383130653236', 'path': '/dev/sdb'} {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 11:23:45 user nova-compute[74683]: DEBUG nova.objects.instance [None req-374f616e-b464-489c-82d5-e1b6b4a92705 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lazy-loading 'flavor' on Instance uuid 7ced47a3-311d-4083-94e1-b2d42326e24d {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:23:45 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-7bb0fd3d-2629-4fb7-a378-007bf9ca0a76 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.204s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:45 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-7bb0fd3d-2629-4fb7-a378-007bf9ca0a76 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.rescue {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:45 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-7bb0fd3d-2629-4fb7-a378-007bf9ca0a76 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.rescue" returned: 0 in 0.066s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-7bb0fd3d-2629-4fb7-a378-007bf9ca0a76 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:23:45 user nova-compute[74683]: DEBUG nova.objects.instance [None req-7bb0fd3d-2629-4fb7-a378-007bf9ca0a76 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lazy-loading 'migration_context' on Instance uuid b91af786-36e3-4815-811f-fb3c055e758d {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:23:45 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-374f616e-b464-489c-82d5-e1b6b4a92705 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 11:23:45 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:23:45 user nova-compute[74683]:   <source dev="/dev/sdb"/>
Oct 16 11:23:45 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:23:45 user nova-compute[74683]:   <serial>007698a6-0222-4002-8253-d70f69189955</serial>
Oct 16 11:23:45 user nova-compute[74683]: </disk>
Oct 16 11:23:45 user nova-compute[74683]:  {{(pid=74683) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 11:23:45 user nova-compute[74683]: DEBUG nova.objects.base [None req-7bb0fd3d-2629-4fb7-a378-007bf9ca0a76 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Object Instance<b91af786-36e3-4815-811f-fb3c055e758d> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:23:45 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-7bb0fd3d-2629-4fb7-a378-007bf9ca0a76 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Created local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 11:23:45 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-7bb0fd3d-2629-4fb7-a378-007bf9ca0a76 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Start _get_guest_xml network_info=[{"id": "abc9cf45-e4f5-4a33-9ffc-dab110e73398", "address": "fa:16:3e:03:03:02", "network": {"id": "fa128ba8-cd2f-4621-ac04-ecc21569bb68", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321708612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1321708612-network", "vif_mac": "fa:16:3e:03:03:02"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66a49078f1240bd88207e487dd4951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc9cf45-e4", "ovs_interfaceid": "abc9cf45-e4f5-4a33-9ffc-dab110e73398", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:23:45 user nova-compute[74683]: DEBUG nova.objects.instance [None req-7bb0fd3d-2629-4fb7-a378-007bf9ca0a76 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lazy-loading 'resources' on Instance uuid b91af786-36e3-4815-811f-fb3c055e758d {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:23:45 user nova-compute[74683]: DEBUG nova.objects.base [None req-7bb0fd3d-2629-4fb7-a378-007bf9ca0a76 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Object Instance<b91af786-36e3-4815-811f-fb3c055e758d> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:23:45 user nova-compute[74683]: DEBUG nova.objects.instance [None req-7bb0fd3d-2629-4fb7-a378-007bf9ca0a76 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lazy-loading 'numa_topology' on Instance uuid b91af786-36e3-4815-811f-fb3c055e758d {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:23:45 user nova-compute[74683]: DEBUG nova.objects.base [None req-7bb0fd3d-2629-4fb7-a378-007bf9ca0a76 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Object Instance<b91af786-36e3-4815-811f-fb3c055e758d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:23:45 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-7bb0fd3d-2629-4fb7-a378-007bf9ca0a76 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:23:45 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-7bb0fd3d-2629-4fb7-a378-007bf9ca0a76 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:23:45 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-7bb0fd3d-2629-4fb7-a378-007bf9ca0a76 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:23:45 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-7bb0fd3d-2629-4fb7-a378-007bf9ca0a76 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:23:45 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-7bb0fd3d-2629-4fb7-a378-007bf9ca0a76 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:23:45 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-7bb0fd3d-2629-4fb7-a378-007bf9ca0a76 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:23:45 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-7bb0fd3d-2629-4fb7-a378-007bf9ca0a76 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:23:45 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-7bb0fd3d-2629-4fb7-a378-007bf9ca0a76 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:23:45 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-7bb0fd3d-2629-4fb7-a378-007bf9ca0a76 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:23:45 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-7bb0fd3d-2629-4fb7-a378-007bf9ca0a76 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:23:45 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-7bb0fd3d-2629-4fb7-a378-007bf9ca0a76 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:23:45 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-7bb0fd3d-2629-4fb7-a378-007bf9ca0a76 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:23:45 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-7bb0fd3d-2629-4fb7-a378-007bf9ca0a76 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:23:45 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-7bb0fd3d-2629-4fb7-a378-007bf9ca0a76 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:23:45 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-7bb0fd3d-2629-4fb7-a378-007bf9ca0a76 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:23:45 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-7bb0fd3d-2629-4fb7-a378-007bf9ca0a76 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:23:45 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-7bb0fd3d-2629-4fb7-a378-007bf9ca0a76 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:23:45 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-7bb0fd3d-2629-4fb7-a378-007bf9ca0a76 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:23:45 user nova-compute[74683]: DEBUG nova.objects.instance [None req-7bb0fd3d-2629-4fb7-a378-007bf9ca0a76 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lazy-loading 'vcpu_model' on Instance uuid b91af786-36e3-4815-811f-fb3c055e758d {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:23:45 user nova-compute[74683]: DEBUG nova.objects.base [None req-7bb0fd3d-2629-4fb7-a378-007bf9ca0a76 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Object Instance<b91af786-36e3-4815-811f-fb3c055e758d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:23:45 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-7bb0fd3d-2629-4fb7-a378-007bf9ca0a76 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:21:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-311629692',display_name='tempest-ServerRescueNegativeTestJSON-server-311629692',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-311629692',id=24,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:22:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e66a49078f1240bd88207e487dd4951e',ramdisk_id='',reservation_id='r-d5sue84g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1690011355',owner_user_name='tempest-ServerRescueNegativeTestJSON-1690011355-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:22:02Z,user_data=None,user_id='3436197c787446d4a03fb7697d7999a1',uuid=b91af786-36e3-4815-811f-fb3c055e758d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "abc9cf45-e4f5-4a33-9ffc-dab110e73398", "address": "fa:16:3e:03:03:02", "network": {"id": "fa128ba8-cd2f-4621-ac04-ecc21569bb68", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321708612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1321708612-network", "vif_mac": "fa:16:3e:03:03:02"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66a49078f1240bd88207e487dd4951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc9cf45-e4", "ovs_interfaceid": "abc9cf45-e4f5-4a33-9ffc-dab110e73398", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:23:45 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-7bb0fd3d-2629-4fb7-a378-007bf9ca0a76 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Converting VIF {"id": "abc9cf45-e4f5-4a33-9ffc-dab110e73398", "address": "fa:16:3e:03:03:02", "network": {"id": "fa128ba8-cd2f-4621-ac04-ecc21569bb68", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321708612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1321708612-network", "vif_mac": "fa:16:3e:03:03:02"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66a49078f1240bd88207e487dd4951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc9cf45-e4", "ovs_interfaceid": "abc9cf45-e4f5-4a33-9ffc-dab110e73398", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:23:45 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-7bb0fd3d-2629-4fb7-a378-007bf9ca0a76 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:03:02,bridge_name='br-int',has_traffic_filtering=True,id=abc9cf45-e4f5-4a33-9ffc-dab110e73398,network=Network(fa128ba8-cd2f-4621-ac04-ecc21569bb68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabc9cf45-e4') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:23:45 user nova-compute[74683]: DEBUG nova.objects.instance [None req-7bb0fd3d-2629-4fb7-a378-007bf9ca0a76 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lazy-loading 'pci_devices' on Instance uuid b91af786-36e3-4815-811f-fb3c055e758d {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:23:45 user nova-compute[74683]: DEBUG nova.objects.base [None req-7bb0fd3d-2629-4fb7-a378-007bf9ca0a76 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Object Instance<b91af786-36e3-4815-811f-fb3c055e758d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:23:45 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-7bb0fd3d-2629-4fb7-a378-007bf9ca0a76 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: b91af786-36e3-4815-811f-fb3c055e758d] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:23:45 user nova-compute[74683]:   <uuid>b91af786-36e3-4815-811f-fb3c055e758d</uuid>
Oct 16 11:23:45 user nova-compute[74683]:   <name>instance-00000018</name>
Oct 16 11:23:45 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:23:45 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:23:45 user nova-compute[74683]:   <metadata>
Oct 16 11:23:45 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:23:45 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:23:45 user nova-compute[74683]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-311629692</nova:name>
Oct 16 11:23:45 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:23:45</nova:creationTime>
Oct 16 11:23:45 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:23:45 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:23:45 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:23:45 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:23:45 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:23:45 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:23:45 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:23:45 user nova-compute[74683]:       <nova:owner>
Oct 16 11:23:45 user nova-compute[74683]:         <nova:user uuid="3436197c787446d4a03fb7697d7999a1">tempest-ServerRescueNegativeTestJSON-1690011355-project-member</nova:user>
Oct 16 11:23:45 user nova-compute[74683]:         <nova:project uuid="e66a49078f1240bd88207e487dd4951e">tempest-ServerRescueNegativeTestJSON-1690011355</nova:project>
Oct 16 11:23:45 user nova-compute[74683]:       </nova:owner>
Oct 16 11:23:45 user nova-compute[74683]:       <nova:root type="image" uuid="0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f"/>
Oct 16 11:23:45 user nova-compute[74683]:       <nova:ports>
Oct 16 11:23:45 user nova-compute[74683]:         <nova:port uuid="abc9cf45-e4f5-4a33-9ffc-dab110e73398">
Oct 16 11:23:45 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 16 11:23:45 user nova-compute[74683]:         </nova:port>
Oct 16 11:23:45 user nova-compute[74683]:       </nova:ports>
Oct 16 11:23:45 user nova-compute[74683]:     </nova:instance>
Oct 16 11:23:45 user nova-compute[74683]:   </metadata>
Oct 16 11:23:45 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:23:45 user nova-compute[74683]:     <system>
Oct 16 11:23:45 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:23:45 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:23:45 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:23:45 user nova-compute[74683]:       <entry name="serial">b91af786-36e3-4815-811f-fb3c055e758d</entry>
Oct 16 11:23:45 user nova-compute[74683]:       <entry name="uuid">b91af786-36e3-4815-811f-fb3c055e758d</entry>
Oct 16 11:23:45 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:23:45 user nova-compute[74683]:     </system>
Oct 16 11:23:45 user nova-compute[74683]:   </sysinfo>
Oct 16 11:23:45 user nova-compute[74683]:   <os>
Oct 16 11:23:45 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:23:45 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:23:45 user nova-compute[74683]:   </os>
Oct 16 11:23:45 user nova-compute[74683]:   <features>
Oct 16 11:23:45 user nova-compute[74683]:     <acpi/>
Oct 16 11:23:45 user nova-compute[74683]:     <apic/>
Oct 16 11:23:45 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:23:45 user nova-compute[74683]:   </features>
Oct 16 11:23:45 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:23:45 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:23:45 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:23:45 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:23:45 user nova-compute[74683]:   </clock>
Oct 16 11:23:45 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:23:45 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:23:45 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:23:45 user nova-compute[74683]:   </cpu>
Oct 16 11:23:45 user nova-compute[74683]:   <devices>
Oct 16 11:23:45 user nova-compute[74683]:     <disk type="file" device="disk">
Oct 16 11:23:45 user nova-compute[74683]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 11:23:45 user nova-compute[74683]:       <source file="/opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.rescue"/>
Oct 16 11:23:45 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:23:45 user nova-compute[74683]:     </disk>
Oct 16 11:23:45 user nova-compute[74683]:     <disk type="file" device="disk">
Oct 16 11:23:45 user nova-compute[74683]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 11:23:45 user nova-compute[74683]:       <source file="/opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk"/>
Oct 16 11:23:45 user nova-compute[74683]:       <target dev="vdb" bus="virtio"/>
Oct 16 11:23:45 user nova-compute[74683]:     </disk>
Oct 16 11:23:45 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:23:45 user nova-compute[74683]:       <mac address="fa:16:3e:03:03:02"/>
Oct 16 11:23:45 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:23:45 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:23:45 user nova-compute[74683]:       <target dev="tapabc9cf45-e4"/>
Oct 16 11:23:45 user nova-compute[74683]:     </interface>
Oct 16 11:23:45 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:23:45 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/console.log" append="off"/>
Oct 16 11:23:45 user nova-compute[74683]:     </serial>
Oct 16 11:23:45 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:23:45 user nova-compute[74683]:     <video>
Oct 16 11:23:45 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:23:45 user nova-compute[74683]:     </video>
Oct 16 11:23:45 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:23:45 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:23:45 user nova-compute[74683]:     </rng>
Oct 16 11:23:45 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:23:45 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:23:45 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:23:45 user nova-compute[74683]:     </memballoon>
Oct 16 11:23:45 user nova-compute[74683]:   </devices>
Oct 16 11:23:45 user nova-compute[74683]: </domain>
Oct 16 11:23:45 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:23:45 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Instance destroyed successfully.
Oct 16 11:23:45 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-7bb0fd3d-2629-4fb7-a378-007bf9ca0a76 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:23:45 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-7bb0fd3d-2629-4fb7-a378-007bf9ca0a76 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:23:45 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-7bb0fd3d-2629-4fb7-a378-007bf9ca0a76 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] No VIF found with MAC fa:16:3e:03:03:02, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:23:45 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-374f616e-b464-489c-82d5-e1b6b4a92705 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:23:45 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-374f616e-b464-489c-82d5-e1b6b4a92705 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:23:45 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-374f616e-b464-489c-82d5-e1b6b4a92705 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] No VIF found with MAC fa:16:3e:33:b2:31, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:23:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-374f616e-b464-489c-82d5-e1b6b4a92705 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lock "7ced47a3-311d-4083-94e1-b2d42326e24d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.667s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:23:46 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-59fe7e67-1624-487a-8305-6cda6ffa07ae tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Acquiring lock "7ced47a3-311d-4083-94e1-b2d42326e24d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:23:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-59fe7e67-1624-487a-8305-6cda6ffa07ae tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lock "7ced47a3-311d-4083-94e1-b2d42326e24d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:23:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:47 user nova-compute[74683]: INFO nova.compute.manager [None req-59fe7e67-1624-487a-8305-6cda6ffa07ae tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Detaching volume 007698a6-0222-4002-8253-d70f69189955
Oct 16 11:23:47 user nova-compute[74683]: INFO nova.virt.block_device [None req-59fe7e67-1624-487a-8305-6cda6ffa07ae tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Attempting to driver detach volume 007698a6-0222-4002-8253-d70f69189955 from mountpoint /dev/vdb
Oct 16 11:23:47 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-59fe7e67-1624-487a-8305-6cda6ffa07ae tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Attempting to detach device vdb from instance 7ced47a3-311d-4083-94e1-b2d42326e24d from the persistent domain config. {{(pid=74683) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 11:23:47 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-59fe7e67-1624-487a-8305-6cda6ffa07ae tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 11:23:47 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:23:47 user nova-compute[74683]:   <source dev="/dev/sdb"/>
Oct 16 11:23:47 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:23:47 user nova-compute[74683]:   <serial>007698a6-0222-4002-8253-d70f69189955</serial>
Oct 16 11:23:47 user nova-compute[74683]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 11:23:47 user nova-compute[74683]: </disk>
Oct 16 11:23:47 user nova-compute[74683]:  {{(pid=74683) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 11:23:47 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-59fe7e67-1624-487a-8305-6cda6ffa07ae tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Successfully detached device vdb from instance 7ced47a3-311d-4083-94e1-b2d42326e24d from the persistent domain config.
Oct 16 11:23:47 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-59fe7e67-1624-487a-8305-6cda6ffa07ae tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7ced47a3-311d-4083-94e1-b2d42326e24d from the live domain config. {{(pid=74683) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 11:23:47 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-59fe7e67-1624-487a-8305-6cda6ffa07ae tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 11:23:47 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:23:47 user nova-compute[74683]:   <source dev="/dev/sdb"/>
Oct 16 11:23:47 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:23:47 user nova-compute[74683]:   <serial>007698a6-0222-4002-8253-d70f69189955</serial>
Oct 16 11:23:47 user nova-compute[74683]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 11:23:47 user nova-compute[74683]: </disk>
Oct 16 11:23:47 user nova-compute[74683]:  {{(pid=74683) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 11:23:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:48 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-59fe7e67-1624-487a-8305-6cda6ffa07ae tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7ced47a3-311d-4083-94e1-b2d42326e24d {{(pid=74683) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 11:23:49 user nova-compute[74683]: DEBUG nova.compute.manager [None req-7bb0fd3d-2629-4fb7-a378-007bf9ca0a76 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:23:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Acquiring lock "4b6a8c25-d3ca-48ff-b22f-9338200ebc01" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:23:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Lock "4b6a8c25-d3ca-48ff-b22f-9338200ebc01" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:23:50 user nova-compute[74683]: DEBUG nova.compute.manager [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 4b6a8c25-d3ca-48ff-b22f-9338200ebc01] Starting instance... {{(pid=74683) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 11:23:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:23:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:23:50 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74683) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 11:23:50 user nova-compute[74683]: INFO nova.compute.claims [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 4b6a8c25-d3ca-48ff-b22f-9338200ebc01] Claim successful on node user
Oct 16 11:23:51 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:51 user nova-compute[74683]: DEBUG nova.compute.manager [req-93f9d8d3-70b1-4890-ae4c-735551f65a34 req-af4eca12-afb4-4c69-bc5e-d96cd730a381 service nova] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Received event network-vif-unplugged-abc9cf45-e4f5-4a33-9ffc-dab110e73398 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:23:51 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-93f9d8d3-70b1-4890-ae4c-735551f65a34 req-af4eca12-afb4-4c69-bc5e-d96cd730a381 service nova] Acquiring lock "b91af786-36e3-4815-811f-fb3c055e758d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:23:51 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-93f9d8d3-70b1-4890-ae4c-735551f65a34 req-af4eca12-afb4-4c69-bc5e-d96cd730a381 service nova] Lock "b91af786-36e3-4815-811f-fb3c055e758d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:23:51 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-93f9d8d3-70b1-4890-ae4c-735551f65a34 req-af4eca12-afb4-4c69-bc5e-d96cd730a381 service nova] Lock "b91af786-36e3-4815-811f-fb3c055e758d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:23:51 user nova-compute[74683]: DEBUG nova.compute.manager [req-93f9d8d3-70b1-4890-ae4c-735551f65a34 req-af4eca12-afb4-4c69-bc5e-d96cd730a381 service nova] [instance: b91af786-36e3-4815-811f-fb3c055e758d] No waiting events found dispatching network-vif-unplugged-abc9cf45-e4f5-4a33-9ffc-dab110e73398 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:23:51 user nova-compute[74683]: WARNING nova.compute.manager [req-93f9d8d3-70b1-4890-ae4c-735551f65a34 req-af4eca12-afb4-4c69-bc5e-d96cd730a381 service nova] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Received unexpected event network-vif-unplugged-abc9cf45-e4f5-4a33-9ffc-dab110e73398 for instance with vm_state rescued and task_state None.
Oct 16 11:23:51 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:23:51 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:23:51 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.734s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:23:51 user nova-compute[74683]: DEBUG nova.compute.manager [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 4b6a8c25-d3ca-48ff-b22f-9338200ebc01] Start building networks asynchronously for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 11:23:51 user nova-compute[74683]: DEBUG nova.compute.manager [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 4b6a8c25-d3ca-48ff-b22f-9338200ebc01] Allocating IP information in the background. {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 11:23:51 user nova-compute[74683]: DEBUG nova.network.neutron [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 4b6a8c25-d3ca-48ff-b22f-9338200ebc01] allocate_for_instance() {{(pid=74683) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 11:23:51 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 4b6a8c25-d3ca-48ff-b22f-9338200ebc01] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 11:23:51 user nova-compute[74683]: DEBUG nova.compute.manager [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 4b6a8c25-d3ca-48ff-b22f-9338200ebc01] Start building block device mappings for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 11:23:51 user nova-compute[74683]: DEBUG nova.policy [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c9a0c7b02744e87885fe8d252e88d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adfa96f9deab4c4eb584876b48e804e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74683) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 11:23:51 user nova-compute[74683]: DEBUG nova.compute.manager [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 4b6a8c25-d3ca-48ff-b22f-9338200ebc01] Start spawning the instance on the hypervisor. {{(pid=74683) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 11:23:51 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 4b6a8c25-d3ca-48ff-b22f-9338200ebc01] Creating instance directory {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 11:23:51 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 4b6a8c25-d3ca-48ff-b22f-9338200ebc01] Creating image(s)
Oct 16 11:23:51 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Acquiring lock "/opt/stack/data/nova/instances/4b6a8c25-d3ca-48ff-b22f-9338200ebc01/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:23:51 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Lock "/opt/stack/data/nova/instances/4b6a8c25-d3ca-48ff-b22f-9338200ebc01/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:23:51 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Lock "/opt/stack/data/nova/instances/4b6a8c25-d3ca-48ff-b22f-9338200ebc01/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:23:51 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.188s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:52 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Acquiring lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:23:52 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:23:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.240s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/4b6a8c25-d3ca-48ff-b22f-9338200ebc01/disk 1073741824 {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/4b6a8c25-d3ca-48ff-b22f-9338200ebc01/disk 1073741824" returned: 0 in 0.060s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:52 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.308s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:23:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.206s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:52 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4b6a8c25-d3ca-48ff-b22f-9338200ebc01/disk. size=1073741824 {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 11:23:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b6a8c25-d3ca-48ff-b22f-9338200ebc01/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:23:52 user nova-compute[74683]: DEBUG nova.network.neutron [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 4b6a8c25-d3ca-48ff-b22f-9338200ebc01] Successfully created port: b2efd2e8-26ef-4ed3-b3a6-79e0e3c39c83 {{(pid=74683) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 11:23:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b6a8c25-d3ca-48ff-b22f-9338200ebc01/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:23:52 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Cannot resize image /opt/stack/data/nova/instances/4b6a8c25-d3ca-48ff-b22f-9338200ebc01/disk to a smaller size. {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 11:23:52 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 4b6a8c25-d3ca-48ff-b22f-9338200ebc01] Created local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 11:23:52 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 4b6a8c25-d3ca-48ff-b22f-9338200ebc01] Ensure instance console log exists: /opt/stack/data/nova/instances/4b6a8c25-d3ca-48ff-b22f-9338200ebc01/console.log {{(pid=74683) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 11:23:52 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:23:52 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:23:52 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:23:53 user nova-compute[74683]: DEBUG nova.network.neutron [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 4b6a8c25-d3ca-48ff-b22f-9338200ebc01] Successfully updated port: b2efd2e8-26ef-4ed3-b3a6-79e0e3c39c83 {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:23:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Acquiring lock "refresh_cache-4b6a8c25-d3ca-48ff-b22f-9338200ebc01" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:23:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Acquired lock "refresh_cache-4b6a8c25-d3ca-48ff-b22f-9338200ebc01" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:23:53 user nova-compute[74683]: DEBUG nova.network.neutron [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 4b6a8c25-d3ca-48ff-b22f-9338200ebc01] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:23:53 user nova-compute[74683]: DEBUG nova.compute.manager [req-73bdfc70-6282-4431-a034-a24fa9584963 req-814964ef-9e84-4499-a8a2-e364095d60ed service nova] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Received event network-vif-plugged-abc9cf45-e4f5-4a33-9ffc-dab110e73398 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:23:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-73bdfc70-6282-4431-a034-a24fa9584963 req-814964ef-9e84-4499-a8a2-e364095d60ed service nova] Acquiring lock "b91af786-36e3-4815-811f-fb3c055e758d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:23:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-73bdfc70-6282-4431-a034-a24fa9584963 req-814964ef-9e84-4499-a8a2-e364095d60ed service nova] Lock "b91af786-36e3-4815-811f-fb3c055e758d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:23:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-73bdfc70-6282-4431-a034-a24fa9584963 req-814964ef-9e84-4499-a8a2-e364095d60ed service nova] Lock "b91af786-36e3-4815-811f-fb3c055e758d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:23:53 user nova-compute[74683]: DEBUG nova.compute.manager [req-73bdfc70-6282-4431-a034-a24fa9584963 req-814964ef-9e84-4499-a8a2-e364095d60ed service nova] [instance: b91af786-36e3-4815-811f-fb3c055e758d] No waiting events found dispatching network-vif-plugged-abc9cf45-e4f5-4a33-9ffc-dab110e73398 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:23:53 user nova-compute[74683]: WARNING nova.compute.manager [req-73bdfc70-6282-4431-a034-a24fa9584963 req-814964ef-9e84-4499-a8a2-e364095d60ed service nova] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Received unexpected event network-vif-plugged-abc9cf45-e4f5-4a33-9ffc-dab110e73398 for instance with vm_state rescued and task_state None.
Oct 16 11:23:53 user nova-compute[74683]: DEBUG nova.compute.manager [req-73bdfc70-6282-4431-a034-a24fa9584963 req-814964ef-9e84-4499-a8a2-e364095d60ed service nova] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Received event network-vif-plugged-abc9cf45-e4f5-4a33-9ffc-dab110e73398 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:23:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-73bdfc70-6282-4431-a034-a24fa9584963 req-814964ef-9e84-4499-a8a2-e364095d60ed service nova] Acquiring lock "b91af786-36e3-4815-811f-fb3c055e758d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:23:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-73bdfc70-6282-4431-a034-a24fa9584963 req-814964ef-9e84-4499-a8a2-e364095d60ed service nova] Lock "b91af786-36e3-4815-811f-fb3c055e758d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:23:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-73bdfc70-6282-4431-a034-a24fa9584963 req-814964ef-9e84-4499-a8a2-e364095d60ed service nova] Lock "b91af786-36e3-4815-811f-fb3c055e758d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:23:53 user nova-compute[74683]: DEBUG nova.compute.manager [req-73bdfc70-6282-4431-a034-a24fa9584963 req-814964ef-9e84-4499-a8a2-e364095d60ed service nova] [instance: b91af786-36e3-4815-811f-fb3c055e758d] No waiting events found dispatching network-vif-plugged-abc9cf45-e4f5-4a33-9ffc-dab110e73398 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:23:53 user nova-compute[74683]: WARNING nova.compute.manager [req-73bdfc70-6282-4431-a034-a24fa9584963 req-814964ef-9e84-4499-a8a2-e364095d60ed service nova] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Received unexpected event network-vif-plugged-abc9cf45-e4f5-4a33-9ffc-dab110e73398 for instance with vm_state rescued and task_state None.
Oct 16 11:23:53 user nova-compute[74683]: DEBUG nova.compute.manager [req-73bdfc70-6282-4431-a034-a24fa9584963 req-814964ef-9e84-4499-a8a2-e364095d60ed service nova] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Received event network-vif-plugged-abc9cf45-e4f5-4a33-9ffc-dab110e73398 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:23:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-73bdfc70-6282-4431-a034-a24fa9584963 req-814964ef-9e84-4499-a8a2-e364095d60ed service nova] Acquiring lock "b91af786-36e3-4815-811f-fb3c055e758d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:23:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-73bdfc70-6282-4431-a034-a24fa9584963 req-814964ef-9e84-4499-a8a2-e364095d60ed service nova] Lock "b91af786-36e3-4815-811f-fb3c055e758d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:23:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-73bdfc70-6282-4431-a034-a24fa9584963 req-814964ef-9e84-4499-a8a2-e364095d60ed service nova] Lock "b91af786-36e3-4815-811f-fb3c055e758d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:23:53 user nova-compute[74683]: DEBUG nova.compute.manager [req-73bdfc70-6282-4431-a034-a24fa9584963 req-814964ef-9e84-4499-a8a2-e364095d60ed service nova] [instance: b91af786-36e3-4815-811f-fb3c055e758d] No waiting events found dispatching network-vif-plugged-abc9cf45-e4f5-4a33-9ffc-dab110e73398 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:23:53 user nova-compute[74683]: WARNING nova.compute.manager [req-73bdfc70-6282-4431-a034-a24fa9584963 req-814964ef-9e84-4499-a8a2-e364095d60ed service nova] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Received unexpected event network-vif-plugged-abc9cf45-e4f5-4a33-9ffc-dab110e73398 for instance with vm_state rescued and task_state None.
Oct 16 11:23:53 user nova-compute[74683]: DEBUG nova.compute.manager [req-73bdfc70-6282-4431-a034-a24fa9584963 req-814964ef-9e84-4499-a8a2-e364095d60ed service nova] [instance: 4b6a8c25-d3ca-48ff-b22f-9338200ebc01] Received event network-changed-b2efd2e8-26ef-4ed3-b3a6-79e0e3c39c83 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:23:53 user nova-compute[74683]: DEBUG nova.compute.manager [req-73bdfc70-6282-4431-a034-a24fa9584963 req-814964ef-9e84-4499-a8a2-e364095d60ed service nova] [instance: 4b6a8c25-d3ca-48ff-b22f-9338200ebc01] Refreshing instance network info cache due to event network-changed-b2efd2e8-26ef-4ed3-b3a6-79e0e3c39c83. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:23:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-73bdfc70-6282-4431-a034-a24fa9584963 req-814964ef-9e84-4499-a8a2-e364095d60ed service nova] Acquiring lock "refresh_cache-4b6a8c25-d3ca-48ff-b22f-9338200ebc01" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:23:53 user nova-compute[74683]: DEBUG nova.network.neutron [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 4b6a8c25-d3ca-48ff-b22f-9338200ebc01] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:23:53 user nova-compute[74683]: DEBUG nova.network.neutron [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 4b6a8c25-d3ca-48ff-b22f-9338200ebc01] Updating instance_info_cache with network_info: [{"id": "b2efd2e8-26ef-4ed3-b3a6-79e0e3c39c83", "address": "fa:16:3e:ff:75:2d", "network": {"id": "acc0dc8b-0dc9-47ad-8630-d9e91dd67dbc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-679008794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adfa96f9deab4c4eb584876b48e804e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2efd2e8-26", "ovs_interfaceid": "b2efd2e8-26ef-4ed3-b3a6-79e0e3c39c83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:23:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Releasing lock "refresh_cache-4b6a8c25-d3ca-48ff-b22f-9338200ebc01" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:23:53 user nova-compute[74683]: DEBUG nova.compute.manager [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 4b6a8c25-d3ca-48ff-b22f-9338200ebc01] Instance network_info: |[{"id": "b2efd2e8-26ef-4ed3-b3a6-79e0e3c39c83", "address": "fa:16:3e:ff:75:2d", "network": {"id": "acc0dc8b-0dc9-47ad-8630-d9e91dd67dbc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-679008794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adfa96f9deab4c4eb584876b48e804e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2efd2e8-26", "ovs_interfaceid": "b2efd2e8-26ef-4ed3-b3a6-79e0e3c39c83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 11:23:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-73bdfc70-6282-4431-a034-a24fa9584963 req-814964ef-9e84-4499-a8a2-e364095d60ed service nova] Acquired lock "refresh_cache-4b6a8c25-d3ca-48ff-b22f-9338200ebc01" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:23:53 user nova-compute[74683]: DEBUG nova.network.neutron [req-73bdfc70-6282-4431-a034-a24fa9584963 req-814964ef-9e84-4499-a8a2-e364095d60ed service nova] [instance: 4b6a8c25-d3ca-48ff-b22f-9338200ebc01] Refreshing network info cache for port b2efd2e8-26ef-4ed3-b3a6-79e0e3c39c83 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:23:53 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 4b6a8c25-d3ca-48ff-b22f-9338200ebc01] Start _get_guest_xml network_info=[{"id": "b2efd2e8-26ef-4ed3-b3a6-79e0e3c39c83", "address": "fa:16:3e:ff:75:2d", "network": {"id": "acc0dc8b-0dc9-47ad-8630-d9e91dd67dbc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-679008794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adfa96f9deab4c4eb584876b48e804e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2efd2e8-26", "ovs_interfaceid": "b2efd2e8-26ef-4ed3-b3a6-79e0e3c39c83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:23:54 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:23:54 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:23:54 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:23:54 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:23:54 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:23:54 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:23:54 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:23:54 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:23:54 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:23:54 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:23:54 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:23:54 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:23:54 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:23:54 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:23:54 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:23:54 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:23:54 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:23:54 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:23:54 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:23:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1001018970',display_name='tempest-ServersNegativeTestJSON-server-1001018970',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1001018970',id=27,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='adfa96f9deab4c4eb584876b48e804e0',ramdisk_id='',reservation_id='r-8kb11h8o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-282145638',owner_user_name='tempest-ServersNegativeTestJSON-282145638-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:23:52Z,user_data=None,user_id='0c9a0c7b02744e87885fe8d252e88d1c',uuid=4b6a8c25-d3ca-48ff-b22f-9338200ebc01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2efd2e8-26ef-4ed3-b3a6-79e0e3c39c83", "address": "fa:16:3e:ff:75:2d", "network": {"id": "acc0dc8b-0dc9-47ad-8630-d9e91dd67dbc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-679008794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adfa96f9deab4c4eb584876b48e804e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2efd2e8-26", "ovs_interfaceid": "b2efd2e8-26ef-4ed3-b3a6-79e0e3c39c83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:23:54 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Converting VIF {"id": "b2efd2e8-26ef-4ed3-b3a6-79e0e3c39c83", "address": "fa:16:3e:ff:75:2d", "network": {"id": "acc0dc8b-0dc9-47ad-8630-d9e91dd67dbc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-679008794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adfa96f9deab4c4eb584876b48e804e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2efd2e8-26", "ovs_interfaceid": "b2efd2e8-26ef-4ed3-b3a6-79e0e3c39c83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:23:54 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:75:2d,bridge_name='br-int',has_traffic_filtering=True,id=b2efd2e8-26ef-4ed3-b3a6-79e0e3c39c83,network=Network(acc0dc8b-0dc9-47ad-8630-d9e91dd67dbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2efd2e8-26') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:23:54 user nova-compute[74683]: DEBUG nova.objects.instance [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Lazy-loading 'pci_devices' on Instance uuid 4b6a8c25-d3ca-48ff-b22f-9338200ebc01 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:23:54 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 4b6a8c25-d3ca-48ff-b22f-9338200ebc01] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:23:54 user nova-compute[74683]:   <uuid>4b6a8c25-d3ca-48ff-b22f-9338200ebc01</uuid>
Oct 16 11:23:54 user nova-compute[74683]:   <name>instance-0000001b</name>
Oct 16 11:23:54 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:23:54 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:23:54 user nova-compute[74683]:   <metadata>
Oct 16 11:23:54 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:23:54 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:23:54 user nova-compute[74683]:       <nova:name>tempest-ServersNegativeTestJSON-server-1001018970</nova:name>
Oct 16 11:23:54 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:23:54</nova:creationTime>
Oct 16 11:23:54 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:23:54 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:23:54 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:23:54 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:23:54 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:23:54 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:23:54 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:23:54 user nova-compute[74683]:       <nova:owner>
Oct 16 11:23:54 user nova-compute[74683]:         <nova:user uuid="0c9a0c7b02744e87885fe8d252e88d1c">tempest-ServersNegativeTestJSON-282145638-project-member</nova:user>
Oct 16 11:23:54 user nova-compute[74683]:         <nova:project uuid="adfa96f9deab4c4eb584876b48e804e0">tempest-ServersNegativeTestJSON-282145638</nova:project>
Oct 16 11:23:54 user nova-compute[74683]:       </nova:owner>
Oct 16 11:23:54 user nova-compute[74683]:       <nova:root type="image" uuid="0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f"/>
Oct 16 11:23:54 user nova-compute[74683]:       <nova:ports>
Oct 16 11:23:54 user nova-compute[74683]:         <nova:port uuid="b2efd2e8-26ef-4ed3-b3a6-79e0e3c39c83">
Oct 16 11:23:54 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 16 11:23:54 user nova-compute[74683]:         </nova:port>
Oct 16 11:23:54 user nova-compute[74683]:       </nova:ports>
Oct 16 11:23:54 user nova-compute[74683]:     </nova:instance>
Oct 16 11:23:54 user nova-compute[74683]:   </metadata>
Oct 16 11:23:54 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:23:54 user nova-compute[74683]:     <system>
Oct 16 11:23:54 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:23:54 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:23:54 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:23:54 user nova-compute[74683]:       <entry name="serial">4b6a8c25-d3ca-48ff-b22f-9338200ebc01</entry>
Oct 16 11:23:54 user nova-compute[74683]:       <entry name="uuid">4b6a8c25-d3ca-48ff-b22f-9338200ebc01</entry>
Oct 16 11:23:54 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:23:54 user nova-compute[74683]:     </system>
Oct 16 11:23:54 user nova-compute[74683]:   </sysinfo>
Oct 16 11:23:54 user nova-compute[74683]:   <os>
Oct 16 11:23:54 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:23:54 user nova-compute[74683]:     <boot dev="hd"/>
Oct 16 11:23:54 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:23:54 user nova-compute[74683]:   </os>
Oct 16 11:23:54 user nova-compute[74683]:   <features>
Oct 16 11:23:54 user nova-compute[74683]:     <acpi/>
Oct 16 11:23:54 user nova-compute[74683]:     <apic/>
Oct 16 11:23:54 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:23:54 user nova-compute[74683]:   </features>
Oct 16 11:23:54 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:23:54 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:23:54 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:23:54 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:23:54 user nova-compute[74683]:   </clock>
Oct 16 11:23:54 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:23:54 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:23:54 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:23:54 user nova-compute[74683]:   </cpu>
Oct 16 11:23:54 user nova-compute[74683]:   <devices>
Oct 16 11:23:54 user nova-compute[74683]:     <disk type="file" device="disk">
Oct 16 11:23:54 user nova-compute[74683]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 11:23:54 user nova-compute[74683]:       <source file="/opt/stack/data/nova/instances/4b6a8c25-d3ca-48ff-b22f-9338200ebc01/disk"/>
Oct 16 11:23:54 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:23:54 user nova-compute[74683]:     </disk>
Oct 16 11:23:54 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:23:54 user nova-compute[74683]:       <mac address="fa:16:3e:ff:75:2d"/>
Oct 16 11:23:54 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:23:54 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:23:54 user nova-compute[74683]:       <target dev="tapb2efd2e8-26"/>
Oct 16 11:23:54 user nova-compute[74683]:     </interface>
Oct 16 11:23:54 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:23:54 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/4b6a8c25-d3ca-48ff-b22f-9338200ebc01/console.log" append="off"/>
Oct 16 11:23:54 user nova-compute[74683]:     </serial>
Oct 16 11:23:54 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:23:54 user nova-compute[74683]:     <video>
Oct 16 11:23:54 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:23:54 user nova-compute[74683]:     </video>
Oct 16 11:23:54 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:23:54 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:23:54 user nova-compute[74683]:     </rng>
Oct 16 11:23:54 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:23:54 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:23:54 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:23:54 user nova-compute[74683]:     </memballoon>
Oct 16 11:23:54 user nova-compute[74683]:   </devices>
Oct 16 11:23:54 user nova-compute[74683]: </domain>
Oct 16 11:23:54 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:23:54 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:23:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1001018970',display_name='tempest-ServersNegativeTestJSON-server-1001018970',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1001018970',id=27,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='adfa96f9deab4c4eb584876b48e804e0',ramdisk_id='',reservation_id='r-8kb11h8o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-282145638',owner_user_name='tempest-ServersNegativeTestJSON-282145638-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:23:52Z,user_data=None,user_id='0c9a0c7b02744e87885fe8d252e88d1c',uuid=4b6a8c25-d3ca-48ff-b22f-9338200ebc01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2efd2e8-26ef-4ed3-b3a6-79e0e3c39c83", "address": "fa:16:3e:ff:75:2d", "network": {"id": "acc0dc8b-0dc9-47ad-8630-d9e91dd67dbc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-679008794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adfa96f9deab4c4eb584876b48e804e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2efd2e8-26", "ovs_interfaceid": "b2efd2e8-26ef-4ed3-b3a6-79e0e3c39c83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:23:54 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Converting VIF {"id": "b2efd2e8-26ef-4ed3-b3a6-79e0e3c39c83", "address": "fa:16:3e:ff:75:2d", "network": {"id": "acc0dc8b-0dc9-47ad-8630-d9e91dd67dbc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-679008794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adfa96f9deab4c4eb584876b48e804e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2efd2e8-26", "ovs_interfaceid": "b2efd2e8-26ef-4ed3-b3a6-79e0e3c39c83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:23:54 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:75:2d,bridge_name='br-int',has_traffic_filtering=True,id=b2efd2e8-26ef-4ed3-b3a6-79e0e3c39c83,network=Network(acc0dc8b-0dc9-47ad-8630-d9e91dd67dbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2efd2e8-26') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:23:54 user nova-compute[74683]: DEBUG os_vif [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:75:2d,bridge_name='br-int',has_traffic_filtering=True,id=b2efd2e8-26ef-4ed3-b3a6-79e0e3c39c83,network=Network(acc0dc8b-0dc9-47ad-8630-d9e91dd67dbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2efd2e8-26') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:23:54 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:54 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:23:54 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:23:54 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:54 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '234bddf3-f750-5db9-a799-f7e7f4f96134', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:23:54 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:54 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:23:54 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:54 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb2efd2e8-26, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:23:54 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb2efd2e8-26, col_values=(('qos', UUID('8cc1bbdc-92f2-4b02-af1c-eef8a799d6c4')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:23:54 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb2efd2e8-26, col_values=(('external_ids', {'iface-id': 'b2efd2e8-26ef-4ed3-b3a6-79e0e3c39c83', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:75:2d', 'vm-uuid': '4b6a8c25-d3ca-48ff-b22f-9338200ebc01'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:23:54 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:54 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:23:54 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:54 user nova-compute[74683]: INFO os_vif [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:75:2d,bridge_name='br-int',has_traffic_filtering=True,id=b2efd2e8-26ef-4ed3-b3a6-79e0e3c39c83,network=Network(acc0dc8b-0dc9-47ad-8630-d9e91dd67dbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2efd2e8-26')
Oct 16 11:23:54 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:23:54 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] No VIF found with MAC fa:16:3e:ff:75:2d, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:23:54 user nova-compute[74683]: DEBUG nova.network.neutron [req-73bdfc70-6282-4431-a034-a24fa9584963 req-814964ef-9e84-4499-a8a2-e364095d60ed service nova] [instance: 4b6a8c25-d3ca-48ff-b22f-9338200ebc01] Updated VIF entry in instance network info cache for port b2efd2e8-26ef-4ed3-b3a6-79e0e3c39c83. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:23:54 user nova-compute[74683]: DEBUG nova.network.neutron [req-73bdfc70-6282-4431-a034-a24fa9584963 req-814964ef-9e84-4499-a8a2-e364095d60ed service nova] [instance: 4b6a8c25-d3ca-48ff-b22f-9338200ebc01] Updating instance_info_cache with network_info: [{"id": "b2efd2e8-26ef-4ed3-b3a6-79e0e3c39c83", "address": "fa:16:3e:ff:75:2d", "network": {"id": "acc0dc8b-0dc9-47ad-8630-d9e91dd67dbc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-679008794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adfa96f9deab4c4eb584876b48e804e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2efd2e8-26", "ovs_interfaceid": "b2efd2e8-26ef-4ed3-b3a6-79e0e3c39c83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:23:54 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-73bdfc70-6282-4431-a034-a24fa9584963 req-814964ef-9e84-4499-a8a2-e364095d60ed service nova] Releasing lock "refresh_cache-4b6a8c25-d3ca-48ff-b22f-9338200ebc01" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:23:55 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:55 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:55 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:55 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:56 user nova-compute[74683]: DEBUG nova.compute.manager [req-03c72ef9-7422-4c52-b594-b31045066a08 req-6d302572-3b65-4892-8f7c-b70e83cfbb88 service nova] [instance: 4b6a8c25-d3ca-48ff-b22f-9338200ebc01] Received event network-vif-plugged-b2efd2e8-26ef-4ed3-b3a6-79e0e3c39c83 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:23:56 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-03c72ef9-7422-4c52-b594-b31045066a08 req-6d302572-3b65-4892-8f7c-b70e83cfbb88 service nova] Acquiring lock "4b6a8c25-d3ca-48ff-b22f-9338200ebc01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:23:56 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-03c72ef9-7422-4c52-b594-b31045066a08 req-6d302572-3b65-4892-8f7c-b70e83cfbb88 service nova] Lock "4b6a8c25-d3ca-48ff-b22f-9338200ebc01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:23:56 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-03c72ef9-7422-4c52-b594-b31045066a08 req-6d302572-3b65-4892-8f7c-b70e83cfbb88 service nova] Lock "4b6a8c25-d3ca-48ff-b22f-9338200ebc01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:23:56 user nova-compute[74683]: DEBUG nova.compute.manager [req-03c72ef9-7422-4c52-b594-b31045066a08 req-6d302572-3b65-4892-8f7c-b70e83cfbb88 service nova] [instance: 4b6a8c25-d3ca-48ff-b22f-9338200ebc01] No waiting events found dispatching network-vif-plugged-b2efd2e8-26ef-4ed3-b3a6-79e0e3c39c83 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:23:56 user nova-compute[74683]: WARNING nova.compute.manager [req-03c72ef9-7422-4c52-b594-b31045066a08 req-6d302572-3b65-4892-8f7c-b70e83cfbb88 service nova] [instance: 4b6a8c25-d3ca-48ff-b22f-9338200ebc01] Received unexpected event network-vif-plugged-b2efd2e8-26ef-4ed3-b3a6-79e0e3c39c83 for instance with vm_state building and task_state spawning.
Oct 16 11:23:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:58 user nova-compute[74683]: DEBUG nova.compute.manager [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 4b6a8c25-d3ca-48ff-b22f-9338200ebc01] Instance event wait completed in 0 seconds for  {{(pid=74683) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 11:23:58 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 4b6a8c25-d3ca-48ff-b22f-9338200ebc01] Guest created on hypervisor {{(pid=74683) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 11:23:58 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 4b6a8c25-d3ca-48ff-b22f-9338200ebc01] Instance spawned successfully.
Oct 16 11:23:58 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 4b6a8c25-d3ca-48ff-b22f-9338200ebc01] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 11:23:58 user nova-compute[74683]: DEBUG nova.compute.manager [req-118beb75-dac5-41b5-a3d3-dff54ac7c11b req-b2c97cca-8821-4190-b4e0-1b2b8f4e624f service nova] [instance: 4b6a8c25-d3ca-48ff-b22f-9338200ebc01] Received event network-vif-plugged-b2efd2e8-26ef-4ed3-b3a6-79e0e3c39c83 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:23:58 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-118beb75-dac5-41b5-a3d3-dff54ac7c11b req-b2c97cca-8821-4190-b4e0-1b2b8f4e624f service nova] Acquiring lock "4b6a8c25-d3ca-48ff-b22f-9338200ebc01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:23:58 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-118beb75-dac5-41b5-a3d3-dff54ac7c11b req-b2c97cca-8821-4190-b4e0-1b2b8f4e624f service nova] Lock "4b6a8c25-d3ca-48ff-b22f-9338200ebc01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:23:58 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-118beb75-dac5-41b5-a3d3-dff54ac7c11b req-b2c97cca-8821-4190-b4e0-1b2b8f4e624f service nova] Lock "4b6a8c25-d3ca-48ff-b22f-9338200ebc01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:23:58 user nova-compute[74683]: DEBUG nova.compute.manager [req-118beb75-dac5-41b5-a3d3-dff54ac7c11b req-b2c97cca-8821-4190-b4e0-1b2b8f4e624f service nova] [instance: 4b6a8c25-d3ca-48ff-b22f-9338200ebc01] No waiting events found dispatching network-vif-plugged-b2efd2e8-26ef-4ed3-b3a6-79e0e3c39c83 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:23:58 user nova-compute[74683]: WARNING nova.compute.manager [req-118beb75-dac5-41b5-a3d3-dff54ac7c11b req-b2c97cca-8821-4190-b4e0-1b2b8f4e624f service nova] [instance: 4b6a8c25-d3ca-48ff-b22f-9338200ebc01] Received unexpected event network-vif-plugged-b2efd2e8-26ef-4ed3-b3a6-79e0e3c39c83 for instance with vm_state building and task_state spawning.
Oct 16 11:23:58 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-fa96e9c2-cb55-43f1-afc3-25d51ed3b4ab tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Acquiring lock "ddb55617-a6a9-40f9-b2ff-b2b626f149ab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:23:58 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-fa96e9c2-cb55-43f1-afc3-25d51ed3b4ab tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "ddb55617-a6a9-40f9-b2ff-b2b626f149ab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:23:58 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-fa96e9c2-cb55-43f1-afc3-25d51ed3b4ab tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Acquiring lock "ddb55617-a6a9-40f9-b2ff-b2b626f149ab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:23:58 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-fa96e9c2-cb55-43f1-afc3-25d51ed3b4ab tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "ddb55617-a6a9-40f9-b2ff-b2b626f149ab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:23:58 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-fa96e9c2-cb55-43f1-afc3-25d51ed3b4ab tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "ddb55617-a6a9-40f9-b2ff-b2b626f149ab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:23:58 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 4b6a8c25-d3ca-48ff-b22f-9338200ebc01] Found default for hw_cdrom_bus of ide {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:23:58 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 4b6a8c25-d3ca-48ff-b22f-9338200ebc01] Found default for hw_disk_bus of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:23:58 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 4b6a8c25-d3ca-48ff-b22f-9338200ebc01] Found default for hw_input_bus of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:23:58 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 4b6a8c25-d3ca-48ff-b22f-9338200ebc01] Found default for hw_pointer_model of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:23:58 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 4b6a8c25-d3ca-48ff-b22f-9338200ebc01] Found default for hw_video_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:23:58 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 4b6a8c25-d3ca-48ff-b22f-9338200ebc01] Found default for hw_vif_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:23:58 user nova-compute[74683]: INFO nova.compute.manager [None req-fa96e9c2-cb55-43f1-afc3-25d51ed3b4ab tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Terminating instance
Oct 16 11:23:58 user nova-compute[74683]: DEBUG nova.compute.manager [None req-fa96e9c2-cb55-43f1-afc3-25d51ed3b4ab tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Start destroying the instance on the hypervisor. {{(pid=74683) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 11:23:58 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:58 user nova-compute[74683]: INFO nova.compute.manager [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 4b6a8c25-d3ca-48ff-b22f-9338200ebc01] Took 6.67 seconds to spawn the instance on the hypervisor.
Oct 16 11:23:58 user nova-compute[74683]: DEBUG nova.compute.manager [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 4b6a8c25-d3ca-48ff-b22f-9338200ebc01] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:23:58 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:58 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:58 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:58 user nova-compute[74683]: INFO nova.compute.manager [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 4b6a8c25-d3ca-48ff-b22f-9338200ebc01] Took 7.87 seconds to build instance.
Oct 16 11:23:58 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-319e1d6c-ea25-4c50-ac0e-a44c10fdf1ff tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Lock "4b6a8c25-d3ca-48ff-b22f-9338200ebc01" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.028s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:23:59 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:59 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:59 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Instance destroyed successfully.
Oct 16 11:23:59 user nova-compute[74683]: DEBUG nova.objects.instance [None req-fa96e9c2-cb55-43f1-afc3-25d51ed3b4ab tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lazy-loading 'resources' on Instance uuid ddb55617-a6a9-40f9-b2ff-b2b626f149ab {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:23:59 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-fa96e9c2-cb55-43f1-afc3-25d51ed3b4ab tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:20:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-467008345',display_name='tempest-AttachVolumeNegativeTest-server-467008345',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-467008345',id=19,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDu+D6rI4EEeIVo+0j8q2sc/Z3foRziPciTIQsH5ccfIp/5lh01xYiabgBMALsQdUh1Vh08s9YY3GzoSeik+vZXkup2ugwTiDv+6fF5IKsmbUMHCBWP6BpsK1XRjkAvDOg==',key_name='tempest-keypair-524558883',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:20:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72c66aa774134aa6a873eabffc28ec07',ramdisk_id='',reservation_id='r-lud73uv8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-845934820',owner_user_name='tempest-AttachVolumeNegativeTest-845934820-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:20:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cdc203c025d84efe86e25cfdf75107b8',uuid=ddb55617-a6a9-40f9-b2ff-b2b626f149ab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "027ef7bc-bc4d-4668-9e74-58cc707b99d8", "address": "fa:16:3e:34:9b:23", "network": {"id": "f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-137528169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c66aa774134aa6a873eabffc28ec07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap027ef7bc-bc", "ovs_interfaceid": "027ef7bc-bc4d-4668-9e74-58cc707b99d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:23:59 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-fa96e9c2-cb55-43f1-afc3-25d51ed3b4ab tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Converting VIF {"id": "027ef7bc-bc4d-4668-9e74-58cc707b99d8", "address": "fa:16:3e:34:9b:23", "network": {"id": "f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-137528169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c66aa774134aa6a873eabffc28ec07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap027ef7bc-bc", "ovs_interfaceid": "027ef7bc-bc4d-4668-9e74-58cc707b99d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:23:59 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-fa96e9c2-cb55-43f1-afc3-25d51ed3b4ab tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:34:9b:23,bridge_name='br-int',has_traffic_filtering=True,id=027ef7bc-bc4d-4668-9e74-58cc707b99d8,network=Network(f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap027ef7bc-bc') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:23:59 user nova-compute[74683]: DEBUG os_vif [None req-fa96e9c2-cb55-43f1-afc3-25d51ed3b4ab tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:9b:23,bridge_name='br-int',has_traffic_filtering=True,id=027ef7bc-bc4d-4668-9e74-58cc707b99d8,network=Network(f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap027ef7bc-bc') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:23:59 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:59 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap027ef7bc-bc, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:23:59 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:59 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:23:59 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:59 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=425ca763-12df-40fc-b40d-0fbd129dee37) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:23:59 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:59 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:23:59 user nova-compute[74683]: INFO os_vif [None req-fa96e9c2-cb55-43f1-afc3-25d51ed3b4ab tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:9b:23,bridge_name='br-int',has_traffic_filtering=True,id=027ef7bc-bc4d-4668-9e74-58cc707b99d8,network=Network(f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap027ef7bc-bc')
Oct 16 11:23:59 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-fa96e9c2-cb55-43f1-afc3-25d51ed3b4ab tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Deleting instance files /opt/stack/data/nova/instances/ddb55617-a6a9-40f9-b2ff-b2b626f149ab_del
Oct 16 11:23:59 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-fa96e9c2-cb55-43f1-afc3-25d51ed3b4ab tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Deletion of /opt/stack/data/nova/instances/ddb55617-a6a9-40f9-b2ff-b2b626f149ab_del complete
Oct 16 11:23:59 user nova-compute[74683]: INFO nova.compute.manager [None req-fa96e9c2-cb55-43f1-afc3-25d51ed3b4ab tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Took 1.00 seconds to destroy the instance on the hypervisor.
Oct 16 11:23:59 user nova-compute[74683]: DEBUG oslo.service.loopingcall [None req-fa96e9c2-cb55-43f1-afc3-25d51ed3b4ab tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74683) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 11:23:59 user nova-compute[74683]: DEBUG nova.compute.manager [-] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Deallocating network for instance {{(pid=74683) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 11:23:59 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] deallocate_for_instance() {{(pid=74683) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 11:24:00 user nova-compute[74683]: DEBUG nova.compute.manager [req-1afaf31f-7d5f-410d-8043-5ad0506302d6 req-96a14739-2476-457b-a843-ec331da86067 service nova] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Received event network-vif-unplugged-027ef7bc-bc4d-4668-9e74-58cc707b99d8 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:24:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-1afaf31f-7d5f-410d-8043-5ad0506302d6 req-96a14739-2476-457b-a843-ec331da86067 service nova] Acquiring lock "ddb55617-a6a9-40f9-b2ff-b2b626f149ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:24:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-1afaf31f-7d5f-410d-8043-5ad0506302d6 req-96a14739-2476-457b-a843-ec331da86067 service nova] Lock "ddb55617-a6a9-40f9-b2ff-b2b626f149ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:24:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-1afaf31f-7d5f-410d-8043-5ad0506302d6 req-96a14739-2476-457b-a843-ec331da86067 service nova] Lock "ddb55617-a6a9-40f9-b2ff-b2b626f149ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:24:00 user nova-compute[74683]: DEBUG nova.compute.manager [req-1afaf31f-7d5f-410d-8043-5ad0506302d6 req-96a14739-2476-457b-a843-ec331da86067 service nova] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] No waiting events found dispatching network-vif-unplugged-027ef7bc-bc4d-4668-9e74-58cc707b99d8 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:24:00 user nova-compute[74683]: DEBUG nova.compute.manager [req-1afaf31f-7d5f-410d-8043-5ad0506302d6 req-96a14739-2476-457b-a843-ec331da86067 service nova] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Received event network-vif-unplugged-027ef7bc-bc4d-4668-9e74-58cc707b99d8 for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 11:24:00 user nova-compute[74683]: DEBUG nova.compute.manager [req-1afaf31f-7d5f-410d-8043-5ad0506302d6 req-96a14739-2476-457b-a843-ec331da86067 service nova] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Received event network-vif-plugged-027ef7bc-bc4d-4668-9e74-58cc707b99d8 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:24:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-1afaf31f-7d5f-410d-8043-5ad0506302d6 req-96a14739-2476-457b-a843-ec331da86067 service nova] Acquiring lock "ddb55617-a6a9-40f9-b2ff-b2b626f149ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:24:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-1afaf31f-7d5f-410d-8043-5ad0506302d6 req-96a14739-2476-457b-a843-ec331da86067 service nova] Lock "ddb55617-a6a9-40f9-b2ff-b2b626f149ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:24:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-1afaf31f-7d5f-410d-8043-5ad0506302d6 req-96a14739-2476-457b-a843-ec331da86067 service nova] Lock "ddb55617-a6a9-40f9-b2ff-b2b626f149ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:24:00 user nova-compute[74683]: DEBUG nova.compute.manager [req-1afaf31f-7d5f-410d-8043-5ad0506302d6 req-96a14739-2476-457b-a843-ec331da86067 service nova] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] No waiting events found dispatching network-vif-plugged-027ef7bc-bc4d-4668-9e74-58cc707b99d8 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:24:00 user nova-compute[74683]: WARNING nova.compute.manager [req-1afaf31f-7d5f-410d-8043-5ad0506302d6 req-96a14739-2476-457b-a843-ec331da86067 service nova] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Received unexpected event network-vif-plugged-027ef7bc-bc4d-4668-9e74-58cc707b99d8 for instance with vm_state active and task_state deleting.
Oct 16 11:24:00 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:24:00 user nova-compute[74683]: INFO nova.compute.manager [-] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Took 1.11 seconds to deallocate network for instance.
Oct 16 11:24:00 user nova-compute[74683]: DEBUG nova.compute.manager [req-e8ec29c3-ef49-4504-9354-720425d2ba5c req-c496ef76-e08d-47b1-86a1-91037b2e7f25 service nova] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Received event network-vif-deleted-027ef7bc-bc4d-4668-9e74-58cc707b99d8 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:24:00 user nova-compute[74683]: INFO nova.compute.manager [req-e8ec29c3-ef49-4504-9354-720425d2ba5c req-c496ef76-e08d-47b1-86a1-91037b2e7f25 service nova] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Neutron deleted interface 027ef7bc-bc4d-4668-9e74-58cc707b99d8; detaching it from the instance and deleting it from the info cache
Oct 16 11:24:00 user nova-compute[74683]: DEBUG nova.network.neutron [req-e8ec29c3-ef49-4504-9354-720425d2ba5c req-c496ef76-e08d-47b1-86a1-91037b2e7f25 service nova] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:24:00 user nova-compute[74683]: DEBUG nova.compute.manager [req-e8ec29c3-ef49-4504-9354-720425d2ba5c req-c496ef76-e08d-47b1-86a1-91037b2e7f25 service nova] [instance: ddb55617-a6a9-40f9-b2ff-b2b626f149ab] Detach interface failed, port_id=027ef7bc-bc4d-4668-9e74-58cc707b99d8, reason: Instance ddb55617-a6a9-40f9-b2ff-b2b626f149ab could not be found. {{(pid=74683) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 16 11:24:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-fa96e9c2-cb55-43f1-afc3-25d51ed3b4ab tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:24:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-fa96e9c2-cb55-43f1-afc3-25d51ed3b4ab tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:24:01 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-fa96e9c2-cb55-43f1-afc3-25d51ed3b4ab tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:24:01 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-fa96e9c2-cb55-43f1-afc3-25d51ed3b4ab tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:24:01 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-fa96e9c2-cb55-43f1-afc3-25d51ed3b4ab tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.563s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:24:01 user nova-compute[74683]: INFO nova.scheduler.client.report [None req-fa96e9c2-cb55-43f1-afc3-25d51ed3b4ab tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Deleted allocations for instance ddb55617-a6a9-40f9-b2ff-b2b626f149ab
Oct 16 11:24:01 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-fa96e9c2-cb55-43f1-afc3-25d51ed3b4ab tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "ddb55617-a6a9-40f9-b2ff-b2b626f149ab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.934s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:24:01 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:24:02 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:24:02 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Cleaning up deleted instances {{(pid=74683) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 16 11:24:02 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] There are 0 instances to clean {{(pid=74683) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 16 11:24:04 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Acquiring lock "6300da82-2079-455c-8ab2-9fd13ce9e825" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:24:04 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Lock "6300da82-2079-455c-8ab2-9fd13ce9e825" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:24:04 user nova-compute[74683]: DEBUG nova.compute.manager [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Starting instance... {{(pid=74683) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 11:24:04 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:24:04 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:24:04 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:24:04 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74683) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 11:24:04 user nova-compute[74683]: INFO nova.compute.claims [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Claim successful on node user
Oct 16 11:24:04 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:24:04 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:24:04 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:24:05 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.687s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:24:05 user nova-compute[74683]: DEBUG nova.compute.manager [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Start building networks asynchronously for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 11:24:05 user nova-compute[74683]: DEBUG nova.compute.manager [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Allocating IP information in the background. {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 11:24:05 user nova-compute[74683]: DEBUG nova.network.neutron [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] allocate_for_instance() {{(pid=74683) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 11:24:05 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 11:24:05 user nova-compute[74683]: DEBUG nova.compute.manager [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Start building block device mappings for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 11:24:05 user nova-compute[74683]: DEBUG nova.policy [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '63e1538b7b554db3811903f3df41eee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2acac594f9894f11a7cca5125c538a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74683) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 11:24:05 user nova-compute[74683]: INFO nova.virt.block_device [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Booting with volume 7d2a9abe-890e-4bae-9d88-b64305a6ca3d at /dev/vda
Oct 16 11:24:05 user nova-compute[74683]: DEBUG os_brick.utils [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:24:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:24:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:24:05 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e338d474-ae9e-4ce5-abb9-d5f4f4668ba2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:70b9d336ab7d\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:24:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:24:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:24:05 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce71f1ba-c544-4ce3-8c3a-691ff6c134e7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:24:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:24:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:24:05 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[caaee313-38d1-4088-8d5c-283546ae4919]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:24:05 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[888fd954-f5bd-4809-9528-3d80cafad6f0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:24:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Running cmd (subprocess): nvme version {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:24:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] 'nvme version' failed. Not Retrying. {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:24:05 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] nvme not present on system {{(pid=74683) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 11:24:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:24:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:24:05 user nova-compute[74683]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 11:24:05 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[46148859-1a32-4e46-a83e-267e164b44ac]: (4, '') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:24:05 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74683) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 11:24:05 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 11:24:05 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] LIGHTOS: no hostnqn found. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 11:24:05 user nova-compute[74683]: DEBUG os_brick.utils [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:70b9d336ab7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:24:05 user nova-compute[74683]: DEBUG nova.virt.block_device [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Updating existing volume attachment record: 10d050dc-7678-47a7-bcc7-d28582a6d5e9 {{(pid=74683) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 11:24:05 user nova-compute[74683]: DEBUG nova.network.neutron [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Successfully created port: 8f938207-dce7-4aca-a123-d902f44fd036 {{(pid=74683) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 11:24:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:24:06 user nova-compute[74683]: DEBUG nova.network.neutron [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Successfully updated port: 8f938207-dce7-4aca-a123-d902f44fd036 {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:24:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Acquiring lock "refresh_cache-6300da82-2079-455c-8ab2-9fd13ce9e825" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:24:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Acquired lock "refresh_cache-6300da82-2079-455c-8ab2-9fd13ce9e825" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:24:06 user nova-compute[74683]: DEBUG nova.network.neutron [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:24:06 user nova-compute[74683]: DEBUG nova.compute.manager [req-c7a45439-b29d-4f3a-97da-2e28d4589ce8 req-e1c29608-86b4-4671-9828-6ea7eaf48837 service nova] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Received event network-changed-8f938207-dce7-4aca-a123-d902f44fd036 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:24:06 user nova-compute[74683]: DEBUG nova.compute.manager [req-c7a45439-b29d-4f3a-97da-2e28d4589ce8 req-e1c29608-86b4-4671-9828-6ea7eaf48837 service nova] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Refreshing instance network info cache due to event network-changed-8f938207-dce7-4aca-a123-d902f44fd036. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:24:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c7a45439-b29d-4f3a-97da-2e28d4589ce8 req-e1c29608-86b4-4671-9828-6ea7eaf48837 service nova] Acquiring lock "refresh_cache-6300da82-2079-455c-8ab2-9fd13ce9e825" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:24:06 user nova-compute[74683]: DEBUG nova.network.neutron [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:24:06 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:24:06 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Starting heal instance info cache {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 11:24:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "refresh_cache-45ca3cbb-53d6-4046-9be3-92cc6b71bfad" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:24:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquired lock "refresh_cache-45ca3cbb-53d6-4046-9be3-92cc6b71bfad" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:24:06 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Forcefully refreshing network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 11:24:06 user nova-compute[74683]: DEBUG nova.network.neutron [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Updating instance_info_cache with network_info: [{"id": "8f938207-dce7-4aca-a123-d902f44fd036", "address": "fa:16:3e:fc:f8:bc", "network": {"id": "438d9722-66f5-44e2-b7ee-3e4c9dbe1928", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1131023911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2acac594f9894f11a7cca5125c538a0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f938207-dc", "ovs_interfaceid": "8f938207-dce7-4aca-a123-d902f44fd036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:24:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Releasing lock "refresh_cache-6300da82-2079-455c-8ab2-9fd13ce9e825" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:24:06 user nova-compute[74683]: DEBUG nova.compute.manager [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Instance network_info: |[{"id": "8f938207-dce7-4aca-a123-d902f44fd036", "address": "fa:16:3e:fc:f8:bc", "network": {"id": "438d9722-66f5-44e2-b7ee-3e4c9dbe1928", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1131023911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2acac594f9894f11a7cca5125c538a0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f938207-dc", "ovs_interfaceid": "8f938207-dce7-4aca-a123-d902f44fd036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 11:24:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c7a45439-b29d-4f3a-97da-2e28d4589ce8 req-e1c29608-86b4-4671-9828-6ea7eaf48837 service nova] Acquired lock "refresh_cache-6300da82-2079-455c-8ab2-9fd13ce9e825" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:24:06 user nova-compute[74683]: DEBUG nova.network.neutron [req-c7a45439-b29d-4f3a-97da-2e28d4589ce8 req-e1c29608-86b4-4671-9828-6ea7eaf48837 service nova] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Refreshing network info cache for port 8f938207-dce7-4aca-a123-d902f44fd036 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:24:07 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Updating instance_info_cache with network_info: [{"id": "28029fd9-7463-4b6a-8dc9-c47993f71bb5", "address": "fa:16:3e:fd:e5:2b", "network": {"id": "76ba31b5-c467-45e4-ae9a-111f41fd62a3", "bridge": "br-int", "label": "tempest-TestStampPattern-2049888281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "377cd8de2ae042938a9072f64567a911", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28029fd9-74", "ovs_interfaceid": "28029fd9-7463-4b6a-8dc9-c47993f71bb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:24:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Releasing lock "refresh_cache-45ca3cbb-53d6-4046-9be3-92cc6b71bfad" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:24:07 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Updated the network info_cache for instance {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 11:24:07 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:24:07 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:24:07 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:24:07 user nova-compute[74683]: DEBUG nova.network.neutron [req-c7a45439-b29d-4f3a-97da-2e28d4589ce8 req-e1c29608-86b4-4671-9828-6ea7eaf48837 service nova] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Updated VIF entry in instance network info cache for port 8f938207-dce7-4aca-a123-d902f44fd036. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:24:07 user nova-compute[74683]: DEBUG nova.network.neutron [req-c7a45439-b29d-4f3a-97da-2e28d4589ce8 req-e1c29608-86b4-4671-9828-6ea7eaf48837 service nova] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Updating instance_info_cache with network_info: [{"id": "8f938207-dce7-4aca-a123-d902f44fd036", "address": "fa:16:3e:fc:f8:bc", "network": {"id": "438d9722-66f5-44e2-b7ee-3e4c9dbe1928", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1131023911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2acac594f9894f11a7cca5125c538a0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f938207-dc", "ovs_interfaceid": "8f938207-dce7-4aca-a123-d902f44fd036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:24:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c7a45439-b29d-4f3a-97da-2e28d4589ce8 req-e1c29608-86b4-4671-9828-6ea7eaf48837 service nova] Releasing lock "refresh_cache-6300da82-2079-455c-8ab2-9fd13ce9e825" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:24:07 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:24:07 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Cleaning up deleted instances with incomplete migration  {{(pid=74683) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 16 11:24:08 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-59fe7e67-1624-487a-8305-6cda6ffa07ae tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7ced47a3-311d-4083-94e1-b2d42326e24d is timed out.
Oct 16 11:24:08 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-59fe7e67-1624-487a-8305-6cda6ffa07ae tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Successfully detached device vdb from instance 7ced47a3-311d-4083-94e1-b2d42326e24d from the live domain config.
Oct 16 11:24:08 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59fe7e67-1624-487a-8305-6cda6ffa07ae tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] calling os-brick to detach iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 11:24:08 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-59fe7e67-1624-487a-8305-6cda6ffa07ae tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, {'target_iqn': 'iqn.2010-10.org.openstack:007698a6-0222-4002-8253-d70f69189955', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NijLguCU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:24:08 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-59fe7e67-1624-487a-8305-6cda6ffa07ae tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:24:08 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-59fe7e67-1624-487a-8305-6cda6ffa07ae tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:24:08 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-59fe7e67-1624-487a-8305-6cda6ffa07ae tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:24:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:24:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:24:08 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e1dfc3-a051-4d83-8f5e-11343a8ea828]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:007698a6-0222-4002-8253-d70f69189955\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:24:08 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-59fe7e67-1624-487a-8305-6cda6ffa07ae tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 11:24:08 user nova-compute[74683]: No targets found.
Oct 16 11:24:08 user nova-compute[74683]: iSNS:
Oct 16 11:24:08 user nova-compute[74683]: No targets found.
Oct 16 11:24:08 user nova-compute[74683]: STATIC:
Oct 16 11:24:08 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb
Oct 16 11:24:08 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:24:08 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:24:08 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:007698a6-0222-4002-8253-d70f69189955
Oct 16 11:24:08 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:24:08 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:24:08 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee
Oct 16 11:24:08 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:24:08 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:24:08 user nova-compute[74683]: FIRMWARE:
Oct 16 11:24:08 user nova-compute[74683]: No targets found.
Oct 16 11:24:08 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:24:08 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-59fe7e67-1624-487a-8305-6cda6ffa07ae tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 11:24:08 user nova-compute[74683]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 11:24:08 user nova-compute[74683]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74683) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 11:24:08 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-59fe7e67-1624-487a-8305-6cda6ffa07ae tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:007698a6-0222-4002-8253-d70f69189955', 0)] {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 11:24:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:24:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:24:08 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[24186552-1a31-421c-8af7-495f08a40659]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:007698a6-0222-4002-8253-d70f69189955\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:24:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:24:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:24:08 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ba2890-ee51-4724-99e7-79d6a1a11cf8]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:007698a6-0222-4002-8253-d70f69189955 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:24:08 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-59fe7e67-1624-487a-8305-6cda6ffa07ae tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:24:08 user nova-compute[74683]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee (non-flash)
Oct 16 11:24:08 user nova-compute[74683]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:007698a6-0222-4002-8253-d70f69189955 (non-flash)
Oct 16 11:24:08 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:24:08 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-59fe7e67-1624-487a-8305-6cda6ffa07ae tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:24:08 user nova-compute[74683]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee (non-flash)
Oct 16 11:24:08 user nova-compute[74683]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:007698a6-0222-4002-8253-d70f69189955 (non-flash)
Oct 16 11:24:08 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:24:08 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-59fe7e67-1624-487a-8305-6cda6ffa07ae tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda4c5225f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:007698a6-0222-4002-8253-d70f69189955'): ({'sdb'}, set())}) {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 11:24:08 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-59fe7e67-1624-487a-8305-6cda6ffa07ae tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Removing single pathed devices sdb {{(pid=74683) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 11:24:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:24:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:24:08 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade5734b-3163-49cd-87cf-b765da23e08f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:24:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:24:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:24:08 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[441cc02a-6e4c-4621-a391-75d2e6bb9432]: (4, ('ok\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:24:08 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-59fe7e67-1624-487a-8305-6cda6ffa07ae tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Flushing IO for device /dev/sdb {{(pid=74683) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 11:24:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:24:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:24:08 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc2c3f3-8653-44f5-8075-b02011485b9b]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:24:08 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-59fe7e67-1624-487a-8305-6cda6ffa07ae tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74683) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 11:24:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:24:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.059s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:24:08 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca42e1c-ea94-4a59-83e9-efd83886b51b]: (4, ('1', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:24:08 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-59fe7e67-1624-487a-8305-6cda6ffa07ae tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 11:24:08 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-59fe7e67-1624-487a-8305-6cda6ffa07ae tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] SCSI volumes sdb have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 11:24:08 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-59fe7e67-1624-487a-8305-6cda6ffa07ae tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:007698a6-0222-4002-8253-d70f69189955')] {{(pid=74683) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 11:24:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:007698a6-0222-4002-8253-d70f69189955 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:24:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:007698a6-0222-4002-8253-d70f69189955 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:24:08 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96a0b2a-710f-4b07-aa04-6ee9fd077772]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:24:08 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-59fe7e67-1624-487a-8305-6cda6ffa07ae tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:24:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:007698a6-0222-4002-8253-d70f69189955 -p 172.16.0.220:3260 --logout {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:24:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:007698a6-0222-4002-8253-d70f69189955 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:24:08 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8971d9-cab3-4cea-9435-ba86976d6e49]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:007698a6-0222-4002-8253-d70f69189955, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:007698a6-0222-4002-8253-d70f69189955, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:24:08 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-59fe7e67-1624-487a-8305-6cda6ffa07ae tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:007698a6-0222-4002-8253-d70f69189955, portal: 172.16.0.220,3260]
Oct 16 11:24:08 user nova-compute[74683]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:007698a6-0222-4002-8253-d70f69189955, portal: 172.16.0.220,3260] successful.
Oct 16 11:24:08 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:24:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:007698a6-0222-4002-8253-d70f69189955 -p 172.16.0.220:3260 --op delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:24:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:007698a6-0222-4002-8253-d70f69189955 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:24:08 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d23a5e-0bf7-4910-adbd-46a1c93a1788]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:24:08 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-59fe7e67-1624-487a-8305-6cda6ffa07ae tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:24:08 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-59fe7e67-1624-487a-8305-6cda6ffa07ae tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:24:08 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-59fe7e67-1624-487a-8305-6cda6ffa07ae tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] <== disconnect_volume: return (328ms) None {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:24:08 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59fe7e67-1624-487a-8305-6cda6ffa07ae tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Disconnected iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 11:24:09 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:24:10 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:24:11 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:24:11 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:24:12 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:24:12 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74683) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 11:24:12 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:24:12 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:24:12 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:24:12 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:24:12 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Auditing locally available compute resources for user (node: user) {{(pid=74683) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 11:24:12 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b6a8c25-d3ca-48ff-b22f-9338200ebc01/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:24:13 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b6a8c25-d3ca-48ff-b22f-9338200ebc01/disk --force-share --output=json" returned: 0 in 0.333s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:24:13 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b6a8c25-d3ca-48ff-b22f-9338200ebc01/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:24:13 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b6a8c25-d3ca-48ff-b22f-9338200ebc01/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:24:13 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45ca3cbb-53d6-4046-9be3-92cc6b71bfad/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:24:13 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45ca3cbb-53d6-4046-9be3-92cc6b71bfad/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:24:13 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45ca3cbb-53d6-4046-9be3-92cc6b71bfad/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:24:13 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45ca3cbb-53d6-4046-9be3-92cc6b71bfad/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:24:13 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9fc5a9-8659-497c-bb07-af52fe2e1761/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:24:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9fc5a9-8659-497c-bb07-af52fe2e1761/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:24:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9fc5a9-8659-497c-bb07-af52fe2e1761/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:24:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9fc5a9-8659-497c-bb07-af52fe2e1761/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:24:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:24:14 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:24:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:24:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:24:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:24:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.rescue --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:24:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:24:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.rescue --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:24:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:24:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:24:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:24:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:24:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:24:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84bb680-a542-4cb2-b0c5-67a210c25e9e/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:24:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84bb680-a542-4cb2-b0c5-67a210c25e9e/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:24:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84bb680-a542-4cb2-b0c5-67a210c25e9e/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:24:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84bb680-a542-4cb2-b0c5-67a210c25e9e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:24:15 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:24:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:24:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:24:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:24:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:24:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:24:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:24:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:24:16 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:24:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:24:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b79d385-e512-4297-9aa4-2b9bb0cac23c/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:24:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b79d385-e512-4297-9aa4-2b9bb0cac23c/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:24:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b79d385-e512-4297-9aa4-2b9bb0cac23c/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:24:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b79d385-e512-4297-9aa4-2b9bb0cac23c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:24:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ced47a3-311d-4083-94e1-b2d42326e24d/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:24:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ced47a3-311d-4083-94e1-b2d42326e24d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:24:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ced47a3-311d-4083-94e1-b2d42326e24d/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:24:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ced47a3-311d-4083-94e1-b2d42326e24d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:24:17 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:24:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b4eaccb-e068-4e8a-9084-16229815b1d7/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:24:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b4eaccb-e068-4e8a-9084-16229815b1d7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:24:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b4eaccb-e068-4e8a-9084-16229815b1d7/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:24:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b4eaccb-e068-4e8a-9084-16229815b1d7/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:24:18 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:24:18 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:24:18 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Hypervisor/Node resource view: name=user free_ram=7381MB free_disk=25.03342056274414GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74683) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 11:24:18 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:24:18 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:24:18 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 18a77385-fab9-4ea0-8aa6-666cf7e798a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:24:18 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance d5e55361-d9ed-4d07-91b0-ec4d08b2e817 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:24:18 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 45ca3cbb-53d6-4046-9be3-92cc6b71bfad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:24:18 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance e84bb680-a542-4cb2-b0c5-67a210c25e9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:24:18 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance edd01413-1f8a-49e3-aa3c-ecb19c62afae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:24:18 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 7ced47a3-311d-4083-94e1-b2d42326e24d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:24:18 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 6c9fc5a9-8659-497c-bb07-af52fe2e1761 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:24:18 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 9b8ba94f-43cc-4f06-bcd9-83935ccbe117 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:24:18 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance b91af786-36e3-4815-811f-fb3c055e758d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:24:18 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 0b79d385-e512-4297-9aa4-2b9bb0cac23c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:24:18 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 4b4eaccb-e068-4e8a-9084-16229815b1d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:24:18 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 4b6a8c25-d3ca-48ff-b22f-9338200ebc01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:24:18 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 6300da82-2079-455c-8ab2-9fd13ce9e825 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:24:18 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 11:24:18 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 11:24:18 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Refreshing inventories for resource provider 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 16 11:24:18 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Updating ProviderTree inventory for provider 7142d606-df50-4cbe-b5ed-1802caa31862 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 16 11:24:18 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Updating inventory in ProviderTree for provider 7142d606-df50-4cbe-b5ed-1802caa31862 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 16 11:24:18 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Refreshing aggregate associations for resource provider 7142d606-df50-4cbe-b5ed-1802caa31862, aggregates: None {{(pid=74683) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 16 11:24:18 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Refreshing trait associations for resource provider 7142d606-df50-4cbe-b5ed-1802caa31862, traits: COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VMVGA {{(pid=74683) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 16 11:24:19 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:24:19 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:24:19 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Compute_service record updated for user:user {{(pid=74683) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 11:24:19 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.930s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:24:19 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:24:20 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:24:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG nova.objects.instance [None req-59fe7e67-1624-487a-8305-6cda6ffa07ae tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lazy-loading 'flavor' on Instance uuid 7ced47a3-311d-4083-94e1-b2d42326e24d {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-59fe7e67-1624-487a-8305-6cda6ffa07ae tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lock "7ced47a3-311d-4083-94e1-b2d42326e24d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 35.833s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG nova.compute.manager [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Start spawning the instance on the hypervisor. {{(pid=74683) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Creating instance directory {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 11:24:23 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Creating image(s)
Oct 16 11:24:23 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Did not create local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Ensure instance console log exists: /opt/stack/data/nova/instances/6300da82-2079-455c-8ab2-9fd13ce9e825/console.log {{(pid=74683) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Start _get_guest_xml network_info=[{"id": "8f938207-dce7-4aca-a123-d902f44fd036", "address": "fa:16:3e:fc:f8:bc", "network": {"id": "438d9722-66f5-44e2-b7ee-3e4c9dbe1928", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1131023911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2acac594f9894f11a7cca5125c538a0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f938207-dc", "ovs_interfaceid": "8f938207-dce7-4aca-a123-d902f44fd036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KhyBgrAX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6300da82-2079-455c-8ab2-9fd13ce9e825', 'attached_at': '', 'detached_at': '', 'volume_id': '7d2a9abe-890e-4bae-9d88-b64305a6ca3d', 'serial': '7d2a9abe-890e-4bae-9d88-b64305a6ca3d'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': '10d050dc-7678-47a7-bcc7-d28582a6d5e9', 'volume_type': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:24:23 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:24:23 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:24:23 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Calling os-brick to attach iSCSI Volume {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KhyBgrAX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:24:23 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:24:23 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:24:23 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:24:23 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:24:23 user nova-compute[74683]: INFO os_brick.initiator.connectors.iscsi [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 11:24:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d -p 172.16.0.220:3260 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60416aa-367e-4daf-8d84-ede3b5db5acd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 11:24:23 user nova-compute[74683]:  {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d -p 172.16.0.220:3260 --interface default --op new {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd2e3f3-d466-468f-930a-84ef563279fb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d] added\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d] added
Oct 16 11:24:23 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31793bb-7ca3-4821-915c-c14e9977043b]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08dfcbd-5d75-4498-a2fd-ec35c2d9b864]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KhyBgrAX {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KhyBgrAX" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0c17ef-c746-45d8-9726-9ecde6d3da29]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KhyBgrAX'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[65bc5950-eb3d-4ade-8fd1-e4f513e2a986]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d4204d-5d9e-4ed9-857b-7fb940281d00]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:24:23 user nova-compute[74683]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee (non-flash)
Oct 16 11:24:23 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:24:23 user nova-compute[74683]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee (non-flash)
Oct 16 11:24:23 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d -p 172.16.0.220:3260 --login {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a57d3b-bbd0-4b3c-8ead-721749814d27]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d, portal: 172.16.0.220,3260]
Oct 16 11:24:23 user nova-compute[74683]: Login to [iface: default, target: iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d, portal: 172.16.0.220,3260] successful.
Oct 16 11:24:23 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b116fca-02d2-4725-bbd8-e2d68e43258f]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[27278023-e452-4aa7-8c48-43224572ca2f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:24:23 user nova-compute[74683]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee (non-flash)
Oct 16 11:24:23 user nova-compute[74683]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d (non-flash)
Oct 16 11:24:23 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:24:23 user nova-compute[74683]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee (non-flash)
Oct 16 11:24:23 user nova-compute[74683]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d (non-flash)
Oct 16 11:24:23 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Connected to 172.16.0.220:3260 {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] HCTL ('33', '-', '-', 0) found on session 25 with lun 0 {{(pid=74683) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74683) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0bb6e43-3237-46a6-b98a-0f39782375aa]: (4, ('- - 0', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:24:23 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KhyBgrAX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 11:24:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:24:24 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:24:24 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23832343862656631', 'path': '/dev/sdb'} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:24:24 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23832343862656631', 'path': '/dev/sdb'} {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 11:24:24 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:24:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2008791236',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2008791236',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOa68DSLJRhCANBPDVkGCmU7Av1Udl+gScSEyqoeBUYh/e3GGLjoSHFS9vMAG6uKONY2e/UESa8D9i77smMN1onMgIj8+r/Pjj2s1FLJPej0ypSN81xjWnl2bNPHPjSwJQ==',key_name='tempest-keypair-1562506741',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2acac594f9894f11a7cca5125c538a0b',ramdisk_id='',reservation_id='r-n6dkjkrr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1612434098',owner_user_name='tempest-ServerActionsV293TestJSON-1612434098-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:24:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63e1538b7b554db3811903f3df41eee3',uuid=6300da82-2079-455c-8ab2-9fd13ce9e825,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f938207-dce7-4aca-a123-d902f44fd036", "address": "fa:16:3e:fc:f8:bc", "network": {"id": "438d9722-66f5-44e2-b7ee-3e4c9dbe1928", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1131023911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2acac594f9894f11a7cca5125c538a0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f938207-dc", "ovs_interfaceid": "8f938207-dce7-4aca-a123-d902f44fd036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:24:24 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Converting VIF {"id": "8f938207-dce7-4aca-a123-d902f44fd036", "address": "fa:16:3e:fc:f8:bc", "network": {"id": "438d9722-66f5-44e2-b7ee-3e4c9dbe1928", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1131023911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2acac594f9894f11a7cca5125c538a0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f938207-dc", "ovs_interfaceid": "8f938207-dce7-4aca-a123-d902f44fd036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:24:24 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:f8:bc,bridge_name='br-int',has_traffic_filtering=True,id=8f938207-dce7-4aca-a123-d902f44fd036,network=Network(438d9722-66f5-44e2-b7ee-3e4c9dbe1928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f938207-dc') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:24:24 user nova-compute[74683]: DEBUG nova.objects.instance [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Lazy-loading 'pci_devices' on Instance uuid 6300da82-2079-455c-8ab2-9fd13ce9e825 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:24:24 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:24:24 user nova-compute[74683]:   <uuid>6300da82-2079-455c-8ab2-9fd13ce9e825</uuid>
Oct 16 11:24:24 user nova-compute[74683]:   <name>instance-0000001c</name>
Oct 16 11:24:24 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:24:24 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:24:24 user nova-compute[74683]:   <metadata>
Oct 16 11:24:24 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:24:24 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:24:24 user nova-compute[74683]:       <nova:name>tempest-ServerActionsV293TestJSON-server-2008791236</nova:name>
Oct 16 11:24:24 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:24:23</nova:creationTime>
Oct 16 11:24:24 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:24:24 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:24:24 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:24:24 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:24:24 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:24:24 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:24:24 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:24:24 user nova-compute[74683]:       <nova:owner>
Oct 16 11:24:24 user nova-compute[74683]:         <nova:user uuid="63e1538b7b554db3811903f3df41eee3">tempest-ServerActionsV293TestJSON-1612434098-project-member</nova:user>
Oct 16 11:24:24 user nova-compute[74683]:         <nova:project uuid="2acac594f9894f11a7cca5125c538a0b">tempest-ServerActionsV293TestJSON-1612434098</nova:project>
Oct 16 11:24:24 user nova-compute[74683]:       </nova:owner>
Oct 16 11:24:24 user nova-compute[74683]:       <nova:ports>
Oct 16 11:24:24 user nova-compute[74683]:         <nova:port uuid="8f938207-dce7-4aca-a123-d902f44fd036">
Oct 16 11:24:24 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 16 11:24:24 user nova-compute[74683]:         </nova:port>
Oct 16 11:24:24 user nova-compute[74683]:       </nova:ports>
Oct 16 11:24:24 user nova-compute[74683]:     </nova:instance>
Oct 16 11:24:24 user nova-compute[74683]:   </metadata>
Oct 16 11:24:24 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:24:24 user nova-compute[74683]:     <system>
Oct 16 11:24:24 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:24:24 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:24:24 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:24:24 user nova-compute[74683]:       <entry name="serial">6300da82-2079-455c-8ab2-9fd13ce9e825</entry>
Oct 16 11:24:24 user nova-compute[74683]:       <entry name="uuid">6300da82-2079-455c-8ab2-9fd13ce9e825</entry>
Oct 16 11:24:24 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:24:24 user nova-compute[74683]:     </system>
Oct 16 11:24:24 user nova-compute[74683]:   </sysinfo>
Oct 16 11:24:24 user nova-compute[74683]:   <os>
Oct 16 11:24:24 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:24:24 user nova-compute[74683]:     <boot dev="hd"/>
Oct 16 11:24:24 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:24:24 user nova-compute[74683]:   </os>
Oct 16 11:24:24 user nova-compute[74683]:   <features>
Oct 16 11:24:24 user nova-compute[74683]:     <acpi/>
Oct 16 11:24:24 user nova-compute[74683]:     <apic/>
Oct 16 11:24:24 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:24:24 user nova-compute[74683]:   </features>
Oct 16 11:24:24 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:24:24 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:24:24 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:24:24 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:24:24 user nova-compute[74683]:   </clock>
Oct 16 11:24:24 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:24:24 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:24:24 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:24:24 user nova-compute[74683]:   </cpu>
Oct 16 11:24:24 user nova-compute[74683]:   <devices>
Oct 16 11:24:24 user nova-compute[74683]:     <disk type="block" device="disk">
Oct 16 11:24:24 user nova-compute[74683]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:24:24 user nova-compute[74683]:       <source dev="/dev/sdb"/>
Oct 16 11:24:24 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:24:24 user nova-compute[74683]:       <serial>7d2a9abe-890e-4bae-9d88-b64305a6ca3d</serial>
Oct 16 11:24:24 user nova-compute[74683]:     </disk>
Oct 16 11:24:24 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:24:24 user nova-compute[74683]:       <mac address="fa:16:3e:fc:f8:bc"/>
Oct 16 11:24:24 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:24:24 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:24:24 user nova-compute[74683]:       <target dev="tap8f938207-dc"/>
Oct 16 11:24:24 user nova-compute[74683]:     </interface>
Oct 16 11:24:24 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:24:24 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/6300da82-2079-455c-8ab2-9fd13ce9e825/console.log" append="off"/>
Oct 16 11:24:24 user nova-compute[74683]:     </serial>
Oct 16 11:24:24 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:24:24 user nova-compute[74683]:     <video>
Oct 16 11:24:24 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:24:24 user nova-compute[74683]:     </video>
Oct 16 11:24:24 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:24:24 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:24:24 user nova-compute[74683]:     </rng>
Oct 16 11:24:24 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:24:24 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:24:24 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:24:24 user nova-compute[74683]:     </memballoon>
Oct 16 11:24:24 user nova-compute[74683]:   </devices>
Oct 16 11:24:24 user nova-compute[74683]: </domain>
Oct 16 11:24:24 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:24:24 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:24:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2008791236',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2008791236',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOa68DSLJRhCANBPDVkGCmU7Av1Udl+gScSEyqoeBUYh/e3GGLjoSHFS9vMAG6uKONY2e/UESa8D9i77smMN1onMgIj8+r/Pjj2s1FLJPej0ypSN81xjWnl2bNPHPjSwJQ==',key_name='tempest-keypair-1562506741',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2acac594f9894f11a7cca5125c538a0b',ramdisk_id='',reservation_id='r-n6dkjkrr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1612434098',owner_user_name='tempest-ServerActionsV293TestJSON-1612434098-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:24:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63e1538b7b554db3811903f3df41eee3',uuid=6300da82-2079-455c-8ab2-9fd13ce9e825,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f938207-dce7-4aca-a123-d902f44fd036", "address": "fa:16:3e:fc:f8:bc", "network": {"id": "438d9722-66f5-44e2-b7ee-3e4c9dbe1928", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1131023911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2acac594f9894f11a7cca5125c538a0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f938207-dc", "ovs_interfaceid": "8f938207-dce7-4aca-a123-d902f44fd036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:24:24 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Converting VIF {"id": "8f938207-dce7-4aca-a123-d902f44fd036", "address": "fa:16:3e:fc:f8:bc", "network": {"id": "438d9722-66f5-44e2-b7ee-3e4c9dbe1928", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1131023911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2acac594f9894f11a7cca5125c538a0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f938207-dc", "ovs_interfaceid": "8f938207-dce7-4aca-a123-d902f44fd036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:24:24 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:f8:bc,bridge_name='br-int',has_traffic_filtering=True,id=8f938207-dce7-4aca-a123-d902f44fd036,network=Network(438d9722-66f5-44e2-b7ee-3e4c9dbe1928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f938207-dc') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:24:24 user nova-compute[74683]: DEBUG os_vif [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:f8:bc,bridge_name='br-int',has_traffic_filtering=True,id=8f938207-dce7-4aca-a123-d902f44fd036,network=Network(438d9722-66f5-44e2-b7ee-3e4c9dbe1928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f938207-dc') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:24:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:24:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:24:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:24:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:24:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c8c6c83b-f308-5692-9b8e-a25a27cfc054', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:24:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:24:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:24:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:24:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f938207-dc, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:24:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8f938207-dc, col_values=(('qos', UUID('beb52868-85a2-4b00-930c-133e825400ab')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:24:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8f938207-dc, col_values=(('external_ids', {'iface-id': '8f938207-dce7-4aca-a123-d902f44fd036', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:f8:bc', 'vm-uuid': '6300da82-2079-455c-8ab2-9fd13ce9e825'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:24:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:24:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:24:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:24:24 user nova-compute[74683]: INFO os_vif [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:f8:bc,bridge_name='br-int',has_traffic_filtering=True,id=8f938207-dce7-4aca-a123-d902f44fd036,network=Network(438d9722-66f5-44e2-b7ee-3e4c9dbe1928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f938207-dc')
Oct 16 11:24:25 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:24:25 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] No VIF found with MAC fa:16:3e:fc:f8:bc, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:24:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:24:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:24:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:24:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:24:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:24:26 user nova-compute[74683]: DEBUG nova.compute.manager [req-e18262f2-9010-404d-9e8c-ca1ae4c71dc5 req-611367ea-d47b-476e-84cf-1849c31748ae service nova] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Received event network-vif-plugged-8f938207-dce7-4aca-a123-d902f44fd036 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:24:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e18262f2-9010-404d-9e8c-ca1ae4c71dc5 req-611367ea-d47b-476e-84cf-1849c31748ae service nova] Acquiring lock "6300da82-2079-455c-8ab2-9fd13ce9e825-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:24:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e18262f2-9010-404d-9e8c-ca1ae4c71dc5 req-611367ea-d47b-476e-84cf-1849c31748ae service nova] Lock "6300da82-2079-455c-8ab2-9fd13ce9e825-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:24:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e18262f2-9010-404d-9e8c-ca1ae4c71dc5 req-611367ea-d47b-476e-84cf-1849c31748ae service nova] Lock "6300da82-2079-455c-8ab2-9fd13ce9e825-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:24:26 user nova-compute[74683]: DEBUG nova.compute.manager [req-e18262f2-9010-404d-9e8c-ca1ae4c71dc5 req-611367ea-d47b-476e-84cf-1849c31748ae service nova] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] No waiting events found dispatching network-vif-plugged-8f938207-dce7-4aca-a123-d902f44fd036 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:24:26 user nova-compute[74683]: WARNING nova.compute.manager [req-e18262f2-9010-404d-9e8c-ca1ae4c71dc5 req-611367ea-d47b-476e-84cf-1849c31748ae service nova] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Received unexpected event network-vif-plugged-8f938207-dce7-4aca-a123-d902f44fd036 for instance with vm_state building and task_state spawning.
Oct 16 11:24:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:24:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:24:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:24:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:24:28 user nova-compute[74683]: DEBUG nova.compute.manager [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Instance event wait completed in 0 seconds for  {{(pid=74683) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 11:24:28 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Guest created on hypervisor {{(pid=74683) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 11:24:28 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Instance spawned successfully.
Oct 16 11:24:28 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 11:24:28 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Found default for hw_cdrom_bus of ide {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:24:28 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Found default for hw_disk_bus of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:24:28 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Found default for hw_input_bus of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:24:28 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Found default for hw_pointer_model of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:24:28 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Found default for hw_video_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:24:28 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Found default for hw_vif_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:24:28 user nova-compute[74683]: INFO nova.compute.manager [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Took 5.15 seconds to spawn the instance on the hypervisor.
Oct 16 11:24:28 user nova-compute[74683]: DEBUG nova.compute.manager [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:24:28 user nova-compute[74683]: INFO nova.compute.manager [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Took 24.43 seconds to build instance.
Oct 16 11:24:28 user nova-compute[74683]: DEBUG nova.compute.manager [req-58af0246-d12e-4eeb-85e4-b74805d22598 req-6f84a52f-5c8f-4213-a0bb-4da07685007c service nova] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Received event network-vif-plugged-8f938207-dce7-4aca-a123-d902f44fd036 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:24:28 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-58af0246-d12e-4eeb-85e4-b74805d22598 req-6f84a52f-5c8f-4213-a0bb-4da07685007c service nova] Acquiring lock "6300da82-2079-455c-8ab2-9fd13ce9e825-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:24:28 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-58af0246-d12e-4eeb-85e4-b74805d22598 req-6f84a52f-5c8f-4213-a0bb-4da07685007c service nova] Lock "6300da82-2079-455c-8ab2-9fd13ce9e825-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:24:28 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-58af0246-d12e-4eeb-85e4-b74805d22598 req-6f84a52f-5c8f-4213-a0bb-4da07685007c service nova] Lock "6300da82-2079-455c-8ab2-9fd13ce9e825-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:24:28 user nova-compute[74683]: DEBUG nova.compute.manager [req-58af0246-d12e-4eeb-85e4-b74805d22598 req-6f84a52f-5c8f-4213-a0bb-4da07685007c service nova] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] No waiting events found dispatching network-vif-plugged-8f938207-dce7-4aca-a123-d902f44fd036 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:24:28 user nova-compute[74683]: WARNING nova.compute.manager [req-58af0246-d12e-4eeb-85e4-b74805d22598 req-6f84a52f-5c8f-4213-a0bb-4da07685007c service nova] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Received unexpected event network-vif-plugged-8f938207-dce7-4aca-a123-d902f44fd036 for instance with vm_state active and task_state None.
Oct 16 11:24:28 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b5fb47a8-91c8-4102-aa78-b6e938acfe98 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Lock "6300da82-2079-455c-8ab2-9fd13ce9e825" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.564s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:24:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:24:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:24:34 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:24:38 user nova-compute[74683]: DEBUG nova.compute.manager [req-9e452547-3ba1-43fd-98c9-fdd5b233f803 req-0466dcd1-7649-4305-8525-6e2f26344f20 service nova] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Received event network-changed-a94c53f7-4f4c-42e6-b121-9d309544dae8 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:24:38 user nova-compute[74683]: DEBUG nova.compute.manager [req-9e452547-3ba1-43fd-98c9-fdd5b233f803 req-0466dcd1-7649-4305-8525-6e2f26344f20 service nova] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Refreshing instance network info cache due to event network-changed-a94c53f7-4f4c-42e6-b121-9d309544dae8. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:24:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-9e452547-3ba1-43fd-98c9-fdd5b233f803 req-0466dcd1-7649-4305-8525-6e2f26344f20 service nova] Acquiring lock "refresh_cache-7ced47a3-311d-4083-94e1-b2d42326e24d" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:24:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-9e452547-3ba1-43fd-98c9-fdd5b233f803 req-0466dcd1-7649-4305-8525-6e2f26344f20 service nova] Acquired lock "refresh_cache-7ced47a3-311d-4083-94e1-b2d42326e24d" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:24:38 user nova-compute[74683]: DEBUG nova.network.neutron [req-9e452547-3ba1-43fd-98c9-fdd5b233f803 req-0466dcd1-7649-4305-8525-6e2f26344f20 service nova] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Refreshing network info cache for port a94c53f7-4f4c-42e6-b121-9d309544dae8 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:24:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b5574cd9-a1e4-40bd-b1cb-12928a4df4a1 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Acquiring lock "7ced47a3-311d-4083-94e1-b2d42326e24d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:24:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b5574cd9-a1e4-40bd-b1cb-12928a4df4a1 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lock "7ced47a3-311d-4083-94e1-b2d42326e24d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:24:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b5574cd9-a1e4-40bd-b1cb-12928a4df4a1 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Acquiring lock "7ced47a3-311d-4083-94e1-b2d42326e24d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:24:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b5574cd9-a1e4-40bd-b1cb-12928a4df4a1 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lock "7ced47a3-311d-4083-94e1-b2d42326e24d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:24:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b5574cd9-a1e4-40bd-b1cb-12928a4df4a1 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lock "7ced47a3-311d-4083-94e1-b2d42326e24d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:24:38 user nova-compute[74683]: INFO nova.compute.manager [None req-b5574cd9-a1e4-40bd-b1cb-12928a4df4a1 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Terminating instance
Oct 16 11:24:38 user nova-compute[74683]: DEBUG nova.compute.manager [None req-b5574cd9-a1e4-40bd-b1cb-12928a4df4a1 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Start destroying the instance on the hypervisor. {{(pid=74683) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 11:24:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:24:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:24:39 user nova-compute[74683]: DEBUG nova.network.neutron [req-9e452547-3ba1-43fd-98c9-fdd5b233f803 req-0466dcd1-7649-4305-8525-6e2f26344f20 service nova] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Updated VIF entry in instance network info cache for port a94c53f7-4f4c-42e6-b121-9d309544dae8. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:24:39 user nova-compute[74683]: DEBUG nova.network.neutron [req-9e452547-3ba1-43fd-98c9-fdd5b233f803 req-0466dcd1-7649-4305-8525-6e2f26344f20 service nova] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Updating instance_info_cache with network_info: [{"id": "a94c53f7-4f4c-42e6-b121-9d309544dae8", "address": "fa:16:3e:33:b2:31", "network": {"id": "76ba31b5-c467-45e4-ae9a-111f41fd62a3", "bridge": "br-int", "label": "tempest-TestStampPattern-2049888281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "377cd8de2ae042938a9072f64567a911", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa94c53f7-4f", "ovs_interfaceid": "a94c53f7-4f4c-42e6-b121-9d309544dae8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:24:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:24:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-9e452547-3ba1-43fd-98c9-fdd5b233f803 req-0466dcd1-7649-4305-8525-6e2f26344f20 service nova] Releasing lock "refresh_cache-7ced47a3-311d-4083-94e1-b2d42326e24d" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:24:39 user nova-compute[74683]: DEBUG nova.compute.manager [req-c50d6008-a146-4693-bd02-aaea9f50ca8d req-80b5f9c0-591b-48b7-b7c9-90717fcc084b service nova] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Received event network-vif-unplugged-a94c53f7-4f4c-42e6-b121-9d309544dae8 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:24:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c50d6008-a146-4693-bd02-aaea9f50ca8d req-80b5f9c0-591b-48b7-b7c9-90717fcc084b service nova] Acquiring lock "7ced47a3-311d-4083-94e1-b2d42326e24d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:24:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c50d6008-a146-4693-bd02-aaea9f50ca8d req-80b5f9c0-591b-48b7-b7c9-90717fcc084b service nova] Lock "7ced47a3-311d-4083-94e1-b2d42326e24d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:24:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c50d6008-a146-4693-bd02-aaea9f50ca8d req-80b5f9c0-591b-48b7-b7c9-90717fcc084b service nova] Lock "7ced47a3-311d-4083-94e1-b2d42326e24d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:24:39 user nova-compute[74683]: DEBUG nova.compute.manager [req-c50d6008-a146-4693-bd02-aaea9f50ca8d req-80b5f9c0-591b-48b7-b7c9-90717fcc084b service nova] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] No waiting events found dispatching network-vif-unplugged-a94c53f7-4f4c-42e6-b121-9d309544dae8 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:24:39 user nova-compute[74683]: DEBUG nova.compute.manager [req-c50d6008-a146-4693-bd02-aaea9f50ca8d req-80b5f9c0-591b-48b7-b7c9-90717fcc084b service nova] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Received event network-vif-unplugged-a94c53f7-4f4c-42e6-b121-9d309544dae8 for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 11:24:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:24:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:24:39 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Instance destroyed successfully.
Oct 16 11:24:39 user nova-compute[74683]: DEBUG nova.objects.instance [None req-b5574cd9-a1e4-40bd-b1cb-12928a4df4a1 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lazy-loading 'resources' on Instance uuid 7ced47a3-311d-4083-94e1-b2d42326e24d {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:24:39 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-b5574cd9-a1e4-40bd-b1cb-12928a4df4a1 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:21:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-537257495',display_name='tempest-TestStampPattern-server-537257495',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-537257495',id=20,image_ref='cd8467ed-4eb3-4557-be1f-e9de42bea9f9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFV+ROpInHshi5FjeDxPiEyFZ7Qvi9jeJ0//dAB7L9KvmXxPyMWLDkzIIO+4mTNqVHH1o36yJrMR626Ju/qnnIOZjnMoP87MpQ3Ptrg2AmfvntWHi+q/nHH1XQPsx2j/Gw==',key_name='tempest-TestStampPattern-1014736713',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:21:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='377cd8de2ae042938a9072f64567a911',ramdisk_id='',reservation_id='r-bv00xcgp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='45ca3cbb-53d6-4046-9be3-92cc6b71bfad',image_min_disk='1',image_min_ram='0',image_owner_id='377cd8de2ae042938a9072f64567a911',image_owner_project_name='tempest-TestStampPattern-1657953611',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1657953611-project-member',image_user_id='ff1b11c3ed3b4ffdbe6a3feada64f5ec',owner_project_name='tempest-TestStampPattern-1657953611',owner_user_name='tempest-TestStampPattern-1657953611-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:21:38Z,user_data=None,user_id='ff1b11c3ed3b4ffdbe6a3feada64f5ec',uuid=7ced47a3-311d-4083-94e1-b2d42326e24d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a94c53f7-4f4c-42e6-b121-9d309544dae8", "address": "fa:16:3e:33:b2:31", "network": {"id": "76ba31b5-c467-45e4-ae9a-111f41fd62a3", "bridge": "br-int", "label": "tempest-TestStampPattern-2049888281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "377cd8de2ae042938a9072f64567a911", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa94c53f7-4f", "ovs_interfaceid": "a94c53f7-4f4c-42e6-b121-9d309544dae8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:24:39 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-b5574cd9-a1e4-40bd-b1cb-12928a4df4a1 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Converting VIF {"id": "a94c53f7-4f4c-42e6-b121-9d309544dae8", "address": "fa:16:3e:33:b2:31", "network": {"id": "76ba31b5-c467-45e4-ae9a-111f41fd62a3", "bridge": "br-int", "label": "tempest-TestStampPattern-2049888281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "377cd8de2ae042938a9072f64567a911", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa94c53f7-4f", "ovs_interfaceid": "a94c53f7-4f4c-42e6-b121-9d309544dae8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:24:39 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-b5574cd9-a1e4-40bd-b1cb-12928a4df4a1 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:b2:31,bridge_name='br-int',has_traffic_filtering=True,id=a94c53f7-4f4c-42e6-b121-9d309544dae8,network=Network(76ba31b5-c467-45e4-ae9a-111f41fd62a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa94c53f7-4f') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:24:39 user nova-compute[74683]: DEBUG os_vif [None req-b5574cd9-a1e4-40bd-b1cb-12928a4df4a1 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:b2:31,bridge_name='br-int',has_traffic_filtering=True,id=a94c53f7-4f4c-42e6-b121-9d309544dae8,network=Network(76ba31b5-c467-45e4-ae9a-111f41fd62a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa94c53f7-4f') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:24:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:24:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa94c53f7-4f, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:24:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:24:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:24:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:24:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3d2433b6-66fc-4d56-b290-c9fb9fab37fe) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:24:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:24:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:24:39 user nova-compute[74683]: INFO os_vif [None req-b5574cd9-a1e4-40bd-b1cb-12928a4df4a1 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:b2:31,bridge_name='br-int',has_traffic_filtering=True,id=a94c53f7-4f4c-42e6-b121-9d309544dae8,network=Network(76ba31b5-c467-45e4-ae9a-111f41fd62a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa94c53f7-4f')
Oct 16 11:24:39 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-b5574cd9-a1e4-40bd-b1cb-12928a4df4a1 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Deleting instance files /opt/stack/data/nova/instances/7ced47a3-311d-4083-94e1-b2d42326e24d_del
Oct 16 11:24:39 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-b5574cd9-a1e4-40bd-b1cb-12928a4df4a1 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Deletion of /opt/stack/data/nova/instances/7ced47a3-311d-4083-94e1-b2d42326e24d_del complete
Oct 16 11:24:39 user nova-compute[74683]: INFO nova.compute.manager [None req-b5574cd9-a1e4-40bd-b1cb-12928a4df4a1 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Took 0.97 seconds to destroy the instance on the hypervisor.
Oct 16 11:24:39 user nova-compute[74683]: DEBUG oslo.service.loopingcall [None req-b5574cd9-a1e4-40bd-b1cb-12928a4df4a1 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74683) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 11:24:39 user nova-compute[74683]: DEBUG nova.compute.manager [-] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Deallocating network for instance {{(pid=74683) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 11:24:39 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] deallocate_for_instance() {{(pid=74683) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 11:24:40 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:24:40 user nova-compute[74683]: INFO nova.compute.manager [-] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Took 0.50 seconds to deallocate network for instance.
Oct 16 11:24:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b5574cd9-a1e4-40bd-b1cb-12928a4df4a1 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:24:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b5574cd9-a1e4-40bd-b1cb-12928a4df4a1 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:24:40 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-b5574cd9-a1e4-40bd-b1cb-12928a4df4a1 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:24:40 user nova-compute[74683]: DEBUG nova.compute.manager [req-feca254c-788a-42dd-8372-4d6446a95216 req-5910d250-e52a-402c-8f96-bd29c586bad8 service nova] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Received event network-vif-deleted-a94c53f7-4f4c-42e6-b121-9d309544dae8 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:24:40 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-b5574cd9-a1e4-40bd-b1cb-12928a4df4a1 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:24:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b5574cd9-a1e4-40bd-b1cb-12928a4df4a1 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.440s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:24:40 user nova-compute[74683]: INFO nova.scheduler.client.report [None req-b5574cd9-a1e4-40bd-b1cb-12928a4df4a1 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Deleted allocations for instance 7ced47a3-311d-4083-94e1-b2d42326e24d
Oct 16 11:24:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b5574cd9-a1e4-40bd-b1cb-12928a4df4a1 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lock "7ced47a3-311d-4083-94e1-b2d42326e24d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.117s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:24:41 user nova-compute[74683]: DEBUG nova.compute.manager [req-b4d0ed8d-809d-4bd8-92a0-4c14cd3dfd96 req-1608134b-8b61-4510-9c15-d0808d8ab36b service nova] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Received event network-vif-plugged-a94c53f7-4f4c-42e6-b121-9d309544dae8 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:24:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b4d0ed8d-809d-4bd8-92a0-4c14cd3dfd96 req-1608134b-8b61-4510-9c15-d0808d8ab36b service nova] Acquiring lock "7ced47a3-311d-4083-94e1-b2d42326e24d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:24:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b4d0ed8d-809d-4bd8-92a0-4c14cd3dfd96 req-1608134b-8b61-4510-9c15-d0808d8ab36b service nova] Lock "7ced47a3-311d-4083-94e1-b2d42326e24d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:24:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b4d0ed8d-809d-4bd8-92a0-4c14cd3dfd96 req-1608134b-8b61-4510-9c15-d0808d8ab36b service nova] Lock "7ced47a3-311d-4083-94e1-b2d42326e24d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:24:41 user nova-compute[74683]: DEBUG nova.compute.manager [req-b4d0ed8d-809d-4bd8-92a0-4c14cd3dfd96 req-1608134b-8b61-4510-9c15-d0808d8ab36b service nova] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] No waiting events found dispatching network-vif-plugged-a94c53f7-4f4c-42e6-b121-9d309544dae8 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:24:41 user nova-compute[74683]: WARNING nova.compute.manager [req-b4d0ed8d-809d-4bd8-92a0-4c14cd3dfd96 req-1608134b-8b61-4510-9c15-d0808d8ab36b service nova] [instance: 7ced47a3-311d-4083-94e1-b2d42326e24d] Received unexpected event network-vif-plugged-a94c53f7-4f4c-42e6-b121-9d309544dae8 for instance with vm_state deleted and task_state None.
Oct 16 11:24:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Acquiring lock "d00bbb1a-534b-4437-9b79-91870c5d8bb5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:24:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "d00bbb1a-534b-4437-9b79-91870c5d8bb5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:24:43 user nova-compute[74683]: DEBUG nova.compute.manager [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Starting instance... {{(pid=74683) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 11:24:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:24:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:24:43 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74683) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 11:24:43 user nova-compute[74683]: INFO nova.compute.claims [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Claim successful on node user
Oct 16 11:24:43 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:24:43 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:24:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.492s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:24:43 user nova-compute[74683]: DEBUG nova.compute.manager [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Start building networks asynchronously for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 11:24:43 user nova-compute[74683]: DEBUG nova.compute.manager [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Allocating IP information in the background. {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 11:24:43 user nova-compute[74683]: DEBUG nova.network.neutron [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] allocate_for_instance() {{(pid=74683) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 11:24:44 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 11:24:44 user nova-compute[74683]: DEBUG nova.compute.manager [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Start building block device mappings for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 11:24:44 user nova-compute[74683]: DEBUG nova.policy [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '76a41804541e4a259771702727d9993e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6e0046017b4bba85caf2a39d1c67b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74683) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 11:24:44 user nova-compute[74683]: INFO nova.virt.block_device [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Booting with volume-backed-image 0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f at /dev/vda
Oct 16 11:24:44 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:24:44 user nova-compute[74683]: DEBUG nova.network.neutron [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Successfully created port: 3d2071d3-9bd0-4aa5-a909-889b3f3155db {{(pid=74683) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 11:24:45 user nova-compute[74683]: DEBUG nova.network.neutron [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Successfully updated port: 3d2071d3-9bd0-4aa5-a909-889b3f3155db {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:24:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Acquiring lock "refresh_cache-d00bbb1a-534b-4437-9b79-91870c5d8bb5" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:24:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Acquired lock "refresh_cache-d00bbb1a-534b-4437-9b79-91870c5d8bb5" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:24:45 user nova-compute[74683]: DEBUG nova.network.neutron [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:24:45 user nova-compute[74683]: DEBUG nova.compute.manager [req-43f34746-6a23-4088-aaad-af187c10fe72 req-f5b5f2e2-37f3-4aaa-b9e7-067bd9e77a46 service nova] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Received event network-changed-3d2071d3-9bd0-4aa5-a909-889b3f3155db {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:24:45 user nova-compute[74683]: DEBUG nova.compute.manager [req-43f34746-6a23-4088-aaad-af187c10fe72 req-f5b5f2e2-37f3-4aaa-b9e7-067bd9e77a46 service nova] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Refreshing instance network info cache due to event network-changed-3d2071d3-9bd0-4aa5-a909-889b3f3155db. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:24:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-43f34746-6a23-4088-aaad-af187c10fe72 req-f5b5f2e2-37f3-4aaa-b9e7-067bd9e77a46 service nova] Acquiring lock "refresh_cache-d00bbb1a-534b-4437-9b79-91870c5d8bb5" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:24:45 user nova-compute[74683]: DEBUG nova.network.neutron [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:24:45 user nova-compute[74683]: DEBUG nova.network.neutron [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Updating instance_info_cache with network_info: [{"id": "3d2071d3-9bd0-4aa5-a909-889b3f3155db", "address": "fa:16:3e:53:66:36", "network": {"id": "4d43cc12-d2cd-4552-90a4-884a0ff3dc66", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-825513246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6e0046017b4bba85caf2a39d1c67b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d2071d3-9b", "ovs_interfaceid": "3d2071d3-9bd0-4aa5-a909-889b3f3155db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:24:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Releasing lock "refresh_cache-d00bbb1a-534b-4437-9b79-91870c5d8bb5" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:24:45 user nova-compute[74683]: DEBUG nova.compute.manager [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Instance network_info: |[{"id": "3d2071d3-9bd0-4aa5-a909-889b3f3155db", "address": "fa:16:3e:53:66:36", "network": {"id": "4d43cc12-d2cd-4552-90a4-884a0ff3dc66", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-825513246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6e0046017b4bba85caf2a39d1c67b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d2071d3-9b", "ovs_interfaceid": "3d2071d3-9bd0-4aa5-a909-889b3f3155db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 11:24:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-43f34746-6a23-4088-aaad-af187c10fe72 req-f5b5f2e2-37f3-4aaa-b9e7-067bd9e77a46 service nova] Acquired lock "refresh_cache-d00bbb1a-534b-4437-9b79-91870c5d8bb5" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:24:45 user nova-compute[74683]: DEBUG nova.network.neutron [req-43f34746-6a23-4088-aaad-af187c10fe72 req-f5b5f2e2-37f3-4aaa-b9e7-067bd9e77a46 service nova] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Refreshing network info cache for port 3d2071d3-9bd0-4aa5-a909-889b3f3155db {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:24:46 user nova-compute[74683]: DEBUG nova.network.neutron [req-43f34746-6a23-4088-aaad-af187c10fe72 req-f5b5f2e2-37f3-4aaa-b9e7-067bd9e77a46 service nova] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Updated VIF entry in instance network info cache for port 3d2071d3-9bd0-4aa5-a909-889b3f3155db. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:24:46 user nova-compute[74683]: DEBUG nova.network.neutron [req-43f34746-6a23-4088-aaad-af187c10fe72 req-f5b5f2e2-37f3-4aaa-b9e7-067bd9e77a46 service nova] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Updating instance_info_cache with network_info: [{"id": "3d2071d3-9bd0-4aa5-a909-889b3f3155db", "address": "fa:16:3e:53:66:36", "network": {"id": "4d43cc12-d2cd-4552-90a4-884a0ff3dc66", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-825513246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6e0046017b4bba85caf2a39d1c67b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d2071d3-9b", "ovs_interfaceid": "3d2071d3-9bd0-4aa5-a909-889b3f3155db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:24:46 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-43f34746-6a23-4088-aaad-af187c10fe72 req-f5b5f2e2-37f3-4aaa-b9e7-067bd9e77a46 service nova] Releasing lock "refresh_cache-d00bbb1a-534b-4437-9b79-91870c5d8bb5" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:24:46 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:24:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquiring lock "73adef6b-881d-466b-b55d-6cf2f974d40e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:24:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "73adef6b-881d-466b-b55d-6cf2f974d40e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:24:48 user nova-compute[74683]: DEBUG nova.compute.manager [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Starting instance... {{(pid=74683) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 11:24:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:24:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:24:48 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74683) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 11:24:48 user nova-compute[74683]: INFO nova.compute.claims [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Claim successful on node user
Oct 16 11:24:49 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:24:49 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:24:49 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.673s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:24:49 user nova-compute[74683]: DEBUG nova.compute.manager [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Start building networks asynchronously for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 11:24:49 user nova-compute[74683]: DEBUG nova.compute.manager [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Allocating IP information in the background. {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 11:24:49 user nova-compute[74683]: DEBUG nova.network.neutron [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] allocate_for_instance() {{(pid=74683) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 11:24:49 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 11:24:49 user nova-compute[74683]: DEBUG nova.compute.manager [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Start building block device mappings for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 11:24:49 user nova-compute[74683]: DEBUG nova.policy [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a463a84e332543dfbc03b81518f82be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefabef9e42412f8309f490dcfecc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74683) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 11:24:49 user nova-compute[74683]: INFO nova.virt.block_device [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Booting with volume 62b0fe50-02bc-4fba-bf25-873c18c036c0 at /dev/vda
Oct 16 11:24:49 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:24:49 user nova-compute[74683]: DEBUG os_brick.utils [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:24:49 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:24:49 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:24:49 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bae3d23-560b-46a4-8d2e-e1f5985762bc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:70b9d336ab7d\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:24:49 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:24:49 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:24:49 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[563396e9-cac8-4dbf-8a57-632d16a63067]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:24:49 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:24:49 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:24:49 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee17062-8596-4a00-9862-a2f59b43a0d3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:24:49 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e83ec9-f2e1-455b-9ffe-0e515fec77ba]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:24:49 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Running cmd (subprocess): nvme version {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:24:49 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] 'nvme version' failed. Not Retrying. {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:24:49 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.nvmeof [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] nvme not present on system {{(pid=74683) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 11:24:49 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:24:49 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:24:49 user nova-compute[74683]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 11:24:49 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b08f052-dc27-4559-bc4a-1d58d0ca5db5]: (4, '') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:24:49 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74683) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 11:24:49 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 11:24:49 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] LIGHTOS: no hostnqn found. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 11:24:49 user nova-compute[74683]: DEBUG os_brick.utils [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:70b9d336ab7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:24:49 user nova-compute[74683]: DEBUG nova.virt.block_device [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Updating existing volume attachment record: 352c077e-d9fc-4522-a383-53a456bbcb16 {{(pid=74683) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 11:24:50 user nova-compute[74683]: DEBUG nova.network.neutron [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Successfully created port: d30ae106-813b-458e-a46b-d92cbdd2e4b2 {{(pid=74683) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 11:24:50 user nova-compute[74683]: DEBUG nova.network.neutron [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Successfully updated port: d30ae106-813b-458e-a46b-d92cbdd2e4b2 {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:24:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquiring lock "refresh_cache-73adef6b-881d-466b-b55d-6cf2f974d40e" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:24:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquired lock "refresh_cache-73adef6b-881d-466b-b55d-6cf2f974d40e" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:24:50 user nova-compute[74683]: DEBUG nova.network.neutron [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:24:50 user nova-compute[74683]: DEBUG nova.compute.manager [req-43f4991e-86a5-4cf0-9500-6ce19be6393c req-55c8dbd3-2071-46d2-83c4-77c6774a0944 service nova] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Received event network-changed-d30ae106-813b-458e-a46b-d92cbdd2e4b2 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:24:50 user nova-compute[74683]: DEBUG nova.compute.manager [req-43f4991e-86a5-4cf0-9500-6ce19be6393c req-55c8dbd3-2071-46d2-83c4-77c6774a0944 service nova] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Refreshing instance network info cache due to event network-changed-d30ae106-813b-458e-a46b-d92cbdd2e4b2. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:24:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-43f4991e-86a5-4cf0-9500-6ce19be6393c req-55c8dbd3-2071-46d2-83c4-77c6774a0944 service nova] Acquiring lock "refresh_cache-73adef6b-881d-466b-b55d-6cf2f974d40e" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:24:51 user nova-compute[74683]: DEBUG nova.network.neutron [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:24:51 user nova-compute[74683]: DEBUG nova.network.neutron [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Updating instance_info_cache with network_info: [{"id": "d30ae106-813b-458e-a46b-d92cbdd2e4b2", "address": "fa:16:3e:28:1e:05", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd30ae106-81", "ovs_interfaceid": "d30ae106-813b-458e-a46b-d92cbdd2e4b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:24:51 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Releasing lock "refresh_cache-73adef6b-881d-466b-b55d-6cf2f974d40e" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:24:51 user nova-compute[74683]: DEBUG nova.compute.manager [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Instance network_info: |[{"id": "d30ae106-813b-458e-a46b-d92cbdd2e4b2", "address": "fa:16:3e:28:1e:05", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd30ae106-81", "ovs_interfaceid": "d30ae106-813b-458e-a46b-d92cbdd2e4b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 11:24:51 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-43f4991e-86a5-4cf0-9500-6ce19be6393c req-55c8dbd3-2071-46d2-83c4-77c6774a0944 service nova] Acquired lock "refresh_cache-73adef6b-881d-466b-b55d-6cf2f974d40e" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:24:51 user nova-compute[74683]: DEBUG nova.network.neutron [req-43f4991e-86a5-4cf0-9500-6ce19be6393c req-55c8dbd3-2071-46d2-83c4-77c6774a0944 service nova] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Refreshing network info cache for port d30ae106-813b-458e-a46b-d92cbdd2e4b2 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:24:51 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:24:51 user nova-compute[74683]: DEBUG nova.network.neutron [req-43f4991e-86a5-4cf0-9500-6ce19be6393c req-55c8dbd3-2071-46d2-83c4-77c6774a0944 service nova] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Updated VIF entry in instance network info cache for port d30ae106-813b-458e-a46b-d92cbdd2e4b2. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:24:51 user nova-compute[74683]: DEBUG nova.network.neutron [req-43f4991e-86a5-4cf0-9500-6ce19be6393c req-55c8dbd3-2071-46d2-83c4-77c6774a0944 service nova] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Updating instance_info_cache with network_info: [{"id": "d30ae106-813b-458e-a46b-d92cbdd2e4b2", "address": "fa:16:3e:28:1e:05", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd30ae106-81", "ovs_interfaceid": "d30ae106-813b-458e-a46b-d92cbdd2e4b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:24:51 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-43f4991e-86a5-4cf0-9500-6ce19be6393c req-55c8dbd3-2071-46d2-83c4-77c6774a0944 service nova] Releasing lock "refresh_cache-73adef6b-881d-466b-b55d-6cf2f974d40e" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:24:52 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Acquiring lock "be9f4840-69c8-4980-afd8-73a84f743dff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:24:52 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "be9f4840-69c8-4980-afd8-73a84f743dff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:24:52 user nova-compute[74683]: DEBUG nova.compute.manager [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Starting instance... {{(pid=74683) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 11:24:52 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:24:52 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:24:52 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74683) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 11:24:52 user nova-compute[74683]: INFO nova.compute.claims [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Claim successful on node user
Oct 16 11:24:53 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:24:53 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:24:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.819s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:24:53 user nova-compute[74683]: DEBUG nova.compute.manager [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Start building networks asynchronously for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 11:24:53 user nova-compute[74683]: DEBUG nova.compute.manager [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Allocating IP information in the background. {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 11:24:53 user nova-compute[74683]: DEBUG nova.network.neutron [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] allocate_for_instance() {{(pid=74683) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 11:24:53 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 11:24:53 user nova-compute[74683]: DEBUG nova.compute.manager [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Start building block device mappings for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 11:24:53 user nova-compute[74683]: DEBUG nova.policy [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cdc203c025d84efe86e25cfdf75107b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c66aa774134aa6a873eabffc28ec07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74683) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 11:24:53 user nova-compute[74683]: DEBUG nova.compute.manager [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Start spawning the instance on the hypervisor. {{(pid=74683) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 11:24:53 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Creating instance directory {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 11:24:53 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Creating image(s)
Oct 16 11:24:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Acquiring lock "/opt/stack/data/nova/instances/be9f4840-69c8-4980-afd8-73a84f743dff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:24:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "/opt/stack/data/nova/instances/be9f4840-69c8-4980-afd8-73a84f743dff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:24:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "/opt/stack/data/nova/instances/be9f4840-69c8-4980-afd8-73a84f743dff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:24:53 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:24:54 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.224s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:24:54 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Acquiring lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:24:54 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:24:54 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:24:54 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.196s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:24:54 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/be9f4840-69c8-4980-afd8-73a84f743dff/disk 1073741824 {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:24:54 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/be9f4840-69c8-4980-afd8-73a84f743dff/disk 1073741824" returned: 0 in 0.052s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:24:54 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:24:54 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:24:54 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.171s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:24:54 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Checking if we can resize image /opt/stack/data/nova/instances/be9f4840-69c8-4980-afd8-73a84f743dff/disk. size=1073741824 {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 11:24:54 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9f4840-69c8-4980-afd8-73a84f743dff/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:24:54 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:24:54 user nova-compute[74683]: DEBUG nova.network.neutron [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Successfully created port: 3a270246-50ff-4381-a519-564fe320578f {{(pid=74683) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 11:24:54 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9f4840-69c8-4980-afd8-73a84f743dff/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:24:54 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Cannot resize image /opt/stack/data/nova/instances/be9f4840-69c8-4980-afd8-73a84f743dff/disk to a smaller size. {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 11:24:54 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Created local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 11:24:54 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Ensure instance console log exists: /opt/stack/data/nova/instances/be9f4840-69c8-4980-afd8-73a84f743dff/console.log {{(pid=74683) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 11:24:54 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:24:54 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:24:54 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:24:55 user nova-compute[74683]: DEBUG nova.network.neutron [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Successfully updated port: 3a270246-50ff-4381-a519-564fe320578f {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:24:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Acquiring lock "refresh_cache-be9f4840-69c8-4980-afd8-73a84f743dff" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:24:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Acquired lock "refresh_cache-be9f4840-69c8-4980-afd8-73a84f743dff" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:24:55 user nova-compute[74683]: DEBUG nova.network.neutron [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:24:55 user nova-compute[74683]: DEBUG nova.compute.manager [req-ba2de05d-9470-4d3e-883f-3e63cf2d56b7 req-419c8381-57c3-440a-b2f0-441b52a3d85c service nova] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Received event network-changed-3a270246-50ff-4381-a519-564fe320578f {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:24:55 user nova-compute[74683]: DEBUG nova.compute.manager [req-ba2de05d-9470-4d3e-883f-3e63cf2d56b7 req-419c8381-57c3-440a-b2f0-441b52a3d85c service nova] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Refreshing instance network info cache due to event network-changed-3a270246-50ff-4381-a519-564fe320578f. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:24:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-ba2de05d-9470-4d3e-883f-3e63cf2d56b7 req-419c8381-57c3-440a-b2f0-441b52a3d85c service nova] Acquiring lock "refresh_cache-be9f4840-69c8-4980-afd8-73a84f743dff" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:24:55 user nova-compute[74683]: DEBUG nova.network.neutron [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:24:55 user nova-compute[74683]: DEBUG nova.network.neutron [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Updating instance_info_cache with network_info: [{"id": "3a270246-50ff-4381-a519-564fe320578f", "address": "fa:16:3e:7c:d6:e6", "network": {"id": "f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-137528169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c66aa774134aa6a873eabffc28ec07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a270246-50", "ovs_interfaceid": "3a270246-50ff-4381-a519-564fe320578f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:24:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Releasing lock "refresh_cache-be9f4840-69c8-4980-afd8-73a84f743dff" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:24:55 user nova-compute[74683]: DEBUG nova.compute.manager [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Instance network_info: |[{"id": "3a270246-50ff-4381-a519-564fe320578f", "address": "fa:16:3e:7c:d6:e6", "network": {"id": "f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-137528169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c66aa774134aa6a873eabffc28ec07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a270246-50", "ovs_interfaceid": "3a270246-50ff-4381-a519-564fe320578f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 11:24:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-ba2de05d-9470-4d3e-883f-3e63cf2d56b7 req-419c8381-57c3-440a-b2f0-441b52a3d85c service nova] Acquired lock "refresh_cache-be9f4840-69c8-4980-afd8-73a84f743dff" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:24:55 user nova-compute[74683]: DEBUG nova.network.neutron [req-ba2de05d-9470-4d3e-883f-3e63cf2d56b7 req-419c8381-57c3-440a-b2f0-441b52a3d85c service nova] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Refreshing network info cache for port 3a270246-50ff-4381-a519-564fe320578f {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:24:55 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Start _get_guest_xml network_info=[{"id": "3a270246-50ff-4381-a519-564fe320578f", "address": "fa:16:3e:7c:d6:e6", "network": {"id": "f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-137528169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c66aa774134aa6a873eabffc28ec07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a270246-50", "ovs_interfaceid": "3a270246-50ff-4381-a519-564fe320578f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:24:55 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:24:55 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:24:55 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:24:55 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:24:55 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:24:55 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:24:55 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:24:55 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:24:55 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:24:55 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:24:55 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:24:55 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:24:55 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:24:55 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:24:55 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:24:55 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:24:55 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:24:55 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:24:55 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:24:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1307435615',display_name='tempest-AttachVolumeNegativeTest-server-1307435615',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1307435615',id=31,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcOtZxCG0U7wp3t7WCYbBQXBdmfNkZ3ZKvPKgRrQpMvs6mpm943cucyAoR4gyTgCDaU9QktrUnKg9dZNGLPj768DlKZSOnznjoKU3Ea9Tu7Gxxnzn3mi0F/o/7J6OC8rQ==',key_name='tempest-keypair-590361388',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72c66aa774134aa6a873eabffc28ec07',ramdisk_id='',reservation_id='r-1s1zs6oe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-845934820',owner_user_name='tempest-AttachVolumeNegativeTest-845934820-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:24:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cdc203c025d84efe86e25cfdf75107b8',uuid=be9f4840-69c8-4980-afd8-73a84f743dff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a270246-50ff-4381-a519-564fe320578f", "address": "fa:16:3e:7c:d6:e6", "network": {"id": "f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-137528169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c66aa774134aa6a873eabffc28ec07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a270246-50", "ovs_interfaceid": "3a270246-50ff-4381-a519-564fe320578f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:24:55 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Converting VIF {"id": "3a270246-50ff-4381-a519-564fe320578f", "address": "fa:16:3e:7c:d6:e6", "network": {"id": "f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-137528169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c66aa774134aa6a873eabffc28ec07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a270246-50", "ovs_interfaceid": "3a270246-50ff-4381-a519-564fe320578f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:24:55 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:d6:e6,bridge_name='br-int',has_traffic_filtering=True,id=3a270246-50ff-4381-a519-564fe320578f,network=Network(f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a270246-50') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:24:55 user nova-compute[74683]: DEBUG nova.objects.instance [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lazy-loading 'pci_devices' on Instance uuid be9f4840-69c8-4980-afd8-73a84f743dff {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:24:56 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:24:56 user nova-compute[74683]:   <uuid>be9f4840-69c8-4980-afd8-73a84f743dff</uuid>
Oct 16 11:24:56 user nova-compute[74683]:   <name>instance-0000001f</name>
Oct 16 11:24:56 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:24:56 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:24:56 user nova-compute[74683]:   <metadata>
Oct 16 11:24:56 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:24:56 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:24:56 user nova-compute[74683]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1307435615</nova:name>
Oct 16 11:24:56 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:24:55</nova:creationTime>
Oct 16 11:24:56 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:24:56 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:24:56 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:24:56 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:24:56 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:24:56 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:24:56 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:24:56 user nova-compute[74683]:       <nova:owner>
Oct 16 11:24:56 user nova-compute[74683]:         <nova:user uuid="cdc203c025d84efe86e25cfdf75107b8">tempest-AttachVolumeNegativeTest-845934820-project-member</nova:user>
Oct 16 11:24:56 user nova-compute[74683]:         <nova:project uuid="72c66aa774134aa6a873eabffc28ec07">tempest-AttachVolumeNegativeTest-845934820</nova:project>
Oct 16 11:24:56 user nova-compute[74683]:       </nova:owner>
Oct 16 11:24:56 user nova-compute[74683]:       <nova:root type="image" uuid="0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f"/>
Oct 16 11:24:56 user nova-compute[74683]:       <nova:ports>
Oct 16 11:24:56 user nova-compute[74683]:         <nova:port uuid="3a270246-50ff-4381-a519-564fe320578f">
Oct 16 11:24:56 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 16 11:24:56 user nova-compute[74683]:         </nova:port>
Oct 16 11:24:56 user nova-compute[74683]:       </nova:ports>
Oct 16 11:24:56 user nova-compute[74683]:     </nova:instance>
Oct 16 11:24:56 user nova-compute[74683]:   </metadata>
Oct 16 11:24:56 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:24:56 user nova-compute[74683]:     <system>
Oct 16 11:24:56 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:24:56 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:24:56 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:24:56 user nova-compute[74683]:       <entry name="serial">be9f4840-69c8-4980-afd8-73a84f743dff</entry>
Oct 16 11:24:56 user nova-compute[74683]:       <entry name="uuid">be9f4840-69c8-4980-afd8-73a84f743dff</entry>
Oct 16 11:24:56 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:24:56 user nova-compute[74683]:     </system>
Oct 16 11:24:56 user nova-compute[74683]:   </sysinfo>
Oct 16 11:24:56 user nova-compute[74683]:   <os>
Oct 16 11:24:56 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:24:56 user nova-compute[74683]:     <boot dev="hd"/>
Oct 16 11:24:56 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:24:56 user nova-compute[74683]:   </os>
Oct 16 11:24:56 user nova-compute[74683]:   <features>
Oct 16 11:24:56 user nova-compute[74683]:     <acpi/>
Oct 16 11:24:56 user nova-compute[74683]:     <apic/>
Oct 16 11:24:56 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:24:56 user nova-compute[74683]:   </features>
Oct 16 11:24:56 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:24:56 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:24:56 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:24:56 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:24:56 user nova-compute[74683]:   </clock>
Oct 16 11:24:56 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:24:56 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:24:56 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:24:56 user nova-compute[74683]:   </cpu>
Oct 16 11:24:56 user nova-compute[74683]:   <devices>
Oct 16 11:24:56 user nova-compute[74683]:     <disk type="file" device="disk">
Oct 16 11:24:56 user nova-compute[74683]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 11:24:56 user nova-compute[74683]:       <source file="/opt/stack/data/nova/instances/be9f4840-69c8-4980-afd8-73a84f743dff/disk"/>
Oct 16 11:24:56 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:24:56 user nova-compute[74683]:     </disk>
Oct 16 11:24:56 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:24:56 user nova-compute[74683]:       <mac address="fa:16:3e:7c:d6:e6"/>
Oct 16 11:24:56 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:24:56 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:24:56 user nova-compute[74683]:       <target dev="tap3a270246-50"/>
Oct 16 11:24:56 user nova-compute[74683]:     </interface>
Oct 16 11:24:56 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:24:56 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/be9f4840-69c8-4980-afd8-73a84f743dff/console.log" append="off"/>
Oct 16 11:24:56 user nova-compute[74683]:     </serial>
Oct 16 11:24:56 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:24:56 user nova-compute[74683]:     <video>
Oct 16 11:24:56 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:24:56 user nova-compute[74683]:     </video>
Oct 16 11:24:56 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:24:56 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:24:56 user nova-compute[74683]:     </rng>
Oct 16 11:24:56 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:24:56 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:24:56 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:24:56 user nova-compute[74683]:     </memballoon>
Oct 16 11:24:56 user nova-compute[74683]:   </devices>
Oct 16 11:24:56 user nova-compute[74683]: </domain>
Oct 16 11:24:56 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:24:56 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:24:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1307435615',display_name='tempest-AttachVolumeNegativeTest-server-1307435615',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1307435615',id=31,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcOtZxCG0U7wp3t7WCYbBQXBdmfNkZ3ZKvPKgRrQpMvs6mpm943cucyAoR4gyTgCDaU9QktrUnKg9dZNGLPj768DlKZSOnznjoKU3Ea9Tu7Gxxnzn3mi0F/o/7J6OC8rQ==',key_name='tempest-keypair-590361388',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72c66aa774134aa6a873eabffc28ec07',ramdisk_id='',reservation_id='r-1s1zs6oe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-845934820',owner_user_name='tempest-AttachVolumeNegativeTest-845934820-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:24:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cdc203c025d84efe86e25cfdf75107b8',uuid=be9f4840-69c8-4980-afd8-73a84f743dff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a270246-50ff-4381-a519-564fe320578f", "address": "fa:16:3e:7c:d6:e6", "network": {"id": "f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-137528169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c66aa774134aa6a873eabffc28ec07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a270246-50", "ovs_interfaceid": "3a270246-50ff-4381-a519-564fe320578f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:24:56 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Converting VIF {"id": "3a270246-50ff-4381-a519-564fe320578f", "address": "fa:16:3e:7c:d6:e6", "network": {"id": "f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-137528169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c66aa774134aa6a873eabffc28ec07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a270246-50", "ovs_interfaceid": "3a270246-50ff-4381-a519-564fe320578f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:24:56 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:d6:e6,bridge_name='br-int',has_traffic_filtering=True,id=3a270246-50ff-4381-a519-564fe320578f,network=Network(f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a270246-50') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:24:56 user nova-compute[74683]: DEBUG os_vif [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:d6:e6,bridge_name='br-int',has_traffic_filtering=True,id=3a270246-50ff-4381-a519-564fe320578f,network=Network(f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a270246-50') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:24:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:24:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:24:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:24:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:24:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '43c4b4f5-15d7-59f9-8092-5fc153cf9c52', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:24:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:24:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:24:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:24:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a270246-50, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:24:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3a270246-50, col_values=(('qos', UUID('83fca17f-ac41-42a1-963e-4a432c5bf002')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:24:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3a270246-50, col_values=(('external_ids', {'iface-id': '3a270246-50ff-4381-a519-564fe320578f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:d6:e6', 'vm-uuid': 'be9f4840-69c8-4980-afd8-73a84f743dff'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:24:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:24:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:24:56 user nova-compute[74683]: INFO os_vif [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:d6:e6,bridge_name='br-int',has_traffic_filtering=True,id=3a270246-50ff-4381-a519-564fe320578f,network=Network(f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a270246-50')
Oct 16 11:24:56 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:24:56 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] No VIF found with MAC fa:16:3e:7c:d6:e6, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:24:56 user nova-compute[74683]: DEBUG nova.network.neutron [req-ba2de05d-9470-4d3e-883f-3e63cf2d56b7 req-419c8381-57c3-440a-b2f0-441b52a3d85c service nova] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Updated VIF entry in instance network info cache for port 3a270246-50ff-4381-a519-564fe320578f. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:24:56 user nova-compute[74683]: DEBUG nova.network.neutron [req-ba2de05d-9470-4d3e-883f-3e63cf2d56b7 req-419c8381-57c3-440a-b2f0-441b52a3d85c service nova] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Updating instance_info_cache with network_info: [{"id": "3a270246-50ff-4381-a519-564fe320578f", "address": "fa:16:3e:7c:d6:e6", "network": {"id": "f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-137528169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c66aa774134aa6a873eabffc28ec07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a270246-50", "ovs_interfaceid": "3a270246-50ff-4381-a519-564fe320578f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:24:56 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-ba2de05d-9470-4d3e-883f-3e63cf2d56b7 req-419c8381-57c3-440a-b2f0-441b52a3d85c service nova] Releasing lock "refresh_cache-be9f4840-69c8-4980-afd8-73a84f743dff" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:24:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:24:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:24:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:24:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:24:57 user nova-compute[74683]: DEBUG nova.compute.manager [req-d399f88e-45a8-4932-bdc3-5c09f3fbdae5 req-9ecd21e1-f7e8-4172-8183-3283976b18fd service nova] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Received event network-vif-plugged-3a270246-50ff-4381-a519-564fe320578f {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:24:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-d399f88e-45a8-4932-bdc3-5c09f3fbdae5 req-9ecd21e1-f7e8-4172-8183-3283976b18fd service nova] Acquiring lock "be9f4840-69c8-4980-afd8-73a84f743dff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:24:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-d399f88e-45a8-4932-bdc3-5c09f3fbdae5 req-9ecd21e1-f7e8-4172-8183-3283976b18fd service nova] Lock "be9f4840-69c8-4980-afd8-73a84f743dff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:24:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-d399f88e-45a8-4932-bdc3-5c09f3fbdae5 req-9ecd21e1-f7e8-4172-8183-3283976b18fd service nova] Lock "be9f4840-69c8-4980-afd8-73a84f743dff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:24:57 user nova-compute[74683]: DEBUG nova.compute.manager [req-d399f88e-45a8-4932-bdc3-5c09f3fbdae5 req-9ecd21e1-f7e8-4172-8183-3283976b18fd service nova] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] No waiting events found dispatching network-vif-plugged-3a270246-50ff-4381-a519-564fe320578f {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:24:57 user nova-compute[74683]: WARNING nova.compute.manager [req-d399f88e-45a8-4932-bdc3-5c09f3fbdae5 req-9ecd21e1-f7e8-4172-8183-3283976b18fd service nova] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Received unexpected event network-vif-plugged-3a270246-50ff-4381-a519-564fe320578f for instance with vm_state building and task_state spawning.
Oct 16 11:24:58 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:24:58 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:24:58 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:24:58 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:24:59 user nova-compute[74683]: DEBUG nova.compute.manager [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Instance event wait completed in 0 seconds for  {{(pid=74683) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 11:24:59 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Guest created on hypervisor {{(pid=74683) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 11:24:59 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Instance spawned successfully.
Oct 16 11:24:59 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 11:24:59 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Found default for hw_cdrom_bus of ide {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:24:59 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Found default for hw_disk_bus of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:24:59 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Found default for hw_input_bus of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:24:59 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Found default for hw_pointer_model of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:24:59 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Found default for hw_video_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:24:59 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Found default for hw_vif_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:24:59 user nova-compute[74683]: INFO nova.compute.manager [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Took 5.90 seconds to spawn the instance on the hypervisor.
Oct 16 11:24:59 user nova-compute[74683]: DEBUG nova.compute.manager [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:24:59 user nova-compute[74683]: DEBUG nova.compute.manager [req-617f1890-d91e-4391-b50e-4d90224104f6 req-e59049de-e9cd-49ee-b122-fa3226a8d80b service nova] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Received event network-vif-plugged-3a270246-50ff-4381-a519-564fe320578f {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:24:59 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-617f1890-d91e-4391-b50e-4d90224104f6 req-e59049de-e9cd-49ee-b122-fa3226a8d80b service nova] Acquiring lock "be9f4840-69c8-4980-afd8-73a84f743dff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:24:59 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-617f1890-d91e-4391-b50e-4d90224104f6 req-e59049de-e9cd-49ee-b122-fa3226a8d80b service nova] Lock "be9f4840-69c8-4980-afd8-73a84f743dff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:24:59 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-617f1890-d91e-4391-b50e-4d90224104f6 req-e59049de-e9cd-49ee-b122-fa3226a8d80b service nova] Lock "be9f4840-69c8-4980-afd8-73a84f743dff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:24:59 user nova-compute[74683]: DEBUG nova.compute.manager [req-617f1890-d91e-4391-b50e-4d90224104f6 req-e59049de-e9cd-49ee-b122-fa3226a8d80b service nova] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] No waiting events found dispatching network-vif-plugged-3a270246-50ff-4381-a519-564fe320578f {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:24:59 user nova-compute[74683]: WARNING nova.compute.manager [req-617f1890-d91e-4391-b50e-4d90224104f6 req-e59049de-e9cd-49ee-b122-fa3226a8d80b service nova] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Received unexpected event network-vif-plugged-3a270246-50ff-4381-a519-564fe320578f for instance with vm_state building and task_state spawning.
Oct 16 11:24:59 user nova-compute[74683]: INFO nova.compute.manager [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Took 7.09 seconds to build instance.
Oct 16 11:24:59 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-375e675c-f53f-4974-b6c6-f5beadec3881 tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "be9f4840-69c8-4980-afd8-73a84f743dff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.206s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:25:00 user nova-compute[74683]: DEBUG os_brick.utils [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:25:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:00 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a70aef-bedd-4ace-9e5a-0df0ae619037]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:70b9d336ab7d\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:00 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[9875d465-3df8-4c63-a8e9-9fe8e990cf21]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:00 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ce0816-339d-4ae0-97d9-15cb67cd3547]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:00 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[139886cf-08f6-43bb-8426-7a2848c68199]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Running cmd (subprocess): nvme version {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] 'nvme version' failed. Not Retrying. {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:25:00 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.nvmeof [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] nvme not present on system {{(pid=74683) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 11:25:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:25:00 user nova-compute[74683]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 11:25:00 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce38a66d-dc51-4dcf-8d08-5f78baaaa5c4]: (4, '') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:00 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74683) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 11:25:00 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 11:25:00 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] LIGHTOS: no hostnqn found. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 11:25:00 user nova-compute[74683]: DEBUG os_brick.utils [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:70b9d336ab7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:25:00 user nova-compute[74683]: DEBUG nova.virt.block_device [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Updating existing volume attachment record: bd57c82d-2579-4ef5-9598-de3d7cd6a8c4 {{(pid=74683) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 11:25:01 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:01 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:06 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:25:06 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Starting heal instance info cache {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 11:25:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "refresh_cache-e84bb680-a542-4cb2-b0c5-67a210c25e9e" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:25:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquired lock "refresh_cache-e84bb680-a542-4cb2-b0c5-67a210c25e9e" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:25:06 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Forcefully refreshing network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 11:25:07 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Updating instance_info_cache with network_info: [{"id": "f57bee45-4d7d-4d93-ab04-0777c2d47ec2", "address": "fa:16:3e:80:bd:6c", "network": {"id": "9fca81bc-e1d4-4e04-83d3-e2a85af3b114", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1394655085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae0f6604619241b798a0043f73efd6df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf57bee45-4d", "ovs_interfaceid": "f57bee45-4d7d-4d93-ab04-0777c2d47ec2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:25:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Releasing lock "refresh_cache-e84bb680-a542-4cb2-b0c5-67a210c25e9e" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:25:07 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Updated the network info_cache for instance {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 11:25:07 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG nova.compute.manager [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Start spawning the instance on the hypervisor. {{(pid=74683) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Creating instance directory {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 11:25:08 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Creating image(s)
Oct 16 11:25:08 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Did not create local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Ensure instance console log exists: /opt/stack/data/nova/instances/73adef6b-881d-466b-b55d-6cf2f974d40e/console.log {{(pid=74683) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Start _get_guest_xml network_info=[{"id": "d30ae106-813b-458e-a46b-d92cbdd2e4b2", "address": "fa:16:3e:28:1e:05", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd30ae106-81", "ovs_interfaceid": "d30ae106-813b-458e-a46b-d92cbdd2e4b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VWFDtMCw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '73adef6b-881d-466b-b55d-6cf2f974d40e', 'attached_at': '', 'detached_at': '', 'volume_id': '62b0fe50-02bc-4fba-bf25-873c18c036c0', 'serial': '62b0fe50-02bc-4fba-bf25-873c18c036c0'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': '352c077e-d9fc-4522-a383-53a456bbcb16', 'volume_type': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:25:08 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:25:08 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:25:08 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Calling os-brick to attach iSCSI Volume {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VWFDtMCw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:25:08 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:25:08 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:25:08 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:25:08 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:25:08 user nova-compute[74683]: INFO os_brick.initiator.connectors.iscsi [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 11:25:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 -p 172.16.0.220:3260 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ffadfb1-b39c-4b4f-8ea3-07a123f86609]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 11:25:08 user nova-compute[74683]:  {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8c9174-066f-4953-9886-6eba1ff75af2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0] added\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0] added
Oct 16 11:25:08 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2523d6-63ec-404e-8f0f-8c1598ff3d1a]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79ffcd0-4774-4a86-8989-132650171ea7]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VWFDtMCw {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VWFDtMCw" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a19643-f9db-49a5-8160-77a7c57a73ed]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VWFDtMCw'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32f1d04-f202-442e-9cc4-2f9bbb98f259]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f009ade-7a80-45d9-b121-82ebce20a5a3]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:25:08 user nova-compute[74683]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee (non-flash)
Oct 16 11:25:08 user nova-compute[74683]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d (non-flash)
Oct 16 11:25:08 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:25:08 user nova-compute[74683]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee (non-flash)
Oct 16 11:25:08 user nova-compute[74683]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d (non-flash)
Oct 16 11:25:08 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 -p 172.16.0.220:3260 --login {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[86770401-8c6a-4bbd-9544-6bf0484d3def]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0, portal: 172.16.0.220,3260]
Oct 16 11:25:08 user nova-compute[74683]: Login to [iface: default, target: iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0, portal: 172.16.0.220,3260] successful.
Oct 16 11:25:08 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7afdad-c96f-4281-9d6a-a7c5a82df26c]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d415678-128b-4ce7-985e-5f97f5bb6b65]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:25:08 user nova-compute[74683]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee (non-flash)
Oct 16 11:25:08 user nova-compute[74683]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d (non-flash)
Oct 16 11:25:08 user nova-compute[74683]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)
Oct 16 11:25:08 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:25:08 user nova-compute[74683]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee (non-flash)
Oct 16 11:25:08 user nova-compute[74683]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d (non-flash)
Oct 16 11:25:08 user nova-compute[74683]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)
Oct 16 11:25:08 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Connected to 172.16.0.220:3260 {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] HCTL ('34', '-', '-', 0) found on session 26 with lun 0 {{(pid=74683) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74683) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.025s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da080a2-969d-413a-a163-0e50456c07e0]: (4, ('- - 0', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Searching for a device in session 26 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:25:08 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VWFDtMCw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 11:25:09 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:25:09 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '23362623135343566', 'path': '/dev/sdc'} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:25:09 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23362623135343566', 'path': '/dev/sdc'} {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 11:25:10 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:24:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-36036086',display_name='tempest-TestVolumeBootPattern-volume-backed-server-36036086',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-36036086',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC7ygYqGHWxK0DaJs1seFklM3baxLiMpTXvH0S8XHkPkH+8csh9PSVwQ1yN6oPcYBqPnV4EbkwqwdR7LXXvahFWIwJgTiOQUNm/4A8pPU781hWAZyVba1wvrF2itzasS9w==',key_name='tempest-keypair-679936023',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2aefabef9e42412f8309f490dcfecc79',ramdisk_id='',reservation_id='r-0tukfkj7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-953001121',owner_user_name='tempest-TestVolumeBootPattern-953001121-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:24:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a463a84e332543dfbc03b81518f82be1',uuid=73adef6b-881d-466b-b55d-6cf2f974d40e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d30ae106-813b-458e-a46b-d92cbdd2e4b2", "address": "fa:16:3e:28:1e:05", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd30ae106-81", "ovs_interfaceid": "d30ae106-813b-458e-a46b-d92cbdd2e4b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:25:10 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Converting VIF {"id": "d30ae106-813b-458e-a46b-d92cbdd2e4b2", "address": "fa:16:3e:28:1e:05", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd30ae106-81", "ovs_interfaceid": "d30ae106-813b-458e-a46b-d92cbdd2e4b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:25:10 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:1e:05,bridge_name='br-int',has_traffic_filtering=True,id=d30ae106-813b-458e-a46b-d92cbdd2e4b2,network=Network(00883fc4-0b74-4afd-9043-82e2933faab3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd30ae106-81') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:25:10 user nova-compute[74683]: DEBUG nova.objects.instance [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lazy-loading 'pci_devices' on Instance uuid 73adef6b-881d-466b-b55d-6cf2f974d40e {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:25:10 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:25:10 user nova-compute[74683]:   <uuid>73adef6b-881d-466b-b55d-6cf2f974d40e</uuid>
Oct 16 11:25:10 user nova-compute[74683]:   <name>instance-0000001e</name>
Oct 16 11:25:10 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:25:10 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:25:10 user nova-compute[74683]:   <metadata>
Oct 16 11:25:10 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:25:10 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:25:10 user nova-compute[74683]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-36036086</nova:name>
Oct 16 11:25:10 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:25:08</nova:creationTime>
Oct 16 11:25:10 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:25:10 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:25:10 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:25:10 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:25:10 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:25:10 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:25:10 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:25:10 user nova-compute[74683]:       <nova:owner>
Oct 16 11:25:10 user nova-compute[74683]:         <nova:user uuid="a463a84e332543dfbc03b81518f82be1">tempest-TestVolumeBootPattern-953001121-project-member</nova:user>
Oct 16 11:25:10 user nova-compute[74683]:         <nova:project uuid="2aefabef9e42412f8309f490dcfecc79">tempest-TestVolumeBootPattern-953001121</nova:project>
Oct 16 11:25:10 user nova-compute[74683]:       </nova:owner>
Oct 16 11:25:10 user nova-compute[74683]:       <nova:ports>
Oct 16 11:25:10 user nova-compute[74683]:         <nova:port uuid="d30ae106-813b-458e-a46b-d92cbdd2e4b2">
Oct 16 11:25:10 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 16 11:25:10 user nova-compute[74683]:         </nova:port>
Oct 16 11:25:10 user nova-compute[74683]:       </nova:ports>
Oct 16 11:25:10 user nova-compute[74683]:     </nova:instance>
Oct 16 11:25:10 user nova-compute[74683]:   </metadata>
Oct 16 11:25:10 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:25:10 user nova-compute[74683]:     <system>
Oct 16 11:25:10 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:25:10 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:25:10 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:25:10 user nova-compute[74683]:       <entry name="serial">73adef6b-881d-466b-b55d-6cf2f974d40e</entry>
Oct 16 11:25:10 user nova-compute[74683]:       <entry name="uuid">73adef6b-881d-466b-b55d-6cf2f974d40e</entry>
Oct 16 11:25:10 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:25:10 user nova-compute[74683]:     </system>
Oct 16 11:25:10 user nova-compute[74683]:   </sysinfo>
Oct 16 11:25:10 user nova-compute[74683]:   <os>
Oct 16 11:25:10 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:25:10 user nova-compute[74683]:     <boot dev="hd"/>
Oct 16 11:25:10 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:25:10 user nova-compute[74683]:   </os>
Oct 16 11:25:10 user nova-compute[74683]:   <features>
Oct 16 11:25:10 user nova-compute[74683]:     <acpi/>
Oct 16 11:25:10 user nova-compute[74683]:     <apic/>
Oct 16 11:25:10 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:25:10 user nova-compute[74683]:   </features>
Oct 16 11:25:10 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:25:10 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:25:10 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:25:10 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:25:10 user nova-compute[74683]:   </clock>
Oct 16 11:25:10 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:25:10 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:25:10 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:25:10 user nova-compute[74683]:   </cpu>
Oct 16 11:25:10 user nova-compute[74683]:   <devices>
Oct 16 11:25:10 user nova-compute[74683]:     <disk type="block" device="disk">
Oct 16 11:25:10 user nova-compute[74683]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:25:10 user nova-compute[74683]:       <source dev="/dev/sdc"/>
Oct 16 11:25:10 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:25:10 user nova-compute[74683]:       <serial>62b0fe50-02bc-4fba-bf25-873c18c036c0</serial>
Oct 16 11:25:10 user nova-compute[74683]:     </disk>
Oct 16 11:25:10 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:25:10 user nova-compute[74683]:       <mac address="fa:16:3e:28:1e:05"/>
Oct 16 11:25:10 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:25:10 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:25:10 user nova-compute[74683]:       <target dev="tapd30ae106-81"/>
Oct 16 11:25:10 user nova-compute[74683]:     </interface>
Oct 16 11:25:10 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:25:10 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/73adef6b-881d-466b-b55d-6cf2f974d40e/console.log" append="off"/>
Oct 16 11:25:10 user nova-compute[74683]:     </serial>
Oct 16 11:25:10 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:25:10 user nova-compute[74683]:     <video>
Oct 16 11:25:10 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:25:10 user nova-compute[74683]:     </video>
Oct 16 11:25:10 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:25:10 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:25:10 user nova-compute[74683]:     </rng>
Oct 16 11:25:10 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:25:10 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:25:10 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:25:10 user nova-compute[74683]:     </memballoon>
Oct 16 11:25:10 user nova-compute[74683]:   </devices>
Oct 16 11:25:10 user nova-compute[74683]: </domain>
Oct 16 11:25:10 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:25:10 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:24:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-36036086',display_name='tempest-TestVolumeBootPattern-volume-backed-server-36036086',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-36036086',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC7ygYqGHWxK0DaJs1seFklM3baxLiMpTXvH0S8XHkPkH+8csh9PSVwQ1yN6oPcYBqPnV4EbkwqwdR7LXXvahFWIwJgTiOQUNm/4A8pPU781hWAZyVba1wvrF2itzasS9w==',key_name='tempest-keypair-679936023',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2aefabef9e42412f8309f490dcfecc79',ramdisk_id='',reservation_id='r-0tukfkj7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-953001121',owner_user_name='tempest-TestVolumeBootPattern-953001121-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:24:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a463a84e332543dfbc03b81518f82be1',uuid=73adef6b-881d-466b-b55d-6cf2f974d40e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d30ae106-813b-458e-a46b-d92cbdd2e4b2", "address": "fa:16:3e:28:1e:05", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd30ae106-81", "ovs_interfaceid": "d30ae106-813b-458e-a46b-d92cbdd2e4b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:25:10 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Converting VIF {"id": "d30ae106-813b-458e-a46b-d92cbdd2e4b2", "address": "fa:16:3e:28:1e:05", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd30ae106-81", "ovs_interfaceid": "d30ae106-813b-458e-a46b-d92cbdd2e4b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:25:10 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:1e:05,bridge_name='br-int',has_traffic_filtering=True,id=d30ae106-813b-458e-a46b-d92cbdd2e4b2,network=Network(00883fc4-0b74-4afd-9043-82e2933faab3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd30ae106-81') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:25:10 user nova-compute[74683]: DEBUG os_vif [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:1e:05,bridge_name='br-int',has_traffic_filtering=True,id=d30ae106-813b-458e-a46b-d92cbdd2e4b2,network=Network(00883fc4-0b74-4afd-9043-82e2933faab3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd30ae106-81') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:25:10 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:10 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:25:10 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:25:10 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:10 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '43ee6edd-82b2-56eb-b650-8170d356b8c8', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:25:10 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:25:10 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:10 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd30ae106-81, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:25:10 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd30ae106-81, col_values=(('qos', UUID('cbeaf1de-a529-410e-8e01-7105a9102cd9')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:25:10 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd30ae106-81, col_values=(('external_ids', {'iface-id': 'd30ae106-813b-458e-a46b-d92cbdd2e4b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:1e:05', 'vm-uuid': '73adef6b-881d-466b-b55d-6cf2f974d40e'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:25:10 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:25:10 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:10 user nova-compute[74683]: INFO os_vif [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:1e:05,bridge_name='br-int',has_traffic_filtering=True,id=d30ae106-813b-458e-a46b-d92cbdd2e4b2,network=Network(00883fc4-0b74-4afd-9043-82e2933faab3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd30ae106-81')
Oct 16 11:25:10 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:25:10 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] No VIF found with MAC fa:16:3e:28:1e:05, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:25:11 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:11 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:11 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:11 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:25:11 user nova-compute[74683]: DEBUG nova.compute.manager [req-2cda1822-1324-4206-867b-33f7986612df req-28956238-9c6c-4504-8da7-eba965405621 service nova] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Received event network-vif-plugged-d30ae106-813b-458e-a46b-d92cbdd2e4b2 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:25:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-2cda1822-1324-4206-867b-33f7986612df req-28956238-9c6c-4504-8da7-eba965405621 service nova] Acquiring lock "73adef6b-881d-466b-b55d-6cf2f974d40e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:25:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-2cda1822-1324-4206-867b-33f7986612df req-28956238-9c6c-4504-8da7-eba965405621 service nova] Lock "73adef6b-881d-466b-b55d-6cf2f974d40e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:25:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-2cda1822-1324-4206-867b-33f7986612df req-28956238-9c6c-4504-8da7-eba965405621 service nova] Lock "73adef6b-881d-466b-b55d-6cf2f974d40e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:25:11 user nova-compute[74683]: DEBUG nova.compute.manager [req-2cda1822-1324-4206-867b-33f7986612df req-28956238-9c6c-4504-8da7-eba965405621 service nova] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] No waiting events found dispatching network-vif-plugged-d30ae106-813b-458e-a46b-d92cbdd2e4b2 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:25:11 user nova-compute[74683]: WARNING nova.compute.manager [req-2cda1822-1324-4206-867b-33f7986612df req-28956238-9c6c-4504-8da7-eba965405621 service nova] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Received unexpected event network-vif-plugged-d30ae106-813b-458e-a46b-d92cbdd2e4b2 for instance with vm_state building and task_state spawning.
Oct 16 11:25:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:12 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:25:12 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:25:12 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:25:12 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74683) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 11:25:13 user nova-compute[74683]: DEBUG nova.compute.manager [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Instance event wait completed in 0 seconds for  {{(pid=74683) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 11:25:13 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Guest created on hypervisor {{(pid=74683) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 11:25:13 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Instance spawned successfully.
Oct 16 11:25:13 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 11:25:13 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Found default for hw_cdrom_bus of ide {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:25:13 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Found default for hw_disk_bus of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:25:13 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Found default for hw_input_bus of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:25:13 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Found default for hw_pointer_model of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:25:13 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Found default for hw_video_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:25:13 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Found default for hw_vif_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:25:13 user nova-compute[74683]: DEBUG nova.compute.manager [req-ee7da333-f1e9-4cb1-94dc-682c5500646f req-6f237008-d0d0-49d3-93e7-320b23eca6ae service nova] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Received event network-vif-plugged-d30ae106-813b-458e-a46b-d92cbdd2e4b2 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:25:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-ee7da333-f1e9-4cb1-94dc-682c5500646f req-6f237008-d0d0-49d3-93e7-320b23eca6ae service nova] Acquiring lock "73adef6b-881d-466b-b55d-6cf2f974d40e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:25:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-ee7da333-f1e9-4cb1-94dc-682c5500646f req-6f237008-d0d0-49d3-93e7-320b23eca6ae service nova] Lock "73adef6b-881d-466b-b55d-6cf2f974d40e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:25:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-ee7da333-f1e9-4cb1-94dc-682c5500646f req-6f237008-d0d0-49d3-93e7-320b23eca6ae service nova] Lock "73adef6b-881d-466b-b55d-6cf2f974d40e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:25:13 user nova-compute[74683]: DEBUG nova.compute.manager [req-ee7da333-f1e9-4cb1-94dc-682c5500646f req-6f237008-d0d0-49d3-93e7-320b23eca6ae service nova] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] No waiting events found dispatching network-vif-plugged-d30ae106-813b-458e-a46b-d92cbdd2e4b2 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:25:13 user nova-compute[74683]: WARNING nova.compute.manager [req-ee7da333-f1e9-4cb1-94dc-682c5500646f req-6f237008-d0d0-49d3-93e7-320b23eca6ae service nova] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Received unexpected event network-vif-plugged-d30ae106-813b-458e-a46b-d92cbdd2e4b2 for instance with vm_state building and task_state spawning.
Oct 16 11:25:13 user nova-compute[74683]: INFO nova.compute.manager [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Took 5.37 seconds to spawn the instance on the hypervisor.
Oct 16 11:25:13 user nova-compute[74683]: DEBUG nova.compute.manager [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:25:14 user nova-compute[74683]: INFO nova.compute.manager [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Took 25.44 seconds to build instance.
Oct 16 11:25:14 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-50e97abe-641a-4b03-ae22-1239d797c400 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "73adef6b-881d-466b-b55d-6cf2f974d40e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.555s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:25:14 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:25:14 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:25:14 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:25:14 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:25:14 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:25:14 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Auditing locally available compute resources for user (node: user) {{(pid=74683) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 11:25:14 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:25:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b6a8c25-d3ca-48ff-b22f-9338200ebc01/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:15 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b6a8c25-d3ca-48ff-b22f-9338200ebc01/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b6a8c25-d3ca-48ff-b22f-9338200ebc01/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b6a8c25-d3ca-48ff-b22f-9338200ebc01/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45ca3cbb-53d6-4046-9be3-92cc6b71bfad/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45ca3cbb-53d6-4046-9be3-92cc6b71bfad/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45ca3cbb-53d6-4046-9be3-92cc6b71bfad/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45ca3cbb-53d6-4046-9be3-92cc6b71bfad/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9fc5a9-8659-497c-bb07-af52fe2e1761/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:15 user nova-compute[74683]: DEBUG nova.compute.manager [req-e8fc922a-e480-4b99-bec9-10e0124c4278 req-ac24b154-acd5-4710-b52e-290ce3e1828b service nova] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Received event network-changed-51406244-8351-4ada-b266-d5ec85d5f5b7 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:25:15 user nova-compute[74683]: DEBUG nova.compute.manager [req-e8fc922a-e480-4b99-bec9-10e0124c4278 req-ac24b154-acd5-4710-b52e-290ce3e1828b service nova] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Refreshing instance network info cache due to event network-changed-51406244-8351-4ada-b266-d5ec85d5f5b7. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:25:15 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e8fc922a-e480-4b99-bec9-10e0124c4278 req-ac24b154-acd5-4710-b52e-290ce3e1828b service nova] Acquiring lock "refresh_cache-4b4eaccb-e068-4e8a-9084-16229815b1d7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:25:15 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e8fc922a-e480-4b99-bec9-10e0124c4278 req-ac24b154-acd5-4710-b52e-290ce3e1828b service nova] Acquired lock "refresh_cache-4b4eaccb-e068-4e8a-9084-16229815b1d7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:25:15 user nova-compute[74683]: DEBUG nova.network.neutron [req-e8fc922a-e480-4b99-bec9-10e0124c4278 req-ac24b154-acd5-4710-b52e-290ce3e1828b service nova] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Refreshing network info cache for port 51406244-8351-4ada-b266-d5ec85d5f5b7 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:25:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9fc5a9-8659-497c-bb07-af52fe2e1761/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9fc5a9-8659-497c-bb07-af52fe2e1761/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9fc5a9-8659-497c-bb07-af52fe2e1761/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:16 user nova-compute[74683]: DEBUG nova.network.neutron [req-e8fc922a-e480-4b99-bec9-10e0124c4278 req-ac24b154-acd5-4710-b52e-290ce3e1828b service nova] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Updated VIF entry in instance network info cache for port 51406244-8351-4ada-b266-d5ec85d5f5b7. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:25:16 user nova-compute[74683]: DEBUG nova.network.neutron [req-e8fc922a-e480-4b99-bec9-10e0124c4278 req-ac24b154-acd5-4710-b52e-290ce3e1828b service nova] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Updating instance_info_cache with network_info: [{"id": "51406244-8351-4ada-b266-d5ec85d5f5b7", "address": "fa:16:3e:34:af:5c", "network": {"id": "cd8cf08c-d79c-4d2e-b849-640c440e1498", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1091743670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcb8da41d6584a689e9b50155288aa5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51406244-83", "ovs_interfaceid": "51406244-8351-4ada-b266-d5ec85d5f5b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:25:16 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-a860202f-93bf-4c53-adc6-f7de9b913964 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Acquiring lock "4b4eaccb-e068-4e8a-9084-16229815b1d7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:25:16 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-a860202f-93bf-4c53-adc6-f7de9b913964 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "4b4eaccb-e068-4e8a-9084-16229815b1d7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:25:16 user nova-compute[74683]: DEBUG nova.objects.instance [None req-a860202f-93bf-4c53-adc6-f7de9b913964 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lazy-loading 'flavor' on Instance uuid 4b4eaccb-e068-4e8a-9084-16229815b1d7 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:25:16 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e8fc922a-e480-4b99-bec9-10e0124c4278 req-ac24b154-acd5-4710-b52e-290ce3e1828b service nova] Releasing lock "refresh_cache-4b4eaccb-e068-4e8a-9084-16229815b1d7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:25:16 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-a860202f-93bf-4c53-adc6-f7de9b913964 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "4b4eaccb-e068-4e8a-9084-16229815b1d7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:25:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:16 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:16 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-a860202f-93bf-4c53-adc6-f7de9b913964 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Acquiring lock "4b4eaccb-e068-4e8a-9084-16229815b1d7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:25:16 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-a860202f-93bf-4c53-adc6-f7de9b913964 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "4b4eaccb-e068-4e8a-9084-16229815b1d7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:25:16 user nova-compute[74683]: INFO nova.compute.manager [None req-a860202f-93bf-4c53-adc6-f7de9b913964 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Attaching volume a52c1cdc-2945-43af-abd1-8a8060b4f152 to /dev/vdb
Oct 16 11:25:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.rescue --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:16 user nova-compute[74683]: DEBUG os_brick.utils [None req-a860202f-93bf-4c53-adc6-f7de9b913964 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:25:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:16 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c6bbe5-1e6e-4a3c-9121-ca0eab414e34]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:70b9d336ab7d\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:16 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9fa86e-6702-43ab-ae9f-9dd7e469dc46]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:16 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[83453d4e-9d09-4c48-8480-f9c36170f5e7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:16 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd39dacb-24fa-4ac5-a9c8-e7919925fdb9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-a860202f-93bf-4c53-adc6-f7de9b913964 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Running cmd (subprocess): nvme version {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-a860202f-93bf-4c53-adc6-f7de9b913964 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] 'nvme version' failed. Not Retrying. {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:25:16 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a860202f-93bf-4c53-adc6-f7de9b913964 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] nvme not present on system {{(pid=74683) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 11:25:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:25:16 user nova-compute[74683]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 11:25:16 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[98bce98d-191f-490b-abe7-831c9948ced6]: (4, '') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:16 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-a860202f-93bf-4c53-adc6-f7de9b913964 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74683) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 11:25:16 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-a860202f-93bf-4c53-adc6-f7de9b913964 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 11:25:16 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-a860202f-93bf-4c53-adc6-f7de9b913964 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] LIGHTOS: no hostnqn found. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 11:25:16 user nova-compute[74683]: DEBUG os_brick.utils [None req-a860202f-93bf-4c53-adc6-f7de9b913964 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:70b9d336ab7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:25:16 user nova-compute[74683]: DEBUG nova.virt.block_device [None req-a860202f-93bf-4c53-adc6-f7de9b913964 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Updating existing volume attachment record: cc80bbe0-948e-4e4e-9efb-2ad7efca0a40 {{(pid=74683) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 11:25:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.rescue --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84bb680-a542-4cb2-b0c5-67a210c25e9e/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84bb680-a542-4cb2-b0c5-67a210c25e9e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84bb680-a542-4cb2-b0c5-67a210c25e9e/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84bb680-a542-4cb2-b0c5-67a210c25e9e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:17 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:25:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:18 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:18 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:18 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:18 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:25:18 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:18 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:18 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:18 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:18 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b79d385-e512-4297-9aa4-2b9bb0cac23c/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:18 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b79d385-e512-4297-9aa4-2b9bb0cac23c/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:18 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b79d385-e512-4297-9aa4-2b9bb0cac23c/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b79d385-e512-4297-9aa4-2b9bb0cac23c/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b4eaccb-e068-4e8a-9084-16229815b1d7/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b4eaccb-e068-4e8a-9084-16229815b1d7/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b4eaccb-e068-4e8a-9084-16229815b1d7/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG nova.compute.manager [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Start spawning the instance on the hypervisor. {{(pid=74683) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Creating instance directory {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 11:25:19 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Creating image(s)
Oct 16 11:25:19 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Did not create local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Ensure instance console log exists: /opt/stack/data/nova/instances/d00bbb1a-534b-4437-9b79-91870c5d8bb5/console.log {{(pid=74683) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Start _get_guest_xml network_info=[{"id": "3d2071d3-9bd0-4aa5-a909-889b3f3155db", "address": "fa:16:3e:53:66:36", "network": {"id": "4d43cc12-d2cd-4552-90a4-884a0ff3dc66", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-825513246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6e0046017b4bba85caf2a39d1c67b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d2071d3-9b", "ovs_interfaceid": "3d2071d3-9bd0-4aa5-a909-889b3f3155db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PSFCAUyR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd00bbb1a-534b-4437-9b79-91870c5d8bb5', 'attached_at': '', 'detached_at': '', 'volume_id': '89f4c36a-6914-44f0-b0ce-54415b3b2354', 'serial': '89f4c36a-6914-44f0-b0ce-54415b3b2354'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': 'bd57c82d-2579-4ef5-9598-de3d7cd6a8c4', 'volume_type': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:25:19 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:25:19 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:25:19 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Calling os-brick to attach iSCSI Volume {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PSFCAUyR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:25:19 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:25:19 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:25:19 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:25:19 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:25:19 user nova-compute[74683]: INFO os_brick.initiator.connectors.iscsi [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 11:25:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 -p 172.16.0.220:3260 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10d68f1-c86b-44f4-98ec-e5b9edcbbce1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 11:25:19 user nova-compute[74683]:  {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 -p 172.16.0.220:3260 --interface default --op new {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf0bdc1-06af-47a1-9818-45f0357a8988]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354] added\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354] added
Oct 16 11:25:19 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d611a0db-5616-4b87-b14f-abf0592fc677]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b4eaccb-e068-4e8a-9084-16229815b1d7/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9f4840-69c8-4980-afd8-73a84f743dff/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[3467369f-2cc2-4945-b462-c6953b1c3757]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PSFCAUyR {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PSFCAUyR" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e5a259-2c70-42cc-9fc7-2bf9d81dd29c]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PSFCAUyR'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad4cd74-5a8c-4210-b9a9-5077638d00ac]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b89ba0-f48e-43cc-8503-7d7db443f429]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:25:19 user nova-compute[74683]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee (non-flash)
Oct 16 11:25:19 user nova-compute[74683]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d (non-flash)
Oct 16 11:25:19 user nova-compute[74683]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)
Oct 16 11:25:19 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:25:19 user nova-compute[74683]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee (non-flash)
Oct 16 11:25:19 user nova-compute[74683]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d (non-flash)
Oct 16 11:25:19 user nova-compute[74683]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)
Oct 16 11:25:19 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 -p 172.16.0.220:3260 --login {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca7d7cc-a7d9-414b-878e-7f518e6b9fb4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354, portal: 172.16.0.220,3260]
Oct 16 11:25:19 user nova-compute[74683]: Login to [iface: default, target: iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354, portal: 172.16.0.220,3260] successful.
Oct 16 11:25:19 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7fe8be4-42af-4623-ab02-8953f74745d5]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9f4840-69c8-4980-afd8-73a84f743dff/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9f4840-69c8-4980-afd8-73a84f743dff/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[4133d4b4-a7ff-4c4e-a915-5512f6ec8090]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:25:19 user nova-compute[74683]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee (non-flash)
Oct 16 11:25:19 user nova-compute[74683]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d (non-flash)
Oct 16 11:25:19 user nova-compute[74683]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)
Oct 16 11:25:19 user nova-compute[74683]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)
Oct 16 11:25:19 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:25:19 user nova-compute[74683]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee (non-flash)
Oct 16 11:25:19 user nova-compute[74683]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d (non-flash)
Oct 16 11:25:19 user nova-compute[74683]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)
Oct 16 11:25:19 user nova-compute[74683]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)
Oct 16 11:25:19 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.386s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Connected to 172.16.0.220:3260 {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] HCTL ('35', '-', '-', 0) found on session 27 with lun 0 {{(pid=74683) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74683) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.037s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[739f258e-b5ae-468b-a8ed-97d7fad58b27]: (4, ('- - 0', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:19 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Searching for a device in session 27 and hctl ['35', '*', '*', 0] yield: None {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:25:20 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9f4840-69c8-4980-afd8-73a84f743dff/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:20 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:25:20 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:25:20 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Hypervisor/Node resource view: name=user free_ram=7056MB free_disk=24.974853515625GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74683) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 11:25:20 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:25:20 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:25:20 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 18a77385-fab9-4ea0-8aa6-666cf7e798a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:25:20 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance d5e55361-d9ed-4d07-91b0-ec4d08b2e817 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:25:20 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 45ca3cbb-53d6-4046-9be3-92cc6b71bfad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:25:20 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance e84bb680-a542-4cb2-b0c5-67a210c25e9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:25:20 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance edd01413-1f8a-49e3-aa3c-ecb19c62afae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:25:20 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 6c9fc5a9-8659-497c-bb07-af52fe2e1761 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:25:20 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 9b8ba94f-43cc-4f06-bcd9-83935ccbe117 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:25:20 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance b91af786-36e3-4815-811f-fb3c055e758d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:25:20 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 0b79d385-e512-4297-9aa4-2b9bb0cac23c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:25:20 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 4b4eaccb-e068-4e8a-9084-16229815b1d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:25:20 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 4b6a8c25-d3ca-48ff-b22f-9338200ebc01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:25:20 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 6300da82-2079-455c-8ab2-9fd13ce9e825 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:25:20 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance d00bbb1a-534b-4437-9b79-91870c5d8bb5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:25:20 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 73adef6b-881d-466b-b55d-6cf2f974d40e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:25:20 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance be9f4840-69c8-4980-afd8-73a84f743dff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:25:20 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 11:25:20 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 11:25:20 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Searching for a device in session 27 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:25:21 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PSFCAUyR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 11:25:21 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.438s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:25:21 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] <== connect_volume: return (1440ms) {'type': 'block', 'scsi_wwn': '26366346562353433', 'path': '/dev/sdd'} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:25:21 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26366346562353433', 'path': '/dev/sdd'} {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 11:25:21 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:24:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2068879379',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2068879379',id=29,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d6e0046017b4bba85caf2a39d1c67b3',ramdisk_id='',reservation_id='r-zizi1x7p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1787816377',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:24:44Z,user_data=None,user_id='76a41804541e4a259771702727d9993e',uuid=d00bbb1a-534b-4437-9b79-91870c5d8bb5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d2071d3-9bd0-4aa5-a909-889b3f3155db", "address": "fa:16:3e:53:66:36", "network": {"id": "4d43cc12-d2cd-4552-90a4-884a0ff3dc66", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-825513246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6e0046017b4bba85caf2a39d1c67b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d2071d3-9b", "ovs_interfaceid": "3d2071d3-9bd0-4aa5-a909-889b3f3155db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:25:21 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Converting VIF {"id": "3d2071d3-9bd0-4aa5-a909-889b3f3155db", "address": "fa:16:3e:53:66:36", "network": {"id": "4d43cc12-d2cd-4552-90a4-884a0ff3dc66", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-825513246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6e0046017b4bba85caf2a39d1c67b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d2071d3-9b", "ovs_interfaceid": "3d2071d3-9bd0-4aa5-a909-889b3f3155db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:25:21 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:66:36,bridge_name='br-int',has_traffic_filtering=True,id=3d2071d3-9bd0-4aa5-a909-889b3f3155db,network=Network(4d43cc12-d2cd-4552-90a4-884a0ff3dc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d2071d3-9b') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:25:21 user nova-compute[74683]: DEBUG nova.objects.instance [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lazy-loading 'pci_devices' on Instance uuid d00bbb1a-534b-4437-9b79-91870c5d8bb5 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:25:21 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:25:21 user nova-compute[74683]:   <uuid>d00bbb1a-534b-4437-9b79-91870c5d8bb5</uuid>
Oct 16 11:25:21 user nova-compute[74683]:   <name>instance-0000001d</name>
Oct 16 11:25:21 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:25:21 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:25:21 user nova-compute[74683]:   <metadata>
Oct 16 11:25:21 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:25:21 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:25:21 user nova-compute[74683]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2068879379</nova:name>
Oct 16 11:25:21 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:25:19</nova:creationTime>
Oct 16 11:25:21 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:25:21 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:25:21 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:25:21 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:25:21 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:25:21 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:25:21 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:25:21 user nova-compute[74683]:       <nova:owner>
Oct 16 11:25:21 user nova-compute[74683]:         <nova:user uuid="76a41804541e4a259771702727d9993e">tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member</nova:user>
Oct 16 11:25:21 user nova-compute[74683]:         <nova:project uuid="4d6e0046017b4bba85caf2a39d1c67b3">tempest-ServerBootFromVolumeStableRescueTest-1787816377</nova:project>
Oct 16 11:25:21 user nova-compute[74683]:       </nova:owner>
Oct 16 11:25:21 user nova-compute[74683]:       <nova:root type="image" uuid="0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f"/>
Oct 16 11:25:21 user nova-compute[74683]:       <nova:ports>
Oct 16 11:25:21 user nova-compute[74683]:         <nova:port uuid="3d2071d3-9bd0-4aa5-a909-889b3f3155db">
Oct 16 11:25:21 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 16 11:25:21 user nova-compute[74683]:         </nova:port>
Oct 16 11:25:21 user nova-compute[74683]:       </nova:ports>
Oct 16 11:25:21 user nova-compute[74683]:     </nova:instance>
Oct 16 11:25:21 user nova-compute[74683]:   </metadata>
Oct 16 11:25:21 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:25:21 user nova-compute[74683]:     <system>
Oct 16 11:25:21 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:25:21 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:25:21 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:25:21 user nova-compute[74683]:       <entry name="serial">d00bbb1a-534b-4437-9b79-91870c5d8bb5</entry>
Oct 16 11:25:21 user nova-compute[74683]:       <entry name="uuid">d00bbb1a-534b-4437-9b79-91870c5d8bb5</entry>
Oct 16 11:25:21 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:25:21 user nova-compute[74683]:     </system>
Oct 16 11:25:21 user nova-compute[74683]:   </sysinfo>
Oct 16 11:25:21 user nova-compute[74683]:   <os>
Oct 16 11:25:21 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:25:21 user nova-compute[74683]:     <boot dev="hd"/>
Oct 16 11:25:21 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:25:21 user nova-compute[74683]:   </os>
Oct 16 11:25:21 user nova-compute[74683]:   <features>
Oct 16 11:25:21 user nova-compute[74683]:     <acpi/>
Oct 16 11:25:21 user nova-compute[74683]:     <apic/>
Oct 16 11:25:21 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:25:21 user nova-compute[74683]:   </features>
Oct 16 11:25:21 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:25:21 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:25:21 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:25:21 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:25:21 user nova-compute[74683]:   </clock>
Oct 16 11:25:21 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:25:21 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:25:21 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:25:21 user nova-compute[74683]:   </cpu>
Oct 16 11:25:21 user nova-compute[74683]:   <devices>
Oct 16 11:25:21 user nova-compute[74683]:     <disk type="block" device="disk">
Oct 16 11:25:21 user nova-compute[74683]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:25:21 user nova-compute[74683]:       <source dev="/dev/sdd"/>
Oct 16 11:25:21 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:25:21 user nova-compute[74683]:       <serial>89f4c36a-6914-44f0-b0ce-54415b3b2354</serial>
Oct 16 11:25:21 user nova-compute[74683]:     </disk>
Oct 16 11:25:21 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:25:21 user nova-compute[74683]:       <mac address="fa:16:3e:53:66:36"/>
Oct 16 11:25:21 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:25:21 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:25:21 user nova-compute[74683]:       <target dev="tap3d2071d3-9b"/>
Oct 16 11:25:21 user nova-compute[74683]:     </interface>
Oct 16 11:25:21 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:25:21 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/d00bbb1a-534b-4437-9b79-91870c5d8bb5/console.log" append="off"/>
Oct 16 11:25:21 user nova-compute[74683]:     </serial>
Oct 16 11:25:21 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:25:21 user nova-compute[74683]:     <video>
Oct 16 11:25:21 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:25:21 user nova-compute[74683]:     </video>
Oct 16 11:25:21 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:25:21 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:25:21 user nova-compute[74683]:     </rng>
Oct 16 11:25:21 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:25:21 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:25:21 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:25:21 user nova-compute[74683]:     </memballoon>
Oct 16 11:25:21 user nova-compute[74683]:   </devices>
Oct 16 11:25:21 user nova-compute[74683]: </domain>
Oct 16 11:25:21 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:25:21 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:24:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2068879379',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2068879379',id=29,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d6e0046017b4bba85caf2a39d1c67b3',ramdisk_id='',reservation_id='r-zizi1x7p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1787816377',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:24:44Z,user_data=None,user_id='76a41804541e4a259771702727d9993e',uuid=d00bbb1a-534b-4437-9b79-91870c5d8bb5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d2071d3-9bd0-4aa5-a909-889b3f3155db", "address": "fa:16:3e:53:66:36", "network": {"id": "4d43cc12-d2cd-4552-90a4-884a0ff3dc66", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-825513246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6e0046017b4bba85caf2a39d1c67b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d2071d3-9b", "ovs_interfaceid": "3d2071d3-9bd0-4aa5-a909-889b3f3155db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:25:21 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Converting VIF {"id": "3d2071d3-9bd0-4aa5-a909-889b3f3155db", "address": "fa:16:3e:53:66:36", "network": {"id": "4d43cc12-d2cd-4552-90a4-884a0ff3dc66", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-825513246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6e0046017b4bba85caf2a39d1c67b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d2071d3-9b", "ovs_interfaceid": "3d2071d3-9bd0-4aa5-a909-889b3f3155db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:25:21 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:66:36,bridge_name='br-int',has_traffic_filtering=True,id=3d2071d3-9bd0-4aa5-a909-889b3f3155db,network=Network(4d43cc12-d2cd-4552-90a4-884a0ff3dc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d2071d3-9b') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:25:21 user nova-compute[74683]: DEBUG os_vif [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:66:36,bridge_name='br-int',has_traffic_filtering=True,id=3d2071d3-9bd0-4aa5-a909-889b3f3155db,network=Network(4d43cc12-d2cd-4552-90a4-884a0ff3dc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d2071d3-9b') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:25:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:25:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:25:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e8f32391-c152-59b6-b7ec-bdb95eb9d7f7', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:25:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:25:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d2071d3-9b, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:25:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3d2071d3-9b, col_values=(('qos', UUID('fb4ce0ef-242d-42ed-ac2a-3ed98333fcc2')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:25:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3d2071d3-9b, col_values=(('external_ids', {'iface-id': '3d2071d3-9bd0-4aa5-a909-889b3f3155db', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:66:36', 'vm-uuid': 'd00bbb1a-534b-4437-9b79-91870c5d8bb5'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:25:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:25:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:21 user nova-compute[74683]: INFO os_vif [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:66:36,bridge_name='br-int',has_traffic_filtering=True,id=3d2071d3-9bd0-4aa5-a909-889b3f3155db,network=Network(4d43cc12-d2cd-4552-90a4-884a0ff3dc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d2071d3-9b')
Oct 16 11:25:21 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:25:21 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] No VIF found with MAC fa:16:3e:53:66:36, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:25:21 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:25:21 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:25:21 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Compute_service record updated for user:user {{(pid=74683) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 11:25:21 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.673s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:25:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:22 user nova-compute[74683]: DEBUG nova.compute.manager [req-b8a6870d-46d8-4faf-bbf6-1ed642c77d1f req-81bffd69-d2d8-4eb5-8f5a-efc8cbe499b7 service nova] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Received event network-vif-plugged-3d2071d3-9bd0-4aa5-a909-889b3f3155db {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:25:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b8a6870d-46d8-4faf-bbf6-1ed642c77d1f req-81bffd69-d2d8-4eb5-8f5a-efc8cbe499b7 service nova] Acquiring lock "d00bbb1a-534b-4437-9b79-91870c5d8bb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:25:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b8a6870d-46d8-4faf-bbf6-1ed642c77d1f req-81bffd69-d2d8-4eb5-8f5a-efc8cbe499b7 service nova] Lock "d00bbb1a-534b-4437-9b79-91870c5d8bb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:25:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b8a6870d-46d8-4faf-bbf6-1ed642c77d1f req-81bffd69-d2d8-4eb5-8f5a-efc8cbe499b7 service nova] Lock "d00bbb1a-534b-4437-9b79-91870c5d8bb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:25:22 user nova-compute[74683]: DEBUG nova.compute.manager [req-b8a6870d-46d8-4faf-bbf6-1ed642c77d1f req-81bffd69-d2d8-4eb5-8f5a-efc8cbe499b7 service nova] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] No waiting events found dispatching network-vif-plugged-3d2071d3-9bd0-4aa5-a909-889b3f3155db {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:25:22 user nova-compute[74683]: WARNING nova.compute.manager [req-b8a6870d-46d8-4faf-bbf6-1ed642c77d1f req-81bffd69-d2d8-4eb5-8f5a-efc8cbe499b7 service nova] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Received unexpected event network-vif-plugged-3d2071d3-9bd0-4aa5-a909-889b3f3155db for instance with vm_state building and task_state spawning.
Oct 16 11:25:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:24 user nova-compute[74683]: DEBUG nova.compute.manager [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Instance event wait completed in 0 seconds for  {{(pid=74683) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 11:25:24 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Guest created on hypervisor {{(pid=74683) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 11:25:24 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Instance spawned successfully.
Oct 16 11:25:24 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 11:25:24 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Found default for hw_cdrom_bus of ide {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:25:24 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Found default for hw_disk_bus of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:25:24 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Found default for hw_input_bus of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:25:24 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Found default for hw_pointer_model of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:25:24 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Found default for hw_video_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:25:24 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Found default for hw_vif_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:25:24 user nova-compute[74683]: DEBUG nova.compute.manager [req-c35c629b-49f0-4ea3-b62d-d4224faf9771 req-1922b2a2-03fc-481f-a809-29a727df462c service nova] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Received event network-vif-plugged-3d2071d3-9bd0-4aa5-a909-889b3f3155db {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:25:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c35c629b-49f0-4ea3-b62d-d4224faf9771 req-1922b2a2-03fc-481f-a809-29a727df462c service nova] Acquiring lock "d00bbb1a-534b-4437-9b79-91870c5d8bb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:25:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c35c629b-49f0-4ea3-b62d-d4224faf9771 req-1922b2a2-03fc-481f-a809-29a727df462c service nova] Lock "d00bbb1a-534b-4437-9b79-91870c5d8bb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:25:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c35c629b-49f0-4ea3-b62d-d4224faf9771 req-1922b2a2-03fc-481f-a809-29a727df462c service nova] Lock "d00bbb1a-534b-4437-9b79-91870c5d8bb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:25:24 user nova-compute[74683]: DEBUG nova.compute.manager [req-c35c629b-49f0-4ea3-b62d-d4224faf9771 req-1922b2a2-03fc-481f-a809-29a727df462c service nova] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] No waiting events found dispatching network-vif-plugged-3d2071d3-9bd0-4aa5-a909-889b3f3155db {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:25:24 user nova-compute[74683]: WARNING nova.compute.manager [req-c35c629b-49f0-4ea3-b62d-d4224faf9771 req-1922b2a2-03fc-481f-a809-29a727df462c service nova] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Received unexpected event network-vif-plugged-3d2071d3-9bd0-4aa5-a909-889b3f3155db for instance with vm_state building and task_state spawning.
Oct 16 11:25:24 user nova-compute[74683]: INFO nova.compute.manager [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Took 5.38 seconds to spawn the instance on the hypervisor.
Oct 16 11:25:24 user nova-compute[74683]: DEBUG nova.compute.manager [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:25:24 user nova-compute[74683]: INFO nova.compute.manager [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Took 41.58 seconds to build instance.
Oct 16 11:25:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-66c69c5b-bfb3-4f0e-a5dc-19c4f63328ba tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "d00bbb1a-534b-4437-9b79-91870c5d8bb5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 41.729s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:25:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a860202f-93bf-4c53-adc6-f7de9b913964 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Calling os-brick to attach iSCSI Volume {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a860202f-93bf-4c53-adc6-f7de9b913964 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xWOyzsUu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:25:36 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-a860202f-93bf-4c53-adc6-f7de9b913964 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:25:36 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-a860202f-93bf-4c53-adc6-f7de9b913964 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-a860202f-93bf-4c53-adc6-f7de9b913964 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:25:36 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-a860202f-93bf-4c53-adc6-f7de9b913964 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:25:36 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-a860202f-93bf-4c53-adc6-f7de9b913964 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-a860202f-93bf-4c53-adc6-f7de9b913964 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:25:36 user nova-compute[74683]: INFO os_brick.initiator.connectors.iscsi [None req-a860202f-93bf-4c53-adc6-f7de9b913964 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 11:25:36 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 -p 172.16.0.220:3260 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7e871b-c259-40d0-b0aa-a1fa1087fb4e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a860202f-93bf-4c53-adc6-f7de9b913964 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 11:25:36 user nova-compute[74683]:  {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 -p 172.16.0.220:3260 --interface default --op new {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c3ad042-909e-4047-8e57-914b8249ec69]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152] added\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a860202f-93bf-4c53-adc6-f7de9b913964 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152] added
Oct 16 11:25:36 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[5871f64c-0d39-47e2-b0cf-88fbc148ae65]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a860202f-93bf-4c53-adc6-f7de9b913964 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b598687-fa23-4ba7-bfa5-740683f19a5b]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a860202f-93bf-4c53-adc6-f7de9b913964 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xWOyzsUu {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xWOyzsUu" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e06c63-e107-4799-a3a3-b2fd35aa4c51]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a860202f-93bf-4c53-adc6-f7de9b913964 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xWOyzsUu'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ca6ff0-9c08-496d-a489-d8ae21efc6ca]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a860202f-93bf-4c53-adc6-f7de9b913964 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c79c52-b6c0-44b3-825e-336ed22224b7]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6ee43b-3eef-43df-b1f9-5d5e9477a40b (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a860202f-93bf-4c53-adc6-f7de9b913964 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:25:36 user nova-compute[74683]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee (non-flash)
Oct 16 11:25:36 user nova-compute[74683]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d (non-flash)
Oct 16 11:25:36 user nova-compute[74683]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)
Oct 16 11:25:36 user nova-compute[74683]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)
Oct 16 11:25:36 user nova-compute[74683]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6ee43b-3eef-43df-b1f9-5d5e9477a40b (non-flash)
Oct 16 11:25:36 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a860202f-93bf-4c53-adc6-f7de9b913964 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:25:36 user nova-compute[74683]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee (non-flash)
Oct 16 11:25:36 user nova-compute[74683]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d (non-flash)
Oct 16 11:25:36 user nova-compute[74683]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)
Oct 16 11:25:36 user nova-compute[74683]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)
Oct 16 11:25:36 user nova-compute[74683]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6ee43b-3eef-43df-b1f9-5d5e9477a40b (non-flash)
Oct 16 11:25:36 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 -p 172.16.0.220:3260 --login {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-94a5ea37-6774-4c80-aba3-eefcf9fc3426 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Acquiring lock "e84bb680-a542-4cb2-b0c5-67a210c25e9e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-94a5ea37-6774-4c80-aba3-eefcf9fc3426 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Lock "e84bb680-a542-4cb2-b0c5-67a210c25e9e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-94a5ea37-6774-4c80-aba3-eefcf9fc3426 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Acquiring lock "e84bb680-a542-4cb2-b0c5-67a210c25e9e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-94a5ea37-6774-4c80-aba3-eefcf9fc3426 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Lock "e84bb680-a542-4cb2-b0c5-67a210c25e9e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-94a5ea37-6774-4c80-aba3-eefcf9fc3426 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Lock "e84bb680-a542-4cb2-b0c5-67a210c25e9e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:25:36 user nova-compute[74683]: INFO nova.compute.manager [None req-94a5ea37-6774-4c80-aba3-eefcf9fc3426 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Terminating instance
Oct 16 11:25:36 user nova-compute[74683]: DEBUG nova.compute.manager [None req-94a5ea37-6774-4c80-aba3-eefcf9fc3426 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Start destroying the instance on the hypervisor. {{(pid=74683) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[758ef0f6-99e5-41be-a549-923ea6322180]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a860202f-93bf-4c53-adc6-f7de9b913964 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152, portal: 172.16.0.220,3260]
Oct 16 11:25:36 user nova-compute[74683]: Login to [iface: default, target: iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152, portal: 172.16.0.220,3260] successful.
Oct 16 11:25:36 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2a37c0-d575-468f-8f25-3565a5311542]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a860202f-93bf-4c53-adc6-f7de9b913964 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[5102dde4-e0f8-4a5f-9572-907ccc18989c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6ee43b-3eef-43df-b1f9-5d5e9477a40b (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a860202f-93bf-4c53-adc6-f7de9b913964 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:25:36 user nova-compute[74683]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee (non-flash)
Oct 16 11:25:36 user nova-compute[74683]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d (non-flash)
Oct 16 11:25:36 user nova-compute[74683]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)
Oct 16 11:25:36 user nova-compute[74683]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)
Oct 16 11:25:36 user nova-compute[74683]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6ee43b-3eef-43df-b1f9-5d5e9477a40b (non-flash)
Oct 16 11:25:36 user nova-compute[74683]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 (non-flash)
Oct 16 11:25:36 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a860202f-93bf-4c53-adc6-f7de9b913964 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:25:36 user nova-compute[74683]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee (non-flash)
Oct 16 11:25:36 user nova-compute[74683]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d (non-flash)
Oct 16 11:25:36 user nova-compute[74683]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)
Oct 16 11:25:36 user nova-compute[74683]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)
Oct 16 11:25:36 user nova-compute[74683]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6ee43b-3eef-43df-b1f9-5d5e9477a40b (non-flash)
Oct 16 11:25:36 user nova-compute[74683]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 (non-flash)
Oct 16 11:25:36 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-a860202f-93bf-4c53-adc6-f7de9b913964 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a860202f-93bf-4c53-adc6-f7de9b913964 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Connected to 172.16.0.220:3260 {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-a860202f-93bf-4c53-adc6-f7de9b913964 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] HCTL ('39', '-', '-', 0) found on session 29 with lun 0 {{(pid=74683) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-a860202f-93bf-4c53-adc6-f7de9b913964 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74683) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.025s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55f1096-d78e-48ad-99f6-6865ae2ae83d]: (4, ('- - 0', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-a860202f-93bf-4c53-adc6-f7de9b913964 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Searching for a device in session 29 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a860202f-93bf-4c53-adc6-f7de9b913964 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xWOyzsUu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG nova.compute.manager [req-e2339b40-3da7-46e5-bcd1-9d5d090963e2 req-0194fedb-76e2-4bbd-a4fc-7aec0f59a12f service nova] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Received event network-vif-unplugged-f57bee45-4d7d-4d93-ab04-0777c2d47ec2 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e2339b40-3da7-46e5-bcd1-9d5d090963e2 req-0194fedb-76e2-4bbd-a4fc-7aec0f59a12f service nova] Acquiring lock "e84bb680-a542-4cb2-b0c5-67a210c25e9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e2339b40-3da7-46e5-bcd1-9d5d090963e2 req-0194fedb-76e2-4bbd-a4fc-7aec0f59a12f service nova] Lock "e84bb680-a542-4cb2-b0c5-67a210c25e9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e2339b40-3da7-46e5-bcd1-9d5d090963e2 req-0194fedb-76e2-4bbd-a4fc-7aec0f59a12f service nova] Lock "e84bb680-a542-4cb2-b0c5-67a210c25e9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG nova.compute.manager [req-e2339b40-3da7-46e5-bcd1-9d5d090963e2 req-0194fedb-76e2-4bbd-a4fc-7aec0f59a12f service nova] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] No waiting events found dispatching network-vif-unplugged-f57bee45-4d7d-4d93-ab04-0777c2d47ec2 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:25:36 user nova-compute[74683]: DEBUG nova.compute.manager [req-e2339b40-3da7-46e5-bcd1-9d5d090963e2 req-0194fedb-76e2-4bbd-a4fc-7aec0f59a12f service nova] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Received event network-vif-unplugged-f57bee45-4d7d-4d93-ab04-0777c2d47ec2 for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 11:25:37 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Instance destroyed successfully.
Oct 16 11:25:37 user nova-compute[74683]: DEBUG nova.objects.instance [None req-94a5ea37-6774-4c80-aba3-eefcf9fc3426 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Lazy-loading 'resources' on Instance uuid e84bb680-a542-4cb2-b0c5-67a210c25e9e {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-94a5ea37-6774-4c80-aba3-eefcf9fc3426 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:19:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1123916680',display_name='tempest-TestVolumeSwap-server-1123916680',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1123916680',id=17,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtJu6KPU+wFH8+oEgO3Gb6kPycHvwJ3cxMZMlUl+zyDZgHVHxTV6VkjR7C0TyWLXR9wkQzP+/vj+MZvv3t2oAR9TsJqTjYF/YD/LGJtaUXyJVeVjyaVfx0kdFqL3Nmcmg==',key_name='tempest-keypair-1228391609',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:19:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae0f6604619241b798a0043f73efd6df',ramdisk_id='',reservation_id='r-d9xuwcmi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1722834028',owner_user_name='tempest-TestVolumeSwap-1722834028-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:19:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12ee22dd1de940e0911943acd54dd7bb',uuid=e84bb680-a542-4cb2-b0c5-67a210c25e9e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f57bee45-4d7d-4d93-ab04-0777c2d47ec2", "address": "fa:16:3e:80:bd:6c", "network": {"id": "9fca81bc-e1d4-4e04-83d3-e2a85af3b114", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1394655085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae0f6604619241b798a0043f73efd6df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf57bee45-4d", "ovs_interfaceid": "f57bee45-4d7d-4d93-ab04-0777c2d47ec2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-94a5ea37-6774-4c80-aba3-eefcf9fc3426 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Converting VIF {"id": "f57bee45-4d7d-4d93-ab04-0777c2d47ec2", "address": "fa:16:3e:80:bd:6c", "network": {"id": "9fca81bc-e1d4-4e04-83d3-e2a85af3b114", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1394655085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae0f6604619241b798a0043f73efd6df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf57bee45-4d", "ovs_interfaceid": "f57bee45-4d7d-4d93-ab04-0777c2d47ec2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-94a5ea37-6774-4c80-aba3-eefcf9fc3426 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:bd:6c,bridge_name='br-int',has_traffic_filtering=True,id=f57bee45-4d7d-4d93-ab04-0777c2d47ec2,network=Network(9fca81bc-e1d4-4e04-83d3-e2a85af3b114),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf57bee45-4d') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG os_vif [None req-94a5ea37-6774-4c80-aba3-eefcf9fc3426 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:bd:6c,bridge_name='br-int',has_traffic_filtering=True,id=f57bee45-4d7d-4d93-ab04-0777c2d47ec2,network=Network(9fca81bc-e1d4-4e04-83d3-e2a85af3b114),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf57bee45-4d') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf57bee45-4d, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7a629633-ad77-423e-8649-c45c79e21210) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:25:37 user nova-compute[74683]: INFO os_vif [None req-94a5ea37-6774-4c80-aba3-eefcf9fc3426 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:bd:6c,bridge_name='br-int',has_traffic_filtering=True,id=f57bee45-4d7d-4d93-ab04-0777c2d47ec2,network=Network(9fca81bc-e1d4-4e04-83d3-e2a85af3b114),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf57bee45-4d')
Oct 16 11:25:37 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94a5ea37-6774-4c80-aba3-eefcf9fc3426 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] calling os-brick to detach iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a5ea37-6774-4c80-aba3-eefcf9fc3426 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, {'target_iqn': 'iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HPFkpWLi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': '83717834-0a00-4b2d-a2a7-7aeaa3d84cee'}, None), 'kwargs': True}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:25:37 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-94a5ea37-6774-4c80-aba3-eefcf9fc3426 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:25:37 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-94a5ea37-6774-4c80-aba3-eefcf9fc3426 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-a860202f-93bf-4c53-adc6-f7de9b913964 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.386s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a860202f-93bf-4c53-adc6-f7de9b913964 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] <== connect_volume: return (1388ms) {'type': 'block', 'scsi_wwn': '23162326266613263', 'path': '/dev/sdh'} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a860202f-93bf-4c53-adc6-f7de9b913964 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162326266613263', 'path': '/dev/sdh'} {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-94a5ea37-6774-4c80-aba3-eefcf9fc3426 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.255s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG nova.objects.instance [None req-a860202f-93bf-4c53-adc6-f7de9b913964 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lazy-loading 'flavor' on Instance uuid 4b4eaccb-e068-4e8a-9084-16229815b1d7 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[727c44c2-817c-476a-9a5b-3c1c8d8b6047]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b6ee43b-3eef-43df-b1f9-5d5e9477a40b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a5ea37-6774-4c80-aba3-eefcf9fc3426 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 11:25:37 user nova-compute[74683]: No targets found.
Oct 16 11:25:37 user nova-compute[74683]: iSNS:
Oct 16 11:25:37 user nova-compute[74683]: No targets found.
Oct 16 11:25:37 user nova-compute[74683]: STATIC:
Oct 16 11:25:37 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152
Oct 16 11:25:37 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:25:37 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:25:37 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354
Oct 16 11:25:37 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:25:37 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:25:37 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d
Oct 16 11:25:37 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:25:37 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:25:37 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb
Oct 16 11:25:37 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:25:37 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:25:37 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:5b6ee43b-3eef-43df-b1f9-5d5e9477a40b
Oct 16 11:25:37 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:25:37 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:25:37 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0
Oct 16 11:25:37 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:25:37 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:25:37 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee
Oct 16 11:25:37 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:25:37 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:25:37 user nova-compute[74683]: FIRMWARE:
Oct 16 11:25:37 user nova-compute[74683]: No targets found.
Oct 16 11:25:37 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a5ea37-6774-4c80-aba3-eefcf9fc3426 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 11:25:37 user nova-compute[74683]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 11:25:37 user nova-compute[74683]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74683) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a5ea37-6774-4c80-aba3-eefcf9fc3426 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee', 0)] {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-a860202f-93bf-4c53-adc6-f7de9b913964 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 11:25:37 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:25:37 user nova-compute[74683]:   <source dev="/dev/sdh"/>
Oct 16 11:25:37 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:25:37 user nova-compute[74683]:   <serial>a52c1cdc-2945-43af-abd1-8a8060b4f152</serial>
Oct 16 11:25:37 user nova-compute[74683]: </disk>
Oct 16 11:25:37 user nova-compute[74683]:  {{(pid=74683) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d660816-37d7-41c3-bffd-d29d356e7955]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b6ee43b-3eef-43df-b1f9-5d5e9477a40b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[497c2d65-33ee-4496-82e9-8b505afa516c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6ee43b-3eef-43df-b1f9-5d5e9477a40b (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a5ea37-6774-4c80-aba3-eefcf9fc3426 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:25:37 user nova-compute[74683]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee (non-flash)
Oct 16 11:25:37 user nova-compute[74683]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d (non-flash)
Oct 16 11:25:37 user nova-compute[74683]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)
Oct 16 11:25:37 user nova-compute[74683]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)
Oct 16 11:25:37 user nova-compute[74683]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6ee43b-3eef-43df-b1f9-5d5e9477a40b (non-flash)
Oct 16 11:25:37 user nova-compute[74683]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 (non-flash)
Oct 16 11:25:37 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a5ea37-6774-4c80-aba3-eefcf9fc3426 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:25:37 user nova-compute[74683]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee (non-flash)
Oct 16 11:25:37 user nova-compute[74683]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d (non-flash)
Oct 16 11:25:37 user nova-compute[74683]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)
Oct 16 11:25:37 user nova-compute[74683]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)
Oct 16 11:25:37 user nova-compute[74683]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6ee43b-3eef-43df-b1f9-5d5e9477a40b (non-flash)
Oct 16 11:25:37 user nova-compute[74683]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 (non-flash)
Oct 16 11:25:37 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a5ea37-6774-4c80-aba3-eefcf9fc3426 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda6c490310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee'): ({'sde'}, set())}) {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-94a5ea37-6774-4c80-aba3-eefcf9fc3426 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Removing single pathed devices sde {{(pid=74683) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[53993625-71de-4cb3-b84a-105c8933b6f5]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[5578c4c7-876f-4814-a12a-624baec1feb4]: (4, ('ok\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-94a5ea37-6774-4c80-aba3-eefcf9fc3426 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Flushing IO for device /dev/sde {{(pid=74683) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d488c83c-5c70-405a-a384-09081c6683f3]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-94a5ea37-6774-4c80-aba3-eefcf9fc3426 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74683) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66e1be7-0299-4954-97ac-c230b8da4284]: (4, ('1', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-94a5ea37-6774-4c80-aba3-eefcf9fc3426 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-94a5ea37-6774-4c80-aba3-eefcf9fc3426 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] SCSI volumes sde have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a5ea37-6774-4c80-aba3-eefcf9fc3426 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee')] {{(pid=74683) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[52eded63-fad6-417e-9cd0-822dba651000]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a5ea37-6774-4c80-aba3-eefcf9fc3426 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee -p 172.16.0.220:3260 --logout {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[64fd27f1-e258-46e2-b98c-22e74dad6134]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a5ea37-6774-4c80-aba3-eefcf9fc3426 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee, portal: 172.16.0.220,3260]
Oct 16 11:25:37 user nova-compute[74683]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee, portal: 172.16.0.220,3260] successful.
Oct 16 11:25:37 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee -p 172.16.0.220:3260 --op delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83717834-0a00-4b2d-a2a7-7aeaa3d84cee -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb1591d-cae4-4e98-81a3-b4572091cc41]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a5ea37-6774-4c80-aba3-eefcf9fc3426 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-94a5ea37-6774-4c80-aba3-eefcf9fc3426 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a5ea37-6774-4c80-aba3-eefcf9fc3426 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] <== disconnect_volume: return (617ms) None {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:25:37 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94a5ea37-6774-4c80-aba3-eefcf9fc3426 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Disconnected iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 11:25:37 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-94a5ea37-6774-4c80-aba3-eefcf9fc3426 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Deleting instance files /opt/stack/data/nova/instances/e84bb680-a542-4cb2-b0c5-67a210c25e9e_del
Oct 16 11:25:37 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-94a5ea37-6774-4c80-aba3-eefcf9fc3426 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Deletion of /opt/stack/data/nova/instances/e84bb680-a542-4cb2-b0c5-67a210c25e9e_del complete
Oct 16 11:25:38 user nova-compute[74683]: INFO nova.compute.manager [None req-94a5ea37-6774-4c80-aba3-eefcf9fc3426 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Took 1.59 seconds to destroy the instance on the hypervisor.
Oct 16 11:25:38 user nova-compute[74683]: DEBUG oslo.service.loopingcall [None req-94a5ea37-6774-4c80-aba3-eefcf9fc3426 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74683) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 11:25:38 user nova-compute[74683]: DEBUG nova.compute.manager [-] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Deallocating network for instance {{(pid=74683) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 11:25:38 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] deallocate_for_instance() {{(pid=74683) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 11:25:38 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-a860202f-93bf-4c53-adc6-f7de9b913964 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:25:38 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-a860202f-93bf-4c53-adc6-f7de9b913964 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:25:38 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-a860202f-93bf-4c53-adc6-f7de9b913964 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] No VIF found with MAC fa:16:3e:34:af:5c, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:25:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-a860202f-93bf-4c53-adc6-f7de9b913964 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "4b4eaccb-e068-4e8a-9084-16229815b1d7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.620s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:25:38 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:25:38 user nova-compute[74683]: INFO nova.compute.manager [-] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Took 0.84 seconds to deallocate network for instance.
Oct 16 11:25:38 user nova-compute[74683]: DEBUG nova.compute.manager [req-276612a9-f17a-4db7-8dae-3035104b3097 req-710ca213-2c91-466e-bf45-96be85768a71 service nova] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Received event network-vif-plugged-f57bee45-4d7d-4d93-ab04-0777c2d47ec2 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:25:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-276612a9-f17a-4db7-8dae-3035104b3097 req-710ca213-2c91-466e-bf45-96be85768a71 service nova] Acquiring lock "e84bb680-a542-4cb2-b0c5-67a210c25e9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:25:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-276612a9-f17a-4db7-8dae-3035104b3097 req-710ca213-2c91-466e-bf45-96be85768a71 service nova] Lock "e84bb680-a542-4cb2-b0c5-67a210c25e9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:25:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-276612a9-f17a-4db7-8dae-3035104b3097 req-710ca213-2c91-466e-bf45-96be85768a71 service nova] Lock "e84bb680-a542-4cb2-b0c5-67a210c25e9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:25:38 user nova-compute[74683]: DEBUG nova.compute.manager [req-276612a9-f17a-4db7-8dae-3035104b3097 req-710ca213-2c91-466e-bf45-96be85768a71 service nova] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] No waiting events found dispatching network-vif-plugged-f57bee45-4d7d-4d93-ab04-0777c2d47ec2 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:25:38 user nova-compute[74683]: WARNING nova.compute.manager [req-276612a9-f17a-4db7-8dae-3035104b3097 req-710ca213-2c91-466e-bf45-96be85768a71 service nova] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Received unexpected event network-vif-plugged-f57bee45-4d7d-4d93-ab04-0777c2d47ec2 for instance with vm_state active and task_state deleting.
Oct 16 11:25:39 user nova-compute[74683]: INFO nova.compute.manager [None req-94a5ea37-6774-4c80-aba3-eefcf9fc3426 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Took 1.09 seconds to detach 1 volumes for instance.
Oct 16 11:25:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-94a5ea37-6774-4c80-aba3-eefcf9fc3426 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:25:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-94a5ea37-6774-4c80-aba3-eefcf9fc3426 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:25:40 user nova-compute[74683]: INFO nova.compute.manager [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Rebuilding instance
Oct 16 11:25:40 user nova-compute[74683]: DEBUG nova.compute.manager [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:25:40 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:40 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:40 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-94a5ea37-6774-4c80-aba3-eefcf9fc3426 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:25:40 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-94a5ea37-6774-4c80-aba3-eefcf9fc3426 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:25:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-94a5ea37-6774-4c80-aba3-eefcf9fc3426 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.570s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:25:40 user nova-compute[74683]: INFO nova.scheduler.client.report [None req-94a5ea37-6774-4c80-aba3-eefcf9fc3426 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Deleted allocations for instance e84bb680-a542-4cb2-b0c5-67a210c25e9e
Oct 16 11:25:40 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:40 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-94a5ea37-6774-4c80-aba3-eefcf9fc3426 tempest-TestVolumeSwap-1722834028 tempest-TestVolumeSwap-1722834028-project-member] Lock "e84bb680-a542-4cb2-b0c5-67a210c25e9e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.305s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:25:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-d366d330-c31c-4efb-b8af-9f6cc2b7f6fa tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Acquiring lock "4b6a8c25-d3ca-48ff-b22f-9338200ebc01" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:25:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-d366d330-c31c-4efb-b8af-9f6cc2b7f6fa tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Lock "4b6a8c25-d3ca-48ff-b22f-9338200ebc01" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:25:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-d366d330-c31c-4efb-b8af-9f6cc2b7f6fa tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Acquiring lock "4b6a8c25-d3ca-48ff-b22f-9338200ebc01-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:25:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-d366d330-c31c-4efb-b8af-9f6cc2b7f6fa tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Lock "4b6a8c25-d3ca-48ff-b22f-9338200ebc01-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:25:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-d366d330-c31c-4efb-b8af-9f6cc2b7f6fa tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Lock "4b6a8c25-d3ca-48ff-b22f-9338200ebc01-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:25:40 user nova-compute[74683]: INFO nova.compute.manager [None req-d366d330-c31c-4efb-b8af-9f6cc2b7f6fa tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 4b6a8c25-d3ca-48ff-b22f-9338200ebc01] Terminating instance
Oct 16 11:25:40 user nova-compute[74683]: DEBUG nova.compute.manager [None req-d366d330-c31c-4efb-b8af-9f6cc2b7f6fa tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 4b6a8c25-d3ca-48ff-b22f-9338200ebc01] Start destroying the instance on the hypervisor. {{(pid=74683) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 11:25:40 user nova-compute[74683]: DEBUG nova.compute.manager [req-9e4dcca8-a35f-4003-8c92-17450840035e req-693cb160-b73a-4e70-8889-aced7c5beafc service nova] [instance: e84bb680-a542-4cb2-b0c5-67a210c25e9e] Received event network-vif-deleted-f57bee45-4d7d-4d93-ab04-0777c2d47ec2 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:25:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:41 user nova-compute[74683]: DEBUG nova.compute.manager [req-33487b4d-5d86-4341-8c84-1106911a6273 req-75c20493-7ab5-4899-ad96-8d7647ba01b4 service nova] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Received event network-vif-unplugged-51406244-8351-4ada-b266-d5ec85d5f5b7 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:25:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-33487b4d-5d86-4341-8c84-1106911a6273 req-75c20493-7ab5-4899-ad96-8d7647ba01b4 service nova] Acquiring lock "4b4eaccb-e068-4e8a-9084-16229815b1d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:25:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-33487b4d-5d86-4341-8c84-1106911a6273 req-75c20493-7ab5-4899-ad96-8d7647ba01b4 service nova] Lock "4b4eaccb-e068-4e8a-9084-16229815b1d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.017s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:25:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-33487b4d-5d86-4341-8c84-1106911a6273 req-75c20493-7ab5-4899-ad96-8d7647ba01b4 service nova] Lock "4b4eaccb-e068-4e8a-9084-16229815b1d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:25:41 user nova-compute[74683]: DEBUG nova.compute.manager [req-33487b4d-5d86-4341-8c84-1106911a6273 req-75c20493-7ab5-4899-ad96-8d7647ba01b4 service nova] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] No waiting events found dispatching network-vif-unplugged-51406244-8351-4ada-b266-d5ec85d5f5b7 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:25:41 user nova-compute[74683]: WARNING nova.compute.manager [req-33487b4d-5d86-4341-8c84-1106911a6273 req-75c20493-7ab5-4899-ad96-8d7647ba01b4 service nova] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Received unexpected event network-vif-unplugged-51406244-8351-4ada-b266-d5ec85d5f5b7 for instance with vm_state active and task_state rebuilding.
Oct 16 11:25:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:41 user nova-compute[74683]: DEBUG nova.compute.manager [req-b653372d-b612-4ba4-9f61-d16a348cd09b req-e9e18c62-8933-4c1d-84bf-7b9942b97e4a service nova] [instance: 4b6a8c25-d3ca-48ff-b22f-9338200ebc01] Received event network-vif-unplugged-b2efd2e8-26ef-4ed3-b3a6-79e0e3c39c83 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:25:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b653372d-b612-4ba4-9f61-d16a348cd09b req-e9e18c62-8933-4c1d-84bf-7b9942b97e4a service nova] Acquiring lock "4b6a8c25-d3ca-48ff-b22f-9338200ebc01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:25:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b653372d-b612-4ba4-9f61-d16a348cd09b req-e9e18c62-8933-4c1d-84bf-7b9942b97e4a service nova] Lock "4b6a8c25-d3ca-48ff-b22f-9338200ebc01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:25:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b653372d-b612-4ba4-9f61-d16a348cd09b req-e9e18c62-8933-4c1d-84bf-7b9942b97e4a service nova] Lock "4b6a8c25-d3ca-48ff-b22f-9338200ebc01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:25:41 user nova-compute[74683]: DEBUG nova.compute.manager [req-b653372d-b612-4ba4-9f61-d16a348cd09b req-e9e18c62-8933-4c1d-84bf-7b9942b97e4a service nova] [instance: 4b6a8c25-d3ca-48ff-b22f-9338200ebc01] No waiting events found dispatching network-vif-unplugged-b2efd2e8-26ef-4ed3-b3a6-79e0e3c39c83 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:25:41 user nova-compute[74683]: DEBUG nova.compute.manager [req-b653372d-b612-4ba4-9f61-d16a348cd09b req-e9e18c62-8933-4c1d-84bf-7b9942b97e4a service nova] [instance: 4b6a8c25-d3ca-48ff-b22f-9338200ebc01] Received event network-vif-unplugged-b2efd2e8-26ef-4ed3-b3a6-79e0e3c39c83 for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 11:25:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:41 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Instance destroyed successfully.
Oct 16 11:25:41 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 4b6a8c25-d3ca-48ff-b22f-9338200ebc01] Instance destroyed successfully.
Oct 16 11:25:41 user nova-compute[74683]: DEBUG nova.objects.instance [None req-d366d330-c31c-4efb-b8af-9f6cc2b7f6fa tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Lazy-loading 'resources' on Instance uuid 4b6a8c25-d3ca-48ff-b22f-9338200ebc01 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:25:41 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-d366d330-c31c-4efb-b8af-9f6cc2b7f6fa tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:23:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1001018970',display_name='tempest-ServersNegativeTestJSON-server-1001018970',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1001018970',id=27,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:23:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='adfa96f9deab4c4eb584876b48e804e0',ramdisk_id='',reservation_id='r-8kb11h8o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-282145638',owner_user_name='tempest-ServersNegativeTestJSON-282145638-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:23:59Z,user_data=None,user_id='0c9a0c7b02744e87885fe8d252e88d1c',uuid=4b6a8c25-d3ca-48ff-b22f-9338200ebc01,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b2efd2e8-26ef-4ed3-b3a6-79e0e3c39c83", "address": "fa:16:3e:ff:75:2d", "network": {"id": "acc0dc8b-0dc9-47ad-8630-d9e91dd67dbc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-679008794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adfa96f9deab4c4eb584876b48e804e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2efd2e8-26", "ovs_interfaceid": "b2efd2e8-26ef-4ed3-b3a6-79e0e3c39c83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:25:41 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-d366d330-c31c-4efb-b8af-9f6cc2b7f6fa tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Converting VIF {"id": "b2efd2e8-26ef-4ed3-b3a6-79e0e3c39c83", "address": "fa:16:3e:ff:75:2d", "network": {"id": "acc0dc8b-0dc9-47ad-8630-d9e91dd67dbc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-679008794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adfa96f9deab4c4eb584876b48e804e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2efd2e8-26", "ovs_interfaceid": "b2efd2e8-26ef-4ed3-b3a6-79e0e3c39c83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:25:41 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-d366d330-c31c-4efb-b8af-9f6cc2b7f6fa tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:75:2d,bridge_name='br-int',has_traffic_filtering=True,id=b2efd2e8-26ef-4ed3-b3a6-79e0e3c39c83,network=Network(acc0dc8b-0dc9-47ad-8630-d9e91dd67dbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2efd2e8-26') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:25:41 user nova-compute[74683]: DEBUG os_vif [None req-d366d330-c31c-4efb-b8af-9f6cc2b7f6fa tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:75:2d,bridge_name='br-int',has_traffic_filtering=True,id=b2efd2e8-26ef-4ed3-b3a6-79e0e3c39c83,network=Network(acc0dc8b-0dc9-47ad-8630-d9e91dd67dbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2efd2e8-26') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:25:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb2efd2e8-26, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:25:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:25:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8cc1bbdc-92f2-4b02-af1c-eef8a799d6c4) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:25:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:25:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:41 user nova-compute[74683]: INFO os_vif [None req-d366d330-c31c-4efb-b8af-9f6cc2b7f6fa tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:75:2d,bridge_name='br-int',has_traffic_filtering=True,id=b2efd2e8-26ef-4ed3-b3a6-79e0e3c39c83,network=Network(acc0dc8b-0dc9-47ad-8630-d9e91dd67dbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2efd2e8-26')
Oct 16 11:25:41 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-d366d330-c31c-4efb-b8af-9f6cc2b7f6fa tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 4b6a8c25-d3ca-48ff-b22f-9338200ebc01] Deleting instance files /opt/stack/data/nova/instances/4b6a8c25-d3ca-48ff-b22f-9338200ebc01_del
Oct 16 11:25:41 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-d366d330-c31c-4efb-b8af-9f6cc2b7f6fa tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 4b6a8c25-d3ca-48ff-b22f-9338200ebc01] Deletion of /opt/stack/data/nova/instances/4b6a8c25-d3ca-48ff-b22f-9338200ebc01_del complete
Oct 16 11:25:41 user nova-compute[74683]: INFO nova.compute.manager [None req-d366d330-c31c-4efb-b8af-9f6cc2b7f6fa tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 4b6a8c25-d3ca-48ff-b22f-9338200ebc01] Took 1.01 seconds to destroy the instance on the hypervisor.
Oct 16 11:25:41 user nova-compute[74683]: DEBUG oslo.service.loopingcall [None req-d366d330-c31c-4efb-b8af-9f6cc2b7f6fa tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74683) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 11:25:41 user nova-compute[74683]: DEBUG nova.compute.manager [-] [instance: 4b6a8c25-d3ca-48ff-b22f-9338200ebc01] Deallocating network for instance {{(pid=74683) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 11:25:41 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: 4b6a8c25-d3ca-48ff-b22f-9338200ebc01] deallocate_for_instance() {{(pid=74683) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 11:25:41 user nova-compute[74683]: INFO nova.compute.manager [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Detaching volume a52c1cdc-2945-43af-abd1-8a8060b4f152
Oct 16 11:25:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:42 user nova-compute[74683]: INFO nova.virt.block_device [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Attempting to driver detach volume a52c1cdc-2945-43af-abd1-8a8060b4f152 from mountpoint /dev/vdb
Oct 16 11:25:42 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Attempting to detach device vdb from instance 4b4eaccb-e068-4e8a-9084-16229815b1d7 from the persistent domain config. {{(pid=74683) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 11:25:42 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 11:25:42 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:25:42 user nova-compute[74683]:   <source dev="/dev/sdh"/>
Oct 16 11:25:42 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:25:42 user nova-compute[74683]:   <serial>a52c1cdc-2945-43af-abd1-8a8060b4f152</serial>
Oct 16 11:25:42 user nova-compute[74683]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 11:25:42 user nova-compute[74683]: </disk>
Oct 16 11:25:42 user nova-compute[74683]:  {{(pid=74683) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 11:25:42 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Successfully detached device vdb from instance 4b4eaccb-e068-4e8a-9084-16229815b1d7 from the persistent domain config.
Oct 16 11:25:42 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] calling os-brick to detach iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 11:25:42 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, {'target_iqn': 'iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xWOyzsUu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:25:42 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 16 11:25:42 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:25:42 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:25:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:42 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6ccfdd-9a46-4568-9182-232bafa854e6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b6ee43b-3eef-43df-b1f9-5d5e9477a40b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:42 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 11:25:42 user nova-compute[74683]: No targets found.
Oct 16 11:25:42 user nova-compute[74683]: iSNS:
Oct 16 11:25:42 user nova-compute[74683]: No targets found.
Oct 16 11:25:42 user nova-compute[74683]: STATIC:
Oct 16 11:25:42 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152
Oct 16 11:25:42 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:25:42 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:25:42 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354
Oct 16 11:25:42 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:25:42 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:25:42 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d
Oct 16 11:25:42 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:25:42 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:25:42 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb
Oct 16 11:25:42 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:25:42 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:25:42 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:5b6ee43b-3eef-43df-b1f9-5d5e9477a40b
Oct 16 11:25:42 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:25:42 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:25:42 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0
Oct 16 11:25:42 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:25:42 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:25:42 user nova-compute[74683]: FIRMWARE:
Oct 16 11:25:42 user nova-compute[74683]: No targets found.
Oct 16 11:25:42 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:25:42 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 11:25:42 user nova-compute[74683]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 11:25:42 user nova-compute[74683]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74683) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 11:25:42 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152', 0)] {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 11:25:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:42 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec897f6d-5d4e-4615-99ef-59350329f421]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b6ee43b-3eef-43df-b1f9-5d5e9477a40b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:42 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d19e45a-80a4-4dfb-90b5-85250c794e5a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6ee43b-3eef-43df-b1f9-5d5e9477a40b (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:42 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:25:42 user nova-compute[74683]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d (non-flash)
Oct 16 11:25:42 user nova-compute[74683]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)
Oct 16 11:25:42 user nova-compute[74683]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)
Oct 16 11:25:42 user nova-compute[74683]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6ee43b-3eef-43df-b1f9-5d5e9477a40b (non-flash)
Oct 16 11:25:42 user nova-compute[74683]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 (non-flash)
Oct 16 11:25:42 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:25:42 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:25:42 user nova-compute[74683]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d (non-flash)
Oct 16 11:25:42 user nova-compute[74683]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)
Oct 16 11:25:42 user nova-compute[74683]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)
Oct 16 11:25:42 user nova-compute[74683]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6ee43b-3eef-43df-b1f9-5d5e9477a40b (non-flash)
Oct 16 11:25:42 user nova-compute[74683]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 (non-flash)
Oct 16 11:25:42 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:25:42 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda642ff640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152'): ({'sdh'}, set())}) {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 11:25:42 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Removing single pathed devices sdh {{(pid=74683) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 11:25:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:42 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a647fb9-1c58-4ec9-8dbb-fb73ba7759e7]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.026s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:42 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d12a29-ee16-449f-b586-d31f650e0ccf]: (4, ('ok\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:42 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Flushing IO for device /dev/sdh {{(pid=74683) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 11:25:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:42 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[2554a2d4-23fd-4e6d-b154-8fafe5172b56]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:42 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74683) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 11:25:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.057s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:42 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[950fb0f0-f626-4376-97d7-0bae3bf0d8f8]: (4, ('1', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:42 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 11:25:42 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] SCSI volumes sdh have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 11:25:42 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152')] {{(pid=74683) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 11:25:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:42 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[930638e0-b4ef-4a14-9c6e-15fa1a56b85d]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:42 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:25:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 -p 172.16.0.220:3260 --logout {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:42 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa600d9-35ea-4713-b678-b56584c69299]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:42 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152, portal: 172.16.0.220,3260]
Oct 16 11:25:42 user nova-compute[74683]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152, portal: 172.16.0.220,3260] successful.
Oct 16 11:25:42 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:25:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 -p 172.16.0.220:3260 --op delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:42 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[07423fdc-adbd-4a55-a250-3c1129139759]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:42 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:25:42 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.390s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:25:42 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] <== disconnect_volume: return (393ms) None {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:25:42 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Disconnected iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 11:25:42 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: 4b6a8c25-d3ca-48ff-b22f-9338200ebc01] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:25:42 user nova-compute[74683]: INFO nova.compute.manager [-] [instance: 4b6a8c25-d3ca-48ff-b22f-9338200ebc01] Took 0.58 seconds to deallocate network for instance.
Oct 16 11:25:42 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-d366d330-c31c-4efb-b8af-9f6cc2b7f6fa tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:25:42 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-d366d330-c31c-4efb-b8af-9f6cc2b7f6fa tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:25:42 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-d366d330-c31c-4efb-b8af-9f6cc2b7f6fa tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-d366d330-c31c-4efb-b8af-9f6cc2b7f6fa tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG nova.compute.manager [req-2c0feb38-e7a2-416d-8331-6421bd85a78a req-6b6c8b62-ec06-46a2-80ea-13cf6df569f9 service nova] [instance: 4b6a8c25-d3ca-48ff-b22f-9338200ebc01] Received event network-vif-deleted-b2efd2e8-26ef-4ed3-b3a6-79e0e3c39c83 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-d366d330-c31c-4efb-b8af-9f6cc2b7f6fa tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.485s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:25:43 user nova-compute[74683]: INFO nova.scheduler.client.report [None req-d366d330-c31c-4efb-b8af-9f6cc2b7f6fa tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Deleted allocations for instance 4b6a8c25-d3ca-48ff-b22f-9338200ebc01
Oct 16 11:25:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-d366d330-c31c-4efb-b8af-9f6cc2b7f6fa tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Lock "4b6a8c25-d3ca-48ff-b22f-9338200ebc01" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.342s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG nova.compute.manager [req-9068b513-159a-477c-9c48-dbb2c3f33d82 req-4900bcc6-cfaf-4be7-9f6c-ff938c26f8d5 service nova] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Received event network-vif-plugged-51406244-8351-4ada-b266-d5ec85d5f5b7 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-9068b513-159a-477c-9c48-dbb2c3f33d82 req-4900bcc6-cfaf-4be7-9f6c-ff938c26f8d5 service nova] Acquiring lock "4b4eaccb-e068-4e8a-9084-16229815b1d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-9068b513-159a-477c-9c48-dbb2c3f33d82 req-4900bcc6-cfaf-4be7-9f6c-ff938c26f8d5 service nova] Lock "4b4eaccb-e068-4e8a-9084-16229815b1d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-9068b513-159a-477c-9c48-dbb2c3f33d82 req-4900bcc6-cfaf-4be7-9f6c-ff938c26f8d5 service nova] Lock "4b4eaccb-e068-4e8a-9084-16229815b1d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG nova.compute.manager [req-9068b513-159a-477c-9c48-dbb2c3f33d82 req-4900bcc6-cfaf-4be7-9f6c-ff938c26f8d5 service nova] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] No waiting events found dispatching network-vif-plugged-51406244-8351-4ada-b266-d5ec85d5f5b7 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:25:43 user nova-compute[74683]: WARNING nova.compute.manager [req-9068b513-159a-477c-9c48-dbb2c3f33d82 req-4900bcc6-cfaf-4be7-9f6c-ff938c26f8d5 service nova] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Received unexpected event network-vif-plugged-51406244-8351-4ada-b266-d5ec85d5f5b7 for instance with vm_state active and task_state rebuilding.
Oct 16 11:25:43 user nova-compute[74683]: DEBUG nova.compute.manager [req-9068b513-159a-477c-9c48-dbb2c3f33d82 req-4900bcc6-cfaf-4be7-9f6c-ff938c26f8d5 service nova] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Received event network-vif-plugged-51406244-8351-4ada-b266-d5ec85d5f5b7 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-9068b513-159a-477c-9c48-dbb2c3f33d82 req-4900bcc6-cfaf-4be7-9f6c-ff938c26f8d5 service nova] Acquiring lock "4b4eaccb-e068-4e8a-9084-16229815b1d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-9068b513-159a-477c-9c48-dbb2c3f33d82 req-4900bcc6-cfaf-4be7-9f6c-ff938c26f8d5 service nova] Lock "4b4eaccb-e068-4e8a-9084-16229815b1d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-9068b513-159a-477c-9c48-dbb2c3f33d82 req-4900bcc6-cfaf-4be7-9f6c-ff938c26f8d5 service nova] Lock "4b4eaccb-e068-4e8a-9084-16229815b1d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG nova.compute.manager [req-9068b513-159a-477c-9c48-dbb2c3f33d82 req-4900bcc6-cfaf-4be7-9f6c-ff938c26f8d5 service nova] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] No waiting events found dispatching network-vif-plugged-51406244-8351-4ada-b266-d5ec85d5f5b7 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:25:43 user nova-compute[74683]: WARNING nova.compute.manager [req-9068b513-159a-477c-9c48-dbb2c3f33d82 req-4900bcc6-cfaf-4be7-9f6c-ff938c26f8d5 service nova] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Received unexpected event network-vif-plugged-51406244-8351-4ada-b266-d5ec85d5f5b7 for instance with vm_state active and task_state rebuilding.
Oct 16 11:25:43 user nova-compute[74683]: DEBUG nova.compute.manager [req-9068b513-159a-477c-9c48-dbb2c3f33d82 req-4900bcc6-cfaf-4be7-9f6c-ff938c26f8d5 service nova] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Received event network-vif-plugged-51406244-8351-4ada-b266-d5ec85d5f5b7 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-9068b513-159a-477c-9c48-dbb2c3f33d82 req-4900bcc6-cfaf-4be7-9f6c-ff938c26f8d5 service nova] Acquiring lock "4b4eaccb-e068-4e8a-9084-16229815b1d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-9068b513-159a-477c-9c48-dbb2c3f33d82 req-4900bcc6-cfaf-4be7-9f6c-ff938c26f8d5 service nova] Lock "4b4eaccb-e068-4e8a-9084-16229815b1d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-9068b513-159a-477c-9c48-dbb2c3f33d82 req-4900bcc6-cfaf-4be7-9f6c-ff938c26f8d5 service nova] Lock "4b4eaccb-e068-4e8a-9084-16229815b1d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG nova.compute.manager [req-9068b513-159a-477c-9c48-dbb2c3f33d82 req-4900bcc6-cfaf-4be7-9f6c-ff938c26f8d5 service nova] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] No waiting events found dispatching network-vif-plugged-51406244-8351-4ada-b266-d5ec85d5f5b7 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:25:43 user nova-compute[74683]: WARNING nova.compute.manager [req-9068b513-159a-477c-9c48-dbb2c3f33d82 req-4900bcc6-cfaf-4be7-9f6c-ff938c26f8d5 service nova] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Received unexpected event network-vif-plugged-51406244-8351-4ada-b266-d5ec85d5f5b7 for instance with vm_state active and task_state rebuilding.
Oct 16 11:25:43 user nova-compute[74683]: DEBUG nova.compute.manager [req-9068b513-159a-477c-9c48-dbb2c3f33d82 req-4900bcc6-cfaf-4be7-9f6c-ff938c26f8d5 service nova] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Received event network-vif-unplugged-51406244-8351-4ada-b266-d5ec85d5f5b7 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-9068b513-159a-477c-9c48-dbb2c3f33d82 req-4900bcc6-cfaf-4be7-9f6c-ff938c26f8d5 service nova] Acquiring lock "4b4eaccb-e068-4e8a-9084-16229815b1d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-9068b513-159a-477c-9c48-dbb2c3f33d82 req-4900bcc6-cfaf-4be7-9f6c-ff938c26f8d5 service nova] Lock "4b4eaccb-e068-4e8a-9084-16229815b1d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-9068b513-159a-477c-9c48-dbb2c3f33d82 req-4900bcc6-cfaf-4be7-9f6c-ff938c26f8d5 service nova] Lock "4b4eaccb-e068-4e8a-9084-16229815b1d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG nova.compute.manager [req-9068b513-159a-477c-9c48-dbb2c3f33d82 req-4900bcc6-cfaf-4be7-9f6c-ff938c26f8d5 service nova] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] No waiting events found dispatching network-vif-unplugged-51406244-8351-4ada-b266-d5ec85d5f5b7 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:25:43 user nova-compute[74683]: WARNING nova.compute.manager [req-9068b513-159a-477c-9c48-dbb2c3f33d82 req-4900bcc6-cfaf-4be7-9f6c-ff938c26f8d5 service nova] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Received unexpected event network-vif-unplugged-51406244-8351-4ada-b266-d5ec85d5f5b7 for instance with vm_state active and task_state rebuilding.
Oct 16 11:25:43 user nova-compute[74683]: DEBUG nova.compute.manager [req-9068b513-159a-477c-9c48-dbb2c3f33d82 req-4900bcc6-cfaf-4be7-9f6c-ff938c26f8d5 service nova] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Received event network-vif-plugged-51406244-8351-4ada-b266-d5ec85d5f5b7 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-9068b513-159a-477c-9c48-dbb2c3f33d82 req-4900bcc6-cfaf-4be7-9f6c-ff938c26f8d5 service nova] Acquiring lock "4b4eaccb-e068-4e8a-9084-16229815b1d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-9068b513-159a-477c-9c48-dbb2c3f33d82 req-4900bcc6-cfaf-4be7-9f6c-ff938c26f8d5 service nova] Lock "4b4eaccb-e068-4e8a-9084-16229815b1d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-9068b513-159a-477c-9c48-dbb2c3f33d82 req-4900bcc6-cfaf-4be7-9f6c-ff938c26f8d5 service nova] Lock "4b4eaccb-e068-4e8a-9084-16229815b1d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG nova.compute.manager [req-9068b513-159a-477c-9c48-dbb2c3f33d82 req-4900bcc6-cfaf-4be7-9f6c-ff938c26f8d5 service nova] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] No waiting events found dispatching network-vif-plugged-51406244-8351-4ada-b266-d5ec85d5f5b7 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:25:43 user nova-compute[74683]: WARNING nova.compute.manager [req-9068b513-159a-477c-9c48-dbb2c3f33d82 req-4900bcc6-cfaf-4be7-9f6c-ff938c26f8d5 service nova] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Received unexpected event network-vif-plugged-51406244-8351-4ada-b266-d5ec85d5f5b7 for instance with vm_state active and task_state rebuilding.
Oct 16 11:25:43 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Instance destroyed successfully.
Oct 16 11:25:43 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:23:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-27181934',display_name='tempest-ServerActionsTestOtherA-server-1084066119',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-27181934',id=26,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMU+0jl/Xpsr5n/olRAHKpCazthU2XJrlviTrSAY+9fnhEiSM0bM3IXfiYZZbkmWCD8gh75QX0AR7OUJ2tlcTCQ4BWG951YpMlhxtAMVD+xs3A2NaoWBXrnOjvkdTqz3aw==',key_name='tempest-keypair-1161073936',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:23:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fcb8da41d6584a689e9b50155288aa5e',ramdisk_id='',reservation_id='r-ze6eely5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-327072564',owner_user_name='tempest-ServerActionsTestOtherA-327072564-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:25:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a55641a42b142ea9fb6c6c1fdb9963e',uuid=4b4eaccb-e068-4e8a-9084-16229815b1d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51406244-8351-4ada-b266-d5ec85d5f5b7", "address": "fa:16:3e:34:af:5c", "network": {"id": "cd8cf08c-d79c-4d2e-b849-640c440e1498", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1091743670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcb8da41d6584a689e9b50155288aa5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51406244-83", "ovs_interfaceid": "51406244-8351-4ada-b266-d5ec85d5f5b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Converting VIF {"id": "51406244-8351-4ada-b266-d5ec85d5f5b7", "address": "fa:16:3e:34:af:5c", "network": {"id": "cd8cf08c-d79c-4d2e-b849-640c440e1498", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1091743670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcb8da41d6584a689e9b50155288aa5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51406244-83", "ovs_interfaceid": "51406244-8351-4ada-b266-d5ec85d5f5b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:34:af:5c,bridge_name='br-int',has_traffic_filtering=True,id=51406244-8351-4ada-b266-d5ec85d5f5b7,network=Network(cd8cf08c-d79c-4d2e-b849-640c440e1498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51406244-83') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG os_vif [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:af:5c,bridge_name='br-int',has_traffic_filtering=True,id=51406244-8351-4ada-b266-d5ec85d5f5b7,network=Network(cd8cf08c-d79c-4d2e-b849-640c440e1498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51406244-83') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap51406244-83, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eeae4a1e-33b6-4669-a69b-f30f9a8c8c21) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:43 user nova-compute[74683]: INFO os_vif [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:af:5c,bridge_name='br-int',has_traffic_filtering=True,id=51406244-8351-4ada-b266-d5ec85d5f5b7,network=Network(cd8cf08c-d79c-4d2e-b849-640c440e1498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51406244-83')
Oct 16 11:25:43 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] calling os-brick to detach iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, {'target_iqn': 'iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xWOyzsUu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:25:43 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 16 11:25:43 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[3863ccc1-3936-4d22-9efd-c579ea056aa9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b6ee43b-3eef-43df-b1f9-5d5e9477a40b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 11:25:43 user nova-compute[74683]: No targets found.
Oct 16 11:25:43 user nova-compute[74683]: iSNS:
Oct 16 11:25:43 user nova-compute[74683]: No targets found.
Oct 16 11:25:43 user nova-compute[74683]: STATIC:
Oct 16 11:25:43 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354
Oct 16 11:25:43 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:25:43 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:25:43 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d
Oct 16 11:25:43 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:25:43 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:25:43 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb
Oct 16 11:25:43 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:25:43 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:25:43 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:5b6ee43b-3eef-43df-b1f9-5d5e9477a40b
Oct 16 11:25:43 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:25:43 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:25:43 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0
Oct 16 11:25:43 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:25:43 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:25:43 user nova-compute[74683]: FIRMWARE:
Oct 16 11:25:43 user nova-compute[74683]: No targets found.
Oct 16 11:25:43 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 11:25:43 user nova-compute[74683]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 11:25:43 user nova-compute[74683]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74683) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152', 0)] {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e64b41-b408-4912-8ef0-70b7d5fed5bd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b6ee43b-3eef-43df-b1f9-5d5e9477a40b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98d0df3-f3d8-4d9b-9be3-1f2d1353612b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6ee43b-3eef-43df-b1f9-5d5e9477a40b (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:25:43 user nova-compute[74683]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d (non-flash)
Oct 16 11:25:43 user nova-compute[74683]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)
Oct 16 11:25:43 user nova-compute[74683]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)
Oct 16 11:25:43 user nova-compute[74683]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6ee43b-3eef-43df-b1f9-5d5e9477a40b (non-flash)
Oct 16 11:25:43 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:25:43 user nova-compute[74683]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d (non-flash)
Oct 16 11:25:43 user nova-compute[74683]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)
Oct 16 11:25:43 user nova-compute[74683]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)
Oct 16 11:25:43 user nova-compute[74683]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6ee43b-3eef-43df-b1f9-5d5e9477a40b (non-flash)
Oct 16 11:25:43 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda6c56dea0>, {}) {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Disconnecting from: [] {{(pid=74683) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.079s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] <== disconnect_volume: return (81ms) None {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Disconnected iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 11:25:43 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Deleting instance files /opt/stack/data/nova/instances/4b4eaccb-e068-4e8a-9084-16229815b1d7_del
Oct 16 11:25:43 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Deletion of /opt/stack/data/nova/instances/4b4eaccb-e068-4e8a-9084-16229815b1d7_del complete
Oct 16 11:25:43 user nova-compute[74683]: INFO nova.virt.block_device [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Booting with volume a52c1cdc-2945-43af-abd1-8a8060b4f152 at /dev/vdb
Oct 16 11:25:43 user nova-compute[74683]: DEBUG nova.compute.manager [req-694be6e0-a010-4182-94e0-a25578dc1b75 req-c015a28d-00d3-4193-9b8d-57fc46458d6e service nova] [instance: 4b6a8c25-d3ca-48ff-b22f-9338200ebc01] Received event network-vif-plugged-b2efd2e8-26ef-4ed3-b3a6-79e0e3c39c83 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-694be6e0-a010-4182-94e0-a25578dc1b75 req-c015a28d-00d3-4193-9b8d-57fc46458d6e service nova] Acquiring lock "4b6a8c25-d3ca-48ff-b22f-9338200ebc01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-694be6e0-a010-4182-94e0-a25578dc1b75 req-c015a28d-00d3-4193-9b8d-57fc46458d6e service nova] Lock "4b6a8c25-d3ca-48ff-b22f-9338200ebc01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-694be6e0-a010-4182-94e0-a25578dc1b75 req-c015a28d-00d3-4193-9b8d-57fc46458d6e service nova] Lock "4b6a8c25-d3ca-48ff-b22f-9338200ebc01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG nova.compute.manager [req-694be6e0-a010-4182-94e0-a25578dc1b75 req-c015a28d-00d3-4193-9b8d-57fc46458d6e service nova] [instance: 4b6a8c25-d3ca-48ff-b22f-9338200ebc01] No waiting events found dispatching network-vif-plugged-b2efd2e8-26ef-4ed3-b3a6-79e0e3c39c83 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:25:43 user nova-compute[74683]: WARNING nova.compute.manager [req-694be6e0-a010-4182-94e0-a25578dc1b75 req-c015a28d-00d3-4193-9b8d-57fc46458d6e service nova] [instance: 4b6a8c25-d3ca-48ff-b22f-9338200ebc01] Received unexpected event network-vif-plugged-b2efd2e8-26ef-4ed3-b3a6-79e0e3c39c83 for instance with vm_state deleted and task_state None.
Oct 16 11:25:43 user nova-compute[74683]: DEBUG os_brick.utils [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5bd116-3fa6-4b4d-8074-6320ab10df4d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:70b9d336ab7d\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aabee3d-5026-426c-b54f-faa5131de2e2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[163ed144-dd78-496b-9277-08f7ba96f493]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f8e8e0-0ff9-4b15-83e8-163f10f72a7c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Running cmd (subprocess): nvme version {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] 'nvme version' failed. Not Retrying. {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.nvmeof [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] nvme not present on system {{(pid=74683) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:25:43 user nova-compute[74683]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 11:25:43 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[59138ab7-2499-404c-b9a7-7e20fc7885a4]: (4, '') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74683) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] LIGHTOS: no hostnqn found. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG os_brick.utils [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:70b9d336ab7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:25:43 user nova-compute[74683]: DEBUG nova.virt.block_device [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Updating existing volume attachment record: e762fbbf-8983-47e7-b334-b6321b0d4100 {{(pid=74683) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 11:25:46 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:48 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:50 user nova-compute[74683]: DEBUG nova.compute.manager [req-bcaebd52-2eea-4715-a2f3-29d42d9afef3 req-74faf4d3-c2b2-48fe-b356-b4dbda84e924 service nova] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Received event network-changed-28029fd9-7463-4b6a-8dc9-c47993f71bb5 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:25:50 user nova-compute[74683]: DEBUG nova.compute.manager [req-bcaebd52-2eea-4715-a2f3-29d42d9afef3 req-74faf4d3-c2b2-48fe-b356-b4dbda84e924 service nova] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Refreshing instance network info cache due to event network-changed-28029fd9-7463-4b6a-8dc9-c47993f71bb5. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:25:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-bcaebd52-2eea-4715-a2f3-29d42d9afef3 req-74faf4d3-c2b2-48fe-b356-b4dbda84e924 service nova] Acquiring lock "refresh_cache-45ca3cbb-53d6-4046-9be3-92cc6b71bfad" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:25:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-bcaebd52-2eea-4715-a2f3-29d42d9afef3 req-74faf4d3-c2b2-48fe-b356-b4dbda84e924 service nova] Acquired lock "refresh_cache-45ca3cbb-53d6-4046-9be3-92cc6b71bfad" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:25:50 user nova-compute[74683]: DEBUG nova.network.neutron [req-bcaebd52-2eea-4715-a2f3-29d42d9afef3 req-74faf4d3-c2b2-48fe-b356-b4dbda84e924 service nova] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Refreshing network info cache for port 28029fd9-7463-4b6a-8dc9-c47993f71bb5 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:25:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2ea16746-acea-4afd-bc45-23ea10f0bd46 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Acquiring lock "45ca3cbb-53d6-4046-9be3-92cc6b71bfad" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:25:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2ea16746-acea-4afd-bc45-23ea10f0bd46 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lock "45ca3cbb-53d6-4046-9be3-92cc6b71bfad" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:25:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2ea16746-acea-4afd-bc45-23ea10f0bd46 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Acquiring lock "45ca3cbb-53d6-4046-9be3-92cc6b71bfad-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:25:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2ea16746-acea-4afd-bc45-23ea10f0bd46 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lock "45ca3cbb-53d6-4046-9be3-92cc6b71bfad-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:25:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2ea16746-acea-4afd-bc45-23ea10f0bd46 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lock "45ca3cbb-53d6-4046-9be3-92cc6b71bfad-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:25:50 user nova-compute[74683]: INFO nova.compute.manager [None req-2ea16746-acea-4afd-bc45-23ea10f0bd46 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Terminating instance
Oct 16 11:25:50 user nova-compute[74683]: DEBUG nova.compute.manager [None req-2ea16746-acea-4afd-bc45-23ea10f0bd46 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Start destroying the instance on the hypervisor. {{(pid=74683) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 11:25:50 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:50 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:50 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:50 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:50 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:50 user nova-compute[74683]: DEBUG nova.network.neutron [req-bcaebd52-2eea-4715-a2f3-29d42d9afef3 req-74faf4d3-c2b2-48fe-b356-b4dbda84e924 service nova] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Updated VIF entry in instance network info cache for port 28029fd9-7463-4b6a-8dc9-c47993f71bb5. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:25:50 user nova-compute[74683]: DEBUG nova.network.neutron [req-bcaebd52-2eea-4715-a2f3-29d42d9afef3 req-74faf4d3-c2b2-48fe-b356-b4dbda84e924 service nova] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Updating instance_info_cache with network_info: [{"id": "28029fd9-7463-4b6a-8dc9-c47993f71bb5", "address": "fa:16:3e:fd:e5:2b", "network": {"id": "76ba31b5-c467-45e4-ae9a-111f41fd62a3", "bridge": "br-int", "label": "tempest-TestStampPattern-2049888281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "377cd8de2ae042938a9072f64567a911", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28029fd9-74", "ovs_interfaceid": "28029fd9-7463-4b6a-8dc9-c47993f71bb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:25:50 user nova-compute[74683]: DEBUG nova.compute.manager [req-b67e327e-cfba-4b72-96ef-5521960c6867 req-8938372f-66a6-476f-bd23-5b30d4cd8f75 service nova] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Received event network-vif-unplugged-28029fd9-7463-4b6a-8dc9-c47993f71bb5 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:25:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b67e327e-cfba-4b72-96ef-5521960c6867 req-8938372f-66a6-476f-bd23-5b30d4cd8f75 service nova] Acquiring lock "45ca3cbb-53d6-4046-9be3-92cc6b71bfad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:25:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b67e327e-cfba-4b72-96ef-5521960c6867 req-8938372f-66a6-476f-bd23-5b30d4cd8f75 service nova] Lock "45ca3cbb-53d6-4046-9be3-92cc6b71bfad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:25:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b67e327e-cfba-4b72-96ef-5521960c6867 req-8938372f-66a6-476f-bd23-5b30d4cd8f75 service nova] Lock "45ca3cbb-53d6-4046-9be3-92cc6b71bfad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:25:50 user nova-compute[74683]: DEBUG nova.compute.manager [req-b67e327e-cfba-4b72-96ef-5521960c6867 req-8938372f-66a6-476f-bd23-5b30d4cd8f75 service nova] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] No waiting events found dispatching network-vif-unplugged-28029fd9-7463-4b6a-8dc9-c47993f71bb5 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:25:50 user nova-compute[74683]: DEBUG nova.compute.manager [req-b67e327e-cfba-4b72-96ef-5521960c6867 req-8938372f-66a6-476f-bd23-5b30d4cd8f75 service nova] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Received event network-vif-unplugged-28029fd9-7463-4b6a-8dc9-c47993f71bb5 for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 11:25:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-bcaebd52-2eea-4715-a2f3-29d42d9afef3 req-74faf4d3-c2b2-48fe-b356-b4dbda84e924 service nova] Releasing lock "refresh_cache-45ca3cbb-53d6-4046-9be3-92cc6b71bfad" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:25:51 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Instance destroyed successfully.
Oct 16 11:25:51 user nova-compute[74683]: DEBUG nova.objects.instance [None req-2ea16746-acea-4afd-bc45-23ea10f0bd46 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lazy-loading 'resources' on Instance uuid 45ca3cbb-53d6-4046-9be3-92cc6b71bfad {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:25:51 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-2ea16746-acea-4afd-bc45-23ea10f0bd46 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:18:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1861434879',display_name='tempest-TestStampPattern-server-1861434879',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1861434879',id=16,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFV+ROpInHshi5FjeDxPiEyFZ7Qvi9jeJ0//dAB7L9KvmXxPyMWLDkzIIO+4mTNqVHH1o36yJrMR626Ju/qnnIOZjnMoP87MpQ3Ptrg2AmfvntWHi+q/nHH1XQPsx2j/Gw==',key_name='tempest-TestStampPattern-1014736713',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:18:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='377cd8de2ae042938a9072f64567a911',ramdisk_id='',reservation_id='r-99kziqc0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1657953611',owner_user_name='tempest-TestStampPattern-1657953611-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:21:27Z,user_data=None,user_id='ff1b11c3ed3b4ffdbe6a3feada64f5ec',uuid=45ca3cbb-53d6-4046-9be3-92cc6b71bfad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "28029fd9-7463-4b6a-8dc9-c47993f71bb5", "address": "fa:16:3e:fd:e5:2b", "network": {"id": "76ba31b5-c467-45e4-ae9a-111f41fd62a3", "bridge": "br-int", "label": "tempest-TestStampPattern-2049888281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "377cd8de2ae042938a9072f64567a911", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28029fd9-74", "ovs_interfaceid": "28029fd9-7463-4b6a-8dc9-c47993f71bb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:25:51 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-2ea16746-acea-4afd-bc45-23ea10f0bd46 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Converting VIF {"id": "28029fd9-7463-4b6a-8dc9-c47993f71bb5", "address": "fa:16:3e:fd:e5:2b", "network": {"id": "76ba31b5-c467-45e4-ae9a-111f41fd62a3", "bridge": "br-int", "label": "tempest-TestStampPattern-2049888281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "377cd8de2ae042938a9072f64567a911", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28029fd9-74", "ovs_interfaceid": "28029fd9-7463-4b6a-8dc9-c47993f71bb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:25:51 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-2ea16746-acea-4afd-bc45-23ea10f0bd46 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:e5:2b,bridge_name='br-int',has_traffic_filtering=True,id=28029fd9-7463-4b6a-8dc9-c47993f71bb5,network=Network(76ba31b5-c467-45e4-ae9a-111f41fd62a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28029fd9-74') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:25:51 user nova-compute[74683]: DEBUG os_vif [None req-2ea16746-acea-4afd-bc45-23ea10f0bd46 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:e5:2b,bridge_name='br-int',has_traffic_filtering=True,id=28029fd9-7463-4b6a-8dc9-c47993f71bb5,network=Network(76ba31b5-c467-45e4-ae9a-111f41fd62a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28029fd9-74') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:25:51 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:51 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap28029fd9-74, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:25:51 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:51 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:25:51 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:51 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=89fe1731-c375-4efc-ae0b-107c6edc9270) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:25:51 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:51 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:25:51 user nova-compute[74683]: INFO os_vif [None req-2ea16746-acea-4afd-bc45-23ea10f0bd46 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:e5:2b,bridge_name='br-int',has_traffic_filtering=True,id=28029fd9-7463-4b6a-8dc9-c47993f71bb5,network=Network(76ba31b5-c467-45e4-ae9a-111f41fd62a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28029fd9-74')
Oct 16 11:25:51 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-2ea16746-acea-4afd-bc45-23ea10f0bd46 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Deleting instance files /opt/stack/data/nova/instances/45ca3cbb-53d6-4046-9be3-92cc6b71bfad_del
Oct 16 11:25:51 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-2ea16746-acea-4afd-bc45-23ea10f0bd46 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Deletion of /opt/stack/data/nova/instances/45ca3cbb-53d6-4046-9be3-92cc6b71bfad_del complete
Oct 16 11:25:51 user nova-compute[74683]: INFO nova.compute.manager [None req-2ea16746-acea-4afd-bc45-23ea10f0bd46 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 16 11:25:51 user nova-compute[74683]: DEBUG oslo.service.loopingcall [None req-2ea16746-acea-4afd-bc45-23ea10f0bd46 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74683) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 11:25:51 user nova-compute[74683]: DEBUG nova.compute.manager [-] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Deallocating network for instance {{(pid=74683) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 11:25:51 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] deallocate_for_instance() {{(pid=74683) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 11:25:51 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:51 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:25:52 user nova-compute[74683]: INFO nova.compute.manager [-] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Took 0.58 seconds to deallocate network for instance.
Oct 16 11:25:52 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2ea16746-acea-4afd-bc45-23ea10f0bd46 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:25:52 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2ea16746-acea-4afd-bc45-23ea10f0bd46 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:25:52 user nova-compute[74683]: DEBUG nova.compute.manager [req-7c52de28-d361-4737-8e47-cfabb21aa4b5 req-925dfb82-2efe-4c45-8391-a08e49ecb544 service nova] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Received event network-vif-deleted-28029fd9-7463-4b6a-8dc9-c47993f71bb5 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:25:52 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-2ea16746-acea-4afd-bc45-23ea10f0bd46 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:25:52 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-2ea16746-acea-4afd-bc45-23ea10f0bd46 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:25:52 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2ea16746-acea-4afd-bc45-23ea10f0bd46 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.458s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:25:52 user nova-compute[74683]: INFO nova.scheduler.client.report [None req-2ea16746-acea-4afd-bc45-23ea10f0bd46 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Deleted allocations for instance 45ca3cbb-53d6-4046-9be3-92cc6b71bfad
Oct 16 11:25:52 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2ea16746-acea-4afd-bc45-23ea10f0bd46 tempest-TestStampPattern-1657953611 tempest-TestStampPattern-1657953611-project-member] Lock "45ca3cbb-53d6-4046-9be3-92cc6b71bfad" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.128s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:25:52 user nova-compute[74683]: DEBUG nova.compute.manager [req-6554e8df-3ab2-4bea-b2f3-6bec7ec2a5a6 req-88721150-49f5-4874-9e6f-aa568c6ba0b1 service nova] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Received event network-vif-plugged-28029fd9-7463-4b6a-8dc9-c47993f71bb5 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:25:52 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-6554e8df-3ab2-4bea-b2f3-6bec7ec2a5a6 req-88721150-49f5-4874-9e6f-aa568c6ba0b1 service nova] Acquiring lock "45ca3cbb-53d6-4046-9be3-92cc6b71bfad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:25:52 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-6554e8df-3ab2-4bea-b2f3-6bec7ec2a5a6 req-88721150-49f5-4874-9e6f-aa568c6ba0b1 service nova] Lock "45ca3cbb-53d6-4046-9be3-92cc6b71bfad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:25:52 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-6554e8df-3ab2-4bea-b2f3-6bec7ec2a5a6 req-88721150-49f5-4874-9e6f-aa568c6ba0b1 service nova] Lock "45ca3cbb-53d6-4046-9be3-92cc6b71bfad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:25:52 user nova-compute[74683]: DEBUG nova.compute.manager [req-6554e8df-3ab2-4bea-b2f3-6bec7ec2a5a6 req-88721150-49f5-4874-9e6f-aa568c6ba0b1 service nova] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] No waiting events found dispatching network-vif-plugged-28029fd9-7463-4b6a-8dc9-c47993f71bb5 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:25:52 user nova-compute[74683]: WARNING nova.compute.manager [req-6554e8df-3ab2-4bea-b2f3-6bec7ec2a5a6 req-88721150-49f5-4874-9e6f-aa568c6ba0b1 service nova] [instance: 45ca3cbb-53d6-4046-9be3-92cc6b71bfad] Received unexpected event network-vif-plugged-28029fd9-7463-4b6a-8dc9-c47993f71bb5 for instance with vm_state deleted and task_state None.
Oct 16 11:25:55 user nova-compute[74683]: DEBUG nova.compute.manager [req-077f6023-730e-4596-8902-ed7aa84d64aa req-b37b603b-8274-4993-a736-9082af544628 service nova] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Received event network-changed-8f938207-dce7-4aca-a123-d902f44fd036 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:25:55 user nova-compute[74683]: DEBUG nova.compute.manager [req-077f6023-730e-4596-8902-ed7aa84d64aa req-b37b603b-8274-4993-a736-9082af544628 service nova] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Refreshing instance network info cache due to event network-changed-8f938207-dce7-4aca-a123-d902f44fd036. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:25:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-077f6023-730e-4596-8902-ed7aa84d64aa req-b37b603b-8274-4993-a736-9082af544628 service nova] Acquiring lock "refresh_cache-6300da82-2079-455c-8ab2-9fd13ce9e825" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:25:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-077f6023-730e-4596-8902-ed7aa84d64aa req-b37b603b-8274-4993-a736-9082af544628 service nova] Acquired lock "refresh_cache-6300da82-2079-455c-8ab2-9fd13ce9e825" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:25:55 user nova-compute[74683]: DEBUG nova.network.neutron [req-077f6023-730e-4596-8902-ed7aa84d64aa req-b37b603b-8274-4993-a736-9082af544628 service nova] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Refreshing network info cache for port 8f938207-dce7-4aca-a123-d902f44fd036 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:25:55 user nova-compute[74683]: DEBUG nova.network.neutron [req-077f6023-730e-4596-8902-ed7aa84d64aa req-b37b603b-8274-4993-a736-9082af544628 service nova] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Updated VIF entry in instance network info cache for port 8f938207-dce7-4aca-a123-d902f44fd036. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:25:55 user nova-compute[74683]: DEBUG nova.network.neutron [req-077f6023-730e-4596-8902-ed7aa84d64aa req-b37b603b-8274-4993-a736-9082af544628 service nova] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Updating instance_info_cache with network_info: [{"id": "8f938207-dce7-4aca-a123-d902f44fd036", "address": "fa:16:3e:fc:f8:bc", "network": {"id": "438d9722-66f5-44e2-b7ee-3e4c9dbe1928", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1131023911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2acac594f9894f11a7cca5125c538a0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f938207-dc", "ovs_interfaceid": "8f938207-dce7-4aca-a123-d902f44fd036", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:25:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-077f6023-730e-4596-8902-ed7aa84d64aa req-b37b603b-8274-4993-a736-9082af544628 service nova] Releasing lock "refresh_cache-6300da82-2079-455c-8ab2-9fd13ce9e825" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:25:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:56 user nova-compute[74683]: INFO nova.compute.manager [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Rebuilding instance
Oct 16 11:25:56 user nova-compute[74683]: DEBUG nova.compute.manager [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:25:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG nova.compute.manager [req-dc4d2621-0082-4118-a0e3-8090c676ca64 req-a804bd61-d4ee-4276-ac77-fc385a9675ba service nova] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Received event network-vif-unplugged-8f938207-dce7-4aca-a123-d902f44fd036 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-dc4d2621-0082-4118-a0e3-8090c676ca64 req-a804bd61-d4ee-4276-ac77-fc385a9675ba service nova] Acquiring lock "6300da82-2079-455c-8ab2-9fd13ce9e825-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-dc4d2621-0082-4118-a0e3-8090c676ca64 req-a804bd61-d4ee-4276-ac77-fc385a9675ba service nova] Lock "6300da82-2079-455c-8ab2-9fd13ce9e825-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-dc4d2621-0082-4118-a0e3-8090c676ca64 req-a804bd61-d4ee-4276-ac77-fc385a9675ba service nova] Lock "6300da82-2079-455c-8ab2-9fd13ce9e825-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG nova.compute.manager [req-dc4d2621-0082-4118-a0e3-8090c676ca64 req-a804bd61-d4ee-4276-ac77-fc385a9675ba service nova] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] No waiting events found dispatching network-vif-unplugged-8f938207-dce7-4aca-a123-d902f44fd036 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:25:57 user nova-compute[74683]: WARNING nova.compute.manager [req-dc4d2621-0082-4118-a0e3-8090c676ca64 req-a804bd61-d4ee-4276-ac77-fc385a9675ba service nova] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Received unexpected event network-vif-unplugged-8f938207-dce7-4aca-a123-d902f44fd036 for instance with vm_state active and task_state rebuilding.
Oct 16 11:25:57 user nova-compute[74683]: DEBUG nova.compute.manager [req-dc4d2621-0082-4118-a0e3-8090c676ca64 req-a804bd61-d4ee-4276-ac77-fc385a9675ba service nova] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Received event network-vif-plugged-8f938207-dce7-4aca-a123-d902f44fd036 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-dc4d2621-0082-4118-a0e3-8090c676ca64 req-a804bd61-d4ee-4276-ac77-fc385a9675ba service nova] Acquiring lock "6300da82-2079-455c-8ab2-9fd13ce9e825-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-dc4d2621-0082-4118-a0e3-8090c676ca64 req-a804bd61-d4ee-4276-ac77-fc385a9675ba service nova] Lock "6300da82-2079-455c-8ab2-9fd13ce9e825-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-dc4d2621-0082-4118-a0e3-8090c676ca64 req-a804bd61-d4ee-4276-ac77-fc385a9675ba service nova] Lock "6300da82-2079-455c-8ab2-9fd13ce9e825-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG nova.compute.manager [req-dc4d2621-0082-4118-a0e3-8090c676ca64 req-a804bd61-d4ee-4276-ac77-fc385a9675ba service nova] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] No waiting events found dispatching network-vif-plugged-8f938207-dce7-4aca-a123-d902f44fd036 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:25:57 user nova-compute[74683]: WARNING nova.compute.manager [req-dc4d2621-0082-4118-a0e3-8090c676ca64 req-a804bd61-d4ee-4276-ac77-fc385a9675ba service nova] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Received unexpected event network-vif-plugged-8f938207-dce7-4aca-a123-d902f44fd036 for instance with vm_state active and task_state rebuilding.
Oct 16 11:25:57 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Instance destroyed successfully.
Oct 16 11:25:57 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Instance destroyed successfully.
Oct 16 11:25:57 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:24:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1489120306',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2008791236',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOa68DSLJRhCANBPDVkGCmU7Av1Udl+gScSEyqoeBUYh/e3GGLjoSHFS9vMAG6uKONY2e/UESa8D9i77smMN1onMgIj8+r/Pjj2s1FLJPej0ypSN81xjWnl2bNPHPjSwJQ==',key_name='tempest-keypair-1562506741',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:24:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2acac594f9894f11a7cca5125c538a0b',ramdisk_id='',reservation_id='r-n6dkjkrr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1612434098',owner_user_name='tempest-ServerActionsV293TestJSON-1612434098-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:25:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63e1538b7b554db3811903f3df41eee3',uuid=6300da82-2079-455c-8ab2-9fd13ce9e825,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f938207-dce7-4aca-a123-d902f44fd036", "address": "fa:16:3e:fc:f8:bc", "network": {"id": "438d9722-66f5-44e2-b7ee-3e4c9dbe1928", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1131023911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2acac594f9894f11a7cca5125c538a0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f938207-dc", "ovs_interfaceid": "8f938207-dce7-4aca-a123-d902f44fd036", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Converting VIF {"id": "8f938207-dce7-4aca-a123-d902f44fd036", "address": "fa:16:3e:fc:f8:bc", "network": {"id": "438d9722-66f5-44e2-b7ee-3e4c9dbe1928", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1131023911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2acac594f9894f11a7cca5125c538a0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f938207-dc", "ovs_interfaceid": "8f938207-dce7-4aca-a123-d902f44fd036", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:f8:bc,bridge_name='br-int',has_traffic_filtering=True,id=8f938207-dce7-4aca-a123-d902f44fd036,network=Network(438d9722-66f5-44e2-b7ee-3e4c9dbe1928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f938207-dc') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG os_vif [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:f8:bc,bridge_name='br-int',has_traffic_filtering=True,id=8f938207-dce7-4aca-a123-d902f44fd036,network=Network(438d9722-66f5-44e2-b7ee-3e4c9dbe1928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f938207-dc') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f938207-dc, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=beb52868-85a2-4b00-930c-133e825400ab) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:25:57 user nova-compute[74683]: INFO os_vif [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:f8:bc,bridge_name='br-int',has_traffic_filtering=True,id=8f938207-dce7-4aca-a123-d902f44fd036,network=Network(438d9722-66f5-44e2-b7ee-3e4c9dbe1928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f938207-dc')
Oct 16 11:25:57 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] calling os-brick to detach iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, {'target_iqn': 'iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KhyBgrAX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:25:57 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 16 11:25:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[802d439f-07ac-4d2b-b7cb-d7904c4d97ca]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8496af6e-663d-4d04-8077-2449b6397073\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b6ee43b-3eef-43df-b1f9-5d5e9477a40b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 11:25:57 user nova-compute[74683]: No targets found.
Oct 16 11:25:57 user nova-compute[74683]: iSNS:
Oct 16 11:25:57 user nova-compute[74683]: No targets found.
Oct 16 11:25:57 user nova-compute[74683]: STATIC:
Oct 16 11:25:57 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:8496af6e-663d-4d04-8077-2449b6397073
Oct 16 11:25:57 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:25:57 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:25:57 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354
Oct 16 11:25:57 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:25:57 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:25:57 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d
Oct 16 11:25:57 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:25:57 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:25:57 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb
Oct 16 11:25:57 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:25:57 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:25:57 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:5b6ee43b-3eef-43df-b1f9-5d5e9477a40b
Oct 16 11:25:57 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:25:57 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:25:57 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0
Oct 16 11:25:57 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:25:57 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:25:57 user nova-compute[74683]: FIRMWARE:
Oct 16 11:25:57 user nova-compute[74683]: No targets found.
Oct 16 11:25:57 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 11:25:57 user nova-compute[74683]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 11:25:57 user nova-compute[74683]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74683) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d', 0)] {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[62defdb6-1d89-4273-99e1-8b73d1e1e339]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b6ee43b-3eef-43df-b1f9-5d5e9477a40b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8496af6e-663d-4d04-8077-2449b6397073\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ecbd834-8dc2-4ade-9f7c-36dea263bf60]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6ee43b-3eef-43df-b1f9-5d5e9477a40b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8496af6e-663d-4d04-8077-2449b6397073 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:25:57 user nova-compute[74683]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d (non-flash)
Oct 16 11:25:57 user nova-compute[74683]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)
Oct 16 11:25:57 user nova-compute[74683]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)
Oct 16 11:25:57 user nova-compute[74683]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6ee43b-3eef-43df-b1f9-5d5e9477a40b (non-flash)
Oct 16 11:25:57 user nova-compute[74683]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8496af6e-663d-4d04-8077-2449b6397073 (non-flash)
Oct 16 11:25:57 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:25:57 user nova-compute[74683]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d (non-flash)
Oct 16 11:25:57 user nova-compute[74683]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)
Oct 16 11:25:57 user nova-compute[74683]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)
Oct 16 11:25:57 user nova-compute[74683]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6ee43b-3eef-43df-b1f9-5d5e9477a40b (non-flash)
Oct 16 11:25:57 user nova-compute[74683]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8496af6e-663d-4d04-8077-2449b6397073 (non-flash)
Oct 16 11:25:57 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda6c39f910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d'): ({'sdb'}, set())}) {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Removing single pathed devices sdb {{(pid=74683) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[384a2d6c-dc2a-4194-b577-d6802302fc67]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[db692838-a4af-48f6-92f5-36ff723e2884]: (4, ('ok\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Flushing IO for device /dev/sdb {{(pid=74683) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[70102bc8-603b-4fbb-acfa-7b7b37be16a0]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74683) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c115d7b-a55f-41f5-afa9-f6bce1fb0876]: (4, ('1', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] SCSI volumes sdb have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOe6b1a124-8248bef1cd5fc058', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e6b1a124', '/dev/disk/by-id/scsi-23832343862656631') {{(pid=85666) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5d500c-c5a9-406a-8486-8e02070c6ea0]: (4, None) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d')] {{(pid=74683) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f988ac-9624-4013-8b54-b4e0920225b5]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d -p 172.16.0.220:3260 --logout {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c3b7b2-926d-49b1-acb7-8fba19802c1e]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d, portal: 172.16.0.220,3260]
Oct 16 11:25:57 user nova-compute[74683]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d, portal: 172.16.0.220,3260] successful.
Oct 16 11:25:57 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d -p 172.16.0.220:3260 --op delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[c252a35c-94c3-4fe0-9093-e96070479ae6]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] <== disconnect_volume: return (350ms) None {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Disconnected iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 11:25:57 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Deleting instance files /opt/stack/data/nova/instances/6300da82-2079-455c-8ab2-9fd13ce9e825_del
Oct 16 11:25:57 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Deletion of /opt/stack/data/nova/instances/6300da82-2079-455c-8ab2-9fd13ce9e825_del complete
Oct 16 11:25:57 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 6300da82-2079-455c-8ab2-9fd13ce9e825 could not be found.
Oct 16 11:25:57 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] calling os-brick to detach iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, {'target_iqn': 'iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KhyBgrAX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:25:57 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 16 11:25:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee372b8-09f3-455d-9fc9-ad27b469f448]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8496af6e-663d-4d04-8077-2449b6397073\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b6ee43b-3eef-43df-b1f9-5d5e9477a40b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 11:25:57 user nova-compute[74683]: No targets found.
Oct 16 11:25:57 user nova-compute[74683]: iSNS:
Oct 16 11:25:57 user nova-compute[74683]: No targets found.
Oct 16 11:25:57 user nova-compute[74683]: STATIC:
Oct 16 11:25:57 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:8496af6e-663d-4d04-8077-2449b6397073
Oct 16 11:25:57 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:25:57 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:25:57 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354
Oct 16 11:25:57 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:25:57 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:25:57 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb
Oct 16 11:25:57 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:25:57 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:25:57 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:5b6ee43b-3eef-43df-b1f9-5d5e9477a40b
Oct 16 11:25:57 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:25:57 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:25:57 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0
Oct 16 11:25:57 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:25:57 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:25:57 user nova-compute[74683]: FIRMWARE:
Oct 16 11:25:57 user nova-compute[74683]: No targets found.
Oct 16 11:25:57 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 11:25:57 user nova-compute[74683]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 11:25:57 user nova-compute[74683]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74683) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d', 0)] {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 11:25:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:58 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:58 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14a5e20-4ee5-431c-9530-94f5595a6aaa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b6ee43b-3eef-43df-b1f9-5d5e9477a40b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8496af6e-663d-4d04-8077-2449b6397073\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:58 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:25:58 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:25:58 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4dc7f70-cfcf-47fb-b8fd-bf5b0208702f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6ee43b-3eef-43df-b1f9-5d5e9477a40b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8496af6e-663d-4d04-8077-2449b6397073 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:25:58 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:25:58 user nova-compute[74683]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)
Oct 16 11:25:58 user nova-compute[74683]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)
Oct 16 11:25:58 user nova-compute[74683]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6ee43b-3eef-43df-b1f9-5d5e9477a40b (non-flash)
Oct 16 11:25:58 user nova-compute[74683]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8496af6e-663d-4d04-8077-2449b6397073 (non-flash)
Oct 16 11:25:58 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:25:58 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:25:58 user nova-compute[74683]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)
Oct 16 11:25:58 user nova-compute[74683]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)
Oct 16 11:25:58 user nova-compute[74683]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6ee43b-3eef-43df-b1f9-5d5e9477a40b (non-flash)
Oct 16 11:25:58 user nova-compute[74683]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8496af6e-663d-4d04-8077-2449b6397073 (non-flash)
Oct 16 11:25:58 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:25:58 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda4c5b5240>, {}) {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 11:25:58 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Disconnecting from: [] {{(pid=74683) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 11:25:58 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.077s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:25:58 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] <== disconnect_volume: return (78ms) None {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:25:58 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Disconnected iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 11:25:59 user nova-compute[74683]: DEBUG nova.compute.manager [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Preparing to wait for external event volume-reimaged-7d2a9abe-890e-4bae-9d88-b64305a6ca3d {{(pid=74683) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Oct 16 11:25:59 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Acquiring lock "6300da82-2079-455c-8ab2-9fd13ce9e825-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:25:59 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Lock "6300da82-2079-455c-8ab2-9fd13ce9e825-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:25:59 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Lock "6300da82-2079-455c-8ab2-9fd13ce9e825-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:26:01 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:26:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:26:03 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Creating instance directory {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 11:26:03 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Creating image(s)
Oct 16 11:26:03 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Acquiring lock "/opt/stack/data/nova/instances/4b4eaccb-e068-4e8a-9084-16229815b1d7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:26:03 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "/opt/stack/data/nova/instances/4b4eaccb-e068-4e8a-9084-16229815b1d7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:26:03 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "/opt/stack/data/nova/instances/4b4eaccb-e068-4e8a-9084-16229815b1d7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:26:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.192s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:03 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Acquiring lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:26:03 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:26:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.178s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/4b4eaccb-e068-4e8a-9084-16229815b1d7/disk 1073741824 {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/4b4eaccb-e068-4e8a-9084-16229815b1d7/disk 1073741824" returned: 0 in 0.049s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:03 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:26:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.173s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:03 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4b4eaccb-e068-4e8a-9084-16229815b1d7/disk. size=1073741824 {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 11:26:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b4eaccb-e068-4e8a-9084-16229815b1d7/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b4eaccb-e068-4e8a-9084-16229815b1d7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:03 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Cannot resize image /opt/stack/data/nova/instances/4b4eaccb-e068-4e8a-9084-16229815b1d7/disk to a smaller size. {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 11:26:03 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Created local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 11:26:03 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Ensure instance console log exists: /opt/stack/data/nova/instances/4b4eaccb-e068-4e8a-9084-16229815b1d7/console.log {{(pid=74683) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 11:26:03 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:26:03 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:26:03 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:26:03 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Start _get_guest_xml network_info=[{"id": "51406244-8351-4ada-b266-d5ec85d5f5b7", "address": "fa:16:3e:34:af:5c", "network": {"id": "cd8cf08c-d79c-4d2e-b849-640c440e1498", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1091743670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcb8da41d6584a689e9b50155288aa5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51406244-83", "ovs_interfaceid": "51406244-8351-4ada-b266-d5ec85d5f5b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xWOyzsUu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4b4eaccb-e068-4e8a-9084-16229815b1d7', 'attached_at': '', 'detached_at': '', 'volume_id': 'a52c1cdc-2945-43af-abd1-8a8060b4f152', 'serial': 'a52c1cdc-2945-43af-abd1-8a8060b4f152'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': None, 'delete_on_termination': False, 'attachment_id': 'e762fbbf-8983-47e7-b334-b6321b0d4100', 'volume_type': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:26:03 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 16 11:26:03 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 16 11:26:03 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:26:03 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:26:03 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:26:03 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:26:03 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:26:03 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:26:03 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:26:03 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:26:03 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:26:03 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:26:03 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:26:03 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:26:03 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:26:03 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:26:03 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:26:03 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:26:03 user nova-compute[74683]: DEBUG nova.objects.instance [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4b4eaccb-e068-4e8a-9084-16229815b1d7 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:26:03 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Calling os-brick to attach iSCSI Volume {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 11:26:03 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xWOyzsUu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:26:03 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 16 11:26:03 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:26:03 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:26:03 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 16 11:26:03 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:26:03 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:26:03 user nova-compute[74683]: INFO os_brick.initiator.connectors.iscsi [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 11:26:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 -p 172.16.0.220:3260 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:03 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee5df52-561e-4651-8d1c-996d172995c1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:26:03 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 11:26:03 user nova-compute[74683]:  {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:26:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 -p 172.16.0.220:3260 --interface default --op new {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:03 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[6360d468-22e8-4289-8617-480ab16c6ff6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152] added\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:26:03 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152] added
Oct 16 11:26:03 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:26:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.071s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[1558a311-b567-490d-ab13-dc0beeaa9b83]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:26:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:26:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.034s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7cca9c0-042e-4340-9387-caac898b6fde]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:26:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:26:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xWOyzsUu {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xWOyzsUu" returned: 0 in 0.067s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[750011ff-5496-470b-8e01-57cbf953637c]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:26:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xWOyzsUu'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:26:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.071s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a929e090-0662-4673-8d3f-3aa4d1dda9aa]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:26:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:26:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8a43fe-4454-4d25-9e0e-d038475e9110]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:26:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:26:04 user nova-compute[74683]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)
Oct 16 11:26:04 user nova-compute[74683]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)
Oct 16 11:26:04 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:26:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:26:04 user nova-compute[74683]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)
Oct 16 11:26:04 user nova-compute[74683]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)
Oct 16 11:26:04 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:26:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 -p 172.16.0.220:3260 --login {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f1430d-8291-4840-bc10-5fdd4f75b955]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:26:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152, portal: 172.16.0.220,3260]
Oct 16 11:26:04 user nova-compute[74683]: Login to [iface: default, target: iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152, portal: 172.16.0.220,3260] successful.
Oct 16 11:26:04 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:26:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b513e27-9af0-4391-9aad-0dc1047e9bd5]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:26:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:26:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac951b1-7fb1-4bc8-9de8-4c3275317ec5]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:26:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:26:04 user nova-compute[74683]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)
Oct 16 11:26:04 user nova-compute[74683]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)
Oct 16 11:26:04 user nova-compute[74683]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 (non-flash)
Oct 16 11:26:04 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:26:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:26:04 user nova-compute[74683]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)
Oct 16 11:26:04 user nova-compute[74683]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)
Oct 16 11:26:04 user nova-compute[74683]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 (non-flash)
Oct 16 11:26:04 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:26:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.498s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:26:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Connected to 172.16.0.220:3260 {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 11:26:04 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] HCTL ('33', '-', '-', 0) found on session 31 with lun 0 {{(pid=74683) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 11:26:04 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74683) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 11:26:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[22afbd09-362a-48b1-8158-de4eeedfd82f]: (4, ('- - 0', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:26:04 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Searching for a device in session 31 and hctl ['33', '*', '*', 0] yield: None {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:26:05 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Searching for a device in session 31 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:26:05 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xWOyzsUu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 11:26:05 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.527s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:26:05 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] <== connect_volume: return (1528ms) {'type': 'block', 'scsi_wwn': '23162326266613263', 'path': '/dev/sdb'} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:26:05 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162326266613263', 'path': '/dev/sdb'} {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 11:26:05 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-16T11:23:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-27181934',display_name='tempest-ServerActionsTestOtherA-server-1084066119',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-27181934',id=26,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMU+0jl/Xpsr5n/olRAHKpCazthU2XJrlviTrSAY+9fnhEiSM0bM3IXfiYZZbkmWCD8gh75QX0AR7OUJ2tlcTCQ4BWG951YpMlhxtAMVD+xs3A2NaoWBXrnOjvkdTqz3aw==',key_name='tempest-keypair-1161073936',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:23:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fcb8da41d6584a689e9b50155288aa5e',ramdisk_id='',reservation_id='r-ze6eely5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-327072564',owner_user_name='tempest-ServerActionsTestOtherA-327072564-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:25:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a55641a42b142ea9fb6c6c1fdb9963e',uuid=4b4eaccb-e068-4e8a-9084-16229815b1d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51406244-8351-4ada-b266-d5ec85d5f5b7", "address": "fa:16:3e:34:af:5c", "network": {"id": "cd8cf08c-d79c-4d2e-b849-640c440e1498", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1091743670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcb8da41d6584a689e9b50155288aa5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51406244-83", "ovs_interfaceid": "51406244-8351-4ada-b266-d5ec85d5f5b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:26:05 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Converting VIF {"id": "51406244-8351-4ada-b266-d5ec85d5f5b7", "address": "fa:16:3e:34:af:5c", "network": {"id": "cd8cf08c-d79c-4d2e-b849-640c440e1498", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1091743670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcb8da41d6584a689e9b50155288aa5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51406244-83", "ovs_interfaceid": "51406244-8351-4ada-b266-d5ec85d5f5b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:26:05 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:34:af:5c,bridge_name='br-int',has_traffic_filtering=True,id=51406244-8351-4ada-b266-d5ec85d5f5b7,network=Network(cd8cf08c-d79c-4d2e-b849-640c440e1498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51406244-83') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:26:05 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:26:05 user nova-compute[74683]:   <uuid>4b4eaccb-e068-4e8a-9084-16229815b1d7</uuid>
Oct 16 11:26:05 user nova-compute[74683]:   <name>instance-0000001a</name>
Oct 16 11:26:05 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:26:05 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:26:05 user nova-compute[74683]:   <metadata>
Oct 16 11:26:05 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:26:05 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:26:05 user nova-compute[74683]:       <nova:name>tempest-ServerActionsTestOtherA-server-1084066119</nova:name>
Oct 16 11:26:05 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:26:03</nova:creationTime>
Oct 16 11:26:05 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:26:05 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:26:05 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:26:05 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:26:05 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:26:05 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:26:05 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:26:05 user nova-compute[74683]:       <nova:owner>
Oct 16 11:26:05 user nova-compute[74683]:         <nova:user uuid="6a55641a42b142ea9fb6c6c1fdb9963e">tempest-ServerActionsTestOtherA-327072564-project-member</nova:user>
Oct 16 11:26:05 user nova-compute[74683]:         <nova:project uuid="fcb8da41d6584a689e9b50155288aa5e">tempest-ServerActionsTestOtherA-327072564</nova:project>
Oct 16 11:26:05 user nova-compute[74683]:       </nova:owner>
Oct 16 11:26:05 user nova-compute[74683]:       <nova:root type="image" uuid="0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f"/>
Oct 16 11:26:05 user nova-compute[74683]:       <nova:ports>
Oct 16 11:26:05 user nova-compute[74683]:         <nova:port uuid="51406244-8351-4ada-b266-d5ec85d5f5b7">
Oct 16 11:26:05 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 16 11:26:05 user nova-compute[74683]:         </nova:port>
Oct 16 11:26:05 user nova-compute[74683]:       </nova:ports>
Oct 16 11:26:05 user nova-compute[74683]:     </nova:instance>
Oct 16 11:26:05 user nova-compute[74683]:   </metadata>
Oct 16 11:26:05 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:26:05 user nova-compute[74683]:     <system>
Oct 16 11:26:05 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:26:05 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:26:05 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:26:05 user nova-compute[74683]:       <entry name="serial">4b4eaccb-e068-4e8a-9084-16229815b1d7</entry>
Oct 16 11:26:05 user nova-compute[74683]:       <entry name="uuid">4b4eaccb-e068-4e8a-9084-16229815b1d7</entry>
Oct 16 11:26:05 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:26:05 user nova-compute[74683]:     </system>
Oct 16 11:26:05 user nova-compute[74683]:   </sysinfo>
Oct 16 11:26:05 user nova-compute[74683]:   <os>
Oct 16 11:26:05 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:26:05 user nova-compute[74683]:     <boot dev="hd"/>
Oct 16 11:26:05 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:26:05 user nova-compute[74683]:   </os>
Oct 16 11:26:05 user nova-compute[74683]:   <features>
Oct 16 11:26:05 user nova-compute[74683]:     <acpi/>
Oct 16 11:26:05 user nova-compute[74683]:     <apic/>
Oct 16 11:26:05 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:26:05 user nova-compute[74683]:   </features>
Oct 16 11:26:05 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:26:05 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:26:05 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:26:05 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:26:05 user nova-compute[74683]:   </clock>
Oct 16 11:26:05 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:26:05 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:26:05 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:26:05 user nova-compute[74683]:   </cpu>
Oct 16 11:26:05 user nova-compute[74683]:   <devices>
Oct 16 11:26:05 user nova-compute[74683]:     <disk type="file" device="disk">
Oct 16 11:26:05 user nova-compute[74683]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 11:26:05 user nova-compute[74683]:       <source file="/opt/stack/data/nova/instances/4b4eaccb-e068-4e8a-9084-16229815b1d7/disk"/>
Oct 16 11:26:05 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:26:05 user nova-compute[74683]:     </disk>
Oct 16 11:26:05 user nova-compute[74683]:     <disk type="block" device="disk">
Oct 16 11:26:05 user nova-compute[74683]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:26:05 user nova-compute[74683]:       <source dev="/dev/sdb"/>
Oct 16 11:26:05 user nova-compute[74683]:       <target dev="vdb" bus="virtio"/>
Oct 16 11:26:05 user nova-compute[74683]:       <serial>a52c1cdc-2945-43af-abd1-8a8060b4f152</serial>
Oct 16 11:26:05 user nova-compute[74683]:     </disk>
Oct 16 11:26:05 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:26:05 user nova-compute[74683]:       <mac address="fa:16:3e:34:af:5c"/>
Oct 16 11:26:05 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:26:05 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:26:05 user nova-compute[74683]:       <target dev="tap51406244-83"/>
Oct 16 11:26:05 user nova-compute[74683]:     </interface>
Oct 16 11:26:05 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:26:05 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/4b4eaccb-e068-4e8a-9084-16229815b1d7/console.log" append="off"/>
Oct 16 11:26:05 user nova-compute[74683]:     </serial>
Oct 16 11:26:05 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:26:05 user nova-compute[74683]:     <video>
Oct 16 11:26:05 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:26:05 user nova-compute[74683]:     </video>
Oct 16 11:26:05 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:26:05 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:26:05 user nova-compute[74683]:     </rng>
Oct 16 11:26:05 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:26:05 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:26:05 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:26:05 user nova-compute[74683]:     </memballoon>
Oct 16 11:26:05 user nova-compute[74683]:   </devices>
Oct 16 11:26:05 user nova-compute[74683]: </domain>
Oct 16 11:26:05 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:26:05 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-16T11:23:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-27181934',display_name='tempest-ServerActionsTestOtherA-server-1084066119',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-27181934',id=26,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMU+0jl/Xpsr5n/olRAHKpCazthU2XJrlviTrSAY+9fnhEiSM0bM3IXfiYZZbkmWCD8gh75QX0AR7OUJ2tlcTCQ4BWG951YpMlhxtAMVD+xs3A2NaoWBXrnOjvkdTqz3aw==',key_name='tempest-keypair-1161073936',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:23:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fcb8da41d6584a689e9b50155288aa5e',ramdisk_id='',reservation_id='r-ze6eely5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-327072564',owner_user_name='tempest-ServerActionsTestOtherA-327072564-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:25:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a55641a42b142ea9fb6c6c1fdb9963e',uuid=4b4eaccb-e068-4e8a-9084-16229815b1d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51406244-8351-4ada-b266-d5ec85d5f5b7", "address": "fa:16:3e:34:af:5c", "network": {"id": "cd8cf08c-d79c-4d2e-b849-640c440e1498", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1091743670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcb8da41d6584a689e9b50155288aa5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51406244-83", "ovs_interfaceid": "51406244-8351-4ada-b266-d5ec85d5f5b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:26:05 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Converting VIF {"id": "51406244-8351-4ada-b266-d5ec85d5f5b7", "address": "fa:16:3e:34:af:5c", "network": {"id": "cd8cf08c-d79c-4d2e-b849-640c440e1498", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1091743670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcb8da41d6584a689e9b50155288aa5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51406244-83", "ovs_interfaceid": "51406244-8351-4ada-b266-d5ec85d5f5b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:26:05 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:34:af:5c,bridge_name='br-int',has_traffic_filtering=True,id=51406244-8351-4ada-b266-d5ec85d5f5b7,network=Network(cd8cf08c-d79c-4d2e-b849-640c440e1498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51406244-83') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:26:05 user nova-compute[74683]: DEBUG os_vif [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:af:5c,bridge_name='br-int',has_traffic_filtering=True,id=51406244-8351-4ada-b266-d5ec85d5f5b7,network=Network(cd8cf08c-d79c-4d2e-b849-640c440e1498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51406244-83') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:26:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:26:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:26:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:26:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:26:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1c1f1343-cad0-5396-abf5-2233838d69d1', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:26:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:26:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:26:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap51406244-83, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:26:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap51406244-83, col_values=(('qos', UUID('8016824f-6c55-4f4a-a502-7d7aae27818c')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:26:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap51406244-83, col_values=(('external_ids', {'iface-id': '51406244-8351-4ada-b266-d5ec85d5f5b7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:af:5c', 'vm-uuid': '4b4eaccb-e068-4e8a-9084-16229815b1d7'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:26:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:26:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:26:05 user nova-compute[74683]: INFO os_vif [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:af:5c,bridge_name='br-int',has_traffic_filtering=True,id=51406244-8351-4ada-b266-d5ec85d5f5b7,network=Network(cd8cf08c-d79c-4d2e-b849-640c440e1498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51406244-83')
Oct 16 11:26:05 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:26:05 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:26:05 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] No VIF found with MAC fa:16:3e:34:af:5c, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:26:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:26:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:26:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:26:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:26:07 user nova-compute[74683]: DEBUG nova.compute.manager [req-3c14288f-14ce-445f-be03-baa7f59ea8f9 req-2d67a3a9-fa29-4e9a-a59d-f56f0e06273b service nova] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Received event network-vif-plugged-51406244-8351-4ada-b266-d5ec85d5f5b7 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:26:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-3c14288f-14ce-445f-be03-baa7f59ea8f9 req-2d67a3a9-fa29-4e9a-a59d-f56f0e06273b service nova] Acquiring lock "4b4eaccb-e068-4e8a-9084-16229815b1d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:26:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-3c14288f-14ce-445f-be03-baa7f59ea8f9 req-2d67a3a9-fa29-4e9a-a59d-f56f0e06273b service nova] Lock "4b4eaccb-e068-4e8a-9084-16229815b1d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:26:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-3c14288f-14ce-445f-be03-baa7f59ea8f9 req-2d67a3a9-fa29-4e9a-a59d-f56f0e06273b service nova] Lock "4b4eaccb-e068-4e8a-9084-16229815b1d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:26:07 user nova-compute[74683]: DEBUG nova.compute.manager [req-3c14288f-14ce-445f-be03-baa7f59ea8f9 req-2d67a3a9-fa29-4e9a-a59d-f56f0e06273b service nova] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] No waiting events found dispatching network-vif-plugged-51406244-8351-4ada-b266-d5ec85d5f5b7 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:26:07 user nova-compute[74683]: WARNING nova.compute.manager [req-3c14288f-14ce-445f-be03-baa7f59ea8f9 req-2d67a3a9-fa29-4e9a-a59d-f56f0e06273b service nova] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Received unexpected event network-vif-plugged-51406244-8351-4ada-b266-d5ec85d5f5b7 for instance with vm_state active and task_state rebuild_spawning.
Oct 16 11:26:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:26:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:26:08 user nova-compute[74683]: DEBUG nova.compute.manager [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Instance event wait completed in 0 seconds for  {{(pid=74683) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 11:26:08 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Guest created on hypervisor {{(pid=74683) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 11:26:08 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Instance spawned successfully.
Oct 16 11:26:08 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 11:26:09 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Found default for hw_cdrom_bus of ide {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:26:09 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Found default for hw_disk_bus of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:26:09 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Found default for hw_input_bus of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:26:09 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Found default for hw_pointer_model of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:26:09 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Found default for hw_video_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:26:09 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Found default for hw_vif_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:26:09 user nova-compute[74683]: DEBUG nova.compute.manager [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:26:09 user nova-compute[74683]: DEBUG nova.compute.manager [req-d21c429f-595d-4311-a361-445c5f965f51 req-9f5cad4c-152b-472a-be5a-7b1ca4b3ca2f service nova] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Received event network-vif-plugged-51406244-8351-4ada-b266-d5ec85d5f5b7 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:26:09 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-d21c429f-595d-4311-a361-445c5f965f51 req-9f5cad4c-152b-472a-be5a-7b1ca4b3ca2f service nova] Acquiring lock "4b4eaccb-e068-4e8a-9084-16229815b1d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:26:09 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-d21c429f-595d-4311-a361-445c5f965f51 req-9f5cad4c-152b-472a-be5a-7b1ca4b3ca2f service nova] Lock "4b4eaccb-e068-4e8a-9084-16229815b1d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:26:09 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-d21c429f-595d-4311-a361-445c5f965f51 req-9f5cad4c-152b-472a-be5a-7b1ca4b3ca2f service nova] Lock "4b4eaccb-e068-4e8a-9084-16229815b1d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:26:09 user nova-compute[74683]: DEBUG nova.compute.manager [req-d21c429f-595d-4311-a361-445c5f965f51 req-9f5cad4c-152b-472a-be5a-7b1ca4b3ca2f service nova] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] No waiting events found dispatching network-vif-plugged-51406244-8351-4ada-b266-d5ec85d5f5b7 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:26:09 user nova-compute[74683]: WARNING nova.compute.manager [req-d21c429f-595d-4311-a361-445c5f965f51 req-9f5cad4c-152b-472a-be5a-7b1ca4b3ca2f service nova] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Received unexpected event network-vif-plugged-51406244-8351-4ada-b266-d5ec85d5f5b7 for instance with vm_state active and task_state None.
Oct 16 11:26:09 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:26:09 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:26:09 user nova-compute[74683]: DEBUG nova.objects.instance [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74683) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Oct 16 11:26:09 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-669df96e-b7d8-422e-8d20-7cc5345448a9 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.078s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:26:10 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:26:11 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:26:14 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:26:14 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:26:14 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Starting heal instance info cache {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 11:26:14 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "refresh_cache-edd01413-1f8a-49e3-aa3c-ecb19c62afae" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:26:14 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquired lock "refresh_cache-edd01413-1f8a-49e3-aa3c-ecb19c62afae" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:26:14 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Forcefully refreshing network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 11:26:14 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Updating instance_info_cache with network_info: [{"id": "7ba36bb4-91c7-42ee-b592-6653e63a1d50", "address": "fa:16:3e:b4:d6:37", "network": {"id": "cd8cf08c-d79c-4d2e-b849-640c440e1498", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1091743670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcb8da41d6584a689e9b50155288aa5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba36bb4-91", "ovs_interfaceid": "7ba36bb4-91c7-42ee-b592-6653e63a1d50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:26:14 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Releasing lock "refresh_cache-edd01413-1f8a-49e3-aa3c-ecb19c62afae" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:26:14 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Updated the network info_cache for instance {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 11:26:14 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:26:14 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:26:14 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:26:14 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:26:14 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:26:14 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74683) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 11:26:15 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:26:16 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:26:16 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:26:16 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:26:16 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:26:16 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:26:16 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Auditing locally available compute resources for user (node: user) {{(pid=74683) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 11:26:16 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:26:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9fc5a9-8659-497c-bb07-af52fe2e1761/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9fc5a9-8659-497c-bb07-af52fe2e1761/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9fc5a9-8659-497c-bb07-af52fe2e1761/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9fc5a9-8659-497c-bb07-af52fe2e1761/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.rescue --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.rescue --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:18 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:18 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:18 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:18 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:18 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:18 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:18 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:18 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:18 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:18 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:26:18 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b79d385-e512-4297-9aa4-2b9bb0cac23c/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b79d385-e512-4297-9aa4-2b9bb0cac23c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b79d385-e512-4297-9aa4-2b9bb0cac23c/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b79d385-e512-4297-9aa4-2b9bb0cac23c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:19 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:26:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b4eaccb-e068-4e8a-9084-16229815b1d7/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b4eaccb-e068-4e8a-9084-16229815b1d7/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b4eaccb-e068-4e8a-9084-16229815b1d7/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b4eaccb-e068-4e8a-9084-16229815b1d7/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:20 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:26:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9f4840-69c8-4980-afd8-73a84f743dff/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9f4840-69c8-4980-afd8-73a84f743dff/disk --force-share --output=json" returned: 0 in 0.322s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9f4840-69c8-4980-afd8-73a84f743dff/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:20 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:26:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9f4840-69c8-4980-afd8-73a84f743dff/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:21 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:26:21 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:26:21 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Hypervisor/Node resource view: name=user free_ram=7456MB free_disk=25.167816162109375GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74683) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 11:26:21 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:26:21 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:26:21 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 18a77385-fab9-4ea0-8aa6-666cf7e798a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:26:21 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance d5e55361-d9ed-4d07-91b0-ec4d08b2e817 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:26:21 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance edd01413-1f8a-49e3-aa3c-ecb19c62afae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:26:21 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 6c9fc5a9-8659-497c-bb07-af52fe2e1761 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:26:21 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 9b8ba94f-43cc-4f06-bcd9-83935ccbe117 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:26:21 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance b91af786-36e3-4815-811f-fb3c055e758d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:26:21 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 0b79d385-e512-4297-9aa4-2b9bb0cac23c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:26:21 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 4b4eaccb-e068-4e8a-9084-16229815b1d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:26:21 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 6300da82-2079-455c-8ab2-9fd13ce9e825 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:26:21 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance d00bbb1a-534b-4437-9b79-91870c5d8bb5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:26:21 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 73adef6b-881d-466b-b55d-6cf2f974d40e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:26:21 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance be9f4840-69c8-4980-afd8-73a84f743dff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:26:21 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 11:26:21 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 11:26:21 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:26:21 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:26:21 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Compute_service record updated for user:user {{(pid=74683) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 11:26:21 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.512s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:26:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:26:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:26:26 user nova-compute[74683]: DEBUG nova.compute.manager [req-41806ebf-6506-49e7-93be-a99660bb52c8 req-17d3d6bb-e349-43be-b38f-6e0bea0f2841 service nova] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Received event volume-reimaged-7d2a9abe-890e-4bae-9d88-b64305a6ca3d {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:26:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-41806ebf-6506-49e7-93be-a99660bb52c8 req-17d3d6bb-e349-43be-b38f-6e0bea0f2841 service nova] Acquiring lock "6300da82-2079-455c-8ab2-9fd13ce9e825-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:26:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-41806ebf-6506-49e7-93be-a99660bb52c8 req-17d3d6bb-e349-43be-b38f-6e0bea0f2841 service nova] Lock "6300da82-2079-455c-8ab2-9fd13ce9e825-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:26:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-41806ebf-6506-49e7-93be-a99660bb52c8 req-17d3d6bb-e349-43be-b38f-6e0bea0f2841 service nova] Lock "6300da82-2079-455c-8ab2-9fd13ce9e825-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:26:26 user nova-compute[74683]: DEBUG nova.compute.manager [req-41806ebf-6506-49e7-93be-a99660bb52c8 req-17d3d6bb-e349-43be-b38f-6e0bea0f2841 service nova] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Processing event volume-reimaged-7d2a9abe-890e-4bae-9d88-b64305a6ca3d {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10871}}
Oct 16 11:26:26 user nova-compute[74683]: DEBUG nova.compute.manager [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Instance event wait completed in 27 seconds for volume-reimaged {{(pid=74683) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 11:26:26 user nova-compute[74683]: INFO nova.virt.block_device [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Booting with volume 7d2a9abe-890e-4bae-9d88-b64305a6ca3d at /dev/vda
Oct 16 11:26:27 user nova-compute[74683]: DEBUG os_brick.utils [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:26:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:27 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2849b84-ef0f-44ba-9b27-c4d2e271024d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:70b9d336ab7d\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:26:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:27 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[c756d497-8f3c-4e24-8c9c-a9f6a28ab34e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:26:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:27 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[84563edc-0c9c-4c58-a1c4-486a3338c240]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:26:27 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e149e5-83d7-42e5-aaa5-5248c903867c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:26:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Running cmd (subprocess): nvme version {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] 'nvme version' failed. Not Retrying. {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:26:27 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.nvmeof [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] nvme not present on system {{(pid=74683) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 11:26:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:26:27 user nova-compute[74683]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 11:26:27 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d187d2-e19b-4636-87bc-ef6cfbd3de7d]: (4, '') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:26:27 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74683) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 11:26:27 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 11:26:27 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] LIGHTOS: no hostnqn found. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 11:26:27 user nova-compute[74683]: DEBUG os_brick.utils [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:70b9d336ab7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:26:27 user nova-compute[74683]: DEBUG nova.virt.block_device [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Updating existing volume attachment record: 0aa913fe-5210-4272-bd15-2da6dbcc5cd0 {{(pid=74683) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 11:26:30 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:26:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:26:34 user nova-compute[74683]: INFO nova.compute.manager [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Rescuing
Oct 16 11:26:34 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Acquiring lock "refresh_cache-d00bbb1a-534b-4437-9b79-91870c5d8bb5" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:26:34 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Acquired lock "refresh_cache-d00bbb1a-534b-4437-9b79-91870c5d8bb5" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:26:34 user nova-compute[74683]: DEBUG nova.network.neutron [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:26:34 user nova-compute[74683]: DEBUG nova.network.neutron [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Updating instance_info_cache with network_info: [{"id": "3d2071d3-9bd0-4aa5-a909-889b3f3155db", "address": "fa:16:3e:53:66:36", "network": {"id": "4d43cc12-d2cd-4552-90a4-884a0ff3dc66", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-825513246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6e0046017b4bba85caf2a39d1c67b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d2071d3-9b", "ovs_interfaceid": "3d2071d3-9bd0-4aa5-a909-889b3f3155db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:26:34 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Releasing lock "refresh_cache-d00bbb1a-534b-4437-9b79-91870c5d8bb5" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:26:34 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:26:34 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:26:34 user nova-compute[74683]: DEBUG nova.compute.manager [req-fdf26009-1bd9-467c-b3b2-048708642969 req-e051eacf-a2d6-40fd-a6f0-4c6a1ca934bf service nova] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Received event network-vif-unplugged-3d2071d3-9bd0-4aa5-a909-889b3f3155db {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:26:34 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-fdf26009-1bd9-467c-b3b2-048708642969 req-e051eacf-a2d6-40fd-a6f0-4c6a1ca934bf service nova] Acquiring lock "d00bbb1a-534b-4437-9b79-91870c5d8bb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:26:34 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-fdf26009-1bd9-467c-b3b2-048708642969 req-e051eacf-a2d6-40fd-a6f0-4c6a1ca934bf service nova] Lock "d00bbb1a-534b-4437-9b79-91870c5d8bb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:26:34 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-fdf26009-1bd9-467c-b3b2-048708642969 req-e051eacf-a2d6-40fd-a6f0-4c6a1ca934bf service nova] Lock "d00bbb1a-534b-4437-9b79-91870c5d8bb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:26:34 user nova-compute[74683]: DEBUG nova.compute.manager [req-fdf26009-1bd9-467c-b3b2-048708642969 req-e051eacf-a2d6-40fd-a6f0-4c6a1ca934bf service nova] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] No waiting events found dispatching network-vif-unplugged-3d2071d3-9bd0-4aa5-a909-889b3f3155db {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:26:34 user nova-compute[74683]: WARNING nova.compute.manager [req-fdf26009-1bd9-467c-b3b2-048708642969 req-e051eacf-a2d6-40fd-a6f0-4c6a1ca934bf service nova] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Received unexpected event network-vif-unplugged-3d2071d3-9bd0-4aa5-a909-889b3f3155db for instance with vm_state active and task_state rescuing.
Oct 16 11:26:35 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:26:35 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:26:35 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Instance destroyed successfully.
Oct 16 11:26:35 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Attempting a stable device rescue
Oct 16 11:26:35 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74683) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 16 11:26:35 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Instance directory exists: not creating {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 16 11:26:35 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Creating image(s)
Oct 16 11:26:35 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Acquiring lock "/opt/stack/data/nova/instances/d00bbb1a-534b-4437-9b79-91870c5d8bb5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:26:35 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "/opt/stack/data/nova/instances/d00bbb1a-534b-4437-9b79-91870c5d8bb5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:26:35 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "/opt/stack/data/nova/instances/d00bbb1a-534b-4437-9b79-91870c5d8bb5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:26:35 user nova-compute[74683]: DEBUG nova.objects.instance [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lazy-loading 'trusted_certs' on Instance uuid d00bbb1a-534b-4437-9b79-91870c5d8bb5 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:26:35 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Acquiring lock "277b29b8c5445afe97c486e1dcabeef46d49eb32" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:26:35 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "277b29b8c5445afe97c486e1dcabeef46d49eb32" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:26:35 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:26:36 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/277b29b8c5445afe97c486e1dcabeef46d49eb32.part --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:26:36 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/277b29b8c5445afe97c486e1dcabeef46d49eb32.part --force-share --output=json" returned: 0 in 0.183s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:36 user nova-compute[74683]: DEBUG nova.virt.images [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] dc8af193-e68b-4f1f-81d8-71bb1c531d02 was qcow2, converting to raw {{(pid=74683) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 16 11:26:36 user nova-compute[74683]: DEBUG nova.privsep.utils [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74683) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 11:26:36 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/277b29b8c5445afe97c486e1dcabeef46d49eb32.part /opt/stack/data/nova/instances/_base/277b29b8c5445afe97c486e1dcabeef46d49eb32.converted {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG nova.compute.manager [req-98718fa2-20a8-4d21-8b24-cd823a440011 req-f64e371c-e11e-4d6b-8426-2550aef3652b service nova] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Received event network-vif-plugged-3d2071d3-9bd0-4aa5-a909-889b3f3155db {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-98718fa2-20a8-4d21-8b24-cd823a440011 req-f64e371c-e11e-4d6b-8426-2550aef3652b service nova] Acquiring lock "d00bbb1a-534b-4437-9b79-91870c5d8bb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-98718fa2-20a8-4d21-8b24-cd823a440011 req-f64e371c-e11e-4d6b-8426-2550aef3652b service nova] Lock "d00bbb1a-534b-4437-9b79-91870c5d8bb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-98718fa2-20a8-4d21-8b24-cd823a440011 req-f64e371c-e11e-4d6b-8426-2550aef3652b service nova] Lock "d00bbb1a-534b-4437-9b79-91870c5d8bb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG nova.compute.manager [req-98718fa2-20a8-4d21-8b24-cd823a440011 req-f64e371c-e11e-4d6b-8426-2550aef3652b service nova] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] No waiting events found dispatching network-vif-plugged-3d2071d3-9bd0-4aa5-a909-889b3f3155db {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:26:37 user nova-compute[74683]: WARNING nova.compute.manager [req-98718fa2-20a8-4d21-8b24-cd823a440011 req-f64e371c-e11e-4d6b-8426-2550aef3652b service nova] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Received unexpected event network-vif-plugged-3d2071d3-9bd0-4aa5-a909-889b3f3155db for instance with vm_state active and task_state rescuing.
Oct 16 11:26:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/277b29b8c5445afe97c486e1dcabeef46d49eb32.part /opt/stack/data/nova/instances/_base/277b29b8c5445afe97c486e1dcabeef46d49eb32.converted" returned: 0 in 0.321s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/277b29b8c5445afe97c486e1dcabeef46d49eb32.converted --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/277b29b8c5445afe97c486e1dcabeef46d49eb32.converted --force-share --output=json" returned: 0 in 0.174s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "277b29b8c5445afe97c486e1dcabeef46d49eb32" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.869s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Acquiring lock "277b29b8c5445afe97c486e1dcabeef46d49eb32" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "277b29b8c5445afe97c486e1dcabeef46d49eb32" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/277b29b8c5445afe97c486e1dcabeef46d49eb32 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/277b29b8c5445afe97c486e1dcabeef46d49eb32 --force-share --output=json" returned: 0 in 0.184s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/277b29b8c5445afe97c486e1dcabeef46d49eb32,backing_fmt=raw /opt/stack/data/nova/instances/d00bbb1a-534b-4437-9b79-91870c5d8bb5/disk.rescue {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/277b29b8c5445afe97c486e1dcabeef46d49eb32,backing_fmt=raw /opt/stack/data/nova/instances/d00bbb1a-534b-4437-9b79-91870c5d8bb5/disk.rescue" returned: 0 in 0.051s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "277b29b8c5445afe97c486e1dcabeef46d49eb32" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG nova.objects.instance [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lazy-loading 'migration_context' on Instance uuid d00bbb1a-534b-4437-9b79-91870c5d8bb5 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG nova.objects.base [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Object Instance<d00bbb1a-534b-4437-9b79-91870c5d8bb5> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Created local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Start _get_guest_xml network_info=[{"id": "3d2071d3-9bd0-4aa5-a909-889b3f3155db", "address": "fa:16:3e:53:66:36", "network": {"id": "4d43cc12-d2cd-4552-90a4-884a0ff3dc66", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-825513246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-825513246-network", "vif_mac": "fa:16:3e:53:66:36"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6e0046017b4bba85caf2a39d1c67b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d2071d3-9b", "ovs_interfaceid": "3d2071d3-9bd0-4aa5-a909-889b3f3155db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'dc8af193-e68b-4f1f-81d8-71bb1c531d02', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PSFCAUyR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'd00bbb1a-534b-4437-9b79-91870c5d8bb5', 'attached_at': '', 'detached_at': '', 'volume_id': '89f4c36a-6914-44f0-b0ce-54415b3b2354', 'serial': '89f4c36a-6914-44f0-b0ce-54415b3b2354'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': 'bd57c82d-2579-4ef5-9598-de3d7cd6a8c4', 'volume_type': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG nova.objects.instance [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lazy-loading 'resources' on Instance uuid d00bbb1a-534b-4437-9b79-91870c5d8bb5 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG nova.objects.base [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Object Instance<d00bbb1a-534b-4437-9b79-91870c5d8bb5> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG nova.objects.instance [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lazy-loading 'numa_topology' on Instance uuid d00bbb1a-534b-4437-9b79-91870c5d8bb5 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG nova.objects.base [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Object Instance<d00bbb1a-534b-4437-9b79-91870c5d8bb5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:26:37 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:26:37 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:26:37 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG nova.objects.instance [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lazy-loading 'vcpu_model' on Instance uuid d00bbb1a-534b-4437-9b79-91870c5d8bb5 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG nova.objects.base [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Object Instance<d00bbb1a-534b-4437-9b79-91870c5d8bb5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Calling os-brick to attach iSCSI Volume {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PSFCAUyR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:26:37 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:26:37 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:26:37 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:26:37 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:26:37 user nova-compute[74683]: INFO os_brick.initiator.connectors.iscsi [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 11:26:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 -p 172.16.0.220:3260 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee33a9cb-6324-4091-88da-4dfab5b7541a]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = PSFCAUyR\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 16 11:26:37 user nova-compute[74683]: node.name = iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354
Oct 16 11:26:37 user nova-compute[74683]: node.tpgt = -1
Oct 16 11:26:37 user nova-compute[74683]: node.startup = automatic
Oct 16 11:26:37 user nova-compute[74683]: node.leading_login = No
Oct 16 11:26:37 user nova-compute[74683]: iface.iscsi_ifacename = default
Oct 16 11:26:37 user nova-compute[74683]: iface.net_ifacename = <empty>
Oct 16 11:26:37 user nova-compute[74683]: iface.ipaddress = <empty>
Oct 16 11:26:37 user nova-compute[74683]: iface.prefix_len = 0
Oct 16 11:26:37 user nova-compute[74683]: iface.hwaddress = <empty>
Oct 16 11:26:37 user nova-compute[74683]: iface.transport_name = tcp
Oct 16 11:26:37 user nova-compute[74683]: iface.initiatorname = <empty>
Oct 16 11:26:37 user nova-compute[74683]: iface.state = <empty>
Oct 16 11:26:37 user nova-compute[74683]: iface.vlan_id = 0
Oct 16 11:26:37 user nova-compute[74683]: iface.vlan_priority = 0
Oct 16 11:26:37 user nova-compute[74683]: iface.vlan_state = <empty>
Oct 16 11:26:37 user nova-compute[74683]: iface.iface_num = 0
Oct 16 11:26:37 user nova-compute[74683]: iface.mtu = 0
Oct 16 11:26:37 user nova-compute[74683]: iface.port = 0
Oct 16 11:26:37 user nova-compute[74683]: iface.bootproto = <empty>
Oct 16 11:26:37 user nova-compute[74683]: iface.subnet_mask = <empty>
Oct 16 11:26:37 user nova-compute[74683]: iface.gateway = <empty>
Oct 16 11:26:37 user nova-compute[74683]: iface.dhcp_alt_client_id_state = <empty>
Oct 16 11:26:37 user nova-compute[74683]: iface.dhcp_alt_client_id = <empty>
Oct 16 11:26:37 user nova-compute[74683]: iface.dhcp_dns = <empty>
Oct 16 11:26:37 user nova-compute[74683]: iface.dhcp_learn_iqn = <empty>
Oct 16 11:26:37 user nova-compute[74683]: iface.dhcp_req_vendor_id_state = <empty>
Oct 16 11:26:37 user nova-compute[74683]: iface.dhcp_vendor_id_state = <empty>
Oct 16 11:26:37 user nova-compute[74683]: iface.dhcp_vendor_id = <empty>
Oct 16 11:26:37 user nova-compute[74683]: iface.dhcp_slp_da = <empty>
Oct 16 11:26:37 user nova-compute[74683]: iface.fragmentation = <empty>
Oct 16 11:26:37 user nova-compute[74683]: iface.gratuitous_arp = <empty>
Oct 16 11:26:37 user nova-compute[74683]: iface.incoming_forwarding = <empty>
Oct 16 11:26:37 user nova-compute[74683]: iface.tos_state = <empty>
Oct 16 11:26:37 user nova-compute[74683]: iface.tos = 0
Oct 16 11:26:37 user nova-compute[74683]: iface.ttl = 0
Oct 16 11:26:37 user nova-compute[74683]: iface.delayed_ack = <empty>
Oct 16 11:26:37 user nova-compute[74683]: iface.tcp_nagle = <empty>
Oct 16 11:26:37 user nova-compute[74683]: iface.tcp_wsf_state = <empty>
Oct 16 11:26:37 user nova-compute[74683]: iface.tcp_wsf = 0
Oct 16 11:26:37 user nova-compute[74683]: iface.tcp_timer_scale = 0
Oct 16 11:26:37 user nova-compute[74683]: iface.tcp_timestamp = <empty>
Oct 16 11:26:37 user nova-compute[74683]: iface.redirect = <empty>
Oct 16 11:26:37 user nova-compute[74683]: iface.def_task_mgmt_timeout = 0
Oct 16 11:26:37 user nova-compute[74683]: iface.header_digest = <empty>
Oct 16 11:26:37 user nova-compute[74683]: iface.data_digest = <empty>
Oct 16 11:26:37 user nova-compute[74683]: iface.immediate_data = <empty>
Oct 16 11:26:37 user nova-compute[74683]: iface.initial_r2t = <empty>
Oct 16 11:26:37 user nova-compute[74683]: iface.data_seq_inorder = <empty>
Oct 16 11:26:37 user nova-compute[74683]: iface.data_pdu_inorder = <empty>
Oct 16 11:26:37 user nova-compute[74683]: iface.erl = 0
Oct 16 11:26:37 user nova-compute[74683]: iface.max_receive_data_len = 0
Oct 16 11:26:37 user nova-compute[74683]: iface.first_burst_len = 0
Oct 16 11:26:37 user nova-compute[74683]: iface.max_outstanding_r2t = 0
Oct 16 11:26:37 user nova-compute[74683]: iface.max_burst_len = 0
Oct 16 11:26:37 user nova-compute[74683]: iface.chap_auth = <empty>
Oct 16 11:26:37 user nova-compute[74683]: iface.bidi_chap = <empty>
Oct 16 11:26:37 user nova-compute[74683]: iface.strict_login_compliance = <empty>
Oct 16 11:26:37 user nova-compute[74683]: iface.discovery_auth = <empty>
Oct 16 11:26:37 user nova-compute[74683]: iface.discovery_logout = <empty>
Oct 16 11:26:37 user nova-compute[74683]: node.discovery_address = <empty>
Oct 16 11:26:37 user nova-compute[74683]: node.discovery_port = 0
Oct 16 11:26:37 user nova-compute[74683]: node.discovery_type = static
Oct 16 11:26:37 user nova-compute[74683]: node.session.initial_cmdsn = 0
Oct 16 11:26:37 user nova-compute[74683]: node.session.initial_login_retry_max = 8
Oct 16 11:26:37 user nova-compute[74683]: node.session.xmit_thread_priority = -20
Oct 16 11:26:37 user nova-compute[74683]: node.session.cmds_max = 128
Oct 16 11:26:37 user nova-compute[74683]: node.session.queue_depth = 32
Oct 16 11:26:37 user nova-compute[74683]: node.session.nr_sessions = 1
Oct 16 11:26:37 user nova-compute[74683]: node.session.auth.authmethod = CHAP
Oct 16 11:26:37 user nova-compute[74683]: node.session.auth.username = PSFCAUyR
Oct 16 11:26:37 user nova-compute[74683]: node.session.auth.password = ***
Oct 16 11:26:37 user nova-compute[74683]: node.session.auth.username_in = <empty>
Oct 16 11:26:37 user nova-compute[74683]: node.session.auth.password_in = <empty>
Oct 16 11:26:37 user nova-compute[74683]: node.session.auth.chap_algs = MD5
Oct 16 11:26:37 user nova-compute[74683]: node.session.timeo.replacement_timeout = 120
Oct 16 11:26:37 user nova-compute[74683]: node.session.err_timeo.abort_timeout = 15
Oct 16 11:26:37 user nova-compute[74683]: node.session.err_timeo.lu_reset_timeout = 30
Oct 16 11:26:37 user nova-compute[74683]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 16 11:26:37 user nova-compute[74683]: node.session.err_timeo.host_reset_timeout = 60
Oct 16 11:26:37 user nova-compute[74683]: node.session.iscsi.FastAbort = Yes
Oct 16 11:26:37 user nova-compute[74683]: node.session.iscsi.InitialR2T = No
Oct 16 11:26:37 user nova-compute[74683]: node.session.iscsi.ImmediateData = Yes
Oct 16 11:26:37 user nova-compute[74683]: node.session.iscsi.FirstBurstLength = 262144
Oct 16 11:26:37 user nova-compute[74683]: node.session.iscsi.MaxBurstLength = 16776192
Oct 16 11:26:37 user nova-compute[74683]: node.session.iscsi.DefaultTime2Retain = 0
Oct 16 11:26:37 user nova-compute[74683]: node.session.iscsi.DefaultTime2Wait = 2
Oct 16 11:26:37 user nova-compute[74683]: node.session.iscsi.MaxConnections = 1
Oct 16 11:26:37 user nova-compute[74683]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 16 11:26:37 user nova-compute[74683]: node.session.iscsi.ERL = 0
Oct 16 11:26:37 user nova-compute[74683]: node.session.scan = manual
Oct 16 11:26:37 user nova-compute[74683]: node.session.reopen_max = 0
Oct 16 11:26:37 user nova-compute[74683]: node.conn[0].address = 172.16.0.220
Oct 16 11:26:37 user nova-compute[74683]: node.conn[0].port = 3260
Oct 16 11:26:37 user nova-compute[74683]: node.conn[0].startup = manual
Oct 16 11:26:37 user nova-compute[74683]: node.conn[0].tcp.window_size = 524288
Oct 16 11:26:37 user nova-compute[74683]: node.conn[0].tcp.type_of_service = 0
Oct 16 11:26:37 user nova-compute[74683]: node.conn[0].timeo.logout_timeout = 15
Oct 16 11:26:37 user nova-compute[74683]: node.conn[0].timeo.login_timeout = 15
Oct 16 11:26:37 user nova-compute[74683]: node.conn[0].timeo.auth_timeout = 45
Oct 16 11:26:37 user nova-compute[74683]: node.conn[0].timeo.noop_out_interval = 5
Oct 16 11:26:37 user nova-compute[74683]: node.conn[0].timeo.noop_out_timeout = 5
Oct 16 11:26:37 user nova-compute[74683]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 16 11:26:37 user nova-compute[74683]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 16 11:26:37 user nova-compute[74683]: node.conn[0].iscsi.HeaderDigest = None
Oct 16 11:26:37 user nova-compute[74683]: node.conn[0].iscsi.DataDigest = None
Oct 16 11:26:37 user nova-compute[74683]: node.conn[0].iscsi.IFMarker = No
Oct 16 11:26:37 user nova-compute[74683]: node.conn[0].iscsi.OFMarker = No
Oct 16 11:26:37 user nova-compute[74683]: # END RECORD
Oct 16 11:26:37 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0384280-ab7f-4d36-8d07-b24cb9e07331]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb245e1-4e9a-498c-993c-6945436ac0a3]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PSFCAUyR {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PSFCAUyR" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0bec02-491d-4104-86cb-83938115a67c]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PSFCAUyR'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e05c149-101b-4266-9d7e-1ce7f295a30c]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ae0412-4e5c-4e0a-98fe-38fdf5e3676f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:26:37 user nova-compute[74683]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)
Oct 16 11:26:37 user nova-compute[74683]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)
Oct 16 11:26:37 user nova-compute[74683]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 (non-flash)
Oct 16 11:26:37 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:26:37 user nova-compute[74683]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)
Oct 16 11:26:37 user nova-compute[74683]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)
Oct 16 11:26:37 user nova-compute[74683]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 (non-flash)
Oct 16 11:26:37 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.145s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Connected to 172.16.0.220:3260 {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] HCTL ('35', '0', '0', 0) found on session 27 with lun 0 {{(pid=74683) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=74683) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.013s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b830e2-c35c-43c2-b402-c81674d52019]: (4, ('0 0 0', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Searching for a device in session 27 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PSFCAUyR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.167s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] <== connect_volume: return (168ms) {'type': 'block', 'scsi_wwn': '26366346562353433', 'path': '/dev/sdd'} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26366346562353433', 'path': '/dev/sdd'} {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:24:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2068879379',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2068879379',id=29,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:25:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d6e0046017b4bba85caf2a39d1c67b3',ramdisk_id='',reservation_id='r-zizi1x7p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1787816377',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:25:25Z,user_data=None,user_id='76a41804541e4a259771702727d9993e',uuid=d00bbb1a-534b-4437-9b79-91870c5d8bb5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d2071d3-9bd0-4aa5-a909-889b3f3155db", "address": "fa:16:3e:53:66:36", "network": {"id": "4d43cc12-d2cd-4552-90a4-884a0ff3dc66", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-825513246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-825513246-network", "vif_mac": "fa:16:3e:53:66:36"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6e0046017b4bba85caf2a39d1c67b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d2071d3-9b", "ovs_interfaceid": "3d2071d3-9bd0-4aa5-a909-889b3f3155db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Converting VIF {"id": "3d2071d3-9bd0-4aa5-a909-889b3f3155db", "address": "fa:16:3e:53:66:36", "network": {"id": "4d43cc12-d2cd-4552-90a4-884a0ff3dc66", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-825513246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-825513246-network", "vif_mac": "fa:16:3e:53:66:36"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6e0046017b4bba85caf2a39d1c67b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d2071d3-9b", "ovs_interfaceid": "3d2071d3-9bd0-4aa5-a909-889b3f3155db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:66:36,bridge_name='br-int',has_traffic_filtering=True,id=3d2071d3-9bd0-4aa5-a909-889b3f3155db,network=Network(4d43cc12-d2cd-4552-90a4-884a0ff3dc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d2071d3-9b') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG nova.objects.instance [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lazy-loading 'pci_devices' on Instance uuid d00bbb1a-534b-4437-9b79-91870c5d8bb5 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG nova.objects.base [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Object Instance<d00bbb1a-534b-4437-9b79-91870c5d8bb5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:26:37 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:26:37 user nova-compute[74683]:   <uuid>d00bbb1a-534b-4437-9b79-91870c5d8bb5</uuid>
Oct 16 11:26:37 user nova-compute[74683]:   <name>instance-0000001d</name>
Oct 16 11:26:37 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:26:37 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:26:37 user nova-compute[74683]:   <metadata>
Oct 16 11:26:37 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:26:37 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:26:37 user nova-compute[74683]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2068879379</nova:name>
Oct 16 11:26:37 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:26:37</nova:creationTime>
Oct 16 11:26:37 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:26:37 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:26:37 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:26:37 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:26:37 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:26:37 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:26:37 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:26:37 user nova-compute[74683]:       <nova:owner>
Oct 16 11:26:37 user nova-compute[74683]:         <nova:user uuid="76a41804541e4a259771702727d9993e">tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member</nova:user>
Oct 16 11:26:37 user nova-compute[74683]:         <nova:project uuid="4d6e0046017b4bba85caf2a39d1c67b3">tempest-ServerBootFromVolumeStableRescueTest-1787816377</nova:project>
Oct 16 11:26:37 user nova-compute[74683]:       </nova:owner>
Oct 16 11:26:37 user nova-compute[74683]:       <nova:root type="image" uuid="0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f"/>
Oct 16 11:26:37 user nova-compute[74683]:       <nova:ports>
Oct 16 11:26:37 user nova-compute[74683]:         <nova:port uuid="3d2071d3-9bd0-4aa5-a909-889b3f3155db">
Oct 16 11:26:37 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 16 11:26:37 user nova-compute[74683]:         </nova:port>
Oct 16 11:26:37 user nova-compute[74683]:       </nova:ports>
Oct 16 11:26:37 user nova-compute[74683]:     </nova:instance>
Oct 16 11:26:37 user nova-compute[74683]:   </metadata>
Oct 16 11:26:37 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:26:37 user nova-compute[74683]:     <system>
Oct 16 11:26:37 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:26:37 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:26:37 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:26:37 user nova-compute[74683]:       <entry name="serial">d00bbb1a-534b-4437-9b79-91870c5d8bb5</entry>
Oct 16 11:26:37 user nova-compute[74683]:       <entry name="uuid">d00bbb1a-534b-4437-9b79-91870c5d8bb5</entry>
Oct 16 11:26:37 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:26:37 user nova-compute[74683]:     </system>
Oct 16 11:26:37 user nova-compute[74683]:   </sysinfo>
Oct 16 11:26:37 user nova-compute[74683]:   <os>
Oct 16 11:26:37 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:26:37 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:26:37 user nova-compute[74683]:   </os>
Oct 16 11:26:37 user nova-compute[74683]:   <features>
Oct 16 11:26:37 user nova-compute[74683]:     <acpi/>
Oct 16 11:26:37 user nova-compute[74683]:     <apic/>
Oct 16 11:26:37 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:26:37 user nova-compute[74683]:   </features>
Oct 16 11:26:37 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:26:37 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:26:37 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:26:37 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:26:37 user nova-compute[74683]:   </clock>
Oct 16 11:26:37 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:26:37 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:26:37 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:26:37 user nova-compute[74683]:   </cpu>
Oct 16 11:26:37 user nova-compute[74683]:   <devices>
Oct 16 11:26:37 user nova-compute[74683]:     <disk type="block" device="disk">
Oct 16 11:26:37 user nova-compute[74683]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:26:37 user nova-compute[74683]:       <source dev="/dev/sdd"/>
Oct 16 11:26:37 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:26:37 user nova-compute[74683]:       <serial>89f4c36a-6914-44f0-b0ce-54415b3b2354</serial>
Oct 16 11:26:37 user nova-compute[74683]:     </disk>
Oct 16 11:26:37 user nova-compute[74683]:     <disk type="file" device="disk">
Oct 16 11:26:37 user nova-compute[74683]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 11:26:37 user nova-compute[74683]:       <source file="/opt/stack/data/nova/instances/d00bbb1a-534b-4437-9b79-91870c5d8bb5/disk.rescue"/>
Oct 16 11:26:37 user nova-compute[74683]:       <target dev="vdb" bus="virtio"/>
Oct 16 11:26:37 user nova-compute[74683]:       <boot order="1"/>
Oct 16 11:26:37 user nova-compute[74683]:     </disk>
Oct 16 11:26:37 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:26:37 user nova-compute[74683]:       <mac address="fa:16:3e:53:66:36"/>
Oct 16 11:26:37 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:26:37 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:26:37 user nova-compute[74683]:       <target dev="tap3d2071d3-9b"/>
Oct 16 11:26:37 user nova-compute[74683]:     </interface>
Oct 16 11:26:37 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:26:37 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/d00bbb1a-534b-4437-9b79-91870c5d8bb5/console.log" append="off"/>
Oct 16 11:26:37 user nova-compute[74683]:     </serial>
Oct 16 11:26:37 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:26:37 user nova-compute[74683]:     <video>
Oct 16 11:26:37 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:26:37 user nova-compute[74683]:     </video>
Oct 16 11:26:37 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:26:37 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:26:37 user nova-compute[74683]:     </rng>
Oct 16 11:26:37 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:26:37 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:26:37 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:26:37 user nova-compute[74683]:     </memballoon>
Oct 16 11:26:37 user nova-compute[74683]:   </devices>
Oct 16 11:26:37 user nova-compute[74683]: </domain>
Oct 16 11:26:37 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:26:37 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Instance destroyed successfully.
Oct 16 11:26:38 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:26:38 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:26:38 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] No VIF found with MAC fa:16:3e:53:66:36, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:26:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:26:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:26:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:26:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:26:39 user nova-compute[74683]: DEBUG nova.compute.manager [req-e982e9c7-7c72-4ffe-a945-2eb9f4fcb59f req-78463be5-65ae-449b-9c74-613de282da08 service nova] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Received event network-vif-plugged-3d2071d3-9bd0-4aa5-a909-889b3f3155db {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:26:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e982e9c7-7c72-4ffe-a945-2eb9f4fcb59f req-78463be5-65ae-449b-9c74-613de282da08 service nova] Acquiring lock "d00bbb1a-534b-4437-9b79-91870c5d8bb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:26:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e982e9c7-7c72-4ffe-a945-2eb9f4fcb59f req-78463be5-65ae-449b-9c74-613de282da08 service nova] Lock "d00bbb1a-534b-4437-9b79-91870c5d8bb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:26:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e982e9c7-7c72-4ffe-a945-2eb9f4fcb59f req-78463be5-65ae-449b-9c74-613de282da08 service nova] Lock "d00bbb1a-534b-4437-9b79-91870c5d8bb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:26:39 user nova-compute[74683]: DEBUG nova.compute.manager [req-e982e9c7-7c72-4ffe-a945-2eb9f4fcb59f req-78463be5-65ae-449b-9c74-613de282da08 service nova] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] No waiting events found dispatching network-vif-plugged-3d2071d3-9bd0-4aa5-a909-889b3f3155db {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:26:39 user nova-compute[74683]: WARNING nova.compute.manager [req-e982e9c7-7c72-4ffe-a945-2eb9f4fcb59f req-78463be5-65ae-449b-9c74-613de282da08 service nova] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Received unexpected event network-vif-plugged-3d2071d3-9bd0-4aa5-a909-889b3f3155db for instance with vm_state active and task_state rescuing.
Oct 16 11:26:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:26:39 user nova-compute[74683]: DEBUG nova.compute.manager [req-dc95be6b-c355-4d12-80a8-e8ce49c89794 req-33b9731e-7b87-4760-9487-9c200f1b4461 service nova] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Received event network-changed-d30ae106-813b-458e-a46b-d92cbdd2e4b2 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:26:39 user nova-compute[74683]: DEBUG nova.compute.manager [req-dc95be6b-c355-4d12-80a8-e8ce49c89794 req-33b9731e-7b87-4760-9487-9c200f1b4461 service nova] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Refreshing instance network info cache due to event network-changed-d30ae106-813b-458e-a46b-d92cbdd2e4b2. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:26:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-dc95be6b-c355-4d12-80a8-e8ce49c89794 req-33b9731e-7b87-4760-9487-9c200f1b4461 service nova] Acquiring lock "refresh_cache-73adef6b-881d-466b-b55d-6cf2f974d40e" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:26:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-dc95be6b-c355-4d12-80a8-e8ce49c89794 req-33b9731e-7b87-4760-9487-9c200f1b4461 service nova] Acquired lock "refresh_cache-73adef6b-881d-466b-b55d-6cf2f974d40e" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:26:39 user nova-compute[74683]: DEBUG nova.network.neutron [req-dc95be6b-c355-4d12-80a8-e8ce49c89794 req-33b9731e-7b87-4760-9487-9c200f1b4461 service nova] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Refreshing network info cache for port d30ae106-813b-458e-a46b-d92cbdd2e4b2 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:26:40 user nova-compute[74683]: INFO nova.compute.manager [None req-897b56f7-8951-4d5a-bec8-54b76f687698 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Rescuing
Oct 16 11:26:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-897b56f7-8951-4d5a-bec8-54b76f687698 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Acquiring lock "refresh_cache-9b8ba94f-43cc-4f06-bcd9-83935ccbe117" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:26:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-897b56f7-8951-4d5a-bec8-54b76f687698 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Acquired lock "refresh_cache-9b8ba94f-43cc-4f06-bcd9-83935ccbe117" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:26:40 user nova-compute[74683]: DEBUG nova.network.neutron [None req-897b56f7-8951-4d5a-bec8-54b76f687698 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:26:40 user nova-compute[74683]: DEBUG nova.network.neutron [req-dc95be6b-c355-4d12-80a8-e8ce49c89794 req-33b9731e-7b87-4760-9487-9c200f1b4461 service nova] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Updated VIF entry in instance network info cache for port d30ae106-813b-458e-a46b-d92cbdd2e4b2. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:26:40 user nova-compute[74683]: DEBUG nova.network.neutron [req-dc95be6b-c355-4d12-80a8-e8ce49c89794 req-33b9731e-7b87-4760-9487-9c200f1b4461 service nova] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Updating instance_info_cache with network_info: [{"id": "d30ae106-813b-458e-a46b-d92cbdd2e4b2", "address": "fa:16:3e:28:1e:05", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd30ae106-81", "ovs_interfaceid": "d30ae106-813b-458e-a46b-d92cbdd2e4b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:26:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-dc95be6b-c355-4d12-80a8-e8ce49c89794 req-33b9731e-7b87-4760-9487-9c200f1b4461 service nova] Releasing lock "refresh_cache-73adef6b-881d-466b-b55d-6cf2f974d40e" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:26:40 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:26:40 user nova-compute[74683]: DEBUG nova.network.neutron [None req-897b56f7-8951-4d5a-bec8-54b76f687698 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Updating instance_info_cache with network_info: [{"id": "ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665", "address": "fa:16:3e:d4:56:40", "network": {"id": "fa128ba8-cd2f-4621-ac04-ecc21569bb68", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321708612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66a49078f1240bd88207e487dd4951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff8b53f2-e6", "ovs_interfaceid": "ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:26:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-897b56f7-8951-4d5a-bec8-54b76f687698 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Releasing lock "refresh_cache-9b8ba94f-43cc-4f06-bcd9-83935ccbe117" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:26:40 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:26:40 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:26:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:26:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:26:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:26:41 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Instance destroyed successfully.
Oct 16 11:26:41 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-897b56f7-8951-4d5a-bec8-54b76f687698 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Attempting rescue
Oct 16 11:26:41 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-897b56f7-8951-4d5a-bec8-54b76f687698 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74683) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 16 11:26:41 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-897b56f7-8951-4d5a-bec8-54b76f687698 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Instance directory exists: not creating {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 16 11:26:41 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-897b56f7-8951-4d5a-bec8-54b76f687698 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Creating image(s)
Oct 16 11:26:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-897b56f7-8951-4d5a-bec8-54b76f687698 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Acquiring lock "/opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:26:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-897b56f7-8951-4d5a-bec8-54b76f687698 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "/opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:26:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-897b56f7-8951-4d5a-bec8-54b76f687698 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "/opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:26:41 user nova-compute[74683]: DEBUG nova.objects.instance [None req-897b56f7-8951-4d5a-bec8-54b76f687698 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9b8ba94f-43cc-4f06-bcd9-83935ccbe117 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:26:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:26:41 user nova-compute[74683]: DEBUG nova.compute.manager [req-237976f9-1d8f-40dc-b143-96e787e56196 req-faa98c55-d073-4cf3-8139-a7b178a4d3af service nova] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Received event network-vif-plugged-3d2071d3-9bd0-4aa5-a909-889b3f3155db {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:26:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-237976f9-1d8f-40dc-b143-96e787e56196 req-faa98c55-d073-4cf3-8139-a7b178a4d3af service nova] Acquiring lock "d00bbb1a-534b-4437-9b79-91870c5d8bb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:26:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-237976f9-1d8f-40dc-b143-96e787e56196 req-faa98c55-d073-4cf3-8139-a7b178a4d3af service nova] Lock "d00bbb1a-534b-4437-9b79-91870c5d8bb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:26:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-237976f9-1d8f-40dc-b143-96e787e56196 req-faa98c55-d073-4cf3-8139-a7b178a4d3af service nova] Lock "d00bbb1a-534b-4437-9b79-91870c5d8bb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:26:41 user nova-compute[74683]: DEBUG nova.compute.manager [req-237976f9-1d8f-40dc-b143-96e787e56196 req-faa98c55-d073-4cf3-8139-a7b178a4d3af service nova] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] No waiting events found dispatching network-vif-plugged-3d2071d3-9bd0-4aa5-a909-889b3f3155db {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:26:41 user nova-compute[74683]: WARNING nova.compute.manager [req-237976f9-1d8f-40dc-b143-96e787e56196 req-faa98c55-d073-4cf3-8139-a7b178a4d3af service nova] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Received unexpected event network-vif-plugged-3d2071d3-9bd0-4aa5-a909-889b3f3155db for instance with vm_state active and task_state rescuing.
Oct 16 11:26:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-897b56f7-8951-4d5a-bec8-54b76f687698 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Acquiring lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:26:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-897b56f7-8951-4d5a-bec8-54b76f687698 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:26:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-897b56f7-8951-4d5a-bec8-54b76f687698 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-897b56f7-8951-4d5a-bec8-54b76f687698 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.187s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-897b56f7-8951-4d5a-bec8-54b76f687698 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk.rescue {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-897b56f7-8951-4d5a-bec8-54b76f687698 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk.rescue" returned: 0 in 0.060s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-897b56f7-8951-4d5a-bec8-54b76f687698 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:26:41 user nova-compute[74683]: DEBUG nova.objects.instance [None req-897b56f7-8951-4d5a-bec8-54b76f687698 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lazy-loading 'migration_context' on Instance uuid 9b8ba94f-43cc-4f06-bcd9-83935ccbe117 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:26:41 user nova-compute[74683]: DEBUG nova.compute.manager [req-7ced0e8f-3408-41c6-8d3c-9b5e77f031a2 req-ead37dde-76d0-4d66-882f-1be08fd9223c service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Received event network-vif-unplugged-ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:26:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-7ced0e8f-3408-41c6-8d3c-9b5e77f031a2 req-ead37dde-76d0-4d66-882f-1be08fd9223c service nova] Acquiring lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:26:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-7ced0e8f-3408-41c6-8d3c-9b5e77f031a2 req-ead37dde-76d0-4d66-882f-1be08fd9223c service nova] Lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:26:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-7ced0e8f-3408-41c6-8d3c-9b5e77f031a2 req-ead37dde-76d0-4d66-882f-1be08fd9223c service nova] Lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:26:41 user nova-compute[74683]: DEBUG nova.compute.manager [req-7ced0e8f-3408-41c6-8d3c-9b5e77f031a2 req-ead37dde-76d0-4d66-882f-1be08fd9223c service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] No waiting events found dispatching network-vif-unplugged-ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:26:41 user nova-compute[74683]: WARNING nova.compute.manager [req-7ced0e8f-3408-41c6-8d3c-9b5e77f031a2 req-ead37dde-76d0-4d66-882f-1be08fd9223c service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Received unexpected event network-vif-unplugged-ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 for instance with vm_state active and task_state rescuing.
Oct 16 11:26:41 user nova-compute[74683]: DEBUG nova.compute.manager [req-7ced0e8f-3408-41c6-8d3c-9b5e77f031a2 req-ead37dde-76d0-4d66-882f-1be08fd9223c service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Received event network-vif-plugged-ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:26:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-7ced0e8f-3408-41c6-8d3c-9b5e77f031a2 req-ead37dde-76d0-4d66-882f-1be08fd9223c service nova] Acquiring lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:26:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-7ced0e8f-3408-41c6-8d3c-9b5e77f031a2 req-ead37dde-76d0-4d66-882f-1be08fd9223c service nova] Lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:26:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-7ced0e8f-3408-41c6-8d3c-9b5e77f031a2 req-ead37dde-76d0-4d66-882f-1be08fd9223c service nova] Lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:26:41 user nova-compute[74683]: DEBUG nova.compute.manager [req-7ced0e8f-3408-41c6-8d3c-9b5e77f031a2 req-ead37dde-76d0-4d66-882f-1be08fd9223c service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] No waiting events found dispatching network-vif-plugged-ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:26:41 user nova-compute[74683]: WARNING nova.compute.manager [req-7ced0e8f-3408-41c6-8d3c-9b5e77f031a2 req-ead37dde-76d0-4d66-882f-1be08fd9223c service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Received unexpected event network-vif-plugged-ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 for instance with vm_state active and task_state rescuing.
Oct 16 11:26:41 user nova-compute[74683]: DEBUG nova.objects.base [None req-897b56f7-8951-4d5a-bec8-54b76f687698 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Object Instance<9b8ba94f-43cc-4f06-bcd9-83935ccbe117> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:26:41 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-897b56f7-8951-4d5a-bec8-54b76f687698 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Created local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 11:26:41 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-897b56f7-8951-4d5a-bec8-54b76f687698 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Start _get_guest_xml network_info=[{"id": "ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665", "address": "fa:16:3e:d4:56:40", "network": {"id": "fa128ba8-cd2f-4621-ac04-ecc21569bb68", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321708612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1321708612-network", "vif_mac": "fa:16:3e:d4:56:40"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66a49078f1240bd88207e487dd4951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff8b53f2-e6", "ovs_interfaceid": "ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:26:41 user nova-compute[74683]: DEBUG nova.objects.instance [None req-897b56f7-8951-4d5a-bec8-54b76f687698 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lazy-loading 'resources' on Instance uuid 9b8ba94f-43cc-4f06-bcd9-83935ccbe117 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:26:41 user nova-compute[74683]: DEBUG nova.compute.manager [None req-c2ceb5db-2dc8-44e8-9ea7-17e2e70ed672 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:26:41 user nova-compute[74683]: DEBUG nova.objects.base [None req-897b56f7-8951-4d5a-bec8-54b76f687698 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Object Instance<9b8ba94f-43cc-4f06-bcd9-83935ccbe117> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:26:41 user nova-compute[74683]: DEBUG nova.objects.instance [None req-897b56f7-8951-4d5a-bec8-54b76f687698 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lazy-loading 'numa_topology' on Instance uuid 9b8ba94f-43cc-4f06-bcd9-83935ccbe117 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:26:42 user nova-compute[74683]: DEBUG nova.objects.base [None req-897b56f7-8951-4d5a-bec8-54b76f687698 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Object Instance<9b8ba94f-43cc-4f06-bcd9-83935ccbe117> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:26:42 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-897b56f7-8951-4d5a-bec8-54b76f687698 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:26:42 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-897b56f7-8951-4d5a-bec8-54b76f687698 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:26:42 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-897b56f7-8951-4d5a-bec8-54b76f687698 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:26:42 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-897b56f7-8951-4d5a-bec8-54b76f687698 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:26:42 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-897b56f7-8951-4d5a-bec8-54b76f687698 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:26:42 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-897b56f7-8951-4d5a-bec8-54b76f687698 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:26:42 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-897b56f7-8951-4d5a-bec8-54b76f687698 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:26:42 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-897b56f7-8951-4d5a-bec8-54b76f687698 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:26:42 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-897b56f7-8951-4d5a-bec8-54b76f687698 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:26:42 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-897b56f7-8951-4d5a-bec8-54b76f687698 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:26:42 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-897b56f7-8951-4d5a-bec8-54b76f687698 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:26:42 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-897b56f7-8951-4d5a-bec8-54b76f687698 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:26:42 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-897b56f7-8951-4d5a-bec8-54b76f687698 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:26:42 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-897b56f7-8951-4d5a-bec8-54b76f687698 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:26:42 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-897b56f7-8951-4d5a-bec8-54b76f687698 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:26:42 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-897b56f7-8951-4d5a-bec8-54b76f687698 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:26:42 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-897b56f7-8951-4d5a-bec8-54b76f687698 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:26:42 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-897b56f7-8951-4d5a-bec8-54b76f687698 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:26:42 user nova-compute[74683]: DEBUG nova.objects.instance [None req-897b56f7-8951-4d5a-bec8-54b76f687698 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9b8ba94f-43cc-4f06-bcd9-83935ccbe117 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:26:42 user nova-compute[74683]: DEBUG nova.objects.base [None req-897b56f7-8951-4d5a-bec8-54b76f687698 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Object Instance<9b8ba94f-43cc-4f06-bcd9-83935ccbe117> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:26:42 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-897b56f7-8951-4d5a-bec8-54b76f687698 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:21:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-75769581',display_name='tempest-ServerRescueNegativeTestJSON-server-75769581',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-75769581',id=23,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:22:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e66a49078f1240bd88207e487dd4951e',ramdisk_id='',reservation_id='r-eju2vrqd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1690011355',owner_user_name='tempest-ServerRescueNegativeTestJSON-1690011355-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:22:02Z,user_data=None,user_id='3436197c787446d4a03fb7697d7999a1',uuid=9b8ba94f-43cc-4f06-bcd9-83935ccbe117,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665", "address": "fa:16:3e:d4:56:40", "network": {"id": "fa128ba8-cd2f-4621-ac04-ecc21569bb68", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321708612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1321708612-network", "vif_mac": "fa:16:3e:d4:56:40"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66a49078f1240bd88207e487dd4951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff8b53f2-e6", "ovs_interfaceid": "ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:26:42 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-897b56f7-8951-4d5a-bec8-54b76f687698 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Converting VIF {"id": "ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665", "address": "fa:16:3e:d4:56:40", "network": {"id": "fa128ba8-cd2f-4621-ac04-ecc21569bb68", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321708612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1321708612-network", "vif_mac": "fa:16:3e:d4:56:40"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66a49078f1240bd88207e487dd4951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff8b53f2-e6", "ovs_interfaceid": "ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:26:42 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-897b56f7-8951-4d5a-bec8-54b76f687698 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d4:56:40,bridge_name='br-int',has_traffic_filtering=True,id=ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665,network=Network(fa128ba8-cd2f-4621-ac04-ecc21569bb68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff8b53f2-e6') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:26:42 user nova-compute[74683]: DEBUG nova.objects.instance [None req-897b56f7-8951-4d5a-bec8-54b76f687698 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lazy-loading 'pci_devices' on Instance uuid 9b8ba94f-43cc-4f06-bcd9-83935ccbe117 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:26:42 user nova-compute[74683]: DEBUG nova.objects.base [None req-897b56f7-8951-4d5a-bec8-54b76f687698 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Object Instance<9b8ba94f-43cc-4f06-bcd9-83935ccbe117> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:26:42 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-897b56f7-8951-4d5a-bec8-54b76f687698 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:26:42 user nova-compute[74683]:   <uuid>9b8ba94f-43cc-4f06-bcd9-83935ccbe117</uuid>
Oct 16 11:26:42 user nova-compute[74683]:   <name>instance-00000017</name>
Oct 16 11:26:42 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:26:42 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:26:42 user nova-compute[74683]:   <metadata>
Oct 16 11:26:42 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:26:42 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:26:42 user nova-compute[74683]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-75769581</nova:name>
Oct 16 11:26:42 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:26:42</nova:creationTime>
Oct 16 11:26:42 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:26:42 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:26:42 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:26:42 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:26:42 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:26:42 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:26:42 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:26:42 user nova-compute[74683]:       <nova:owner>
Oct 16 11:26:42 user nova-compute[74683]:         <nova:user uuid="3436197c787446d4a03fb7697d7999a1">tempest-ServerRescueNegativeTestJSON-1690011355-project-member</nova:user>
Oct 16 11:26:42 user nova-compute[74683]:         <nova:project uuid="e66a49078f1240bd88207e487dd4951e">tempest-ServerRescueNegativeTestJSON-1690011355</nova:project>
Oct 16 11:26:42 user nova-compute[74683]:       </nova:owner>
Oct 16 11:26:42 user nova-compute[74683]:       <nova:root type="image" uuid="0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f"/>
Oct 16 11:26:42 user nova-compute[74683]:       <nova:ports>
Oct 16 11:26:42 user nova-compute[74683]:         <nova:port uuid="ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665">
Oct 16 11:26:42 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 16 11:26:42 user nova-compute[74683]:         </nova:port>
Oct 16 11:26:42 user nova-compute[74683]:       </nova:ports>
Oct 16 11:26:42 user nova-compute[74683]:     </nova:instance>
Oct 16 11:26:42 user nova-compute[74683]:   </metadata>
Oct 16 11:26:42 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:26:42 user nova-compute[74683]:     <system>
Oct 16 11:26:42 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:26:42 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:26:42 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:26:42 user nova-compute[74683]:       <entry name="serial">9b8ba94f-43cc-4f06-bcd9-83935ccbe117</entry>
Oct 16 11:26:42 user nova-compute[74683]:       <entry name="uuid">9b8ba94f-43cc-4f06-bcd9-83935ccbe117</entry>
Oct 16 11:26:42 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:26:42 user nova-compute[74683]:     </system>
Oct 16 11:26:42 user nova-compute[74683]:   </sysinfo>
Oct 16 11:26:42 user nova-compute[74683]:   <os>
Oct 16 11:26:42 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:26:42 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:26:42 user nova-compute[74683]:   </os>
Oct 16 11:26:42 user nova-compute[74683]:   <features>
Oct 16 11:26:42 user nova-compute[74683]:     <acpi/>
Oct 16 11:26:42 user nova-compute[74683]:     <apic/>
Oct 16 11:26:42 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:26:42 user nova-compute[74683]:   </features>
Oct 16 11:26:42 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:26:42 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:26:42 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:26:42 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:26:42 user nova-compute[74683]:   </clock>
Oct 16 11:26:42 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:26:42 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:26:42 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:26:42 user nova-compute[74683]:   </cpu>
Oct 16 11:26:42 user nova-compute[74683]:   <devices>
Oct 16 11:26:42 user nova-compute[74683]:     <disk type="file" device="disk">
Oct 16 11:26:42 user nova-compute[74683]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 11:26:42 user nova-compute[74683]:       <source file="/opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk.rescue"/>
Oct 16 11:26:42 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:26:42 user nova-compute[74683]:     </disk>
Oct 16 11:26:42 user nova-compute[74683]:     <disk type="file" device="disk">
Oct 16 11:26:42 user nova-compute[74683]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 11:26:42 user nova-compute[74683]:       <source file="/opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk"/>
Oct 16 11:26:42 user nova-compute[74683]:       <target dev="vdb" bus="virtio"/>
Oct 16 11:26:42 user nova-compute[74683]:     </disk>
Oct 16 11:26:42 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:26:42 user nova-compute[74683]:       <mac address="fa:16:3e:d4:56:40"/>
Oct 16 11:26:42 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:26:42 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:26:42 user nova-compute[74683]:       <target dev="tapff8b53f2-e6"/>
Oct 16 11:26:42 user nova-compute[74683]:     </interface>
Oct 16 11:26:42 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:26:42 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/console.log" append="off"/>
Oct 16 11:26:42 user nova-compute[74683]:     </serial>
Oct 16 11:26:42 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:26:42 user nova-compute[74683]:     <video>
Oct 16 11:26:42 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:26:42 user nova-compute[74683]:     </video>
Oct 16 11:26:42 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:26:42 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:26:42 user nova-compute[74683]:     </rng>
Oct 16 11:26:42 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:26:42 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:26:42 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:26:42 user nova-compute[74683]:     </memballoon>
Oct 16 11:26:42 user nova-compute[74683]:   </devices>
Oct 16 11:26:42 user nova-compute[74683]: </domain>
Oct 16 11:26:42 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:26:42 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Instance destroyed successfully.
Oct 16 11:26:42 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-897b56f7-8951-4d5a-bec8-54b76f687698 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:26:42 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-897b56f7-8951-4d5a-bec8-54b76f687698 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:26:42 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-897b56f7-8951-4d5a-bec8-54b76f687698 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] No VIF found with MAC fa:16:3e:d4:56:40, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:26:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:26:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:26:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:26:44 user nova-compute[74683]: DEBUG nova.compute.manager [req-e5156afa-a64d-4325-a0cf-8ff588d35167 req-0326c9ea-8dc9-485b-969d-aa0650b61ddd service nova] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Received event network-changed-3a270246-50ff-4381-a519-564fe320578f {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:26:44 user nova-compute[74683]: DEBUG nova.compute.manager [req-e5156afa-a64d-4325-a0cf-8ff588d35167 req-0326c9ea-8dc9-485b-969d-aa0650b61ddd service nova] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Refreshing instance network info cache due to event network-changed-3a270246-50ff-4381-a519-564fe320578f. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:26:44 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e5156afa-a64d-4325-a0cf-8ff588d35167 req-0326c9ea-8dc9-485b-969d-aa0650b61ddd service nova] Acquiring lock "refresh_cache-be9f4840-69c8-4980-afd8-73a84f743dff" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:26:44 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e5156afa-a64d-4325-a0cf-8ff588d35167 req-0326c9ea-8dc9-485b-969d-aa0650b61ddd service nova] Acquired lock "refresh_cache-be9f4840-69c8-4980-afd8-73a84f743dff" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:26:44 user nova-compute[74683]: DEBUG nova.network.neutron [req-e5156afa-a64d-4325-a0cf-8ff588d35167 req-0326c9ea-8dc9-485b-969d-aa0650b61ddd service nova] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Refreshing network info cache for port 3a270246-50ff-4381-a519-564fe320578f {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:26:44 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:26:44 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:26:45 user nova-compute[74683]: DEBUG nova.network.neutron [req-e5156afa-a64d-4325-a0cf-8ff588d35167 req-0326c9ea-8dc9-485b-969d-aa0650b61ddd service nova] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Updated VIF entry in instance network info cache for port 3a270246-50ff-4381-a519-564fe320578f. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:26:45 user nova-compute[74683]: DEBUG nova.network.neutron [req-e5156afa-a64d-4325-a0cf-8ff588d35167 req-0326c9ea-8dc9-485b-969d-aa0650b61ddd service nova] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Updating instance_info_cache with network_info: [{"id": "3a270246-50ff-4381-a519-564fe320578f", "address": "fa:16:3e:7c:d6:e6", "network": {"id": "f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-137528169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c66aa774134aa6a873eabffc28ec07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a270246-50", "ovs_interfaceid": "3a270246-50ff-4381-a519-564fe320578f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:26:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e5156afa-a64d-4325-a0cf-8ff588d35167 req-0326c9ea-8dc9-485b-969d-aa0650b61ddd service nova] Releasing lock "refresh_cache-be9f4840-69c8-4980-afd8-73a84f743dff" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:26:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG nova.compute.manager [req-3e4ff5d7-a37d-4e45-bbb7-f2dc553cc199 req-2212e739-84dc-46eb-b209-cc10fd6614fc service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Received event network-vif-plugged-ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-3e4ff5d7-a37d-4e45-bbb7-f2dc553cc199 req-2212e739-84dc-46eb-b209-cc10fd6614fc service nova] Acquiring lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-3e4ff5d7-a37d-4e45-bbb7-f2dc553cc199 req-2212e739-84dc-46eb-b209-cc10fd6614fc service nova] Lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-3e4ff5d7-a37d-4e45-bbb7-f2dc553cc199 req-2212e739-84dc-46eb-b209-cc10fd6614fc service nova] Lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG nova.compute.manager [req-3e4ff5d7-a37d-4e45-bbb7-f2dc553cc199 req-2212e739-84dc-46eb-b209-cc10fd6614fc service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] No waiting events found dispatching network-vif-plugged-ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:26:46 user nova-compute[74683]: WARNING nova.compute.manager [req-3e4ff5d7-a37d-4e45-bbb7-f2dc553cc199 req-2212e739-84dc-46eb-b209-cc10fd6614fc service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Received unexpected event network-vif-plugged-ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 for instance with vm_state active and task_state rescuing.
Oct 16 11:26:46 user nova-compute[74683]: DEBUG nova.compute.manager [req-3e4ff5d7-a37d-4e45-bbb7-f2dc553cc199 req-2212e739-84dc-46eb-b209-cc10fd6614fc service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Received event network-vif-plugged-ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-3e4ff5d7-a37d-4e45-bbb7-f2dc553cc199 req-2212e739-84dc-46eb-b209-cc10fd6614fc service nova] Acquiring lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-3e4ff5d7-a37d-4e45-bbb7-f2dc553cc199 req-2212e739-84dc-46eb-b209-cc10fd6614fc service nova] Lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-3e4ff5d7-a37d-4e45-bbb7-f2dc553cc199 req-2212e739-84dc-46eb-b209-cc10fd6614fc service nova] Lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG nova.compute.manager [req-3e4ff5d7-a37d-4e45-bbb7-f2dc553cc199 req-2212e739-84dc-46eb-b209-cc10fd6614fc service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] No waiting events found dispatching network-vif-plugged-ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:26:46 user nova-compute[74683]: WARNING nova.compute.manager [req-3e4ff5d7-a37d-4e45-bbb7-f2dc553cc199 req-2212e739-84dc-46eb-b209-cc10fd6614fc service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Received unexpected event network-vif-plugged-ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 for instance with vm_state active and task_state rescuing.
Oct 16 11:26:46 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Creating instance directory {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 11:26:46 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Creating image(s)
Oct 16 11:26:46 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Did not create local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Ensure instance console log exists: /opt/stack/data/nova/instances/6300da82-2079-455c-8ab2-9fd13ce9e825/console.log {{(pid=74683) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Start _get_guest_xml network_info=[{"id": "8f938207-dce7-4aca-a123-d902f44fd036", "address": "fa:16:3e:fc:f8:bc", "network": {"id": "438d9722-66f5-44e2-b7ee-3e4c9dbe1928", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1131023911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2acac594f9894f11a7cca5125c538a0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f938207-dc", "ovs_interfaceid": "8f938207-dce7-4aca-a123-d902f44fd036", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KhyBgrAX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6300da82-2079-455c-8ab2-9fd13ce9e825', 'attached_at': '', 'detached_at': '', 'volume_id': '7d2a9abe-890e-4bae-9d88-b64305a6ca3d', 'serial': '7d2a9abe-890e-4bae-9d88-b64305a6ca3d'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': '0aa913fe-5210-4272-bd15-2da6dbcc5cd0', 'volume_type': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:26:46 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 16 11:26:46 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 16 11:26:46 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG nova.objects.instance [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6300da82-2079-455c-8ab2-9fd13ce9e825 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Calling os-brick to attach iSCSI Volume {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KhyBgrAX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:26:46 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 16 11:26:46 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:26:46 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 16 11:26:46 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:26:46 user nova-compute[74683]: INFO os_brick.initiator.connectors.iscsi [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 11:26:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d -p 172.16.0.220:3260 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cfa5cd3-f840-454b-813c-78cd46e90661]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 11:26:46 user nova-compute[74683]:  {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d -p 172.16.0.220:3260 --interface default --op new {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG nova.compute.manager [None req-897b56f7-8951-4d5a-bec8-54b76f687698 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c3043a-4060-4e60-bfe3-c2bfd693ce33]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d] added\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d] added
Oct 16 11:26:46 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc831132-9963-4832-9d59-8ddf82f6d91d]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f725cc-747e-439e-997f-465b34dbdc52]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KhyBgrAX {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KhyBgrAX" returned: 0 in 0.041s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce2c8dc-2f25-4158-b505-f50e51dda39f]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KhyBgrAX'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[13cea555-2782-43a6-b9b2-c723dd7d8540]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10f798b-afa3-46e1-b37a-2fd774dbc556]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:26:46 user nova-compute[74683]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)
Oct 16 11:26:46 user nova-compute[74683]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)
Oct 16 11:26:46 user nova-compute[74683]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 (non-flash)
Oct 16 11:26:46 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:26:46 user nova-compute[74683]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)
Oct 16 11:26:46 user nova-compute[74683]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)
Oct 16 11:26:46 user nova-compute[74683]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 (non-flash)
Oct 16 11:26:46 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d -p 172.16.0.220:3260 --login {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[75bf2739-bf2a-49e5-8f1c-7e00ab39f373]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d, portal: 172.16.0.220,3260]
Oct 16 11:26:46 user nova-compute[74683]: Login to [iface: default, target: iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d, portal: 172.16.0.220,3260] successful.
Oct 16 11:26:46 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9f11b7-d179-4071-95e6-be12b1f5deae]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b56960f-e287-47a6-afe4-5050302b8da3]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:26:46 user nova-compute[74683]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)
Oct 16 11:26:46 user nova-compute[74683]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)
Oct 16 11:26:46 user nova-compute[74683]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 (non-flash)
Oct 16 11:26:46 user nova-compute[74683]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d (non-flash)
Oct 16 11:26:46 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:26:46 user nova-compute[74683]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)
Oct 16 11:26:46 user nova-compute[74683]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)
Oct 16 11:26:46 user nova-compute[74683]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 (non-flash)
Oct 16 11:26:46 user nova-compute[74683]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d (non-flash)
Oct 16 11:26:46 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.351s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Connected to 172.16.0.220:3260 {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] HCTL ('36', '-', '-', 0) found on session 33 with lun 0 {{(pid=74683) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74683) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[066dd1a8-8b16-4be1-b221-872e5b1d94f4]: (4, ('- - 0', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Searching for a device in session 33 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:26:46 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KhyBgrAX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 11:26:47 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:26:47 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] <== connect_volume: return (1390ms) {'type': 'block', 'scsi_wwn': '23832343862656631', 'path': '/dev/sde'} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:26:47 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23832343862656631', 'path': '/dev/sde'} {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 11:26:47 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-16T11:24:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1489120306',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2008791236',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOa68DSLJRhCANBPDVkGCmU7Av1Udl+gScSEyqoeBUYh/e3GGLjoSHFS9vMAG6uKONY2e/UESa8D9i77smMN1onMgIj8+r/Pjj2s1FLJPej0ypSN81xjWnl2bNPHPjSwJQ==',key_name='tempest-keypair-1562506741',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:24:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2acac594f9894f11a7cca5125c538a0b',ramdisk_id='',reservation_id='r-n6dkjkrr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1612434098',owner_user_name='tempest-ServerActionsV293TestJSON-1612434098-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:26:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63e1538b7b554db3811903f3df41eee3',uuid=6300da82-2079-455c-8ab2-9fd13ce9e825,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f938207-dce7-4aca-a123-d902f44fd036", "address": "fa:16:3e:fc:f8:bc", "network": {"id": "438d9722-66f5-44e2-b7ee-3e4c9dbe1928", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1131023911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2acac594f9894f11a7cca5125c538a0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f938207-dc", "ovs_interfaceid": "8f938207-dce7-4aca-a123-d902f44fd036", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:26:47 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Converting VIF {"id": "8f938207-dce7-4aca-a123-d902f44fd036", "address": "fa:16:3e:fc:f8:bc", "network": {"id": "438d9722-66f5-44e2-b7ee-3e4c9dbe1928", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1131023911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2acac594f9894f11a7cca5125c538a0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f938207-dc", "ovs_interfaceid": "8f938207-dce7-4aca-a123-d902f44fd036", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:26:47 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:f8:bc,bridge_name='br-int',has_traffic_filtering=True,id=8f938207-dce7-4aca-a123-d902f44fd036,network=Network(438d9722-66f5-44e2-b7ee-3e4c9dbe1928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f938207-dc') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:26:47 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:26:47 user nova-compute[74683]:   <uuid>6300da82-2079-455c-8ab2-9fd13ce9e825</uuid>
Oct 16 11:26:47 user nova-compute[74683]:   <name>instance-0000001c</name>
Oct 16 11:26:47 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:26:47 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:26:47 user nova-compute[74683]:   <metadata>
Oct 16 11:26:47 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:26:47 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:26:47 user nova-compute[74683]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1489120306</nova:name>
Oct 16 11:26:47 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:26:46</nova:creationTime>
Oct 16 11:26:47 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:26:47 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:26:47 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:26:47 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:26:47 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:26:47 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:26:47 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:26:47 user nova-compute[74683]:       <nova:owner>
Oct 16 11:26:47 user nova-compute[74683]:         <nova:user uuid="63e1538b7b554db3811903f3df41eee3">tempest-ServerActionsV293TestJSON-1612434098-project-member</nova:user>
Oct 16 11:26:47 user nova-compute[74683]:         <nova:project uuid="2acac594f9894f11a7cca5125c538a0b">tempest-ServerActionsV293TestJSON-1612434098</nova:project>
Oct 16 11:26:47 user nova-compute[74683]:       </nova:owner>
Oct 16 11:26:47 user nova-compute[74683]:       <nova:ports>
Oct 16 11:26:47 user nova-compute[74683]:         <nova:port uuid="8f938207-dce7-4aca-a123-d902f44fd036">
Oct 16 11:26:47 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 16 11:26:47 user nova-compute[74683]:         </nova:port>
Oct 16 11:26:47 user nova-compute[74683]:       </nova:ports>
Oct 16 11:26:47 user nova-compute[74683]:     </nova:instance>
Oct 16 11:26:47 user nova-compute[74683]:   </metadata>
Oct 16 11:26:47 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:26:47 user nova-compute[74683]:     <system>
Oct 16 11:26:47 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:26:47 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:26:47 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:26:47 user nova-compute[74683]:       <entry name="serial">6300da82-2079-455c-8ab2-9fd13ce9e825</entry>
Oct 16 11:26:47 user nova-compute[74683]:       <entry name="uuid">6300da82-2079-455c-8ab2-9fd13ce9e825</entry>
Oct 16 11:26:47 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:26:47 user nova-compute[74683]:     </system>
Oct 16 11:26:47 user nova-compute[74683]:   </sysinfo>
Oct 16 11:26:47 user nova-compute[74683]:   <os>
Oct 16 11:26:47 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:26:47 user nova-compute[74683]:     <boot dev="hd"/>
Oct 16 11:26:47 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:26:47 user nova-compute[74683]:   </os>
Oct 16 11:26:47 user nova-compute[74683]:   <features>
Oct 16 11:26:47 user nova-compute[74683]:     <acpi/>
Oct 16 11:26:47 user nova-compute[74683]:     <apic/>
Oct 16 11:26:47 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:26:47 user nova-compute[74683]:   </features>
Oct 16 11:26:47 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:26:47 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:26:47 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:26:47 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:26:47 user nova-compute[74683]:   </clock>
Oct 16 11:26:47 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:26:47 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:26:47 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:26:47 user nova-compute[74683]:   </cpu>
Oct 16 11:26:47 user nova-compute[74683]:   <devices>
Oct 16 11:26:47 user nova-compute[74683]:     <disk type="block" device="disk">
Oct 16 11:26:47 user nova-compute[74683]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:26:47 user nova-compute[74683]:       <source dev="/dev/sde"/>
Oct 16 11:26:47 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:26:47 user nova-compute[74683]:       <serial>7d2a9abe-890e-4bae-9d88-b64305a6ca3d</serial>
Oct 16 11:26:47 user nova-compute[74683]:     </disk>
Oct 16 11:26:47 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:26:47 user nova-compute[74683]:       <mac address="fa:16:3e:fc:f8:bc"/>
Oct 16 11:26:47 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:26:47 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:26:47 user nova-compute[74683]:       <target dev="tap8f938207-dc"/>
Oct 16 11:26:47 user nova-compute[74683]:     </interface>
Oct 16 11:26:47 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:26:47 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/6300da82-2079-455c-8ab2-9fd13ce9e825/console.log" append="off"/>
Oct 16 11:26:47 user nova-compute[74683]:     </serial>
Oct 16 11:26:47 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:26:47 user nova-compute[74683]:     <video>
Oct 16 11:26:47 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:26:47 user nova-compute[74683]:     </video>
Oct 16 11:26:47 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:26:47 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:26:47 user nova-compute[74683]:     </rng>
Oct 16 11:26:47 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:26:47 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:26:47 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:26:47 user nova-compute[74683]:     </memballoon>
Oct 16 11:26:47 user nova-compute[74683]:   </devices>
Oct 16 11:26:47 user nova-compute[74683]: </domain>
Oct 16 11:26:47 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:26:47 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-16T11:24:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1489120306',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2008791236',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOa68DSLJRhCANBPDVkGCmU7Av1Udl+gScSEyqoeBUYh/e3GGLjoSHFS9vMAG6uKONY2e/UESa8D9i77smMN1onMgIj8+r/Pjj2s1FLJPej0ypSN81xjWnl2bNPHPjSwJQ==',key_name='tempest-keypair-1562506741',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:24:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2acac594f9894f11a7cca5125c538a0b',ramdisk_id='',reservation_id='r-n6dkjkrr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1612434098',owner_user_name='tempest-ServerActionsV293TestJSON-1612434098-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:26:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63e1538b7b554db3811903f3df41eee3',uuid=6300da82-2079-455c-8ab2-9fd13ce9e825,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f938207-dce7-4aca-a123-d902f44fd036", "address": "fa:16:3e:fc:f8:bc", "network": {"id": "438d9722-66f5-44e2-b7ee-3e4c9dbe1928", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1131023911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2acac594f9894f11a7cca5125c538a0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f938207-dc", "ovs_interfaceid": "8f938207-dce7-4aca-a123-d902f44fd036", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:26:47 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Converting VIF {"id": "8f938207-dce7-4aca-a123-d902f44fd036", "address": "fa:16:3e:fc:f8:bc", "network": {"id": "438d9722-66f5-44e2-b7ee-3e4c9dbe1928", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1131023911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2acac594f9894f11a7cca5125c538a0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f938207-dc", "ovs_interfaceid": "8f938207-dce7-4aca-a123-d902f44fd036", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:26:47 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:f8:bc,bridge_name='br-int',has_traffic_filtering=True,id=8f938207-dce7-4aca-a123-d902f44fd036,network=Network(438d9722-66f5-44e2-b7ee-3e4c9dbe1928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f938207-dc') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:26:47 user nova-compute[74683]: DEBUG os_vif [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:f8:bc,bridge_name='br-int',has_traffic_filtering=True,id=8f938207-dce7-4aca-a123-d902f44fd036,network=Network(438d9722-66f5-44e2-b7ee-3e4c9dbe1928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f938207-dc') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:26:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:26:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:26:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:26:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:26:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c8c6c83b-f308-5692-9b8e-a25a27cfc054', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:26:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:26:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:26:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:26:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:26:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f938207-dc, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:26:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8f938207-dc, col_values=(('qos', UUID('810a1850-a34e-444f-9ee9-d3945ea2536c')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:26:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8f938207-dc, col_values=(('external_ids', {'iface-id': '8f938207-dce7-4aca-a123-d902f44fd036', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:f8:bc', 'vm-uuid': '6300da82-2079-455c-8ab2-9fd13ce9e825'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:26:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:26:48 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:26:48 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:26:48 user nova-compute[74683]: INFO os_vif [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:f8:bc,bridge_name='br-int',has_traffic_filtering=True,id=8f938207-dce7-4aca-a123-d902f44fd036,network=Network(438d9722-66f5-44e2-b7ee-3e4c9dbe1928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f938207-dc')
Oct 16 11:26:48 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:26:48 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] No VIF found with MAC fa:16:3e:fc:f8:bc, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:26:49 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:26:49 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:26:49 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:26:49 user nova-compute[74683]: DEBUG nova.compute.manager [req-b09a56a9-1395-41a8-ba9b-a4c80ddcdb01 req-ca499d67-87a7-476c-bc7b-49328bae33c8 service nova] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Received event network-vif-plugged-8f938207-dce7-4aca-a123-d902f44fd036 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:26:49 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b09a56a9-1395-41a8-ba9b-a4c80ddcdb01 req-ca499d67-87a7-476c-bc7b-49328bae33c8 service nova] Acquiring lock "6300da82-2079-455c-8ab2-9fd13ce9e825-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:26:49 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b09a56a9-1395-41a8-ba9b-a4c80ddcdb01 req-ca499d67-87a7-476c-bc7b-49328bae33c8 service nova] Lock "6300da82-2079-455c-8ab2-9fd13ce9e825-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:26:49 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b09a56a9-1395-41a8-ba9b-a4c80ddcdb01 req-ca499d67-87a7-476c-bc7b-49328bae33c8 service nova] Lock "6300da82-2079-455c-8ab2-9fd13ce9e825-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:26:49 user nova-compute[74683]: DEBUG nova.compute.manager [req-b09a56a9-1395-41a8-ba9b-a4c80ddcdb01 req-ca499d67-87a7-476c-bc7b-49328bae33c8 service nova] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] No waiting events found dispatching network-vif-plugged-8f938207-dce7-4aca-a123-d902f44fd036 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:26:49 user nova-compute[74683]: WARNING nova.compute.manager [req-b09a56a9-1395-41a8-ba9b-a4c80ddcdb01 req-ca499d67-87a7-476c-bc7b-49328bae33c8 service nova] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Received unexpected event network-vif-plugged-8f938207-dce7-4aca-a123-d902f44fd036 for instance with vm_state active and task_state rebuild_spawning.
Oct 16 11:26:50 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:26:50 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:26:50 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:26:51 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:26:51 user nova-compute[74683]: DEBUG nova.compute.manager [req-06ad25ad-bb0a-4a49-a452-f5cf88fec916 req-f8402811-67c7-4f9c-bb63-aec763b6f365 service nova] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Received event network-vif-plugged-8f938207-dce7-4aca-a123-d902f44fd036 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:26:51 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-06ad25ad-bb0a-4a49-a452-f5cf88fec916 req-f8402811-67c7-4f9c-bb63-aec763b6f365 service nova] Acquiring lock "6300da82-2079-455c-8ab2-9fd13ce9e825-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:26:51 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-06ad25ad-bb0a-4a49-a452-f5cf88fec916 req-f8402811-67c7-4f9c-bb63-aec763b6f365 service nova] Lock "6300da82-2079-455c-8ab2-9fd13ce9e825-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:26:51 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-06ad25ad-bb0a-4a49-a452-f5cf88fec916 req-f8402811-67c7-4f9c-bb63-aec763b6f365 service nova] Lock "6300da82-2079-455c-8ab2-9fd13ce9e825-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:26:51 user nova-compute[74683]: DEBUG nova.compute.manager [req-06ad25ad-bb0a-4a49-a452-f5cf88fec916 req-f8402811-67c7-4f9c-bb63-aec763b6f365 service nova] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] No waiting events found dispatching network-vif-plugged-8f938207-dce7-4aca-a123-d902f44fd036 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:26:51 user nova-compute[74683]: WARNING nova.compute.manager [req-06ad25ad-bb0a-4a49-a452-f5cf88fec916 req-f8402811-67c7-4f9c-bb63-aec763b6f365 service nova] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Received unexpected event network-vif-plugged-8f938207-dce7-4aca-a123-d902f44fd036 for instance with vm_state active and task_state rebuild_spawning.
Oct 16 11:26:52 user nova-compute[74683]: DEBUG nova.compute.manager [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Instance event wait completed in 0 seconds for  {{(pid=74683) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 11:26:52 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Guest created on hypervisor {{(pid=74683) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 11:26:52 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Instance spawned successfully.
Oct 16 11:26:52 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 11:26:52 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Found default for hw_cdrom_bus of ide {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:26:52 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Found default for hw_disk_bus of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:26:52 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Found default for hw_input_bus of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:26:52 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Found default for hw_pointer_model of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:26:52 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Found default for hw_video_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:26:52 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Found default for hw_vif_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:26:52 user nova-compute[74683]: DEBUG nova.compute.manager [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:26:52 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:26:52 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:26:52 user nova-compute[74683]: DEBUG nova.objects.instance [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74683) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Oct 16 11:26:52 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-41806ebf-6506-49e7-93be-a99660bb52c8 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.110s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:26:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:26:54 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquiring lock "7488aa44-fdba-47b6-8857-0f46df4f66b9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:26:54 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "7488aa44-fdba-47b6-8857-0f46df4f66b9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:26:54 user nova-compute[74683]: DEBUG nova.compute.manager [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Starting instance... {{(pid=74683) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 11:26:54 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:26:54 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:26:54 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74683) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 11:26:54 user nova-compute[74683]: INFO nova.compute.claims [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Claim successful on node user
Oct 16 11:26:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9081a95e-9512-4d29-8351-bcf5fa93bf0b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Acquiring lock "be9f4840-69c8-4980-afd8-73a84f743dff" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:26:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9081a95e-9512-4d29-8351-bcf5fa93bf0b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "be9f4840-69c8-4980-afd8-73a84f743dff" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:26:55 user nova-compute[74683]: DEBUG nova.objects.instance [None req-9081a95e-9512-4d29-8351-bcf5fa93bf0b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lazy-loading 'flavor' on Instance uuid be9f4840-69c8-4980-afd8-73a84f743dff {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:26:55 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:26:55 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:26:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9081a95e-9512-4d29-8351-bcf5fa93bf0b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "be9f4840-69c8-4980-afd8-73a84f743dff" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.099s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:26:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.699s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:26:55 user nova-compute[74683]: DEBUG nova.compute.manager [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Start building networks asynchronously for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 11:26:55 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 11:26:55 user nova-compute[74683]: DEBUG nova.compute.manager [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Allocating IP information in the background. {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 11:26:55 user nova-compute[74683]: DEBUG nova.network.neutron [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] allocate_for_instance() {{(pid=74683) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 11:26:55 user nova-compute[74683]: DEBUG nova.compute.manager [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Start building block device mappings for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 11:26:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9081a95e-9512-4d29-8351-bcf5fa93bf0b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Acquiring lock "be9f4840-69c8-4980-afd8-73a84f743dff" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:26:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9081a95e-9512-4d29-8351-bcf5fa93bf0b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "be9f4840-69c8-4980-afd8-73a84f743dff" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:26:55 user nova-compute[74683]: INFO nova.compute.manager [None req-9081a95e-9512-4d29-8351-bcf5fa93bf0b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Attaching volume 8ce4e030-c669-4bfd-aa46-7958929ceb2f to /dev/vdb
Oct 16 11:26:55 user nova-compute[74683]: INFO nova.virt.block_device [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Booting with volume snapshot 5153e0cb-d69d-483b-89c7-5974ef3e55c8 at /dev/vda
Oct 16 11:26:55 user nova-compute[74683]: DEBUG nova.policy [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a463a84e332543dfbc03b81518f82be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefabef9e42412f8309f490dcfecc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74683) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 11:26:55 user nova-compute[74683]: DEBUG os_brick.utils [None req-9081a95e-9512-4d29-8351-bcf5fa93bf0b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:26:55 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:55 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:55 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[5937c836-c709-4556-91d0-0a5f9a2d220c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:70b9d336ab7d\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:26:55 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:55 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:55 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f39a12-624d-499d-a0de-3f76d1ad9da0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:26:55 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:55 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:26:55 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[b976ec4e-3ce6-486d-bb17-30e02c14670a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:26:55 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0d36ea-b91f-438a-9d01-e636ab1c6120]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:26:55 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9081a95e-9512-4d29-8351-bcf5fa93bf0b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Running cmd (subprocess): nvme version {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:56 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9081a95e-9512-4d29-8351-bcf5fa93bf0b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] 'nvme version' failed. Not Retrying. {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:26:56 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9081a95e-9512-4d29-8351-bcf5fa93bf0b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] nvme not present on system {{(pid=74683) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 11:26:56 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:26:56 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:26:56 user nova-compute[74683]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 11:26:56 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa715e4-e7d7-4d91-9acb-02ac7f43d415]: (4, '') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:26:56 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-9081a95e-9512-4d29-8351-bcf5fa93bf0b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74683) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 11:26:56 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-9081a95e-9512-4d29-8351-bcf5fa93bf0b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 11:26:56 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-9081a95e-9512-4d29-8351-bcf5fa93bf0b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] LIGHTOS: no hostnqn found. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 11:26:56 user nova-compute[74683]: DEBUG os_brick.utils [None req-9081a95e-9512-4d29-8351-bcf5fa93bf0b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] <== get_connector_properties: return (170ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:70b9d336ab7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:26:56 user nova-compute[74683]: DEBUG nova.virt.block_device [None req-9081a95e-9512-4d29-8351-bcf5fa93bf0b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Updating existing volume attachment record: 1efbaa89-bbdc-4960-9bfd-af0550d67d18 {{(pid=74683) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 11:26:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:26:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:26:56 user nova-compute[74683]: DEBUG nova.network.neutron [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Successfully created port: 802af945-243b-44cf-9f6c-0c3185f1d734 {{(pid=74683) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 11:26:57 user nova-compute[74683]: DEBUG nova.network.neutron [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Successfully updated port: 802af945-243b-44cf-9f6c-0c3185f1d734 {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:26:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquiring lock "refresh_cache-7488aa44-fdba-47b6-8857-0f46df4f66b9" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:26:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquired lock "refresh_cache-7488aa44-fdba-47b6-8857-0f46df4f66b9" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:26:57 user nova-compute[74683]: DEBUG nova.network.neutron [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:26:57 user nova-compute[74683]: DEBUG nova.compute.manager [req-94877a9e-0335-4d9f-8bb8-a9c9d1be6378 req-480071a0-79f9-4ed3-893d-e4ed6150c2e4 service nova] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Received event network-changed-802af945-243b-44cf-9f6c-0c3185f1d734 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:26:57 user nova-compute[74683]: DEBUG nova.compute.manager [req-94877a9e-0335-4d9f-8bb8-a9c9d1be6378 req-480071a0-79f9-4ed3-893d-e4ed6150c2e4 service nova] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Refreshing instance network info cache due to event network-changed-802af945-243b-44cf-9f6c-0c3185f1d734. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:26:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-94877a9e-0335-4d9f-8bb8-a9c9d1be6378 req-480071a0-79f9-4ed3-893d-e4ed6150c2e4 service nova] Acquiring lock "refresh_cache-7488aa44-fdba-47b6-8857-0f46df4f66b9" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:26:57 user nova-compute[74683]: DEBUG nova.network.neutron [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:26:57 user nova-compute[74683]: DEBUG nova.network.neutron [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Updating instance_info_cache with network_info: [{"id": "802af945-243b-44cf-9f6c-0c3185f1d734", "address": "fa:16:3e:c8:72:bc", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap802af945-24", "ovs_interfaceid": "802af945-243b-44cf-9f6c-0c3185f1d734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:26:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Releasing lock "refresh_cache-7488aa44-fdba-47b6-8857-0f46df4f66b9" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:26:57 user nova-compute[74683]: DEBUG nova.compute.manager [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Instance network_info: |[{"id": "802af945-243b-44cf-9f6c-0c3185f1d734", "address": "fa:16:3e:c8:72:bc", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap802af945-24", "ovs_interfaceid": "802af945-243b-44cf-9f6c-0c3185f1d734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 11:26:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-94877a9e-0335-4d9f-8bb8-a9c9d1be6378 req-480071a0-79f9-4ed3-893d-e4ed6150c2e4 service nova] Acquired lock "refresh_cache-7488aa44-fdba-47b6-8857-0f46df4f66b9" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:26:57 user nova-compute[74683]: DEBUG nova.network.neutron [req-94877a9e-0335-4d9f-8bb8-a9c9d1be6378 req-480071a0-79f9-4ed3-893d-e4ed6150c2e4 service nova] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Refreshing network info cache for port 802af945-243b-44cf-9f6c-0c3185f1d734 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:26:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:26:58 user nova-compute[74683]: DEBUG nova.network.neutron [req-94877a9e-0335-4d9f-8bb8-a9c9d1be6378 req-480071a0-79f9-4ed3-893d-e4ed6150c2e4 service nova] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Updated VIF entry in instance network info cache for port 802af945-243b-44cf-9f6c-0c3185f1d734. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:26:58 user nova-compute[74683]: DEBUG nova.network.neutron [req-94877a9e-0335-4d9f-8bb8-a9c9d1be6378 req-480071a0-79f9-4ed3-893d-e4ed6150c2e4 service nova] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Updating instance_info_cache with network_info: [{"id": "802af945-243b-44cf-9f6c-0c3185f1d734", "address": "fa:16:3e:c8:72:bc", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap802af945-24", "ovs_interfaceid": "802af945-243b-44cf-9f6c-0c3185f1d734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:26:58 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-94877a9e-0335-4d9f-8bb8-a9c9d1be6378 req-480071a0-79f9-4ed3-893d-e4ed6150c2e4 service nova] Releasing lock "refresh_cache-7488aa44-fdba-47b6-8857-0f46df4f66b9" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:27:00 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:27:01 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:27:03 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:27:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:27:08 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:27:11 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:27:13 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:27:13 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:27:13 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:27:13 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Starting heal instance info cache {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 11:27:13 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Didn't find any instances for network info cache update. {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 16 11:27:13 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:27:13 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:27:13 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:27:13 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:27:13 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:27:14 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9081a95e-9512-4d29-8351-bcf5fa93bf0b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Calling os-brick to attach iSCSI Volume {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 11:27:14 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9081a95e-9512-4d29-8351-bcf5fa93bf0b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8ce4e030-c669-4bfd-aa46-7958929ceb2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DCAyHigI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:27:14 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-9081a95e-9512-4d29-8351-bcf5fa93bf0b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:27:14 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-9081a95e-9512-4d29-8351-bcf5fa93bf0b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:27:14 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-9081a95e-9512-4d29-8351-bcf5fa93bf0b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:27:14 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-9081a95e-9512-4d29-8351-bcf5fa93bf0b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:27:14 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-9081a95e-9512-4d29-8351-bcf5fa93bf0b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ce4e030-c669-4bfd-aa46-7958929ceb2f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:27:14 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-9081a95e-9512-4d29-8351-bcf5fa93bf0b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ce4e030-c669-4bfd-aa46-7958929ceb2f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:27:14 user nova-compute[74683]: INFO os_brick.initiator.connectors.iscsi [None req-9081a95e-9512-4d29-8351-bcf5fa93bf0b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 11:27:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ce4e030-c669-4bfd-aa46-7958929ceb2f -p 172.16.0.220:3260 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:27:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ce4e030-c669-4bfd-aa46-7958929ceb2f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:27:14 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[14743ce9-5b62-4bc7-b6f5-a77bc8ba3938]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:27:14 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9081a95e-9512-4d29-8351-bcf5fa93bf0b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 11:27:14 user nova-compute[74683]:  {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:27:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ce4e030-c669-4bfd-aa46-7958929ceb2f -p 172.16.0.220:3260 --interface default --op new {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:27:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ce4e030-c669-4bfd-aa46-7958929ceb2f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:27:14 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b790bf3-e1cb-44df-b3a2-f1f00b61d8c9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ce4e030-c669-4bfd-aa46-7958929ceb2f] added\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:27:14 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9081a95e-9512-4d29-8351-bcf5fa93bf0b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ce4e030-c669-4bfd-aa46-7958929ceb2f] added
Oct 16 11:27:14 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:27:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ce4e030-c669-4bfd-aa46-7958929ceb2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:27:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ce4e030-c669-4bfd-aa46-7958929ceb2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:27:14 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[015ef785-b10c-4ba3-becc-fbba9b64389f]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:27:14 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9081a95e-9512-4d29-8351-bcf5fa93bf0b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:27:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ce4e030-c669-4bfd-aa46-7958929ceb2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:27:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ce4e030-c669-4bfd-aa46-7958929ceb2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:27:14 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe8b2d9-1661-478a-8c17-4b93d80d5a2a]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:27:14 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9081a95e-9512-4d29-8351-bcf5fa93bf0b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:27:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ce4e030-c669-4bfd-aa46-7958929ceb2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DCAyHigI {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:27:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ce4e030-c669-4bfd-aa46-7958929ceb2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DCAyHigI" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:27:14 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ea96c2-4152-461b-a40c-c311f2417264]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:27:14 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9081a95e-9512-4d29-8351-bcf5fa93bf0b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DCAyHigI'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:27:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ce4e030-c669-4bfd-aa46-7958929ceb2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:27:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ce4e030-c669-4bfd-aa46-7958929ceb2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.041s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:27:15 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c17c14-1d2a-4a33-a657-4c94f07b094a]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:27:15 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9081a95e-9512-4d29-8351-bcf5fa93bf0b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:27:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:27:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:27:15 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[94acd115-16d5-404e-9650-746578229716]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:27:15 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9081a95e-9512-4d29-8351-bcf5fa93bf0b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:27:15 user nova-compute[74683]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)
Oct 16 11:27:15 user nova-compute[74683]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)
Oct 16 11:27:15 user nova-compute[74683]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 (non-flash)
Oct 16 11:27:15 user nova-compute[74683]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d (non-flash)
Oct 16 11:27:15 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:27:15 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9081a95e-9512-4d29-8351-bcf5fa93bf0b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:27:15 user nova-compute[74683]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)
Oct 16 11:27:15 user nova-compute[74683]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)
Oct 16 11:27:15 user nova-compute[74683]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 (non-flash)
Oct 16 11:27:15 user nova-compute[74683]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d (non-flash)
Oct 16 11:27:15 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:27:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ce4e030-c669-4bfd-aa46-7958929ceb2f -p 172.16.0.220:3260 --login {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:27:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ce4e030-c669-4bfd-aa46-7958929ceb2f -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:27:15 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc020093-4543-456d-b28d-ec7a7fe7eaab]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ce4e030-c669-4bfd-aa46-7958929ceb2f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8ce4e030-c669-4bfd-aa46-7958929ceb2f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:27:15 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9081a95e-9512-4d29-8351-bcf5fa93bf0b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ce4e030-c669-4bfd-aa46-7958929ceb2f, portal: 172.16.0.220,3260]
Oct 16 11:27:15 user nova-compute[74683]: Login to [iface: default, target: iqn.2010-10.org.openstack:8ce4e030-c669-4bfd-aa46-7958929ceb2f, portal: 172.16.0.220,3260] successful.
Oct 16 11:27:15 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:27:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ce4e030-c669-4bfd-aa46-7958929ceb2f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:27:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ce4e030-c669-4bfd-aa46-7958929ceb2f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:27:15 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05b3ba0-e880-4cf0-b2fa-0fd17575429e]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:27:15 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9081a95e-9512-4d29-8351-bcf5fa93bf0b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:27:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:27:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:27:15 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9819672-10ce-4dc3-84de-fa5071b6f5a5]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ce4e030-c669-4bfd-aa46-7958929ceb2f (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:27:15 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9081a95e-9512-4d29-8351-bcf5fa93bf0b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:27:15 user nova-compute[74683]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)
Oct 16 11:27:15 user nova-compute[74683]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)
Oct 16 11:27:15 user nova-compute[74683]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 (non-flash)
Oct 16 11:27:15 user nova-compute[74683]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d (non-flash)
Oct 16 11:27:15 user nova-compute[74683]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ce4e030-c669-4bfd-aa46-7958929ceb2f (non-flash)
Oct 16 11:27:15 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:27:15 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9081a95e-9512-4d29-8351-bcf5fa93bf0b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:27:15 user nova-compute[74683]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)
Oct 16 11:27:15 user nova-compute[74683]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)
Oct 16 11:27:15 user nova-compute[74683]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 (non-flash)
Oct 16 11:27:15 user nova-compute[74683]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d (non-flash)
Oct 16 11:27:15 user nova-compute[74683]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ce4e030-c669-4bfd-aa46-7958929ceb2f (non-flash)
Oct 16 11:27:15 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:27:15 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-9081a95e-9512-4d29-8351-bcf5fa93bf0b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ce4e030-c669-4bfd-aa46-7958929ceb2f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:27:15 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9081a95e-9512-4d29-8351-bcf5fa93bf0b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Connected to 172.16.0.220:3260 {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 11:27:15 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-9081a95e-9512-4d29-8351-bcf5fa93bf0b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] HCTL ('38', '-', '-', 0) found on session 34 with lun 0 {{(pid=74683) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 11:27:15 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-9081a95e-9512-4d29-8351-bcf5fa93bf0b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74683) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 11:27:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:27:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.023s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:27:15 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba649e88-5415-4b24-962b-135ff66b9fec]: (4, ('- - 0', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:27:15 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-9081a95e-9512-4d29-8351-bcf5fa93bf0b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Searching for a device in session 34 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:27:15 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9081a95e-9512-4d29-8351-bcf5fa93bf0b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:8ce4e030-c669-4bfd-aa46-7958929ceb2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DCAyHigI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 11:27:15 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:27:15 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74683) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 11:27:16 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-9081a95e-9512-4d29-8351-bcf5fa93bf0b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:27:16 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9081a95e-9512-4d29-8351-bcf5fa93bf0b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] <== connect_volume: return (1388ms) {'type': 'block', 'scsi_wwn': '23334616164313232', 'path': '/dev/sdg'} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:27:16 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9081a95e-9512-4d29-8351-bcf5fa93bf0b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334616164313232', 'path': '/dev/sdg'} {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 11:27:16 user nova-compute[74683]: DEBUG nova.objects.instance [None req-9081a95e-9512-4d29-8351-bcf5fa93bf0b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lazy-loading 'flavor' on Instance uuid be9f4840-69c8-4980-afd8-73a84f743dff {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:27:16 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-9081a95e-9512-4d29-8351-bcf5fa93bf0b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 11:27:16 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:27:16 user nova-compute[74683]:   <source dev="/dev/sdg"/>
Oct 16 11:27:16 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:27:16 user nova-compute[74683]:   <serial>8ce4e030-c669-4bfd-aa46-7958929ceb2f</serial>
Oct 16 11:27:16 user nova-compute[74683]: </disk>
Oct 16 11:27:16 user nova-compute[74683]:  {{(pid=74683) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 11:27:16 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:27:16 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9081a95e-9512-4d29-8351-bcf5fa93bf0b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:27:16 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9081a95e-9512-4d29-8351-bcf5fa93bf0b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:27:16 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9081a95e-9512-4d29-8351-bcf5fa93bf0b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] No VIF found with MAC fa:16:3e:7c:d6:e6, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:27:16 user nova-compute[74683]: DEBUG os_brick.utils [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:27:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:27:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:27:16 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[99307249-1aa3-474a-882b-8b103e5a6e6d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:70b9d336ab7d\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:27:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:27:16 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9081a95e-9512-4d29-8351-bcf5fa93bf0b tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "be9f4840-69c8-4980-afd8-73a84f743dff" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.182s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:27:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:27:16 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[3707c5e7-1e95-45dc-bf5f-6f8af23f92d0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:27:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:27:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:27:17 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8acadd-d8e4-4417-aa17-827ba16c2121]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:27:17 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[757a2984-c409-4099-87b4-2f1d4c45c80e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:27:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Running cmd (subprocess): nvme version {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:27:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] 'nvme version' failed. Not Retrying. {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:27:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.nvmeof [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] nvme not present on system {{(pid=74683) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 11:27:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:27:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:27:17 user nova-compute[74683]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 11:27:17 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[508349dd-68e8-44b3-8944-616ca56714eb]: (4, '') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:27:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74683) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 11:27:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 11:27:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] LIGHTOS: no hostnqn found. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 11:27:17 user nova-compute[74683]: DEBUG os_brick.utils [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:70b9d336ab7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:27:17 user nova-compute[74683]: DEBUG nova.virt.block_device [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Updating existing volume attachment record: 64db0ba9-774c-4a1e-af94-88c7cba69a57 {{(pid=74683) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 11:27:17 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:27:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:27:17 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-714ff27c-0024-433e-8fe9-c4b45667010e tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Acquiring lock "be9f4840-69c8-4980-afd8-73a84f743dff" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:27:17 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-714ff27c-0024-433e-8fe9-c4b45667010e tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "be9f4840-69c8-4980-afd8-73a84f743dff" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:27:17 user nova-compute[74683]: INFO nova.compute.manager [None req-714ff27c-0024-433e-8fe9-c4b45667010e tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Detaching volume 8ce4e030-c669-4bfd-aa46-7958929ceb2f
Oct 16 11:27:17 user nova-compute[74683]: INFO nova.virt.block_device [None req-714ff27c-0024-433e-8fe9-c4b45667010e tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Attempting to driver detach volume 8ce4e030-c669-4bfd-aa46-7958929ceb2f from mountpoint /dev/vdb
Oct 16 11:27:17 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-714ff27c-0024-433e-8fe9-c4b45667010e tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Attempting to detach device vdb from instance be9f4840-69c8-4980-afd8-73a84f743dff from the persistent domain config. {{(pid=74683) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 11:27:17 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-714ff27c-0024-433e-8fe9-c4b45667010e tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 11:27:17 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:27:17 user nova-compute[74683]:   <source dev="/dev/sdg"/>
Oct 16 11:27:17 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:27:17 user nova-compute[74683]:   <serial>8ce4e030-c669-4bfd-aa46-7958929ceb2f</serial>
Oct 16 11:27:17 user nova-compute[74683]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 11:27:17 user nova-compute[74683]: </disk>
Oct 16 11:27:17 user nova-compute[74683]:  {{(pid=74683) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 11:27:17 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-714ff27c-0024-433e-8fe9-c4b45667010e tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Successfully detached device vdb from instance be9f4840-69c8-4980-afd8-73a84f743dff from the persistent domain config.
Oct 16 11:27:17 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-714ff27c-0024-433e-8fe9-c4b45667010e tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance be9f4840-69c8-4980-afd8-73a84f743dff from the live domain config. {{(pid=74683) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 11:27:17 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-714ff27c-0024-433e-8fe9-c4b45667010e tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 11:27:17 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:27:17 user nova-compute[74683]:   <source dev="/dev/sdg"/>
Oct 16 11:27:17 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:27:17 user nova-compute[74683]:   <serial>8ce4e030-c669-4bfd-aa46-7958929ceb2f</serial>
Oct 16 11:27:17 user nova-compute[74683]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 11:27:17 user nova-compute[74683]: </disk>
Oct 16 11:27:17 user nova-compute[74683]:  {{(pid=74683) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 11:27:18 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:27:18 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-714ff27c-0024-433e-8fe9-c4b45667010e tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance be9f4840-69c8-4980-afd8-73a84f743dff {{(pid=74683) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 11:27:18 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:27:18 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:27:18 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:27:18 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:27:18 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Auditing locally available compute resources for user (node: user) {{(pid=74683) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 11:27:18 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:27:18 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:27:18 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9fc5a9-8659-497c-bb07-af52fe2e1761/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:27:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9fc5a9-8659-497c-bb07-af52fe2e1761/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:27:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9fc5a9-8659-497c-bb07-af52fe2e1761/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:27:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9fc5a9-8659-497c-bb07-af52fe2e1761/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:27:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk.rescue --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:27:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:27:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk.rescue --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:27:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:27:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:27:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:27:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:27:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:27:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.rescue --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:27:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:27:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.rescue --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:27:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:27:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:27:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:27:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:27:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:27:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:27:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:27:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:27:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:27:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:27:21 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:27:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d00bbb1a-534b-4437-9b79-91870c5d8bb5/disk.rescue --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:27:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d00bbb1a-534b-4437-9b79-91870c5d8bb5/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:27:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d00bbb1a-534b-4437-9b79-91870c5d8bb5/disk.rescue --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:27:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:27:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d00bbb1a-534b-4437-9b79-91870c5d8bb5/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:27:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:27:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:27:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:27:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:27:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b79d385-e512-4297-9aa4-2b9bb0cac23c/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:27:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b79d385-e512-4297-9aa4-2b9bb0cac23c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:27:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b79d385-e512-4297-9aa4-2b9bb0cac23c/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:27:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b79d385-e512-4297-9aa4-2b9bb0cac23c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:27:22 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:27:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b4eaccb-e068-4e8a-9084-16229815b1d7/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:27:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b4eaccb-e068-4e8a-9084-16229815b1d7/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:27:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b4eaccb-e068-4e8a-9084-16229815b1d7/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:27:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b4eaccb-e068-4e8a-9084-16229815b1d7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:27:22 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:27:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9f4840-69c8-4980-afd8-73a84f743dff/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:27:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:27:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9f4840-69c8-4980-afd8-73a84f743dff/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:27:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9f4840-69c8-4980-afd8-73a84f743dff/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:27:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9f4840-69c8-4980-afd8-73a84f743dff/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:27:23 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:27:23 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:27:23 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Hypervisor/Node resource view: name=user free_ram=7325MB free_disk=25.030414581298828GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74683) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 11:27:23 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:27:23 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:27:23 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 18a77385-fab9-4ea0-8aa6-666cf7e798a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:27:23 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance d5e55361-d9ed-4d07-91b0-ec4d08b2e817 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:27:23 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance edd01413-1f8a-49e3-aa3c-ecb19c62afae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:27:23 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 6c9fc5a9-8659-497c-bb07-af52fe2e1761 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:27:23 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 9b8ba94f-43cc-4f06-bcd9-83935ccbe117 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:27:23 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance b91af786-36e3-4815-811f-fb3c055e758d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:27:23 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 0b79d385-e512-4297-9aa4-2b9bb0cac23c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:27:23 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 4b4eaccb-e068-4e8a-9084-16229815b1d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:27:23 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 6300da82-2079-455c-8ab2-9fd13ce9e825 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:27:23 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance d00bbb1a-534b-4437-9b79-91870c5d8bb5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:27:23 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 73adef6b-881d-466b-b55d-6cf2f974d40e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:27:23 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance be9f4840-69c8-4980-afd8-73a84f743dff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:27:23 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 7488aa44-fdba-47b6-8857-0f46df4f66b9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:27:23 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 11:27:23 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 11:27:24 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:27:24 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:27:24 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Compute_service record updated for user:user {{(pid=74683) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 11:27:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.602s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:27:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:27:28 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:27:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:27:33 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG nova.compute.manager [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Start spawning the instance on the hypervisor. {{(pid=74683) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Creating instance directory {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 11:27:35 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Creating image(s)
Oct 16 11:27:35 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Did not create local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Ensure instance console log exists: /opt/stack/data/nova/instances/7488aa44-fdba-47b6-8857-0f46df4f66b9/console.log {{(pid=74683) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Start _get_guest_xml network_info=[{"id": "802af945-243b-44cf-9f6c-0c3185f1d734", "address": "fa:16:3e:c8:72:bc", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap802af945-24", "ovs_interfaceid": "802af945-243b-44cf-9f6c-0c3185f1d734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-16T11:26:42Z,direct_url=<?>,disk_format='qcow2',id=d0c7b4e1-d49a-46bb-a596-4d580be38324,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1797771168',owner='2aefabef9e42412f8309f490dcfecc79',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-16T11:26:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c8de5eea-f1e9-4670-9f08-f0aad8da8dba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'utWInVAg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7488aa44-fdba-47b6-8857-0f46df4f66b9', 'attached_at': '', 'detached_at': '', 'volume_id': 'c8de5eea-f1e9-4670-9f08-f0aad8da8dba', 'serial': 'c8de5eea-f1e9-4670-9f08-f0aad8da8dba'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': '64db0ba9-774c-4a1e-af94-88c7cba69a57', 'volume_type': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:27:35 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:27:35 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:27:35 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-16T11:26:42Z,direct_url=<?>,disk_format='qcow2',id=d0c7b4e1-d49a-46bb-a596-4d580be38324,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1797771168',owner='2aefabef9e42412f8309f490dcfecc79',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-16T11:26:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Calling os-brick to attach iSCSI Volume {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c8de5eea-f1e9-4670-9f08-f0aad8da8dba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'utWInVAg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:27:35 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:27:35 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:27:35 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:27:35 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8de5eea-f1e9-4670-9f08-f0aad8da8dba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8de5eea-f1e9-4670-9f08-f0aad8da8dba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:27:35 user nova-compute[74683]: INFO os_brick.initiator.connectors.iscsi [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 11:27:35 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8de5eea-f1e9-4670-9f08-f0aad8da8dba -p 172.16.0.220:3260 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8de5eea-f1e9-4670-9f08-f0aad8da8dba -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df6a5b3-5944-44fb-86f6-b46456583820]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 11:27:35 user nova-compute[74683]:  {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8de5eea-f1e9-4670-9f08-f0aad8da8dba -p 172.16.0.220:3260 --interface default --op new {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8de5eea-f1e9-4670-9f08-f0aad8da8dba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[499cbdca-4415-4070-bfe7-70b93271e084]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c8de5eea-f1e9-4670-9f08-f0aad8da8dba] added\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c8de5eea-f1e9-4670-9f08-f0aad8da8dba] added
Oct 16 11:27:35 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8de5eea-f1e9-4670-9f08-f0aad8da8dba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8de5eea-f1e9-4670-9f08-f0aad8da8dba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdcadb65-5d33-4c33-bb0b-3b2f9de5051a]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8de5eea-f1e9-4670-9f08-f0aad8da8dba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8de5eea-f1e9-4670-9f08-f0aad8da8dba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a451a72-dbcf-4781-981b-e5b323de0b3e]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8de5eea-f1e9-4670-9f08-f0aad8da8dba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v utWInVAg {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8de5eea-f1e9-4670-9f08-f0aad8da8dba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v utWInVAg" returned: 0 in 0.025s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[da948667-bf2c-4bb4-bc0b-78b2325fbee4]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'utWInVAg'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8de5eea-f1e9-4670-9f08-f0aad8da8dba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8de5eea-f1e9-4670-9f08-f0aad8da8dba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[11403545-06e5-473b-8646-6abdea1d99d4]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a693e648-1201-4c21-aea0-61c811b60068]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ce4e030-c669-4bfd-aa46-7958929ceb2f (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:27:35 user nova-compute[74683]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)
Oct 16 11:27:35 user nova-compute[74683]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)
Oct 16 11:27:35 user nova-compute[74683]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 (non-flash)
Oct 16 11:27:35 user nova-compute[74683]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d (non-flash)
Oct 16 11:27:35 user nova-compute[74683]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ce4e030-c669-4bfd-aa46-7958929ceb2f (non-flash)
Oct 16 11:27:35 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:27:35 user nova-compute[74683]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)
Oct 16 11:27:35 user nova-compute[74683]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)
Oct 16 11:27:35 user nova-compute[74683]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 (non-flash)
Oct 16 11:27:35 user nova-compute[74683]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d (non-flash)
Oct 16 11:27:35 user nova-compute[74683]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ce4e030-c669-4bfd-aa46-7958929ceb2f (non-flash)
Oct 16 11:27:35 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8de5eea-f1e9-4670-9f08-f0aad8da8dba -p 172.16.0.220:3260 --login {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8de5eea-f1e9-4670-9f08-f0aad8da8dba -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[212a2c9c-9fea-4c41-a54d-b08030081dc2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c8de5eea-f1e9-4670-9f08-f0aad8da8dba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c8de5eea-f1e9-4670-9f08-f0aad8da8dba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c8de5eea-f1e9-4670-9f08-f0aad8da8dba, portal: 172.16.0.220,3260]
Oct 16 11:27:35 user nova-compute[74683]: Login to [iface: default, target: iqn.2010-10.org.openstack:c8de5eea-f1e9-4670-9f08-f0aad8da8dba, portal: 172.16.0.220,3260] successful.
Oct 16 11:27:35 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8de5eea-f1e9-4670-9f08-f0aad8da8dba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8de5eea-f1e9-4670-9f08-f0aad8da8dba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54cc7b7-5ae1-4269-8872-2a3fbcc4a928]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[21655045-c259-498e-a869-af6df0d01cbc]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ce4e030-c669-4bfd-aa46-7958929ceb2f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8de5eea-f1e9-4670-9f08-f0aad8da8dba (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:27:35 user nova-compute[74683]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)
Oct 16 11:27:35 user nova-compute[74683]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)
Oct 16 11:27:35 user nova-compute[74683]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 (non-flash)
Oct 16 11:27:35 user nova-compute[74683]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d (non-flash)
Oct 16 11:27:35 user nova-compute[74683]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ce4e030-c669-4bfd-aa46-7958929ceb2f (non-flash)
Oct 16 11:27:35 user nova-compute[74683]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8de5eea-f1e9-4670-9f08-f0aad8da8dba (non-flash)
Oct 16 11:27:35 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:27:35 user nova-compute[74683]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)
Oct 16 11:27:35 user nova-compute[74683]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)
Oct 16 11:27:35 user nova-compute[74683]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 (non-flash)
Oct 16 11:27:35 user nova-compute[74683]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d (non-flash)
Oct 16 11:27:35 user nova-compute[74683]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ce4e030-c669-4bfd-aa46-7958929ceb2f (non-flash)
Oct 16 11:27:35 user nova-compute[74683]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8de5eea-f1e9-4670-9f08-f0aad8da8dba (non-flash)
Oct 16 11:27:35 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8de5eea-f1e9-4670-9f08-f0aad8da8dba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Connected to 172.16.0.220:3260 {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] HCTL ('39', '-', '-', 0) found on session 35 with lun 0 {{(pid=74683) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74683) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca56ef19-abb3-470d-86f1-9d262b7d2c62]: (4, ('- - 0', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Searching for a device in session 35 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:27:35 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:c8de5eea-f1e9-4670-9f08-f0aad8da8dba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'utWInVAg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 11:27:36 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:27:36 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '23764663132356237', 'path': '/dev/sdh'} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:27:36 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23764663132356237', 'path': '/dev/sdh'} {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 11:27:36 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:26:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1442351814',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1442351814',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1442351814',id=32,image_ref='d0c7b4e1-d49a-46bb-a596-4d580be38324',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqAkv8r22a9Mj/D4+PljzDoahMZD25nouypHV/4U3vg/JXpEL4dzftMZfrHEzkF9li146bGztNTkoSRfh31WIR+ZjYa5BIzG1IsnaUhs1f1Av9EL+5pHmfQWaP9mVF+lQ==',key_name='tempest-keypair-574370236',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2aefabef9e42412f8309f490dcfecc79',ramdisk_id='',reservation_id='r-ur37yp1v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-953001121',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-953001121-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-953001121',owner_user_name='tempest-TestVolumeBootPattern-953001121-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:26:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a463a84e332543dfbc03b81518f82be1',uuid=7488aa44-fdba-47b6-8857-0f46df4f66b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "802af945-243b-44cf-9f6c-0c3185f1d734", "address": "fa:16:3e:c8:72:bc", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap802af945-24", "ovs_interfaceid": "802af945-243b-44cf-9f6c-0c3185f1d734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:27:36 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Converting VIF {"id": "802af945-243b-44cf-9f6c-0c3185f1d734", "address": "fa:16:3e:c8:72:bc", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap802af945-24", "ovs_interfaceid": "802af945-243b-44cf-9f6c-0c3185f1d734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:27:36 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:72:bc,bridge_name='br-int',has_traffic_filtering=True,id=802af945-243b-44cf-9f6c-0c3185f1d734,network=Network(00883fc4-0b74-4afd-9043-82e2933faab3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap802af945-24') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:27:36 user nova-compute[74683]: DEBUG nova.objects.instance [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lazy-loading 'pci_devices' on Instance uuid 7488aa44-fdba-47b6-8857-0f46df4f66b9 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:27:36 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:27:36 user nova-compute[74683]:   <uuid>7488aa44-fdba-47b6-8857-0f46df4f66b9</uuid>
Oct 16 11:27:36 user nova-compute[74683]:   <name>instance-00000020</name>
Oct 16 11:27:36 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:27:36 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:27:36 user nova-compute[74683]:   <metadata>
Oct 16 11:27:36 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:27:36 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:27:36 user nova-compute[74683]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1442351814</nova:name>
Oct 16 11:27:36 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:27:35</nova:creationTime>
Oct 16 11:27:36 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:27:36 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:27:36 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:27:36 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:27:36 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:27:36 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:27:36 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:27:36 user nova-compute[74683]:       <nova:owner>
Oct 16 11:27:36 user nova-compute[74683]:         <nova:user uuid="a463a84e332543dfbc03b81518f82be1">tempest-TestVolumeBootPattern-953001121-project-member</nova:user>
Oct 16 11:27:36 user nova-compute[74683]:         <nova:project uuid="2aefabef9e42412f8309f490dcfecc79">tempest-TestVolumeBootPattern-953001121</nova:project>
Oct 16 11:27:36 user nova-compute[74683]:       </nova:owner>
Oct 16 11:27:36 user nova-compute[74683]:       <nova:root type="image" uuid="d0c7b4e1-d49a-46bb-a596-4d580be38324"/>
Oct 16 11:27:36 user nova-compute[74683]:       <nova:ports>
Oct 16 11:27:36 user nova-compute[74683]:         <nova:port uuid="802af945-243b-44cf-9f6c-0c3185f1d734">
Oct 16 11:27:36 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 16 11:27:36 user nova-compute[74683]:         </nova:port>
Oct 16 11:27:36 user nova-compute[74683]:       </nova:ports>
Oct 16 11:27:36 user nova-compute[74683]:     </nova:instance>
Oct 16 11:27:36 user nova-compute[74683]:   </metadata>
Oct 16 11:27:36 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:27:36 user nova-compute[74683]:     <system>
Oct 16 11:27:36 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:27:36 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:27:36 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:27:36 user nova-compute[74683]:       <entry name="serial">7488aa44-fdba-47b6-8857-0f46df4f66b9</entry>
Oct 16 11:27:36 user nova-compute[74683]:       <entry name="uuid">7488aa44-fdba-47b6-8857-0f46df4f66b9</entry>
Oct 16 11:27:36 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:27:36 user nova-compute[74683]:     </system>
Oct 16 11:27:36 user nova-compute[74683]:   </sysinfo>
Oct 16 11:27:36 user nova-compute[74683]:   <os>
Oct 16 11:27:36 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:27:36 user nova-compute[74683]:     <boot dev="hd"/>
Oct 16 11:27:36 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:27:36 user nova-compute[74683]:   </os>
Oct 16 11:27:36 user nova-compute[74683]:   <features>
Oct 16 11:27:36 user nova-compute[74683]:     <acpi/>
Oct 16 11:27:36 user nova-compute[74683]:     <apic/>
Oct 16 11:27:36 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:27:36 user nova-compute[74683]:   </features>
Oct 16 11:27:36 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:27:36 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:27:36 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:27:36 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:27:36 user nova-compute[74683]:   </clock>
Oct 16 11:27:36 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:27:36 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:27:36 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:27:36 user nova-compute[74683]:   </cpu>
Oct 16 11:27:36 user nova-compute[74683]:   <devices>
Oct 16 11:27:36 user nova-compute[74683]:     <disk type="block" device="disk">
Oct 16 11:27:36 user nova-compute[74683]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:27:36 user nova-compute[74683]:       <source dev="/dev/sdh"/>
Oct 16 11:27:36 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:27:36 user nova-compute[74683]:       <serial>c8de5eea-f1e9-4670-9f08-f0aad8da8dba</serial>
Oct 16 11:27:36 user nova-compute[74683]:     </disk>
Oct 16 11:27:36 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:27:36 user nova-compute[74683]:       <mac address="fa:16:3e:c8:72:bc"/>
Oct 16 11:27:36 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:27:36 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:27:36 user nova-compute[74683]:       <target dev="tap802af945-24"/>
Oct 16 11:27:36 user nova-compute[74683]:     </interface>
Oct 16 11:27:36 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:27:36 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/7488aa44-fdba-47b6-8857-0f46df4f66b9/console.log" append="off"/>
Oct 16 11:27:36 user nova-compute[74683]:     </serial>
Oct 16 11:27:36 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:27:36 user nova-compute[74683]:     <video>
Oct 16 11:27:36 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:27:36 user nova-compute[74683]:     </video>
Oct 16 11:27:36 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:27:36 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:27:36 user nova-compute[74683]:     </rng>
Oct 16 11:27:36 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:27:36 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:27:36 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:27:36 user nova-compute[74683]:     </memballoon>
Oct 16 11:27:36 user nova-compute[74683]:   </devices>
Oct 16 11:27:36 user nova-compute[74683]: </domain>
Oct 16 11:27:36 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:27:36 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:26:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1442351814',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1442351814',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1442351814',id=32,image_ref='d0c7b4e1-d49a-46bb-a596-4d580be38324',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqAkv8r22a9Mj/D4+PljzDoahMZD25nouypHV/4U3vg/JXpEL4dzftMZfrHEzkF9li146bGztNTkoSRfh31WIR+ZjYa5BIzG1IsnaUhs1f1Av9EL+5pHmfQWaP9mVF+lQ==',key_name='tempest-keypair-574370236',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2aefabef9e42412f8309f490dcfecc79',ramdisk_id='',reservation_id='r-ur37yp1v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-953001121',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-953001121-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-953001121',owner_user_name='tempest-TestVolumeBootPattern-953001121-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:26:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a463a84e332543dfbc03b81518f82be1',uuid=7488aa44-fdba-47b6-8857-0f46df4f66b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "802af945-243b-44cf-9f6c-0c3185f1d734", "address": "fa:16:3e:c8:72:bc", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap802af945-24", "ovs_interfaceid": "802af945-243b-44cf-9f6c-0c3185f1d734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:27:36 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Converting VIF {"id": "802af945-243b-44cf-9f6c-0c3185f1d734", "address": "fa:16:3e:c8:72:bc", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap802af945-24", "ovs_interfaceid": "802af945-243b-44cf-9f6c-0c3185f1d734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:27:36 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:72:bc,bridge_name='br-int',has_traffic_filtering=True,id=802af945-243b-44cf-9f6c-0c3185f1d734,network=Network(00883fc4-0b74-4afd-9043-82e2933faab3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap802af945-24') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:27:36 user nova-compute[74683]: DEBUG os_vif [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:72:bc,bridge_name='br-int',has_traffic_filtering=True,id=802af945-243b-44cf-9f6c-0c3185f1d734,network=Network(00883fc4-0b74-4afd-9043-82e2933faab3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap802af945-24') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:27:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:27:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:27:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:27:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:27:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b405211f-bf17-5cc7-846c-eea0dd814967', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:27:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:27:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:27:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:27:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap802af945-24, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:27:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap802af945-24, col_values=(('qos', UUID('4dbce761-79cc-4658-b80f-4b0804d2e04c')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:27:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap802af945-24, col_values=(('external_ids', {'iface-id': '802af945-243b-44cf-9f6c-0c3185f1d734', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:72:bc', 'vm-uuid': '7488aa44-fdba-47b6-8857-0f46df4f66b9'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:27:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:27:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:27:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:27:37 user nova-compute[74683]: INFO os_vif [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:72:bc,bridge_name='br-int',has_traffic_filtering=True,id=802af945-243b-44cf-9f6c-0c3185f1d734,network=Network(00883fc4-0b74-4afd-9043-82e2933faab3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap802af945-24')
Oct 16 11:27:37 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:27:37 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] No VIF found with MAC fa:16:3e:c8:72:bc, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:27:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:27:38 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-714ff27c-0024-433e-8fe9-c4b45667010e tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance be9f4840-69c8-4980-afd8-73a84f743dff is timed out.
Oct 16 11:27:38 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-714ff27c-0024-433e-8fe9-c4b45667010e tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Successfully detached device vdb from instance be9f4840-69c8-4980-afd8-73a84f743dff from the live domain config.
Oct 16 11:27:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:27:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:27:38 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-714ff27c-0024-433e-8fe9-c4b45667010e tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] calling os-brick to detach iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 11:27:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-714ff27c-0024-433e-8fe9-c4b45667010e tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, {'target_iqn': 'iqn.2010-10.org.openstack:8ce4e030-c669-4bfd-aa46-7958929ceb2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DCAyHigI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:27:38 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-714ff27c-0024-433e-8fe9-c4b45667010e tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:27:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-714ff27c-0024-433e-8fe9-c4b45667010e tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:27:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-714ff27c-0024-433e-8fe9-c4b45667010e tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:27:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:27:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:27:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:27:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f371db72-640b-4214-811d-d4b6e5d2d5d5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8ce4e030-c669-4bfd-aa46-7958929ceb2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c8de5eea-f1e9-4670-9f08-f0aad8da8dba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:27:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-714ff27c-0024-433e-8fe9-c4b45667010e tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 11:27:38 user nova-compute[74683]: No targets found.
Oct 16 11:27:38 user nova-compute[74683]: iSNS:
Oct 16 11:27:38 user nova-compute[74683]: No targets found.
Oct 16 11:27:38 user nova-compute[74683]: STATIC:
Oct 16 11:27:38 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152
Oct 16 11:27:38 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:27:38 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:27:38 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354
Oct 16 11:27:38 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:27:38 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:27:38 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:8ce4e030-c669-4bfd-aa46-7958929ceb2f
Oct 16 11:27:38 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:27:38 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:27:38 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d
Oct 16 11:27:38 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:27:38 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:27:38 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:c8de5eea-f1e9-4670-9f08-f0aad8da8dba
Oct 16 11:27:38 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:27:38 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:27:38 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb
Oct 16 11:27:38 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:27:38 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:27:38 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0
Oct 16 11:27:38 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:27:38 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:27:38 user nova-compute[74683]: FIRMWARE:
Oct 16 11:27:38 user nova-compute[74683]: No targets found.
Oct 16 11:27:38 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:27:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-714ff27c-0024-433e-8fe9-c4b45667010e tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 11:27:38 user nova-compute[74683]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 11:27:38 user nova-compute[74683]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74683) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 11:27:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-714ff27c-0024-433e-8fe9-c4b45667010e tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ce4e030-c669-4bfd-aa46-7958929ceb2f', 0)] {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 11:27:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:27:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.050s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:27:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[3583dabc-0a4c-40c7-9df2-d8120c6dd7d0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ce4e030-c669-4bfd-aa46-7958929ceb2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8de5eea-f1e9-4670-9f08-f0aad8da8dba\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:27:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:27:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:27:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[1145df4d-05e1-4ab4-a031-d2ea09d9374e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ce4e030-c669-4bfd-aa46-7958929ceb2f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8de5eea-f1e9-4670-9f08-f0aad8da8dba (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:27:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-714ff27c-0024-433e-8fe9-c4b45667010e tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:27:38 user nova-compute[74683]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)
Oct 16 11:27:38 user nova-compute[74683]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)
Oct 16 11:27:38 user nova-compute[74683]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 (non-flash)
Oct 16 11:27:38 user nova-compute[74683]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d (non-flash)
Oct 16 11:27:38 user nova-compute[74683]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ce4e030-c669-4bfd-aa46-7958929ceb2f (non-flash)
Oct 16 11:27:38 user nova-compute[74683]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8de5eea-f1e9-4670-9f08-f0aad8da8dba (non-flash)
Oct 16 11:27:38 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:27:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-714ff27c-0024-433e-8fe9-c4b45667010e tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:27:38 user nova-compute[74683]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)
Oct 16 11:27:38 user nova-compute[74683]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)
Oct 16 11:27:38 user nova-compute[74683]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 (non-flash)
Oct 16 11:27:38 user nova-compute[74683]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d (non-flash)
Oct 16 11:27:38 user nova-compute[74683]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ce4e030-c669-4bfd-aa46-7958929ceb2f (non-flash)
Oct 16 11:27:38 user nova-compute[74683]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8de5eea-f1e9-4670-9f08-f0aad8da8dba (non-flash)
Oct 16 11:27:38 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:27:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-714ff27c-0024-433e-8fe9-c4b45667010e tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda4c5d4940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ce4e030-c669-4bfd-aa46-7958929ceb2f'): ({'sdg'}, set())}) {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 11:27:38 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-714ff27c-0024-433e-8fe9-c4b45667010e tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Removing single pathed devices sdg {{(pid=74683) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 11:27:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:27:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:27:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d36d43-b220-4b2c-be0d-6ee5cc310952]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:27:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:27:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:27:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[37de8d02-415e-4e8a-8021-3a89eeca9c5c]: (4, ('ok\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:27:38 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-714ff27c-0024-433e-8fe9-c4b45667010e tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Flushing IO for device /dev/sdg {{(pid=74683) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 11:27:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:27:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:27:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[09fe2efb-5e75-49e2-8596-b715a4adca80]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:27:38 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-714ff27c-0024-433e-8fe9-c4b45667010e tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74683) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 11:27:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:27:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.058s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:27:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c05c03-23b3-4e03-8d0a-dca2394758de]: (4, ('1', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:27:38 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-714ff27c-0024-433e-8fe9-c4b45667010e tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 11:27:38 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-714ff27c-0024-433e-8fe9-c4b45667010e tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] SCSI volumes sdg have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 11:27:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-714ff27c-0024-433e-8fe9-c4b45667010e tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ce4e030-c669-4bfd-aa46-7958929ceb2f')] {{(pid=74683) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 11:27:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ce4e030-c669-4bfd-aa46-7958929ceb2f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:27:38 user nova-compute[74683]: DEBUG nova.compute.manager [req-06ee7051-b548-4cc8-97bb-45cb74f2dea5 req-cc3dd8d4-3db6-495c-a7dc-4ccb68ea681c service nova] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Received event network-vif-plugged-802af945-243b-44cf-9f6c-0c3185f1d734 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:27:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-06ee7051-b548-4cc8-97bb-45cb74f2dea5 req-cc3dd8d4-3db6-495c-a7dc-4ccb68ea681c service nova] Acquiring lock "7488aa44-fdba-47b6-8857-0f46df4f66b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:27:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-06ee7051-b548-4cc8-97bb-45cb74f2dea5 req-cc3dd8d4-3db6-495c-a7dc-4ccb68ea681c service nova] Lock "7488aa44-fdba-47b6-8857-0f46df4f66b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:27:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-06ee7051-b548-4cc8-97bb-45cb74f2dea5 req-cc3dd8d4-3db6-495c-a7dc-4ccb68ea681c service nova] Lock "7488aa44-fdba-47b6-8857-0f46df4f66b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:27:38 user nova-compute[74683]: DEBUG nova.compute.manager [req-06ee7051-b548-4cc8-97bb-45cb74f2dea5 req-cc3dd8d4-3db6-495c-a7dc-4ccb68ea681c service nova] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] No waiting events found dispatching network-vif-plugged-802af945-243b-44cf-9f6c-0c3185f1d734 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:27:38 user nova-compute[74683]: WARNING nova.compute.manager [req-06ee7051-b548-4cc8-97bb-45cb74f2dea5 req-cc3dd8d4-3db6-495c-a7dc-4ccb68ea681c service nova] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Received unexpected event network-vif-plugged-802af945-243b-44cf-9f6c-0c3185f1d734 for instance with vm_state building and task_state spawning.
Oct 16 11:27:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:27:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ce4e030-c669-4bfd-aa46-7958929ceb2f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:27:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4ed8fd-2343-49da-b1d1-953f336dc25f]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:27:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-714ff27c-0024-433e-8fe9-c4b45667010e tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:27:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ce4e030-c669-4bfd-aa46-7958929ceb2f -p 172.16.0.220:3260 --logout {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:27:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ce4e030-c669-4bfd-aa46-7958929ceb2f -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:27:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3073ded-3a39-462e-a719-376082273ff0]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:8ce4e030-c669-4bfd-aa46-7958929ceb2f, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:8ce4e030-c669-4bfd-aa46-7958929ceb2f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:27:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-714ff27c-0024-433e-8fe9-c4b45667010e tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:8ce4e030-c669-4bfd-aa46-7958929ceb2f, portal: 172.16.0.220,3260]
Oct 16 11:27:38 user nova-compute[74683]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:8ce4e030-c669-4bfd-aa46-7958929ceb2f, portal: 172.16.0.220,3260] successful.
Oct 16 11:27:38 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:27:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ce4e030-c669-4bfd-aa46-7958929ceb2f -p 172.16.0.220:3260 --op delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:27:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ce4e030-c669-4bfd-aa46-7958929ceb2f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:27:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c89f8d-6c05-4a9d-9d37-f50d2ceb6d6c]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:27:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-714ff27c-0024-433e-8fe9-c4b45667010e tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:27:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-714ff27c-0024-433e-8fe9-c4b45667010e tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.448s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:27:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-714ff27c-0024-433e-8fe9-c4b45667010e tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] <== disconnect_volume: return (449ms) None {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:27:38 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-714ff27c-0024-433e-8fe9-c4b45667010e tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Disconnected iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 11:27:40 user nova-compute[74683]: DEBUG nova.compute.manager [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Instance event wait completed in 0 seconds for  {{(pid=74683) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 11:27:40 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Guest created on hypervisor {{(pid=74683) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 11:27:40 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Instance spawned successfully.
Oct 16 11:27:40 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 11:27:40 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Found default for hw_input_bus of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:27:40 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Found default for hw_pointer_model of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:27:40 user nova-compute[74683]: INFO nova.compute.manager [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Took 5.27 seconds to spawn the instance on the hypervisor.
Oct 16 11:27:40 user nova-compute[74683]: DEBUG nova.compute.manager [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:27:40 user nova-compute[74683]: DEBUG nova.compute.manager [req-e91ece08-f668-4c9f-850f-be4e5125fe8f req-52de7089-7d8b-4fe6-8560-8cee85fa31bb service nova] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Received event network-vif-plugged-802af945-243b-44cf-9f6c-0c3185f1d734 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:27:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e91ece08-f668-4c9f-850f-be4e5125fe8f req-52de7089-7d8b-4fe6-8560-8cee85fa31bb service nova] Acquiring lock "7488aa44-fdba-47b6-8857-0f46df4f66b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:27:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e91ece08-f668-4c9f-850f-be4e5125fe8f req-52de7089-7d8b-4fe6-8560-8cee85fa31bb service nova] Lock "7488aa44-fdba-47b6-8857-0f46df4f66b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:27:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e91ece08-f668-4c9f-850f-be4e5125fe8f req-52de7089-7d8b-4fe6-8560-8cee85fa31bb service nova] Lock "7488aa44-fdba-47b6-8857-0f46df4f66b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:27:40 user nova-compute[74683]: DEBUG nova.compute.manager [req-e91ece08-f668-4c9f-850f-be4e5125fe8f req-52de7089-7d8b-4fe6-8560-8cee85fa31bb service nova] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] No waiting events found dispatching network-vif-plugged-802af945-243b-44cf-9f6c-0c3185f1d734 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:27:40 user nova-compute[74683]: WARNING nova.compute.manager [req-e91ece08-f668-4c9f-850f-be4e5125fe8f req-52de7089-7d8b-4fe6-8560-8cee85fa31bb service nova] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Received unexpected event network-vif-plugged-802af945-243b-44cf-9f6c-0c3185f1d734 for instance with vm_state building and task_state spawning.
Oct 16 11:27:40 user nova-compute[74683]: INFO nova.compute.manager [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Took 46.01 seconds to build instance.
Oct 16 11:27:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-842e0d6e-4f1b-444f-9fca-c172cc2d497c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "7488aa44-fdba-47b6-8857-0f46df4f66b9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 46.161s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:27:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:27:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:27:45 user nova-compute[74683]: DEBUG nova.objects.instance [None req-714ff27c-0024-433e-8fe9-c4b45667010e tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lazy-loading 'flavor' on Instance uuid be9f4840-69c8-4980-afd8-73a84f743dff {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:27:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-714ff27c-0024-433e-8fe9-c4b45667010e tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "be9f4840-69c8-4980-afd8-73a84f743dff" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 28.142s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:27:46 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:27:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:27:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:27:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:27:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74683) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 11:27:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:27:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:27:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:27:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:27:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:01 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ff1ceb55-347f-4300-a5d5-d3b6136e079c tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Acquiring lock "be9f4840-69c8-4980-afd8-73a84f743dff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:28:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ff1ceb55-347f-4300-a5d5-d3b6136e079c tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "be9f4840-69c8-4980-afd8-73a84f743dff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:28:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ff1ceb55-347f-4300-a5d5-d3b6136e079c tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Acquiring lock "be9f4840-69c8-4980-afd8-73a84f743dff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:28:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ff1ceb55-347f-4300-a5d5-d3b6136e079c tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "be9f4840-69c8-4980-afd8-73a84f743dff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:28:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ff1ceb55-347f-4300-a5d5-d3b6136e079c tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "be9f4840-69c8-4980-afd8-73a84f743dff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:28:08 user nova-compute[74683]: INFO nova.compute.manager [None req-ff1ceb55-347f-4300-a5d5-d3b6136e079c tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Terminating instance
Oct 16 11:28:08 user nova-compute[74683]: DEBUG nova.compute.manager [None req-ff1ceb55-347f-4300-a5d5-d3b6136e079c tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Start destroying the instance on the hypervisor. {{(pid=74683) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 11:28:08 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:08 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:08 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:08 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:08 user nova-compute[74683]: DEBUG nova.compute.manager [req-87504fce-b863-477d-a000-5cfda0bd95f0 req-c55cd6a7-58b6-4e26-abb3-c96c3e4fcf2a service nova] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Received event network-vif-unplugged-3a270246-50ff-4381-a519-564fe320578f {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:28:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-87504fce-b863-477d-a000-5cfda0bd95f0 req-c55cd6a7-58b6-4e26-abb3-c96c3e4fcf2a service nova] Acquiring lock "be9f4840-69c8-4980-afd8-73a84f743dff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:28:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-87504fce-b863-477d-a000-5cfda0bd95f0 req-c55cd6a7-58b6-4e26-abb3-c96c3e4fcf2a service nova] Lock "be9f4840-69c8-4980-afd8-73a84f743dff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:28:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-87504fce-b863-477d-a000-5cfda0bd95f0 req-c55cd6a7-58b6-4e26-abb3-c96c3e4fcf2a service nova] Lock "be9f4840-69c8-4980-afd8-73a84f743dff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:28:08 user nova-compute[74683]: DEBUG nova.compute.manager [req-87504fce-b863-477d-a000-5cfda0bd95f0 req-c55cd6a7-58b6-4e26-abb3-c96c3e4fcf2a service nova] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] No waiting events found dispatching network-vif-unplugged-3a270246-50ff-4381-a519-564fe320578f {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:28:08 user nova-compute[74683]: DEBUG nova.compute.manager [req-87504fce-b863-477d-a000-5cfda0bd95f0 req-c55cd6a7-58b6-4e26-abb3-c96c3e4fcf2a service nova] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Received event network-vif-unplugged-3a270246-50ff-4381-a519-564fe320578f for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 11:28:09 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Instance destroyed successfully.
Oct 16 11:28:09 user nova-compute[74683]: DEBUG nova.objects.instance [None req-ff1ceb55-347f-4300-a5d5-d3b6136e079c tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lazy-loading 'resources' on Instance uuid be9f4840-69c8-4980-afd8-73a84f743dff {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:28:09 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-ff1ceb55-347f-4300-a5d5-d3b6136e079c tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:24:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1307435615',display_name='tempest-AttachVolumeNegativeTest-server-1307435615',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1307435615',id=31,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcOtZxCG0U7wp3t7WCYbBQXBdmfNkZ3ZKvPKgRrQpMvs6mpm943cucyAoR4gyTgCDaU9QktrUnKg9dZNGLPj768DlKZSOnznjoKU3Ea9Tu7Gxxnzn3mi0F/o/7J6OC8rQ==',key_name='tempest-keypair-590361388',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:24:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72c66aa774134aa6a873eabffc28ec07',ramdisk_id='',reservation_id='r-1s1zs6oe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-845934820',owner_user_name='tempest-AttachVolumeNegativeTest-845934820-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:25:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cdc203c025d84efe86e25cfdf75107b8',uuid=be9f4840-69c8-4980-afd8-73a84f743dff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a270246-50ff-4381-a519-564fe320578f", "address": "fa:16:3e:7c:d6:e6", "network": {"id": "f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-137528169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c66aa774134aa6a873eabffc28ec07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a270246-50", "ovs_interfaceid": "3a270246-50ff-4381-a519-564fe320578f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:28:09 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-ff1ceb55-347f-4300-a5d5-d3b6136e079c tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Converting VIF {"id": "3a270246-50ff-4381-a519-564fe320578f", "address": "fa:16:3e:7c:d6:e6", "network": {"id": "f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-137528169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c66aa774134aa6a873eabffc28ec07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a270246-50", "ovs_interfaceid": "3a270246-50ff-4381-a519-564fe320578f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:28:09 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-ff1ceb55-347f-4300-a5d5-d3b6136e079c tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:d6:e6,bridge_name='br-int',has_traffic_filtering=True,id=3a270246-50ff-4381-a519-564fe320578f,network=Network(f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a270246-50') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:28:09 user nova-compute[74683]: DEBUG os_vif [None req-ff1ceb55-347f-4300-a5d5-d3b6136e079c tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:d6:e6,bridge_name='br-int',has_traffic_filtering=True,id=3a270246-50ff-4381-a519-564fe320578f,network=Network(f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a270246-50') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:28:09 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:09 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a270246-50, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:28:09 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:09 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:28:09 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:09 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:09 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=83fca17f-ac41-42a1-963e-4a432c5bf002) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:28:09 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:09 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:09 user nova-compute[74683]: INFO os_vif [None req-ff1ceb55-347f-4300-a5d5-d3b6136e079c tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:d6:e6,bridge_name='br-int',has_traffic_filtering=True,id=3a270246-50ff-4381-a519-564fe320578f,network=Network(f9a4a7c8-a2f9-4c72-a4e8-b7268cc6dbd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a270246-50')
Oct 16 11:28:09 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-ff1ceb55-347f-4300-a5d5-d3b6136e079c tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Deleting instance files /opt/stack/data/nova/instances/be9f4840-69c8-4980-afd8-73a84f743dff_del
Oct 16 11:28:09 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-ff1ceb55-347f-4300-a5d5-d3b6136e079c tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Deletion of /opt/stack/data/nova/instances/be9f4840-69c8-4980-afd8-73a84f743dff_del complete
Oct 16 11:28:09 user nova-compute[74683]: INFO nova.compute.manager [None req-ff1ceb55-347f-4300-a5d5-d3b6136e079c tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Took 0.88 seconds to destroy the instance on the hypervisor.
Oct 16 11:28:09 user nova-compute[74683]: DEBUG oslo.service.loopingcall [None req-ff1ceb55-347f-4300-a5d5-d3b6136e079c tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74683) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 11:28:09 user nova-compute[74683]: DEBUG nova.compute.manager [-] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Deallocating network for instance {{(pid=74683) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 11:28:09 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] deallocate_for_instance() {{(pid=74683) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 11:28:10 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:28:10 user nova-compute[74683]: INFO nova.compute.manager [-] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Took 0.93 seconds to deallocate network for instance.
Oct 16 11:28:10 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ff1ceb55-347f-4300-a5d5-d3b6136e079c tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:28:10 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ff1ceb55-347f-4300-a5d5-d3b6136e079c tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:28:10 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-ff1ceb55-347f-4300-a5d5-d3b6136e079c tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:28:10 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-ff1ceb55-347f-4300-a5d5-d3b6136e079c tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:28:10 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ff1ceb55-347f-4300-a5d5-d3b6136e079c tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.415s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:28:10 user nova-compute[74683]: INFO nova.scheduler.client.report [None req-ff1ceb55-347f-4300-a5d5-d3b6136e079c tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Deleted allocations for instance be9f4840-69c8-4980-afd8-73a84f743dff
Oct 16 11:28:10 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ff1ceb55-347f-4300-a5d5-d3b6136e079c tempest-AttachVolumeNegativeTest-845934820 tempest-AttachVolumeNegativeTest-845934820-project-member] Lock "be9f4840-69c8-4980-afd8-73a84f743dff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.422s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:28:10 user nova-compute[74683]: DEBUG nova.compute.manager [req-a10305f6-add7-4baa-a795-a8b5e5138d94 req-1fc3d831-80db-4623-846f-1d38e7e36571 service nova] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Received event network-vif-plugged-3a270246-50ff-4381-a519-564fe320578f {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:28:10 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a10305f6-add7-4baa-a795-a8b5e5138d94 req-1fc3d831-80db-4623-846f-1d38e7e36571 service nova] Acquiring lock "be9f4840-69c8-4980-afd8-73a84f743dff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:28:10 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a10305f6-add7-4baa-a795-a8b5e5138d94 req-1fc3d831-80db-4623-846f-1d38e7e36571 service nova] Lock "be9f4840-69c8-4980-afd8-73a84f743dff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:28:10 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a10305f6-add7-4baa-a795-a8b5e5138d94 req-1fc3d831-80db-4623-846f-1d38e7e36571 service nova] Lock "be9f4840-69c8-4980-afd8-73a84f743dff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:28:10 user nova-compute[74683]: DEBUG nova.compute.manager [req-a10305f6-add7-4baa-a795-a8b5e5138d94 req-1fc3d831-80db-4623-846f-1d38e7e36571 service nova] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] No waiting events found dispatching network-vif-plugged-3a270246-50ff-4381-a519-564fe320578f {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:28:10 user nova-compute[74683]: WARNING nova.compute.manager [req-a10305f6-add7-4baa-a795-a8b5e5138d94 req-1fc3d831-80db-4623-846f-1d38e7e36571 service nova] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Received unexpected event network-vif-plugged-3a270246-50ff-4381-a519-564fe320578f for instance with vm_state deleted and task_state None.
Oct 16 11:28:10 user nova-compute[74683]: DEBUG nova.compute.manager [req-a10305f6-add7-4baa-a795-a8b5e5138d94 req-1fc3d831-80db-4623-846f-1d38e7e36571 service nova] [instance: be9f4840-69c8-4980-afd8-73a84f743dff] Received event network-vif-deleted-3a270246-50ff-4381-a519-564fe320578f {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:28:11 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:14 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:14 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:28:14 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Starting heal instance info cache {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 11:28:14 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Rebuilding the list of instances to heal {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 11:28:14 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "refresh_cache-18a77385-fab9-4ea0-8aa6-666cf7e798a6" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:28:14 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquired lock "refresh_cache-18a77385-fab9-4ea0-8aa6-666cf7e798a6" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:28:14 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Forcefully refreshing network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 11:28:14 user nova-compute[74683]: DEBUG nova.objects.instance [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lazy-loading 'info_cache' on Instance uuid 18a77385-fab9-4ea0-8aa6-666cf7e798a6 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:28:14 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Updating instance_info_cache with network_info: [{"id": "fab663e7-134f-4cde-8cf1-2ccb1c83a812", "address": "fa:16:3e:8c:d5:b1", "network": {"id": "4d43cc12-d2cd-4552-90a4-884a0ff3dc66", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-825513246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6e0046017b4bba85caf2a39d1c67b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfab663e7-13", "ovs_interfaceid": "fab663e7-134f-4cde-8cf1-2ccb1c83a812", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:28:14 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Releasing lock "refresh_cache-18a77385-fab9-4ea0-8aa6-666cf7e798a6" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:28:14 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Updated the network info_cache for instance {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 11:28:14 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:28:14 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:28:14 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:28:15 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:28:15 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:28:16 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:28:16 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74683) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 11:28:17 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:28:19 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:28:19 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:28:19 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:28:19 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:28:19 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:28:19 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Auditing locally available compute resources for user (node: user) {{(pid=74683) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 11:28:19 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:28:19 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:28:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9fc5a9-8659-497c-bb07-af52fe2e1761/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:28:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9fc5a9-8659-497c-bb07-af52fe2e1761/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:28:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9fc5a9-8659-497c-bb07-af52fe2e1761/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:28:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9fc5a9-8659-497c-bb07-af52fe2e1761/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:28:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk.rescue --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:28:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:28:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk.rescue --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:28:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:28:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:28:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:28:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:28:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:28:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.rescue --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:28:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:28:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.rescue --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:28:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:28:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:28:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:28:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:28:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:28:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:28:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:28:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:28:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:28:22 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:28:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d00bbb1a-534b-4437-9b79-91870c5d8bb5/disk.rescue --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:28:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d00bbb1a-534b-4437-9b79-91870c5d8bb5/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:28:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d00bbb1a-534b-4437-9b79-91870c5d8bb5/disk.rescue --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:28:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d00bbb1a-534b-4437-9b79-91870c5d8bb5/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:28:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:28:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:28:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:28:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:28:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b79d385-e512-4297-9aa4-2b9bb0cac23c/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:28:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b79d385-e512-4297-9aa4-2b9bb0cac23c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:28:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b79d385-e512-4297-9aa4-2b9bb0cac23c/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:28:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b79d385-e512-4297-9aa4-2b9bb0cac23c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:28:23 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:28:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b4eaccb-e068-4e8a-9084-16229815b1d7/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:28:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b4eaccb-e068-4e8a-9084-16229815b1d7/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:28:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b4eaccb-e068-4e8a-9084-16229815b1d7/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:28:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b4eaccb-e068-4e8a-9084-16229815b1d7/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:28:23 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:28:23 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:28:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:24 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:28:24 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:28:24 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Hypervisor/Node resource view: name=user free_ram=7431MB free_disk=25.054603576660156GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74683) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 11:28:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:28:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:28:24 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 18a77385-fab9-4ea0-8aa6-666cf7e798a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:28:24 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance d5e55361-d9ed-4d07-91b0-ec4d08b2e817 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:28:24 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance edd01413-1f8a-49e3-aa3c-ecb19c62afae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:28:24 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 6c9fc5a9-8659-497c-bb07-af52fe2e1761 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:28:24 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 9b8ba94f-43cc-4f06-bcd9-83935ccbe117 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:28:24 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance b91af786-36e3-4815-811f-fb3c055e758d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:28:24 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 0b79d385-e512-4297-9aa4-2b9bb0cac23c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:28:24 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 4b4eaccb-e068-4e8a-9084-16229815b1d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:28:24 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 6300da82-2079-455c-8ab2-9fd13ce9e825 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:28:24 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance d00bbb1a-534b-4437-9b79-91870c5d8bb5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:28:24 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 73adef6b-881d-466b-b55d-6cf2f974d40e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:28:24 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 7488aa44-fdba-47b6-8857-0f46df4f66b9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:28:24 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 11:28:24 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 11:28:24 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:28:24 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:28:24 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Compute_service record updated for user:user {{(pid=74683) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 11:28:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.615s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:28:24 user nova-compute[74683]: INFO nova.compute.manager [None req-ba7f6119-f049-45bc-99b4-41f6937eaaff tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Unrescuing
Oct 16 11:28:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ba7f6119-f049-45bc-99b4-41f6937eaaff tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Acquiring lock "refresh_cache-d00bbb1a-534b-4437-9b79-91870c5d8bb5" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:28:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ba7f6119-f049-45bc-99b4-41f6937eaaff tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Acquired lock "refresh_cache-d00bbb1a-534b-4437-9b79-91870c5d8bb5" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:28:24 user nova-compute[74683]: DEBUG nova.network.neutron [None req-ba7f6119-f049-45bc-99b4-41f6937eaaff tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:28:25 user nova-compute[74683]: DEBUG nova.network.neutron [None req-ba7f6119-f049-45bc-99b4-41f6937eaaff tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Updating instance_info_cache with network_info: [{"id": "3d2071d3-9bd0-4aa5-a909-889b3f3155db", "address": "fa:16:3e:53:66:36", "network": {"id": "4d43cc12-d2cd-4552-90a4-884a0ff3dc66", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-825513246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6e0046017b4bba85caf2a39d1c67b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d2071d3-9b", "ovs_interfaceid": "3d2071d3-9bd0-4aa5-a909-889b3f3155db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:28:25 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ba7f6119-f049-45bc-99b4-41f6937eaaff tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Releasing lock "refresh_cache-d00bbb1a-534b-4437-9b79-91870c5d8bb5" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:28:25 user nova-compute[74683]: DEBUG nova.objects.instance [None req-ba7f6119-f049-45bc-99b4-41f6937eaaff tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lazy-loading 'flavor' on Instance uuid d00bbb1a-534b-4437-9b79-91870c5d8bb5 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:28:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:26 user nova-compute[74683]: DEBUG nova.compute.manager [req-c668d1b1-4aed-4120-9af0-5ab8af9e7aea req-60c6d6c8-8958-49f5-ac7f-00d397259891 service nova] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Received event network-vif-unplugged-3d2071d3-9bd0-4aa5-a909-889b3f3155db {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:28:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c668d1b1-4aed-4120-9af0-5ab8af9e7aea req-60c6d6c8-8958-49f5-ac7f-00d397259891 service nova] Acquiring lock "d00bbb1a-534b-4437-9b79-91870c5d8bb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:28:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c668d1b1-4aed-4120-9af0-5ab8af9e7aea req-60c6d6c8-8958-49f5-ac7f-00d397259891 service nova] Lock "d00bbb1a-534b-4437-9b79-91870c5d8bb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:28:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c668d1b1-4aed-4120-9af0-5ab8af9e7aea req-60c6d6c8-8958-49f5-ac7f-00d397259891 service nova] Lock "d00bbb1a-534b-4437-9b79-91870c5d8bb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:28:26 user nova-compute[74683]: DEBUG nova.compute.manager [req-c668d1b1-4aed-4120-9af0-5ab8af9e7aea req-60c6d6c8-8958-49f5-ac7f-00d397259891 service nova] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] No waiting events found dispatching network-vif-unplugged-3d2071d3-9bd0-4aa5-a909-889b3f3155db {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:28:26 user nova-compute[74683]: WARNING nova.compute.manager [req-c668d1b1-4aed-4120-9af0-5ab8af9e7aea req-60c6d6c8-8958-49f5-ac7f-00d397259891 service nova] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Received unexpected event network-vif-unplugged-3d2071d3-9bd0-4aa5-a909-889b3f3155db for instance with vm_state rescued and task_state unrescuing.
Oct 16 11:28:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:26 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Instance destroyed successfully.
Oct 16 11:28:28 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:28 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:28 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:28 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:28 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:28 user nova-compute[74683]: DEBUG nova.compute.manager [req-efa75103-f8eb-4e67-a2b6-4e00f6a10257 req-80406e70-5859-40f4-8645-811672f78a60 service nova] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Received event network-vif-plugged-3d2071d3-9bd0-4aa5-a909-889b3f3155db {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:28:28 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-efa75103-f8eb-4e67-a2b6-4e00f6a10257 req-80406e70-5859-40f4-8645-811672f78a60 service nova] Acquiring lock "d00bbb1a-534b-4437-9b79-91870c5d8bb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:28:28 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-efa75103-f8eb-4e67-a2b6-4e00f6a10257 req-80406e70-5859-40f4-8645-811672f78a60 service nova] Lock "d00bbb1a-534b-4437-9b79-91870c5d8bb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:28:28 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-efa75103-f8eb-4e67-a2b6-4e00f6a10257 req-80406e70-5859-40f4-8645-811672f78a60 service nova] Lock "d00bbb1a-534b-4437-9b79-91870c5d8bb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:28:28 user nova-compute[74683]: DEBUG nova.compute.manager [req-efa75103-f8eb-4e67-a2b6-4e00f6a10257 req-80406e70-5859-40f4-8645-811672f78a60 service nova] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] No waiting events found dispatching network-vif-plugged-3d2071d3-9bd0-4aa5-a909-889b3f3155db {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:28:28 user nova-compute[74683]: WARNING nova.compute.manager [req-efa75103-f8eb-4e67-a2b6-4e00f6a10257 req-80406e70-5859-40f4-8645-811672f78a60 service nova] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Received unexpected event network-vif-plugged-3d2071d3-9bd0-4aa5-a909-889b3f3155db for instance with vm_state rescued and task_state unrescuing.
Oct 16 11:28:28 user nova-compute[74683]: DEBUG nova.compute.manager [req-efa75103-f8eb-4e67-a2b6-4e00f6a10257 req-80406e70-5859-40f4-8645-811672f78a60 service nova] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Received event network-vif-plugged-3d2071d3-9bd0-4aa5-a909-889b3f3155db {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:28:28 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-efa75103-f8eb-4e67-a2b6-4e00f6a10257 req-80406e70-5859-40f4-8645-811672f78a60 service nova] Acquiring lock "d00bbb1a-534b-4437-9b79-91870c5d8bb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:28:28 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-efa75103-f8eb-4e67-a2b6-4e00f6a10257 req-80406e70-5859-40f4-8645-811672f78a60 service nova] Lock "d00bbb1a-534b-4437-9b79-91870c5d8bb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:28:28 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-efa75103-f8eb-4e67-a2b6-4e00f6a10257 req-80406e70-5859-40f4-8645-811672f78a60 service nova] Lock "d00bbb1a-534b-4437-9b79-91870c5d8bb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:28:28 user nova-compute[74683]: DEBUG nova.compute.manager [req-efa75103-f8eb-4e67-a2b6-4e00f6a10257 req-80406e70-5859-40f4-8645-811672f78a60 service nova] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] No waiting events found dispatching network-vif-plugged-3d2071d3-9bd0-4aa5-a909-889b3f3155db {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:28:28 user nova-compute[74683]: WARNING nova.compute.manager [req-efa75103-f8eb-4e67-a2b6-4e00f6a10257 req-80406e70-5859-40f4-8645-811672f78a60 service nova] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Received unexpected event network-vif-plugged-3d2071d3-9bd0-4aa5-a909-889b3f3155db for instance with vm_state rescued and task_state unrescuing.
Oct 16 11:28:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:30 user nova-compute[74683]: DEBUG nova.compute.manager [None req-ba7f6119-f049-45bc-99b4-41f6937eaaff tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:28:30 user nova-compute[74683]: DEBUG nova.compute.manager [req-3974f980-74b2-442b-ab25-250e1e7a4fde req-4bf5631b-e67f-44c5-a37e-f7253e6edba8 service nova] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Received event network-vif-plugged-3d2071d3-9bd0-4aa5-a909-889b3f3155db {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:28:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-3974f980-74b2-442b-ab25-250e1e7a4fde req-4bf5631b-e67f-44c5-a37e-f7253e6edba8 service nova] Acquiring lock "d00bbb1a-534b-4437-9b79-91870c5d8bb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:28:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-3974f980-74b2-442b-ab25-250e1e7a4fde req-4bf5631b-e67f-44c5-a37e-f7253e6edba8 service nova] Lock "d00bbb1a-534b-4437-9b79-91870c5d8bb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:28:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-3974f980-74b2-442b-ab25-250e1e7a4fde req-4bf5631b-e67f-44c5-a37e-f7253e6edba8 service nova] Lock "d00bbb1a-534b-4437-9b79-91870c5d8bb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:28:30 user nova-compute[74683]: DEBUG nova.compute.manager [req-3974f980-74b2-442b-ab25-250e1e7a4fde req-4bf5631b-e67f-44c5-a37e-f7253e6edba8 service nova] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] No waiting events found dispatching network-vif-plugged-3d2071d3-9bd0-4aa5-a909-889b3f3155db {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:28:30 user nova-compute[74683]: WARNING nova.compute.manager [req-3974f980-74b2-442b-ab25-250e1e7a4fde req-4bf5631b-e67f-44c5-a37e-f7253e6edba8 service nova] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Received unexpected event network-vif-plugged-3d2071d3-9bd0-4aa5-a909-889b3f3155db for instance with vm_state active and task_state None.
Oct 16 11:28:31 user nova-compute[74683]: INFO nova.compute.manager [None req-51c2a841-1956-43e9-a47d-bfb7e541fcc6 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Unrescuing
Oct 16 11:28:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-51c2a841-1956-43e9-a47d-bfb7e541fcc6 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Acquiring lock "refresh_cache-9b8ba94f-43cc-4f06-bcd9-83935ccbe117" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:28:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-51c2a841-1956-43e9-a47d-bfb7e541fcc6 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Acquired lock "refresh_cache-9b8ba94f-43cc-4f06-bcd9-83935ccbe117" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:28:31 user nova-compute[74683]: DEBUG nova.network.neutron [None req-51c2a841-1956-43e9-a47d-bfb7e541fcc6 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:28:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:31 user nova-compute[74683]: DEBUG nova.network.neutron [None req-51c2a841-1956-43e9-a47d-bfb7e541fcc6 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Updating instance_info_cache with network_info: [{"id": "ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665", "address": "fa:16:3e:d4:56:40", "network": {"id": "fa128ba8-cd2f-4621-ac04-ecc21569bb68", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321708612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66a49078f1240bd88207e487dd4951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff8b53f2-e6", "ovs_interfaceid": "ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:28:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-51c2a841-1956-43e9-a47d-bfb7e541fcc6 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Releasing lock "refresh_cache-9b8ba94f-43cc-4f06-bcd9-83935ccbe117" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:28:31 user nova-compute[74683]: DEBUG nova.objects.instance [None req-51c2a841-1956-43e9-a47d-bfb7e541fcc6 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lazy-loading 'flavor' on Instance uuid 9b8ba94f-43cc-4f06-bcd9-83935ccbe117 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:28:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:32 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-713ac547-00cc-4063-98bc-04a708b71de3 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Acquiring lock "4b4eaccb-e068-4e8a-9084-16229815b1d7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:28:32 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-713ac547-00cc-4063-98bc-04a708b71de3 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "4b4eaccb-e068-4e8a-9084-16229815b1d7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:28:32 user nova-compute[74683]: INFO nova.compute.manager [None req-713ac547-00cc-4063-98bc-04a708b71de3 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Detaching volume a52c1cdc-2945-43af-abd1-8a8060b4f152
Oct 16 11:28:32 user nova-compute[74683]: INFO nova.virt.block_device [None req-713ac547-00cc-4063-98bc-04a708b71de3 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Attempting to driver detach volume a52c1cdc-2945-43af-abd1-8a8060b4f152 from mountpoint /dev/vdb
Oct 16 11:28:32 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-713ac547-00cc-4063-98bc-04a708b71de3 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Attempting to detach device vdb from instance 4b4eaccb-e068-4e8a-9084-16229815b1d7 from the persistent domain config. {{(pid=74683) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 11:28:32 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-713ac547-00cc-4063-98bc-04a708b71de3 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 11:28:32 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:28:32 user nova-compute[74683]:   <source dev="/dev/sdb"/>
Oct 16 11:28:32 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:28:32 user nova-compute[74683]:   <serial>a52c1cdc-2945-43af-abd1-8a8060b4f152</serial>
Oct 16 11:28:32 user nova-compute[74683]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 16 11:28:32 user nova-compute[74683]: </disk>
Oct 16 11:28:32 user nova-compute[74683]:  {{(pid=74683) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 11:28:32 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-713ac547-00cc-4063-98bc-04a708b71de3 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Successfully detached device vdb from instance 4b4eaccb-e068-4e8a-9084-16229815b1d7 from the persistent domain config.
Oct 16 11:28:32 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-713ac547-00cc-4063-98bc-04a708b71de3 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4b4eaccb-e068-4e8a-9084-16229815b1d7 from the live domain config. {{(pid=74683) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 11:28:32 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-713ac547-00cc-4063-98bc-04a708b71de3 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 11:28:32 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:28:32 user nova-compute[74683]:   <source dev="/dev/sdb"/>
Oct 16 11:28:32 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:28:32 user nova-compute[74683]:   <serial>a52c1cdc-2945-43af-abd1-8a8060b4f152</serial>
Oct 16 11:28:32 user nova-compute[74683]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 16 11:28:32 user nova-compute[74683]: </disk>
Oct 16 11:28:32 user nova-compute[74683]:  {{(pid=74683) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 11:28:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:32 user nova-compute[74683]: DEBUG nova.compute.manager [req-fa570c61-d505-4d93-9e41-2fbcb8d75c37 req-d1a49aa9-a2b8-4c6c-b0c2-0495a18b4702 service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Received event network-vif-unplugged-ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:28:32 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-fa570c61-d505-4d93-9e41-2fbcb8d75c37 req-d1a49aa9-a2b8-4c6c-b0c2-0495a18b4702 service nova] Acquiring lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:28:32 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-fa570c61-d505-4d93-9e41-2fbcb8d75c37 req-d1a49aa9-a2b8-4c6c-b0c2-0495a18b4702 service nova] Lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:28:32 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-fa570c61-d505-4d93-9e41-2fbcb8d75c37 req-d1a49aa9-a2b8-4c6c-b0c2-0495a18b4702 service nova] Lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:28:32 user nova-compute[74683]: DEBUG nova.compute.manager [req-fa570c61-d505-4d93-9e41-2fbcb8d75c37 req-d1a49aa9-a2b8-4c6c-b0c2-0495a18b4702 service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] No waiting events found dispatching network-vif-unplugged-ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:28:32 user nova-compute[74683]: WARNING nova.compute.manager [req-fa570c61-d505-4d93-9e41-2fbcb8d75c37 req-d1a49aa9-a2b8-4c6c-b0c2-0495a18b4702 service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Received unexpected event network-vif-unplugged-ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 for instance with vm_state rescued and task_state unrescuing.
Oct 16 11:28:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:32 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-713ac547-00cc-4063-98bc-04a708b71de3 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4b4eaccb-e068-4e8a-9084-16229815b1d7 {{(pid=74683) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 11:28:32 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Instance destroyed successfully.
Oct 16 11:28:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:34 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:34 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:34 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:34 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:34 user nova-compute[74683]: DEBUG nova.compute.manager [req-cc48983b-6b81-4f09-bd81-d4544c4f032c req-ce7c1064-56e0-47d7-90b8-7385c36c794b service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Received event network-vif-plugged-ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:28:34 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-cc48983b-6b81-4f09-bd81-d4544c4f032c req-ce7c1064-56e0-47d7-90b8-7385c36c794b service nova] Acquiring lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:28:34 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-cc48983b-6b81-4f09-bd81-d4544c4f032c req-ce7c1064-56e0-47d7-90b8-7385c36c794b service nova] Lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:28:34 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-cc48983b-6b81-4f09-bd81-d4544c4f032c req-ce7c1064-56e0-47d7-90b8-7385c36c794b service nova] Lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:28:34 user nova-compute[74683]: DEBUG nova.compute.manager [req-cc48983b-6b81-4f09-bd81-d4544c4f032c req-ce7c1064-56e0-47d7-90b8-7385c36c794b service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] No waiting events found dispatching network-vif-plugged-ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:28:34 user nova-compute[74683]: WARNING nova.compute.manager [req-cc48983b-6b81-4f09-bd81-d4544c4f032c req-ce7c1064-56e0-47d7-90b8-7385c36c794b service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Received unexpected event network-vif-plugged-ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 for instance with vm_state rescued and task_state unrescuing.
Oct 16 11:28:34 user nova-compute[74683]: DEBUG nova.compute.manager [req-cc48983b-6b81-4f09-bd81-d4544c4f032c req-ce7c1064-56e0-47d7-90b8-7385c36c794b service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Received event network-vif-plugged-ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:28:34 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-cc48983b-6b81-4f09-bd81-d4544c4f032c req-ce7c1064-56e0-47d7-90b8-7385c36c794b service nova] Acquiring lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:28:34 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-cc48983b-6b81-4f09-bd81-d4544c4f032c req-ce7c1064-56e0-47d7-90b8-7385c36c794b service nova] Lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:28:34 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-cc48983b-6b81-4f09-bd81-d4544c4f032c req-ce7c1064-56e0-47d7-90b8-7385c36c794b service nova] Lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:28:34 user nova-compute[74683]: DEBUG nova.compute.manager [req-cc48983b-6b81-4f09-bd81-d4544c4f032c req-ce7c1064-56e0-47d7-90b8-7385c36c794b service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] No waiting events found dispatching network-vif-plugged-ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:28:34 user nova-compute[74683]: WARNING nova.compute.manager [req-cc48983b-6b81-4f09-bd81-d4544c4f032c req-ce7c1064-56e0-47d7-90b8-7385c36c794b service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Received unexpected event network-vif-plugged-ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 for instance with vm_state rescued and task_state unrescuing.
Oct 16 11:28:34 user nova-compute[74683]: DEBUG nova.compute.manager [req-cc48983b-6b81-4f09-bd81-d4544c4f032c req-ce7c1064-56e0-47d7-90b8-7385c36c794b service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Received event network-vif-plugged-ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:28:34 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-cc48983b-6b81-4f09-bd81-d4544c4f032c req-ce7c1064-56e0-47d7-90b8-7385c36c794b service nova] Acquiring lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:28:34 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-cc48983b-6b81-4f09-bd81-d4544c4f032c req-ce7c1064-56e0-47d7-90b8-7385c36c794b service nova] Lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:28:34 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-cc48983b-6b81-4f09-bd81-d4544c4f032c req-ce7c1064-56e0-47d7-90b8-7385c36c794b service nova] Lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:28:34 user nova-compute[74683]: DEBUG nova.compute.manager [req-cc48983b-6b81-4f09-bd81-d4544c4f032c req-ce7c1064-56e0-47d7-90b8-7385c36c794b service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] No waiting events found dispatching network-vif-plugged-ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:28:34 user nova-compute[74683]: WARNING nova.compute.manager [req-cc48983b-6b81-4f09-bd81-d4544c4f032c req-ce7c1064-56e0-47d7-90b8-7385c36c794b service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Received unexpected event network-vif-plugged-ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 for instance with vm_state rescued and task_state unrescuing.
Oct 16 11:28:34 user nova-compute[74683]: DEBUG nova.compute.manager [req-cc48983b-6b81-4f09-bd81-d4544c4f032c req-ce7c1064-56e0-47d7-90b8-7385c36c794b service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Received event network-vif-unplugged-ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:28:34 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-cc48983b-6b81-4f09-bd81-d4544c4f032c req-ce7c1064-56e0-47d7-90b8-7385c36c794b service nova] Acquiring lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:28:34 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-cc48983b-6b81-4f09-bd81-d4544c4f032c req-ce7c1064-56e0-47d7-90b8-7385c36c794b service nova] Lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:28:34 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-cc48983b-6b81-4f09-bd81-d4544c4f032c req-ce7c1064-56e0-47d7-90b8-7385c36c794b service nova] Lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:28:34 user nova-compute[74683]: DEBUG nova.compute.manager [req-cc48983b-6b81-4f09-bd81-d4544c4f032c req-ce7c1064-56e0-47d7-90b8-7385c36c794b service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] No waiting events found dispatching network-vif-unplugged-ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:28:34 user nova-compute[74683]: WARNING nova.compute.manager [req-cc48983b-6b81-4f09-bd81-d4544c4f032c req-ce7c1064-56e0-47d7-90b8-7385c36c794b service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Received unexpected event network-vif-unplugged-ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 for instance with vm_state rescued and task_state unrescuing.
Oct 16 11:28:34 user nova-compute[74683]: DEBUG nova.compute.manager [req-cc48983b-6b81-4f09-bd81-d4544c4f032c req-ce7c1064-56e0-47d7-90b8-7385c36c794b service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Received event network-vif-plugged-ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:28:34 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-cc48983b-6b81-4f09-bd81-d4544c4f032c req-ce7c1064-56e0-47d7-90b8-7385c36c794b service nova] Acquiring lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:28:34 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-cc48983b-6b81-4f09-bd81-d4544c4f032c req-ce7c1064-56e0-47d7-90b8-7385c36c794b service nova] Lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:28:34 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-cc48983b-6b81-4f09-bd81-d4544c4f032c req-ce7c1064-56e0-47d7-90b8-7385c36c794b service nova] Lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:28:34 user nova-compute[74683]: DEBUG nova.compute.manager [req-cc48983b-6b81-4f09-bd81-d4544c4f032c req-ce7c1064-56e0-47d7-90b8-7385c36c794b service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] No waiting events found dispatching network-vif-plugged-ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:28:34 user nova-compute[74683]: WARNING nova.compute.manager [req-cc48983b-6b81-4f09-bd81-d4544c4f032c req-ce7c1064-56e0-47d7-90b8-7385c36c794b service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Received unexpected event network-vif-plugged-ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 for instance with vm_state rescued and task_state unrescuing.
Oct 16 11:28:34 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:34 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:36 user nova-compute[74683]: DEBUG nova.compute.manager [req-e3cc5303-364b-4195-a00a-90982528b0cc req-cec13828-fa23-43ba-805b-565d3224951c service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Received event network-vif-plugged-ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:28:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e3cc5303-364b-4195-a00a-90982528b0cc req-cec13828-fa23-43ba-805b-565d3224951c service nova] Acquiring lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:28:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e3cc5303-364b-4195-a00a-90982528b0cc req-cec13828-fa23-43ba-805b-565d3224951c service nova] Lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:28:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e3cc5303-364b-4195-a00a-90982528b0cc req-cec13828-fa23-43ba-805b-565d3224951c service nova] Lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:28:36 user nova-compute[74683]: DEBUG nova.compute.manager [req-e3cc5303-364b-4195-a00a-90982528b0cc req-cec13828-fa23-43ba-805b-565d3224951c service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] No waiting events found dispatching network-vif-plugged-ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:28:36 user nova-compute[74683]: WARNING nova.compute.manager [req-e3cc5303-364b-4195-a00a-90982528b0cc req-cec13828-fa23-43ba-805b-565d3224951c service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Received unexpected event network-vif-plugged-ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 for instance with vm_state rescued and task_state unrescuing.
Oct 16 11:28:36 user nova-compute[74683]: DEBUG nova.compute.manager [req-e3cc5303-364b-4195-a00a-90982528b0cc req-cec13828-fa23-43ba-805b-565d3224951c service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Received event network-vif-plugged-ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:28:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e3cc5303-364b-4195-a00a-90982528b0cc req-cec13828-fa23-43ba-805b-565d3224951c service nova] Acquiring lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:28:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e3cc5303-364b-4195-a00a-90982528b0cc req-cec13828-fa23-43ba-805b-565d3224951c service nova] Lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:28:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e3cc5303-364b-4195-a00a-90982528b0cc req-cec13828-fa23-43ba-805b-565d3224951c service nova] Lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:28:36 user nova-compute[74683]: DEBUG nova.compute.manager [req-e3cc5303-364b-4195-a00a-90982528b0cc req-cec13828-fa23-43ba-805b-565d3224951c service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] No waiting events found dispatching network-vif-plugged-ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:28:36 user nova-compute[74683]: WARNING nova.compute.manager [req-e3cc5303-364b-4195-a00a-90982528b0cc req-cec13828-fa23-43ba-805b-565d3224951c service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Received unexpected event network-vif-plugged-ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 for instance with vm_state rescued and task_state unrescuing.
Oct 16 11:28:36 user nova-compute[74683]: DEBUG nova.compute.manager [None req-51c2a841-1956-43e9-a47d-bfb7e541fcc6 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:28:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-3f6284b5-5277-4664-bbbc-a16c311af7a9 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Acquiring lock "6300da82-2079-455c-8ab2-9fd13ce9e825" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:28:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-3f6284b5-5277-4664-bbbc-a16c311af7a9 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Lock "6300da82-2079-455c-8ab2-9fd13ce9e825" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:28:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-3f6284b5-5277-4664-bbbc-a16c311af7a9 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Acquiring lock "6300da82-2079-455c-8ab2-9fd13ce9e825-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:28:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-3f6284b5-5277-4664-bbbc-a16c311af7a9 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Lock "6300da82-2079-455c-8ab2-9fd13ce9e825-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:28:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-3f6284b5-5277-4664-bbbc-a16c311af7a9 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Lock "6300da82-2079-455c-8ab2-9fd13ce9e825-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:28:38 user nova-compute[74683]: INFO nova.compute.manager [None req-3f6284b5-5277-4664-bbbc-a16c311af7a9 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Terminating instance
Oct 16 11:28:38 user nova-compute[74683]: DEBUG nova.compute.manager [None req-3f6284b5-5277-4664-bbbc-a16c311af7a9 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Start destroying the instance on the hypervisor. {{(pid=74683) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 11:28:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:39 user nova-compute[74683]: DEBUG nova.compute.manager [req-3bb89d09-6cee-4f4d-a768-18121040471c req-9f56a6d1-5107-431b-bb51-bc81fb2e917f service nova] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Received event network-vif-unplugged-8f938207-dce7-4aca-a123-d902f44fd036 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:28:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-3bb89d09-6cee-4f4d-a768-18121040471c req-9f56a6d1-5107-431b-bb51-bc81fb2e917f service nova] Acquiring lock "6300da82-2079-455c-8ab2-9fd13ce9e825-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:28:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-3bb89d09-6cee-4f4d-a768-18121040471c req-9f56a6d1-5107-431b-bb51-bc81fb2e917f service nova] Lock "6300da82-2079-455c-8ab2-9fd13ce9e825-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:28:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-3bb89d09-6cee-4f4d-a768-18121040471c req-9f56a6d1-5107-431b-bb51-bc81fb2e917f service nova] Lock "6300da82-2079-455c-8ab2-9fd13ce9e825-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:28:39 user nova-compute[74683]: DEBUG nova.compute.manager [req-3bb89d09-6cee-4f4d-a768-18121040471c req-9f56a6d1-5107-431b-bb51-bc81fb2e917f service nova] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] No waiting events found dispatching network-vif-unplugged-8f938207-dce7-4aca-a123-d902f44fd036 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:28:39 user nova-compute[74683]: DEBUG nova.compute.manager [req-3bb89d09-6cee-4f4d-a768-18121040471c req-9f56a6d1-5107-431b-bb51-bc81fb2e917f service nova] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Received event network-vif-unplugged-8f938207-dce7-4aca-a123-d902f44fd036 for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 11:28:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:39 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Instance destroyed successfully.
Oct 16 11:28:39 user nova-compute[74683]: DEBUG nova.objects.instance [None req-3f6284b5-5277-4664-bbbc-a16c311af7a9 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Lazy-loading 'resources' on Instance uuid 6300da82-2079-455c-8ab2-9fd13ce9e825 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:28:39 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-3f6284b5-5277-4664-bbbc-a16c311af7a9 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-16T11:24:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1489120306',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2008791236',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOa68DSLJRhCANBPDVkGCmU7Av1Udl+gScSEyqoeBUYh/e3GGLjoSHFS9vMAG6uKONY2e/UESa8D9i77smMN1onMgIj8+r/Pjj2s1FLJPej0ypSN81xjWnl2bNPHPjSwJQ==',key_name='tempest-keypair-1562506741',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:26:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2acac594f9894f11a7cca5125c538a0b',ramdisk_id='',reservation_id='r-n6dkjkrr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1612434098',owner_user_name='tempest-ServerActionsV293TestJSON-1612434098-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:26:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63e1538b7b554db3811903f3df41eee3',uuid=6300da82-2079-455c-8ab2-9fd13ce9e825,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f938207-dce7-4aca-a123-d902f44fd036", "address": "fa:16:3e:fc:f8:bc", "network": {"id": "438d9722-66f5-44e2-b7ee-3e4c9dbe1928", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1131023911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2acac594f9894f11a7cca5125c538a0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f938207-dc", "ovs_interfaceid": "8f938207-dce7-4aca-a123-d902f44fd036", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:28:39 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-3f6284b5-5277-4664-bbbc-a16c311af7a9 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Converting VIF {"id": "8f938207-dce7-4aca-a123-d902f44fd036", "address": "fa:16:3e:fc:f8:bc", "network": {"id": "438d9722-66f5-44e2-b7ee-3e4c9dbe1928", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1131023911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2acac594f9894f11a7cca5125c538a0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f938207-dc", "ovs_interfaceid": "8f938207-dce7-4aca-a123-d902f44fd036", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:28:39 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-3f6284b5-5277-4664-bbbc-a16c311af7a9 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:f8:bc,bridge_name='br-int',has_traffic_filtering=True,id=8f938207-dce7-4aca-a123-d902f44fd036,network=Network(438d9722-66f5-44e2-b7ee-3e4c9dbe1928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f938207-dc') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:28:39 user nova-compute[74683]: DEBUG os_vif [None req-3f6284b5-5277-4664-bbbc-a16c311af7a9 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:f8:bc,bridge_name='br-int',has_traffic_filtering=True,id=8f938207-dce7-4aca-a123-d902f44fd036,network=Network(438d9722-66f5-44e2-b7ee-3e4c9dbe1928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f938207-dc') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:28:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f938207-dc, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:28:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=810a1850-a34e-444f-9ee9-d3945ea2536c) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:28:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:28:39 user nova-compute[74683]: INFO os_vif [None req-3f6284b5-5277-4664-bbbc-a16c311af7a9 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:f8:bc,bridge_name='br-int',has_traffic_filtering=True,id=8f938207-dce7-4aca-a123-d902f44fd036,network=Network(438d9722-66f5-44e2-b7ee-3e4c9dbe1928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f938207-dc')
Oct 16 11:28:39 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f6284b5-5277-4664-bbbc-a16c311af7a9 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] calling os-brick to detach iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 11:28:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6284b5-5277-4664-bbbc-a16c311af7a9 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, {'target_iqn': 'iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KhyBgrAX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:28:39 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-3f6284b5-5277-4664-bbbc-a16c311af7a9 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:28:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-3f6284b5-5277-4664-bbbc-a16c311af7a9 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:28:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-3f6284b5-5277-4664-bbbc-a16c311af7a9 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:28:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:28:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:28:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f383ca70-153e-4f93-ad12-d6735df207d5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c8de5eea-f1e9-4670-9f08-f0aad8da8dba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:28:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6284b5-5277-4664-bbbc-a16c311af7a9 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 11:28:39 user nova-compute[74683]: No targets found.
Oct 16 11:28:39 user nova-compute[74683]: iSNS:
Oct 16 11:28:39 user nova-compute[74683]: No targets found.
Oct 16 11:28:39 user nova-compute[74683]: STATIC:
Oct 16 11:28:39 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152
Oct 16 11:28:39 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:28:39 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:28:39 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354
Oct 16 11:28:39 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:28:39 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:28:39 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d
Oct 16 11:28:39 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:28:39 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:28:39 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:c8de5eea-f1e9-4670-9f08-f0aad8da8dba
Oct 16 11:28:39 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:28:39 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:28:39 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb
Oct 16 11:28:39 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:28:39 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:28:39 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0
Oct 16 11:28:39 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:28:39 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:28:39 user nova-compute[74683]: FIRMWARE:
Oct 16 11:28:39 user nova-compute[74683]: No targets found.
Oct 16 11:28:39 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:28:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6284b5-5277-4664-bbbc-a16c311af7a9 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 11:28:39 user nova-compute[74683]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 11:28:39 user nova-compute[74683]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74683) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 11:28:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6284b5-5277-4664-bbbc-a16c311af7a9 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d', 0)] {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 11:28:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:28:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:28:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f82a56-c7f3-4078-ad4d-c2f11a9e5fa8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8de5eea-f1e9-4670-9f08-f0aad8da8dba\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:28:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:28:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:28:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[5093f77b-efd5-4ffa-afe7-7a4a6b4442bd]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8de5eea-f1e9-4670-9f08-f0aad8da8dba (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:28:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6284b5-5277-4664-bbbc-a16c311af7a9 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:28:39 user nova-compute[74683]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)
Oct 16 11:28:39 user nova-compute[74683]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)
Oct 16 11:28:39 user nova-compute[74683]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 (non-flash)
Oct 16 11:28:39 user nova-compute[74683]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d (non-flash)
Oct 16 11:28:39 user nova-compute[74683]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8de5eea-f1e9-4670-9f08-f0aad8da8dba (non-flash)
Oct 16 11:28:39 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:28:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6284b5-5277-4664-bbbc-a16c311af7a9 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:28:39 user nova-compute[74683]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)
Oct 16 11:28:39 user nova-compute[74683]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)
Oct 16 11:28:39 user nova-compute[74683]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 (non-flash)
Oct 16 11:28:39 user nova-compute[74683]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d (non-flash)
Oct 16 11:28:39 user nova-compute[74683]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8de5eea-f1e9-4670-9f08-f0aad8da8dba (non-flash)
Oct 16 11:28:39 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:28:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6284b5-5277-4664-bbbc-a16c311af7a9 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda4c7c7ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d'): ({'sde'}, set())}) {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 11:28:39 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-3f6284b5-5277-4664-bbbc-a16c311af7a9 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Removing single pathed devices sde {{(pid=74683) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 11:28:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:28:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:28:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f775cd3-1032-4551-9d74-9b0d8a46ae13]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:28:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:28:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:28:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87e32cc-96cc-456d-899e-f6ee4562c0a3]: (4, ('ok\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:28:39 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-3f6284b5-5277-4664-bbbc-a16c311af7a9 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Flushing IO for device /dev/sde {{(pid=74683) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 11:28:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:28:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:28:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc580a9-aee4-450a-bce9-ea9a22b22c82]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:28:39 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-3f6284b5-5277-4664-bbbc-a16c311af7a9 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74683) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 11:28:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:28:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.078s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:28:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d435acd-bf31-44e5-865f-ee8942f58cbe]: (4, ('1', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:28:39 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-3f6284b5-5277-4664-bbbc-a16c311af7a9 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 11:28:39 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-3f6284b5-5277-4664-bbbc-a16c311af7a9 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] SCSI volumes sde have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 11:28:39 user nova-compute[74683]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOe6b1a124-8248bef1cd5fc058', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e6b1a124', '/dev/disk/by-id/scsi-23832343862656631') {{(pid=85666) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 16 11:28:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[822297a3-ac55-4a80-96c7-04ce5815151e]: (4, None) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:28:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6284b5-5277-4664-bbbc-a16c311af7a9 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d')] {{(pid=74683) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 11:28:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:28:40 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:28:40 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[098531ba-422e-4a46-8684-f45c703c5767]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:28:40 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6284b5-5277-4664-bbbc-a16c311af7a9 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:28:40 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d -p 172.16.0.220:3260 --logout {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:28:40 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:28:40 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b137a8-50d3-41c5-ba83-97b4d09af66e]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:28:40 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6284b5-5277-4664-bbbc-a16c311af7a9 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d, portal: 172.16.0.220,3260]
Oct 16 11:28:40 user nova-compute[74683]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d, portal: 172.16.0.220,3260] successful.
Oct 16 11:28:40 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:28:40 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d -p 172.16.0.220:3260 --op delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:28:40 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d2a9abe-890e-4bae-9d88-b64305a6ca3d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:28:40 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd602b2d-e535-4e6f-9f70-a00d356a73a2]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:28:40 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6284b5-5277-4664-bbbc-a16c311af7a9 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:28:40 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-3f6284b5-5277-4664-bbbc-a16c311af7a9 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.405s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:28:40 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6284b5-5277-4664-bbbc-a16c311af7a9 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] <== disconnect_volume: return (406ms) None {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:28:40 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f6284b5-5277-4664-bbbc-a16c311af7a9 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Disconnected iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 11:28:40 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-3f6284b5-5277-4664-bbbc-a16c311af7a9 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Deleting instance files /opt/stack/data/nova/instances/6300da82-2079-455c-8ab2-9fd13ce9e825_del
Oct 16 11:28:40 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-3f6284b5-5277-4664-bbbc-a16c311af7a9 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Deletion of /opt/stack/data/nova/instances/6300da82-2079-455c-8ab2-9fd13ce9e825_del complete
Oct 16 11:28:40 user nova-compute[74683]: INFO nova.compute.manager [None req-3f6284b5-5277-4664-bbbc-a16c311af7a9 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Took 1.33 seconds to destroy the instance on the hypervisor.
Oct 16 11:28:40 user nova-compute[74683]: DEBUG oslo.service.loopingcall [None req-3f6284b5-5277-4664-bbbc-a16c311af7a9 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74683) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 11:28:40 user nova-compute[74683]: DEBUG nova.compute.manager [-] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Deallocating network for instance {{(pid=74683) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 11:28:40 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] deallocate_for_instance() {{(pid=74683) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 11:28:40 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:28:40 user nova-compute[74683]: INFO nova.compute.manager [-] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Took 0.76 seconds to deallocate network for instance.
Oct 16 11:28:40 user nova-compute[74683]: DEBUG nova.compute.manager [req-b5585b8f-8a2f-4a62-9c3a-b2cf74f3c97f req-6f57d9e9-6cb9-47bd-bc36-ed5fd8aa8c8a service nova] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Received event network-vif-deleted-8f938207-dce7-4aca-a123-d902f44fd036 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:28:40 user nova-compute[74683]: INFO nova.compute.manager [req-b5585b8f-8a2f-4a62-9c3a-b2cf74f3c97f req-6f57d9e9-6cb9-47bd-bc36-ed5fd8aa8c8a service nova] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Neutron deleted interface 8f938207-dce7-4aca-a123-d902f44fd036; detaching it from the instance and deleting it from the info cache
Oct 16 11:28:40 user nova-compute[74683]: DEBUG nova.network.neutron [req-b5585b8f-8a2f-4a62-9c3a-b2cf74f3c97f req-6f57d9e9-6cb9-47bd-bc36-ed5fd8aa8c8a service nova] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:28:41 user nova-compute[74683]: DEBUG nova.compute.manager [req-b5585b8f-8a2f-4a62-9c3a-b2cf74f3c97f req-6f57d9e9-6cb9-47bd-bc36-ed5fd8aa8c8a service nova] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Detach interface failed, port_id=8f938207-dce7-4aca-a123-d902f44fd036, reason: Instance 6300da82-2079-455c-8ab2-9fd13ce9e825 could not be found. {{(pid=74683) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 16 11:28:41 user nova-compute[74683]: DEBUG nova.compute.manager [req-160edb33-1b32-4b34-b641-4e0e7e033708 req-3c55ede0-c906-4583-b1ed-48826aefa57f service nova] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Received event network-vif-plugged-8f938207-dce7-4aca-a123-d902f44fd036 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:28:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-160edb33-1b32-4b34-b641-4e0e7e033708 req-3c55ede0-c906-4583-b1ed-48826aefa57f service nova] Acquiring lock "6300da82-2079-455c-8ab2-9fd13ce9e825-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:28:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-160edb33-1b32-4b34-b641-4e0e7e033708 req-3c55ede0-c906-4583-b1ed-48826aefa57f service nova] Lock "6300da82-2079-455c-8ab2-9fd13ce9e825-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:28:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-160edb33-1b32-4b34-b641-4e0e7e033708 req-3c55ede0-c906-4583-b1ed-48826aefa57f service nova] Lock "6300da82-2079-455c-8ab2-9fd13ce9e825-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:28:41 user nova-compute[74683]: DEBUG nova.compute.manager [req-160edb33-1b32-4b34-b641-4e0e7e033708 req-3c55ede0-c906-4583-b1ed-48826aefa57f service nova] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] No waiting events found dispatching network-vif-plugged-8f938207-dce7-4aca-a123-d902f44fd036 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:28:41 user nova-compute[74683]: WARNING nova.compute.manager [req-160edb33-1b32-4b34-b641-4e0e7e033708 req-3c55ede0-c906-4583-b1ed-48826aefa57f service nova] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Received unexpected event network-vif-plugged-8f938207-dce7-4aca-a123-d902f44fd036 for instance with vm_state active and task_state deleting.
Oct 16 11:28:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:41 user nova-compute[74683]: INFO nova.compute.manager [None req-3f6284b5-5277-4664-bbbc-a16c311af7a9 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Took 0.83 seconds to detach 1 volumes for instance.
Oct 16 11:28:41 user nova-compute[74683]: DEBUG nova.compute.manager [None req-3f6284b5-5277-4664-bbbc-a16c311af7a9 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] [instance: 6300da82-2079-455c-8ab2-9fd13ce9e825] Deleting volume: 7d2a9abe-890e-4bae-9d88-b64305a6ca3d {{(pid=74683) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 16 11:28:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-3f6284b5-5277-4664-bbbc-a16c311af7a9 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:28:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-3f6284b5-5277-4664-bbbc-a16c311af7a9 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:28:42 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-3f6284b5-5277-4664-bbbc-a16c311af7a9 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:28:42 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-3f6284b5-5277-4664-bbbc-a16c311af7a9 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:28:42 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-3f6284b5-5277-4664-bbbc-a16c311af7a9 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.403s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:28:42 user nova-compute[74683]: INFO nova.scheduler.client.report [None req-3f6284b5-5277-4664-bbbc-a16c311af7a9 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Deleted allocations for instance 6300da82-2079-455c-8ab2-9fd13ce9e825
Oct 16 11:28:42 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-3f6284b5-5277-4664-bbbc-a16c311af7a9 tempest-ServerActionsV293TestJSON-1612434098 tempest-ServerActionsV293TestJSON-1612434098-project-member] Lock "6300da82-2079-455c-8ab2-9fd13ce9e825" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.643s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:28:44 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:45 user nova-compute[74683]: DEBUG nova.compute.manager [req-75cfc819-1c9b-45f1-bfd0-e5e836098b45 req-8cfcbfa9-b323-4124-ae53-e3d163b3d7bc service nova] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Received event network-changed-802af945-243b-44cf-9f6c-0c3185f1d734 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:28:45 user nova-compute[74683]: DEBUG nova.compute.manager [req-75cfc819-1c9b-45f1-bfd0-e5e836098b45 req-8cfcbfa9-b323-4124-ae53-e3d163b3d7bc service nova] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Refreshing instance network info cache due to event network-changed-802af945-243b-44cf-9f6c-0c3185f1d734. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:28:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-75cfc819-1c9b-45f1-bfd0-e5e836098b45 req-8cfcbfa9-b323-4124-ae53-e3d163b3d7bc service nova] Acquiring lock "refresh_cache-7488aa44-fdba-47b6-8857-0f46df4f66b9" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:28:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-75cfc819-1c9b-45f1-bfd0-e5e836098b45 req-8cfcbfa9-b323-4124-ae53-e3d163b3d7bc service nova] Acquired lock "refresh_cache-7488aa44-fdba-47b6-8857-0f46df4f66b9" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:28:45 user nova-compute[74683]: DEBUG nova.network.neutron [req-75cfc819-1c9b-45f1-bfd0-e5e836098b45 req-8cfcbfa9-b323-4124-ae53-e3d163b3d7bc service nova] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Refreshing network info cache for port 802af945-243b-44cf-9f6c-0c3185f1d734 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:28:46 user nova-compute[74683]: DEBUG nova.network.neutron [req-75cfc819-1c9b-45f1-bfd0-e5e836098b45 req-8cfcbfa9-b323-4124-ae53-e3d163b3d7bc service nova] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Updated VIF entry in instance network info cache for port 802af945-243b-44cf-9f6c-0c3185f1d734. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:28:46 user nova-compute[74683]: DEBUG nova.network.neutron [req-75cfc819-1c9b-45f1-bfd0-e5e836098b45 req-8cfcbfa9-b323-4124-ae53-e3d163b3d7bc service nova] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Updating instance_info_cache with network_info: [{"id": "802af945-243b-44cf-9f6c-0c3185f1d734", "address": "fa:16:3e:c8:72:bc", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap802af945-24", "ovs_interfaceid": "802af945-243b-44cf-9f6c-0c3185f1d734", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:28:46 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-75cfc819-1c9b-45f1-bfd0-e5e836098b45 req-8cfcbfa9-b323-4124-ae53-e3d163b3d7bc service nova] Releasing lock "refresh_cache-7488aa44-fdba-47b6-8857-0f46df4f66b9" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:28:46 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-bbe66cc2-02a4-448f-b786-3bdab842893c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquiring lock "7488aa44-fdba-47b6-8857-0f46df4f66b9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:28:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-bbe66cc2-02a4-448f-b786-3bdab842893c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "7488aa44-fdba-47b6-8857-0f46df4f66b9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:28:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-bbe66cc2-02a4-448f-b786-3bdab842893c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquiring lock "7488aa44-fdba-47b6-8857-0f46df4f66b9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:28:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-bbe66cc2-02a4-448f-b786-3bdab842893c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "7488aa44-fdba-47b6-8857-0f46df4f66b9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:28:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-bbe66cc2-02a4-448f-b786-3bdab842893c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "7488aa44-fdba-47b6-8857-0f46df4f66b9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:28:47 user nova-compute[74683]: INFO nova.compute.manager [None req-bbe66cc2-02a4-448f-b786-3bdab842893c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Terminating instance
Oct 16 11:28:47 user nova-compute[74683]: DEBUG nova.compute.manager [None req-bbe66cc2-02a4-448f-b786-3bdab842893c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Start destroying the instance on the hypervisor. {{(pid=74683) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 11:28:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:47 user nova-compute[74683]: DEBUG nova.compute.manager [req-b849f53c-fdfa-4389-a7e4-2e3611e839d4 req-965b6285-f57f-4a03-8064-23d7ff6e6305 service nova] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Received event network-vif-unplugged-802af945-243b-44cf-9f6c-0c3185f1d734 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:28:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b849f53c-fdfa-4389-a7e4-2e3611e839d4 req-965b6285-f57f-4a03-8064-23d7ff6e6305 service nova] Acquiring lock "7488aa44-fdba-47b6-8857-0f46df4f66b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:28:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b849f53c-fdfa-4389-a7e4-2e3611e839d4 req-965b6285-f57f-4a03-8064-23d7ff6e6305 service nova] Lock "7488aa44-fdba-47b6-8857-0f46df4f66b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:28:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b849f53c-fdfa-4389-a7e4-2e3611e839d4 req-965b6285-f57f-4a03-8064-23d7ff6e6305 service nova] Lock "7488aa44-fdba-47b6-8857-0f46df4f66b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:28:47 user nova-compute[74683]: DEBUG nova.compute.manager [req-b849f53c-fdfa-4389-a7e4-2e3611e839d4 req-965b6285-f57f-4a03-8064-23d7ff6e6305 service nova] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] No waiting events found dispatching network-vif-unplugged-802af945-243b-44cf-9f6c-0c3185f1d734 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:28:47 user nova-compute[74683]: DEBUG nova.compute.manager [req-b849f53c-fdfa-4389-a7e4-2e3611e839d4 req-965b6285-f57f-4a03-8064-23d7ff6e6305 service nova] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Received event network-vif-unplugged-802af945-243b-44cf-9f6c-0c3185f1d734 for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 11:28:47 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Instance destroyed successfully.
Oct 16 11:28:47 user nova-compute[74683]: DEBUG nova.objects.instance [None req-bbe66cc2-02a4-448f-b786-3bdab842893c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lazy-loading 'resources' on Instance uuid 7488aa44-fdba-47b6-8857-0f46df4f66b9 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:28:47 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-bbe66cc2-02a4-448f-b786-3bdab842893c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:26:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1442351814',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1442351814',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1442351814',id=32,image_ref='d0c7b4e1-d49a-46bb-a596-4d580be38324',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqAkv8r22a9Mj/D4+PljzDoahMZD25nouypHV/4U3vg/JXpEL4dzftMZfrHEzkF9li146bGztNTkoSRfh31WIR+ZjYa5BIzG1IsnaUhs1f1Av9EL+5pHmfQWaP9mVF+lQ==',key_name='tempest-keypair-574370236',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:27:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2aefabef9e42412f8309f490dcfecc79',ramdisk_id='',reservation_id='r-ur37yp1v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-953001121',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-953001121-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-953001121',owner_user_name='tempest-TestVolumeBootPattern-953001121-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:27:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a463a84e332543dfbc03b81518f82be1',uuid=7488aa44-fdba-47b6-8857-0f46df4f66b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "802af945-243b-44cf-9f6c-0c3185f1d734", "address": "fa:16:3e:c8:72:bc", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap802af945-24", "ovs_interfaceid": "802af945-243b-44cf-9f6c-0c3185f1d734", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:28:47 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-bbe66cc2-02a4-448f-b786-3bdab842893c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Converting VIF {"id": "802af945-243b-44cf-9f6c-0c3185f1d734", "address": "fa:16:3e:c8:72:bc", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap802af945-24", "ovs_interfaceid": "802af945-243b-44cf-9f6c-0c3185f1d734", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:28:47 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-bbe66cc2-02a4-448f-b786-3bdab842893c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c8:72:bc,bridge_name='br-int',has_traffic_filtering=True,id=802af945-243b-44cf-9f6c-0c3185f1d734,network=Network(00883fc4-0b74-4afd-9043-82e2933faab3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap802af945-24') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:28:47 user nova-compute[74683]: DEBUG os_vif [None req-bbe66cc2-02a4-448f-b786-3bdab842893c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:72:bc,bridge_name='br-int',has_traffic_filtering=True,id=802af945-243b-44cf-9f6c-0c3185f1d734,network=Network(00883fc4-0b74-4afd-9043-82e2933faab3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap802af945-24') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:28:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap802af945-24, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:28:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:28:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4dbce761-79cc-4658-b80f-4b0804d2e04c) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:28:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:47 user nova-compute[74683]: INFO os_vif [None req-bbe66cc2-02a4-448f-b786-3bdab842893c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:72:bc,bridge_name='br-int',has_traffic_filtering=True,id=802af945-243b-44cf-9f6c-0c3185f1d734,network=Network(00883fc4-0b74-4afd-9043-82e2933faab3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap802af945-24')
Oct 16 11:28:47 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbe66cc2-02a4-448f-b786-3bdab842893c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] calling os-brick to detach iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 11:28:47 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbe66cc2-02a4-448f-b786-3bdab842893c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, {'target_iqn': 'iqn.2010-10.org.openstack:c8de5eea-f1e9-4670-9f08-f0aad8da8dba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'utWInVAg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:28:47 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-bbe66cc2-02a4-448f-b786-3bdab842893c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:28:47 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-bbe66cc2-02a4-448f-b786-3bdab842893c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:28:47 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-bbe66cc2-02a4-448f-b786-3bdab842893c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:28:47 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:28:47 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:28:47 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[138c3e8d-8502-4f55-a554-6cc8a53af165]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c8de5eea-f1e9-4670-9f08-f0aad8da8dba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:28:47 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbe66cc2-02a4-448f-b786-3bdab842893c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 11:28:47 user nova-compute[74683]: No targets found.
Oct 16 11:28:47 user nova-compute[74683]: iSNS:
Oct 16 11:28:47 user nova-compute[74683]: No targets found.
Oct 16 11:28:47 user nova-compute[74683]: STATIC:
Oct 16 11:28:47 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152
Oct 16 11:28:47 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:28:47 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:28:47 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354
Oct 16 11:28:47 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:28:47 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:28:47 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:c8de5eea-f1e9-4670-9f08-f0aad8da8dba
Oct 16 11:28:47 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:28:47 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:28:47 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb
Oct 16 11:28:47 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:28:47 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:28:47 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0
Oct 16 11:28:47 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:28:47 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:28:47 user nova-compute[74683]: FIRMWARE:
Oct 16 11:28:47 user nova-compute[74683]: No targets found.
Oct 16 11:28:47 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:28:48 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbe66cc2-02a4-448f-b786-3bdab842893c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 11:28:48 user nova-compute[74683]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 11:28:48 user nova-compute[74683]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74683) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 11:28:48 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbe66cc2-02a4-448f-b786-3bdab842893c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8de5eea-f1e9-4670-9f08-f0aad8da8dba', 0)] {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 11:28:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:28:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:28:48 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b997b5-2226-4ec9-9764-0275e7e123ed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8de5eea-f1e9-4670-9f08-f0aad8da8dba\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:28:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:28:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:28:48 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ccf634f-756f-4941-947e-3ae17009f190]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8de5eea-f1e9-4670-9f08-f0aad8da8dba (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:28:48 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbe66cc2-02a4-448f-b786-3bdab842893c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:28:48 user nova-compute[74683]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)
Oct 16 11:28:48 user nova-compute[74683]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)
Oct 16 11:28:48 user nova-compute[74683]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 (non-flash)
Oct 16 11:28:48 user nova-compute[74683]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8de5eea-f1e9-4670-9f08-f0aad8da8dba (non-flash)
Oct 16 11:28:48 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:28:48 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbe66cc2-02a4-448f-b786-3bdab842893c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:28:48 user nova-compute[74683]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)
Oct 16 11:28:48 user nova-compute[74683]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)
Oct 16 11:28:48 user nova-compute[74683]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 (non-flash)
Oct 16 11:28:48 user nova-compute[74683]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8de5eea-f1e9-4670-9f08-f0aad8da8dba (non-flash)
Oct 16 11:28:48 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:28:48 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbe66cc2-02a4-448f-b786-3bdab842893c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda4c615000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8de5eea-f1e9-4670-9f08-f0aad8da8dba'): ({'sdh'}, set())}) {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 11:28:48 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-bbe66cc2-02a4-448f-b786-3bdab842893c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Removing single pathed devices sdh {{(pid=74683) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 11:28:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:28:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:28:48 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b9841b-1f96-4183-968b-816e925493f0]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:28:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:28:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:28:48 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01b4041-7702-46c5-9fbe-1c0cc1ab3dde]: (4, ('ok\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:28:48 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-bbe66cc2-02a4-448f-b786-3bdab842893c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Flushing IO for device /dev/sdh {{(pid=74683) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 11:28:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:28:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:28:48 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[671439b6-6149-4d0f-8e57-82a5917a237f]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:28:48 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-bbe66cc2-02a4-448f-b786-3bdab842893c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74683) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 11:28:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:28:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.043s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:28:48 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f619e0e9-d3fe-4edb-8155-1781020d132c]: (4, ('1', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:28:48 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-bbe66cc2-02a4-448f-b786-3bdab842893c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 11:28:48 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-bbe66cc2-02a4-448f-b786-3bdab842893c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] SCSI volumes sdh have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 11:28:48 user nova-compute[74683]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23764663132356237', '/dev/disk/by-id/scsi-1SCST_BIOf38c4ea9-7df125b7cd2f9bd2', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f38c4ea9') {{(pid=85666) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 16 11:28:48 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d971c43-f64c-4ecd-b19e-be3db59c6af1]: (4, None) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:28:48 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbe66cc2-02a4-448f-b786-3bdab842893c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8de5eea-f1e9-4670-9f08-f0aad8da8dba')] {{(pid=74683) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 11:28:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8de5eea-f1e9-4670-9f08-f0aad8da8dba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:28:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8de5eea-f1e9-4670-9f08-f0aad8da8dba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:28:48 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4980827-4c6a-442e-aefd-300122ff38f2]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:28:48 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbe66cc2-02a4-448f-b786-3bdab842893c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:28:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8de5eea-f1e9-4670-9f08-f0aad8da8dba -p 172.16.0.220:3260 --logout {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:28:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8de5eea-f1e9-4670-9f08-f0aad8da8dba -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:28:48 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb65a3e-0c3a-4805-aa7e-b51673a49ad7]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:c8de5eea-f1e9-4670-9f08-f0aad8da8dba, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:c8de5eea-f1e9-4670-9f08-f0aad8da8dba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:28:48 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbe66cc2-02a4-448f-b786-3bdab842893c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:c8de5eea-f1e9-4670-9f08-f0aad8da8dba, portal: 172.16.0.220,3260]
Oct 16 11:28:48 user nova-compute[74683]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:c8de5eea-f1e9-4670-9f08-f0aad8da8dba, portal: 172.16.0.220,3260] successful.
Oct 16 11:28:48 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:28:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8de5eea-f1e9-4670-9f08-f0aad8da8dba -p 172.16.0.220:3260 --op delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:28:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8de5eea-f1e9-4670-9f08-f0aad8da8dba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:28:48 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[30306194-23cc-48c8-987e-a3caf2b60004]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:28:48 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbe66cc2-02a4-448f-b786-3bdab842893c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:28:48 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-bbe66cc2-02a4-448f-b786-3bdab842893c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:28:48 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbe66cc2-02a4-448f-b786-3bdab842893c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] <== disconnect_volume: return (333ms) None {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:28:48 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbe66cc2-02a4-448f-b786-3bdab842893c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Disconnected iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 11:28:48 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-bbe66cc2-02a4-448f-b786-3bdab842893c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Deleting instance files /opt/stack/data/nova/instances/7488aa44-fdba-47b6-8857-0f46df4f66b9_del
Oct 16 11:28:48 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-bbe66cc2-02a4-448f-b786-3bdab842893c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Deletion of /opt/stack/data/nova/instances/7488aa44-fdba-47b6-8857-0f46df4f66b9_del complete
Oct 16 11:28:48 user nova-compute[74683]: INFO nova.compute.manager [None req-bbe66cc2-02a4-448f-b786-3bdab842893c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Took 1.18 seconds to destroy the instance on the hypervisor.
Oct 16 11:28:48 user nova-compute[74683]: DEBUG oslo.service.loopingcall [None req-bbe66cc2-02a4-448f-b786-3bdab842893c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74683) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 11:28:48 user nova-compute[74683]: DEBUG nova.compute.manager [-] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Deallocating network for instance {{(pid=74683) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 11:28:48 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] deallocate_for_instance() {{(pid=74683) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 11:28:48 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:28:49 user nova-compute[74683]: INFO nova.compute.manager [-] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Took 0.62 seconds to deallocate network for instance.
Oct 16 11:28:49 user nova-compute[74683]: DEBUG nova.compute.manager [req-7c6c6975-d907-4023-a35d-4a19d5fc44aa req-90634b0b-db8b-4676-838b-88bb5ee0cab5 service nova] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Received event network-vif-deleted-802af945-243b-44cf-9f6c-0c3185f1d734 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:28:49 user nova-compute[74683]: INFO nova.compute.manager [req-7c6c6975-d907-4023-a35d-4a19d5fc44aa req-90634b0b-db8b-4676-838b-88bb5ee0cab5 service nova] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Neutron deleted interface 802af945-243b-44cf-9f6c-0c3185f1d734; detaching it from the instance and deleting it from the info cache
Oct 16 11:28:49 user nova-compute[74683]: DEBUG nova.network.neutron [req-7c6c6975-d907-4023-a35d-4a19d5fc44aa req-90634b0b-db8b-4676-838b-88bb5ee0cab5 service nova] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:28:49 user nova-compute[74683]: DEBUG nova.compute.manager [req-7c6c6975-d907-4023-a35d-4a19d5fc44aa req-90634b0b-db8b-4676-838b-88bb5ee0cab5 service nova] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Detach interface failed, port_id=802af945-243b-44cf-9f6c-0c3185f1d734, reason: Instance 7488aa44-fdba-47b6-8857-0f46df4f66b9 could not be found. {{(pid=74683) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 16 11:28:49 user nova-compute[74683]: DEBUG nova.compute.manager [req-915facf7-db67-4218-a13c-fba552612b92 req-259e26cb-eabf-45c3-81bc-78f071075346 service nova] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Received event network-vif-plugged-802af945-243b-44cf-9f6c-0c3185f1d734 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:28:49 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-915facf7-db67-4218-a13c-fba552612b92 req-259e26cb-eabf-45c3-81bc-78f071075346 service nova] Acquiring lock "7488aa44-fdba-47b6-8857-0f46df4f66b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:28:49 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-915facf7-db67-4218-a13c-fba552612b92 req-259e26cb-eabf-45c3-81bc-78f071075346 service nova] Lock "7488aa44-fdba-47b6-8857-0f46df4f66b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:28:49 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-915facf7-db67-4218-a13c-fba552612b92 req-259e26cb-eabf-45c3-81bc-78f071075346 service nova] Lock "7488aa44-fdba-47b6-8857-0f46df4f66b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:28:49 user nova-compute[74683]: DEBUG nova.compute.manager [req-915facf7-db67-4218-a13c-fba552612b92 req-259e26cb-eabf-45c3-81bc-78f071075346 service nova] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] No waiting events found dispatching network-vif-plugged-802af945-243b-44cf-9f6c-0c3185f1d734 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:28:49 user nova-compute[74683]: WARNING nova.compute.manager [req-915facf7-db67-4218-a13c-fba552612b92 req-259e26cb-eabf-45c3-81bc-78f071075346 service nova] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Received unexpected event network-vif-plugged-802af945-243b-44cf-9f6c-0c3185f1d734 for instance with vm_state active and task_state deleting.
Oct 16 11:28:51 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:52 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-713ac547-00cc-4063-98bc-04a708b71de3 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4b4eaccb-e068-4e8a-9084-16229815b1d7 is timed out.
Oct 16 11:28:52 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-713ac547-00cc-4063-98bc-04a708b71de3 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Successfully detached device vdb from instance 4b4eaccb-e068-4e8a-9084-16229815b1d7 from the live domain config.
Oct 16 11:28:52 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-713ac547-00cc-4063-98bc-04a708b71de3 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] calling os-brick to detach iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 11:28:52 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-713ac547-00cc-4063-98bc-04a708b71de3 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, {'target_iqn': 'iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xWOyzsUu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:28:52 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-713ac547-00cc-4063-98bc-04a708b71de3 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:28:52 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-713ac547-00cc-4063-98bc-04a708b71de3 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:28:52 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-713ac547-00cc-4063-98bc-04a708b71de3 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:28:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:28:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.107s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:28:52 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aaf7450-63c8-49f6-a081-ab0d95279f09]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:28:52 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-713ac547-00cc-4063-98bc-04a708b71de3 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 11:28:52 user nova-compute[74683]: No targets found.
Oct 16 11:28:52 user nova-compute[74683]: iSNS:
Oct 16 11:28:52 user nova-compute[74683]: No targets found.
Oct 16 11:28:52 user nova-compute[74683]: STATIC:
Oct 16 11:28:52 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152
Oct 16 11:28:52 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:28:52 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:28:52 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354
Oct 16 11:28:52 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:28:52 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:28:52 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb
Oct 16 11:28:52 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:28:52 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:28:52 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0
Oct 16 11:28:52 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:28:52 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:28:52 user nova-compute[74683]: FIRMWARE:
Oct 16 11:28:52 user nova-compute[74683]: No targets found.
Oct 16 11:28:52 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:28:52 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-713ac547-00cc-4063-98bc-04a708b71de3 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 11:28:52 user nova-compute[74683]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 11:28:52 user nova-compute[74683]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74683) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 11:28:52 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-713ac547-00cc-4063-98bc-04a708b71de3 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152', 0)] {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 11:28:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:28:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:28:52 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd66e3b-8207-4d79-b1df-06e5ec819b9f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:28:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:28:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:28:52 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c60f75-1e75-4478-85ee-8c1af03e056f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:28:52 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-713ac547-00cc-4063-98bc-04a708b71de3 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:28:52 user nova-compute[74683]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)
Oct 16 11:28:52 user nova-compute[74683]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)
Oct 16 11:28:52 user nova-compute[74683]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 (non-flash)
Oct 16 11:28:52 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:28:52 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-713ac547-00cc-4063-98bc-04a708b71de3 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:28:52 user nova-compute[74683]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)
Oct 16 11:28:52 user nova-compute[74683]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)
Oct 16 11:28:52 user nova-compute[74683]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 (non-flash)
Oct 16 11:28:52 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:28:52 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-713ac547-00cc-4063-98bc-04a708b71de3 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda4c7c6170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152'): ({'sdb'}, set())}) {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 11:28:52 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-713ac547-00cc-4063-98bc-04a708b71de3 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Removing single pathed devices sdb {{(pid=74683) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 11:28:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:28:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:28:52 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd33234-1849-4063-9b9c-b0c9d96f762c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:28:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:28:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:28:52 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[159f1da5-f2fc-41c2-bf2c-aa07de6cac25]: (4, ('ok\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:28:52 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-713ac547-00cc-4063-98bc-04a708b71de3 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Flushing IO for device /dev/sdb {{(pid=74683) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 11:28:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:28:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:28:52 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e74131-02d0-458a-b0ee-ad0887041009]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:28:52 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-713ac547-00cc-4063-98bc-04a708b71de3 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74683) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 11:28:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:28:53 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:28:53 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98e473a-b875-4d77-a919-65556f18aff9]: (4, ('1', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:28:53 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-713ac547-00cc-4063-98bc-04a708b71de3 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 11:28:53 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-713ac547-00cc-4063-98bc-04a708b71de3 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] SCSI volumes sdb have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 11:28:53 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-713ac547-00cc-4063-98bc-04a708b71de3 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152')] {{(pid=74683) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 11:28:53 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:28:53 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:28:53 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c02b4f7-7ec5-4f48-9ab1-fe56b25ef966]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:28:53 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-713ac547-00cc-4063-98bc-04a708b71de3 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:28:53 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 -p 172.16.0.220:3260 --logout {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:28:53 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:28:53 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[4225b251-171c-47e5-96ae-d571f10abe93]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:28:53 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-713ac547-00cc-4063-98bc-04a708b71de3 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152, portal: 172.16.0.220,3260]
Oct 16 11:28:53 user nova-compute[74683]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152, portal: 172.16.0.220,3260] successful.
Oct 16 11:28:53 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:28:53 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 -p 172.16.0.220:3260 --op delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:28:53 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a52c1cdc-2945-43af-abd1-8a8060b4f152 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:28:53 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5dc0c9-393c-4bdc-8311-a8e4b4e4a907]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:28:53 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-713ac547-00cc-4063-98bc-04a708b71de3 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:28:53 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-713ac547-00cc-4063-98bc-04a708b71de3 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.407s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:28:53 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-713ac547-00cc-4063-98bc-04a708b71de3 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] <== disconnect_volume: return (408ms) None {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:28:53 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-713ac547-00cc-4063-98bc-04a708b71de3 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Disconnected iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 11:28:54 user nova-compute[74683]: DEBUG nova.objects.instance [None req-713ac547-00cc-4063-98bc-04a708b71de3 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lazy-loading 'flavor' on Instance uuid 4b4eaccb-e068-4e8a-9084-16229815b1d7 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:28:54 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-713ac547-00cc-4063-98bc-04a708b71de3 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "4b4eaccb-e068-4e8a-9084-16229815b1d7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.032s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:28:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:28:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:29:00 user nova-compute[74683]: INFO nova.compute.manager [None req-bbe66cc2-02a4-448f-b786-3bdab842893c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Took 11.37 seconds to detach 1 volumes for instance.
Oct 16 11:29:00 user nova-compute[74683]: DEBUG nova.compute.manager [None req-bbe66cc2-02a4-448f-b786-3bdab842893c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 7488aa44-fdba-47b6-8857-0f46df4f66b9] Deleting volume: c8de5eea-f1e9-4670-9f08-f0aad8da8dba {{(pid=74683) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 16 11:29:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-bbe66cc2-02a4-448f-b786-3bdab842893c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:29:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-bbe66cc2-02a4-448f-b786-3bdab842893c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:29:00 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-bbe66cc2-02a4-448f-b786-3bdab842893c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:29:00 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-bbe66cc2-02a4-448f-b786-3bdab842893c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:29:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-bbe66cc2-02a4-448f-b786-3bdab842893c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.403s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:29:00 user nova-compute[74683]: INFO nova.scheduler.client.report [None req-bbe66cc2-02a4-448f-b786-3bdab842893c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Deleted allocations for instance 7488aa44-fdba-47b6-8857-0f46df4f66b9
Oct 16 11:29:01 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-bbe66cc2-02a4-448f-b786-3bdab842893c tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "7488aa44-fdba-47b6-8857-0f46df4f66b9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.853s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:29:01 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:29:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:29:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:29:07 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:29:07 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Cleaning up deleted instances with incomplete migration  {{(pid=74683) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 16 11:29:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:29:08 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:29:08 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Starting heal instance info cache {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 11:29:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "refresh_cache-d5e55361-d9ed-4d07-91b0-ec4d08b2e817" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:29:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquired lock "refresh_cache-d5e55361-d9ed-4d07-91b0-ec4d08b2e817" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:29:08 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Forcefully refreshing network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 11:29:09 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Updating instance_info_cache with network_info: [{"id": "ade44b63-49bb-4dbc-b0f9-95156f4fd6db", "address": "fa:16:3e:ad:0a:5c", "network": {"id": "4d43cc12-d2cd-4552-90a4-884a0ff3dc66", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-825513246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6e0046017b4bba85caf2a39d1c67b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade44b63-49", "ovs_interfaceid": "ade44b63-49bb-4dbc-b0f9-95156f4fd6db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:29:09 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Releasing lock "refresh_cache-d5e55361-d9ed-4d07-91b0-ec4d08b2e817" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:29:09 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Updated the network info_cache for instance {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 11:29:09 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:29:11 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:29:12 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:29:12 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:29:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:29:13 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:29:13 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:29:15 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:29:16 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:29:16 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74683) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 11:29:16 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:29:16 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Cleaning up deleted instances {{(pid=74683) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 16 11:29:16 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] There are 0 instances to clean {{(pid=74683) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 16 11:29:17 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:29:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:29:19 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:29:19 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:29:19 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:29:19 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:29:19 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:29:19 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Auditing locally available compute resources for user (node: user) {{(pid=74683) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 11:29:19 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:29:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9fc5a9-8659-497c-bb07-af52fe2e1761/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:29:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9fc5a9-8659-497c-bb07-af52fe2e1761/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:29:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9fc5a9-8659-497c-bb07-af52fe2e1761/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:29:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9fc5a9-8659-497c-bb07-af52fe2e1761/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:29:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:29:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:29:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:29:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:29:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.rescue --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:29:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:29:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.rescue --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:29:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:29:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:29:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:29:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:29:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:29:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:29:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:29:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:29:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:29:21 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:29:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:29:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:29:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:29:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:29:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b79d385-e512-4297-9aa4-2b9bb0cac23c/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:29:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b79d385-e512-4297-9aa4-2b9bb0cac23c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:29:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b79d385-e512-4297-9aa4-2b9bb0cac23c/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:29:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-bdf9a0ce-7878-4b53-840e-bbb548a7e6dd tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Acquiring lock "4b4eaccb-e068-4e8a-9084-16229815b1d7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:29:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-bdf9a0ce-7878-4b53-840e-bbb548a7e6dd tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "4b4eaccb-e068-4e8a-9084-16229815b1d7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:29:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-bdf9a0ce-7878-4b53-840e-bbb548a7e6dd tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Acquiring lock "4b4eaccb-e068-4e8a-9084-16229815b1d7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:29:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-bdf9a0ce-7878-4b53-840e-bbb548a7e6dd tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "4b4eaccb-e068-4e8a-9084-16229815b1d7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:29:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-bdf9a0ce-7878-4b53-840e-bbb548a7e6dd tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "4b4eaccb-e068-4e8a-9084-16229815b1d7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:29:22 user nova-compute[74683]: INFO nova.compute.manager [None req-bdf9a0ce-7878-4b53-840e-bbb548a7e6dd tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Terminating instance
Oct 16 11:29:22 user nova-compute[74683]: DEBUG nova.compute.manager [None req-bdf9a0ce-7878-4b53-840e-bbb548a7e6dd tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Start destroying the instance on the hypervisor. {{(pid=74683) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 11:29:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b79d385-e512-4297-9aa4-2b9bb0cac23c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:29:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:29:22 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:29:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:29:22 user nova-compute[74683]: DEBUG nova.compute.manager [req-0bc12be8-57bf-4450-bc3c-6ed1cc86f1d0 req-d59c7b5a-d15b-43a9-9217-1d4aedc28842 service nova] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Received event network-vif-unplugged-51406244-8351-4ada-b266-d5ec85d5f5b7 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:29:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-0bc12be8-57bf-4450-bc3c-6ed1cc86f1d0 req-d59c7b5a-d15b-43a9-9217-1d4aedc28842 service nova] Acquiring lock "4b4eaccb-e068-4e8a-9084-16229815b1d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:29:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-0bc12be8-57bf-4450-bc3c-6ed1cc86f1d0 req-d59c7b5a-d15b-43a9-9217-1d4aedc28842 service nova] Lock "4b4eaccb-e068-4e8a-9084-16229815b1d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:29:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-0bc12be8-57bf-4450-bc3c-6ed1cc86f1d0 req-d59c7b5a-d15b-43a9-9217-1d4aedc28842 service nova] Lock "4b4eaccb-e068-4e8a-9084-16229815b1d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:29:22 user nova-compute[74683]: DEBUG nova.compute.manager [req-0bc12be8-57bf-4450-bc3c-6ed1cc86f1d0 req-d59c7b5a-d15b-43a9-9217-1d4aedc28842 service nova] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] No waiting events found dispatching network-vif-unplugged-51406244-8351-4ada-b266-d5ec85d5f5b7 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:29:22 user nova-compute[74683]: DEBUG nova.compute.manager [req-0bc12be8-57bf-4450-bc3c-6ed1cc86f1d0 req-d59c7b5a-d15b-43a9-9217-1d4aedc28842 service nova] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Received event network-vif-unplugged-51406244-8351-4ada-b266-d5ec85d5f5b7 for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 11:29:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:29:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:29:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b4eaccb-e068-4e8a-9084-16229815b1d7/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:29:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b4eaccb-e068-4e8a-9084-16229815b1d7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:29:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:29:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b4eaccb-e068-4e8a-9084-16229815b1d7/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:29:23 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Instance destroyed successfully.
Oct 16 11:29:23 user nova-compute[74683]: DEBUG nova.objects.instance [None req-bdf9a0ce-7878-4b53-840e-bbb548a7e6dd tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lazy-loading 'resources' on Instance uuid 4b4eaccb-e068-4e8a-9084-16229815b1d7 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:29:23 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-bdf9a0ce-7878-4b53-840e-bbb548a7e6dd tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-16T11:23:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-27181934',display_name='tempest-ServerActionsTestOtherA-server-1084066119',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-27181934',id=26,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMU+0jl/Xpsr5n/olRAHKpCazthU2XJrlviTrSAY+9fnhEiSM0bM3IXfiYZZbkmWCD8gh75QX0AR7OUJ2tlcTCQ4BWG951YpMlhxtAMVD+xs3A2NaoWBXrnOjvkdTqz3aw==',key_name='tempest-keypair-1161073936',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:26:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fcb8da41d6584a689e9b50155288aa5e',ramdisk_id='',reservation_id='r-ze6eely5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-327072564',owner_user_name='tempest-ServerActionsTestOtherA-327072564-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:26:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a55641a42b142ea9fb6c6c1fdb9963e',uuid=4b4eaccb-e068-4e8a-9084-16229815b1d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51406244-8351-4ada-b266-d5ec85d5f5b7", "address": "fa:16:3e:34:af:5c", "network": {"id": "cd8cf08c-d79c-4d2e-b849-640c440e1498", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1091743670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcb8da41d6584a689e9b50155288aa5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51406244-83", "ovs_interfaceid": "51406244-8351-4ada-b266-d5ec85d5f5b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:29:23 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-bdf9a0ce-7878-4b53-840e-bbb548a7e6dd tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Converting VIF {"id": "51406244-8351-4ada-b266-d5ec85d5f5b7", "address": "fa:16:3e:34:af:5c", "network": {"id": "cd8cf08c-d79c-4d2e-b849-640c440e1498", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1091743670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcb8da41d6584a689e9b50155288aa5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51406244-83", "ovs_interfaceid": "51406244-8351-4ada-b266-d5ec85d5f5b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:29:23 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-bdf9a0ce-7878-4b53-840e-bbb548a7e6dd tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:34:af:5c,bridge_name='br-int',has_traffic_filtering=True,id=51406244-8351-4ada-b266-d5ec85d5f5b7,network=Network(cd8cf08c-d79c-4d2e-b849-640c440e1498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51406244-83') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:29:23 user nova-compute[74683]: DEBUG os_vif [None req-bdf9a0ce-7878-4b53-840e-bbb548a7e6dd tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:af:5c,bridge_name='br-int',has_traffic_filtering=True,id=51406244-8351-4ada-b266-d5ec85d5f5b7,network=Network(cd8cf08c-d79c-4d2e-b849-640c440e1498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51406244-83') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:29:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:29:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap51406244-83, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:29:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b4eaccb-e068-4e8a-9084-16229815b1d7/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:29:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:29:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:29:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:29:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8016824f-6c55-4f4a-a502-7d7aae27818c) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:29:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:29:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:29:23 user nova-compute[74683]: INFO os_vif [None req-bdf9a0ce-7878-4b53-840e-bbb548a7e6dd tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:af:5c,bridge_name='br-int',has_traffic_filtering=True,id=51406244-8351-4ada-b266-d5ec85d5f5b7,network=Network(cd8cf08c-d79c-4d2e-b849-640c440e1498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51406244-83')
Oct 16 11:29:23 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-bdf9a0ce-7878-4b53-840e-bbb548a7e6dd tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Deleting instance files /opt/stack/data/nova/instances/4b4eaccb-e068-4e8a-9084-16229815b1d7_del
Oct 16 11:29:23 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-bdf9a0ce-7878-4b53-840e-bbb548a7e6dd tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Deletion of /opt/stack/data/nova/instances/4b4eaccb-e068-4e8a-9084-16229815b1d7_del complete
Oct 16 11:29:23 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:29:23 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:29:23 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Hypervisor/Node resource view: name=user free_ram=7804MB free_disk=25.044281005859375GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74683) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 11:29:23 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:29:23 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:29:23 user nova-compute[74683]: INFO nova.compute.manager [None req-bdf9a0ce-7878-4b53-840e-bbb548a7e6dd tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Took 1.20 seconds to destroy the instance on the hypervisor.
Oct 16 11:29:23 user nova-compute[74683]: DEBUG oslo.service.loopingcall [None req-bdf9a0ce-7878-4b53-840e-bbb548a7e6dd tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74683) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 11:29:23 user nova-compute[74683]: DEBUG nova.compute.manager [-] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Deallocating network for instance {{(pid=74683) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 11:29:23 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] deallocate_for_instance() {{(pid=74683) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 11:29:23 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 18a77385-fab9-4ea0-8aa6-666cf7e798a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:29:23 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance d5e55361-d9ed-4d07-91b0-ec4d08b2e817 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:29:23 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance edd01413-1f8a-49e3-aa3c-ecb19c62afae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:29:23 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 6c9fc5a9-8659-497c-bb07-af52fe2e1761 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:29:23 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 9b8ba94f-43cc-4f06-bcd9-83935ccbe117 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:29:23 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance b91af786-36e3-4815-811f-fb3c055e758d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:29:23 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 0b79d385-e512-4297-9aa4-2b9bb0cac23c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:29:23 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 4b4eaccb-e068-4e8a-9084-16229815b1d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:29:23 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance d00bbb1a-534b-4437-9b79-91870c5d8bb5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:29:23 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 73adef6b-881d-466b-b55d-6cf2f974d40e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:29:23 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 11:29:23 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 11:29:23 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Refreshing inventories for resource provider 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 16 11:29:23 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Updating ProviderTree inventory for provider 7142d606-df50-4cbe-b5ed-1802caa31862 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 16 11:29:23 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Updating inventory in ProviderTree for provider 7142d606-df50-4cbe-b5ed-1802caa31862 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 16 11:29:24 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Refreshing aggregate associations for resource provider 7142d606-df50-4cbe-b5ed-1802caa31862, aggregates: None {{(pid=74683) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 16 11:29:24 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Refreshing trait associations for resource provider 7142d606-df50-4cbe-b5ed-1802caa31862, traits: COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VMVGA {{(pid=74683) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 16 11:29:24 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:29:24 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:29:24 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Compute_service record updated for user:user {{(pid=74683) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 11:29:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.847s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:29:24 user nova-compute[74683]: DEBUG nova.compute.manager [req-6074152e-f48d-4645-ab3e-44f5d6a39046 req-c848d8f1-f44c-4608-a2c4-23f75c2ed94f service nova] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Received event network-vif-plugged-51406244-8351-4ada-b266-d5ec85d5f5b7 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:29:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-6074152e-f48d-4645-ab3e-44f5d6a39046 req-c848d8f1-f44c-4608-a2c4-23f75c2ed94f service nova] Acquiring lock "4b4eaccb-e068-4e8a-9084-16229815b1d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:29:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-6074152e-f48d-4645-ab3e-44f5d6a39046 req-c848d8f1-f44c-4608-a2c4-23f75c2ed94f service nova] Lock "4b4eaccb-e068-4e8a-9084-16229815b1d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:29:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-6074152e-f48d-4645-ab3e-44f5d6a39046 req-c848d8f1-f44c-4608-a2c4-23f75c2ed94f service nova] Lock "4b4eaccb-e068-4e8a-9084-16229815b1d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:29:24 user nova-compute[74683]: DEBUG nova.compute.manager [req-6074152e-f48d-4645-ab3e-44f5d6a39046 req-c848d8f1-f44c-4608-a2c4-23f75c2ed94f service nova] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] No waiting events found dispatching network-vif-plugged-51406244-8351-4ada-b266-d5ec85d5f5b7 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:29:24 user nova-compute[74683]: WARNING nova.compute.manager [req-6074152e-f48d-4645-ab3e-44f5d6a39046 req-c848d8f1-f44c-4608-a2c4-23f75c2ed94f service nova] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Received unexpected event network-vif-plugged-51406244-8351-4ada-b266-d5ec85d5f5b7 for instance with vm_state active and task_state deleting.
Oct 16 11:29:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:29:25 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:29:25 user nova-compute[74683]: INFO nova.compute.manager [-] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Took 1.44 seconds to deallocate network for instance.
Oct 16 11:29:25 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-bdf9a0ce-7878-4b53-840e-bbb548a7e6dd tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:29:25 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-bdf9a0ce-7878-4b53-840e-bbb548a7e6dd tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:29:25 user nova-compute[74683]: DEBUG nova.compute.manager [req-e264c8d9-2901-4160-8de0-4866cdedfb9b req-d9b1d36f-61a7-4734-b059-f4e47b17dd6f service nova] [instance: 4b4eaccb-e068-4e8a-9084-16229815b1d7] Received event network-vif-deleted-51406244-8351-4ada-b266-d5ec85d5f5b7 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:29:25 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-bdf9a0ce-7878-4b53-840e-bbb548a7e6dd tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:29:25 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-bdf9a0ce-7878-4b53-840e-bbb548a7e6dd tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:29:25 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-bdf9a0ce-7878-4b53-840e-bbb548a7e6dd tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.384s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:29:25 user nova-compute[74683]: INFO nova.scheduler.client.report [None req-bdf9a0ce-7878-4b53-840e-bbb548a7e6dd tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Deleted allocations for instance 4b4eaccb-e068-4e8a-9084-16229815b1d7
Oct 16 11:29:25 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-bdf9a0ce-7878-4b53-840e-bbb548a7e6dd tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "4b4eaccb-e068-4e8a-9084-16229815b1d7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.215s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:29:28 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:29:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:29:33 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:29:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:29:40 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:29:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:29:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-61c93ea0-aaab-4527-819e-27d739a13da7 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquiring lock "73adef6b-881d-466b-b55d-6cf2f974d40e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:29:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-61c93ea0-aaab-4527-819e-27d739a13da7 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "73adef6b-881d-466b-b55d-6cf2f974d40e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:29:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-61c93ea0-aaab-4527-819e-27d739a13da7 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquiring lock "73adef6b-881d-466b-b55d-6cf2f974d40e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:29:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-61c93ea0-aaab-4527-819e-27d739a13da7 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "73adef6b-881d-466b-b55d-6cf2f974d40e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:29:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-61c93ea0-aaab-4527-819e-27d739a13da7 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "73adef6b-881d-466b-b55d-6cf2f974d40e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:29:47 user nova-compute[74683]: INFO nova.compute.manager [None req-61c93ea0-aaab-4527-819e-27d739a13da7 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Terminating instance
Oct 16 11:29:47 user nova-compute[74683]: DEBUG nova.compute.manager [None req-61c93ea0-aaab-4527-819e-27d739a13da7 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Start destroying the instance on the hypervisor. {{(pid=74683) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 11:29:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:29:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:29:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:29:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:29:47 user nova-compute[74683]: DEBUG nova.compute.manager [req-f5d3e123-3d82-4fd3-b5a6-e8081de49613 req-98948946-823b-436a-95cc-1a16e7582706 service nova] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Received event network-vif-unplugged-d30ae106-813b-458e-a46b-d92cbdd2e4b2 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:29:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f5d3e123-3d82-4fd3-b5a6-e8081de49613 req-98948946-823b-436a-95cc-1a16e7582706 service nova] Acquiring lock "73adef6b-881d-466b-b55d-6cf2f974d40e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:29:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f5d3e123-3d82-4fd3-b5a6-e8081de49613 req-98948946-823b-436a-95cc-1a16e7582706 service nova] Lock "73adef6b-881d-466b-b55d-6cf2f974d40e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:29:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f5d3e123-3d82-4fd3-b5a6-e8081de49613 req-98948946-823b-436a-95cc-1a16e7582706 service nova] Lock "73adef6b-881d-466b-b55d-6cf2f974d40e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:29:47 user nova-compute[74683]: DEBUG nova.compute.manager [req-f5d3e123-3d82-4fd3-b5a6-e8081de49613 req-98948946-823b-436a-95cc-1a16e7582706 service nova] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] No waiting events found dispatching network-vif-unplugged-d30ae106-813b-458e-a46b-d92cbdd2e4b2 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:29:47 user nova-compute[74683]: DEBUG nova.compute.manager [req-f5d3e123-3d82-4fd3-b5a6-e8081de49613 req-98948946-823b-436a-95cc-1a16e7582706 service nova] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Received event network-vif-unplugged-d30ae106-813b-458e-a46b-d92cbdd2e4b2 for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 11:29:48 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Instance destroyed successfully.
Oct 16 11:29:48 user nova-compute[74683]: DEBUG nova.objects.instance [None req-61c93ea0-aaab-4527-819e-27d739a13da7 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lazy-loading 'resources' on Instance uuid 73adef6b-881d-466b-b55d-6cf2f974d40e {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:29:48 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:29:48 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-61c93ea0-aaab-4527-819e-27d739a13da7 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:24:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-36036086',display_name='tempest-TestVolumeBootPattern-volume-backed-server-36036086',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-36036086',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC7ygYqGHWxK0DaJs1seFklM3baxLiMpTXvH0S8XHkPkH+8csh9PSVwQ1yN6oPcYBqPnV4EbkwqwdR7LXXvahFWIwJgTiOQUNm/4A8pPU781hWAZyVba1wvrF2itzasS9w==',key_name='tempest-keypair-679936023',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:25:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2aefabef9e42412f8309f490dcfecc79',ramdisk_id='',reservation_id='r-0tukfkj7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-953001121',owner_user_name='tempest-TestVolumeBootPattern-953001121-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:25:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a463a84e332543dfbc03b81518f82be1',uuid=73adef6b-881d-466b-b55d-6cf2f974d40e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d30ae106-813b-458e-a46b-d92cbdd2e4b2", "address": "fa:16:3e:28:1e:05", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd30ae106-81", "ovs_interfaceid": "d30ae106-813b-458e-a46b-d92cbdd2e4b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:29:48 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-61c93ea0-aaab-4527-819e-27d739a13da7 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Converting VIF {"id": "d30ae106-813b-458e-a46b-d92cbdd2e4b2", "address": "fa:16:3e:28:1e:05", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd30ae106-81", "ovs_interfaceid": "d30ae106-813b-458e-a46b-d92cbdd2e4b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:29:48 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-61c93ea0-aaab-4527-819e-27d739a13da7 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:1e:05,bridge_name='br-int',has_traffic_filtering=True,id=d30ae106-813b-458e-a46b-d92cbdd2e4b2,network=Network(00883fc4-0b74-4afd-9043-82e2933faab3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd30ae106-81') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:29:48 user nova-compute[74683]: DEBUG os_vif [None req-61c93ea0-aaab-4527-819e-27d739a13da7 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:1e:05,bridge_name='br-int',has_traffic_filtering=True,id=d30ae106-813b-458e-a46b-d92cbdd2e4b2,network=Network(00883fc4-0b74-4afd-9043-82e2933faab3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd30ae106-81') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:29:48 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:29:48 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd30ae106-81, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:29:48 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:29:48 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:29:48 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cbeaf1de-a529-410e-8e01-7105a9102cd9) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:29:48 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:29:48 user nova-compute[74683]: INFO os_vif [None req-61c93ea0-aaab-4527-819e-27d739a13da7 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:1e:05,bridge_name='br-int',has_traffic_filtering=True,id=d30ae106-813b-458e-a46b-d92cbdd2e4b2,network=Network(00883fc4-0b74-4afd-9043-82e2933faab3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd30ae106-81')
Oct 16 11:29:48 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61c93ea0-aaab-4527-819e-27d739a13da7 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] calling os-brick to detach iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 11:29:48 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c93ea0-aaab-4527-819e-27d739a13da7 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, {'target_iqn': 'iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VWFDtMCw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:29:48 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-61c93ea0-aaab-4527-819e-27d739a13da7 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:29:48 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-61c93ea0-aaab-4527-819e-27d739a13da7 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:29:48 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-61c93ea0-aaab-4527-819e-27d739a13da7 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:29:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:29:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:29:48 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee68365-96e0-45c9-9e94-baba6766e139]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:29:48 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c93ea0-aaab-4527-819e-27d739a13da7 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 11:29:48 user nova-compute[74683]: No targets found.
Oct 16 11:29:48 user nova-compute[74683]: iSNS:
Oct 16 11:29:48 user nova-compute[74683]: No targets found.
Oct 16 11:29:48 user nova-compute[74683]: STATIC:
Oct 16 11:29:48 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354
Oct 16 11:29:48 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:29:48 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:29:48 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb
Oct 16 11:29:48 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:29:48 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:29:48 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0
Oct 16 11:29:48 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:29:48 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:29:48 user nova-compute[74683]: FIRMWARE:
Oct 16 11:29:48 user nova-compute[74683]: No targets found.
Oct 16 11:29:48 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:29:48 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c93ea0-aaab-4527-819e-27d739a13da7 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 11:29:48 user nova-compute[74683]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 11:29:48 user nova-compute[74683]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74683) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 11:29:48 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c93ea0-aaab-4527-819e-27d739a13da7 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0', 0)] {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 11:29:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:29:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:29:48 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f0f4a2-633d-4845-aeab-ea02a4d1fa8c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:29:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:29:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:29:48 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[74accf84-aba3-48c5-a2cd-5f7bccd1a477]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:29:48 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c93ea0-aaab-4527-819e-27d739a13da7 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:29:48 user nova-compute[74683]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)
Oct 16 11:29:48 user nova-compute[74683]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)
Oct 16 11:29:48 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:29:48 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c93ea0-aaab-4527-819e-27d739a13da7 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:29:48 user nova-compute[74683]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 (non-flash)
Oct 16 11:29:48 user nova-compute[74683]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)
Oct 16 11:29:48 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:29:48 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c93ea0-aaab-4527-819e-27d739a13da7 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda4c5b5000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0'): ({'sdc'}, set())}) {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 11:29:48 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-61c93ea0-aaab-4527-819e-27d739a13da7 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Removing single pathed devices sdc {{(pid=74683) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 11:29:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:29:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:29:48 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ccb9775-8dad-4873-bfdc-070c0d2d4262]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:29:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:29:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:29:48 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aef70c8-5592-49c9-b201-0a0782429026]: (4, ('ok\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:29:48 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-61c93ea0-aaab-4527-819e-27d739a13da7 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Flushing IO for device /dev/sdc {{(pid=74683) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 11:29:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:29:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:29:48 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f91f9f-cc16-4cc8-91b1-8975c1d078c8]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:29:48 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-61c93ea0-aaab-4527-819e-27d739a13da7 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74683) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 11:29:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:29:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:29:48 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f546afb1-72d0-453f-897e-4a0dea232c08]: (4, ('1', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:29:48 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-61c93ea0-aaab-4527-819e-27d739a13da7 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 11:29:48 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-61c93ea0-aaab-4527-819e-27d739a13da7 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] SCSI volumes sdc have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 11:29:48 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c93ea0-aaab-4527-819e-27d739a13da7 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0')] {{(pid=74683) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 11:29:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:29:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:29:48 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5a3f5d-8295-48ba-85a8-e75667349a39]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:29:48 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c93ea0-aaab-4527-819e-27d739a13da7 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:29:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 -p 172.16.0.220:3260 --logout {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:29:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:29:48 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f659a6c-0909-4551-8ce6-b1a801bc7b06]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:29:48 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c93ea0-aaab-4527-819e-27d739a13da7 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0, portal: 172.16.0.220,3260]
Oct 16 11:29:48 user nova-compute[74683]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0, portal: 172.16.0.220,3260] successful.
Oct 16 11:29:48 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:29:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 -p 172.16.0.220:3260 --op delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:29:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62b0fe50-02bc-4fba-bf25-873c18c036c0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:29:48 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a42921d-5238-49ac-b7af-a48bb3979e22]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:29:48 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c93ea0-aaab-4527-819e-27d739a13da7 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:29:48 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-61c93ea0-aaab-4527-819e-27d739a13da7 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:29:48 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c93ea0-aaab-4527-819e-27d739a13da7 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] <== disconnect_volume: return (326ms) None {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:29:48 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61c93ea0-aaab-4527-819e-27d739a13da7 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Disconnected iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 11:29:48 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-61c93ea0-aaab-4527-819e-27d739a13da7 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Deleting instance files /opt/stack/data/nova/instances/73adef6b-881d-466b-b55d-6cf2f974d40e_del
Oct 16 11:29:48 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-61c93ea0-aaab-4527-819e-27d739a13da7 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Deletion of /opt/stack/data/nova/instances/73adef6b-881d-466b-b55d-6cf2f974d40e_del complete
Oct 16 11:29:48 user nova-compute[74683]: INFO nova.compute.manager [None req-61c93ea0-aaab-4527-819e-27d739a13da7 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Took 1.21 seconds to destroy the instance on the hypervisor.
Oct 16 11:29:48 user nova-compute[74683]: DEBUG oslo.service.loopingcall [None req-61c93ea0-aaab-4527-819e-27d739a13da7 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74683) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 11:29:48 user nova-compute[74683]: DEBUG nova.compute.manager [-] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Deallocating network for instance {{(pid=74683) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 11:29:48 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] deallocate_for_instance() {{(pid=74683) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 11:29:49 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:29:49 user nova-compute[74683]: INFO nova.compute.manager [-] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Took 0.93 seconds to deallocate network for instance.
Oct 16 11:29:49 user nova-compute[74683]: DEBUG nova.compute.manager [req-e4336cbe-8f40-4194-8e57-b17d7ca73795 req-fb7eb963-f793-41fc-b679-14a186560230 service nova] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Received event network-vif-deleted-d30ae106-813b-458e-a46b-d92cbdd2e4b2 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:29:49 user nova-compute[74683]: DEBUG nova.compute.manager [req-6df2389d-b69e-43d1-bb28-696fc2f7a9c4 req-5a6cf2ee-5f21-4d4c-a217-1ebb234ad1bd service nova] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Received event network-vif-plugged-d30ae106-813b-458e-a46b-d92cbdd2e4b2 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:29:49 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-6df2389d-b69e-43d1-bb28-696fc2f7a9c4 req-5a6cf2ee-5f21-4d4c-a217-1ebb234ad1bd service nova] Acquiring lock "73adef6b-881d-466b-b55d-6cf2f974d40e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:29:49 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-6df2389d-b69e-43d1-bb28-696fc2f7a9c4 req-5a6cf2ee-5f21-4d4c-a217-1ebb234ad1bd service nova] Lock "73adef6b-881d-466b-b55d-6cf2f974d40e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:29:49 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-6df2389d-b69e-43d1-bb28-696fc2f7a9c4 req-5a6cf2ee-5f21-4d4c-a217-1ebb234ad1bd service nova] Lock "73adef6b-881d-466b-b55d-6cf2f974d40e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:29:49 user nova-compute[74683]: DEBUG nova.compute.manager [req-6df2389d-b69e-43d1-bb28-696fc2f7a9c4 req-5a6cf2ee-5f21-4d4c-a217-1ebb234ad1bd service nova] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] No waiting events found dispatching network-vif-plugged-d30ae106-813b-458e-a46b-d92cbdd2e4b2 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:29:49 user nova-compute[74683]: WARNING nova.compute.manager [req-6df2389d-b69e-43d1-bb28-696fc2f7a9c4 req-5a6cf2ee-5f21-4d4c-a217-1ebb234ad1bd service nova] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Received unexpected event network-vif-plugged-d30ae106-813b-458e-a46b-d92cbdd2e4b2 for instance with vm_state active and task_state deleting.
Oct 16 11:29:50 user nova-compute[74683]: INFO nova.compute.manager [None req-61c93ea0-aaab-4527-819e-27d739a13da7 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Took 0.88 seconds to detach 1 volumes for instance.
Oct 16 11:29:50 user nova-compute[74683]: DEBUG nova.compute.manager [None req-61c93ea0-aaab-4527-819e-27d739a13da7 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 73adef6b-881d-466b-b55d-6cf2f974d40e] Deleting volume: 62b0fe50-02bc-4fba-bf25-873c18c036c0 {{(pid=74683) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 16 11:29:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-61c93ea0-aaab-4527-819e-27d739a13da7 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:29:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-61c93ea0-aaab-4527-819e-27d739a13da7 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:29:50 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-61c93ea0-aaab-4527-819e-27d739a13da7 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:29:50 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-61c93ea0-aaab-4527-819e-27d739a13da7 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:29:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-61c93ea0-aaab-4527-819e-27d739a13da7 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.322s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:29:50 user nova-compute[74683]: INFO nova.scheduler.client.report [None req-61c93ea0-aaab-4527-819e-27d739a13da7 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Deleted allocations for instance 73adef6b-881d-466b-b55d-6cf2f974d40e
Oct 16 11:29:51 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-61c93ea0-aaab-4527-819e-27d739a13da7 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "73adef6b-881d-466b-b55d-6cf2f974d40e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.630s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:29:53 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:29:58 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:30:02 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._sync_power_states {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:30:02 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Triggering sync for uuid 18a77385-fab9-4ea0-8aa6-666cf7e798a6 {{(pid=74683) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 11:30:02 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Triggering sync for uuid d5e55361-d9ed-4d07-91b0-ec4d08b2e817 {{(pid=74683) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 11:30:02 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Triggering sync for uuid edd01413-1f8a-49e3-aa3c-ecb19c62afae {{(pid=74683) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 11:30:02 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Triggering sync for uuid 6c9fc5a9-8659-497c-bb07-af52fe2e1761 {{(pid=74683) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 11:30:02 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Triggering sync for uuid 9b8ba94f-43cc-4f06-bcd9-83935ccbe117 {{(pid=74683) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 11:30:02 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Triggering sync for uuid b91af786-36e3-4815-811f-fb3c055e758d {{(pid=74683) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 11:30:02 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Triggering sync for uuid 0b79d385-e512-4297-9aa4-2b9bb0cac23c {{(pid=74683) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 11:30:02 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Triggering sync for uuid d00bbb1a-534b-4437-9b79-91870c5d8bb5 {{(pid=74683) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 11:30:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "18a77385-fab9-4ea0-8aa6-666cf7e798a6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:30:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "18a77385-fab9-4ea0-8aa6-666cf7e798a6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:30:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "d5e55361-d9ed-4d07-91b0-ec4d08b2e817" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:30:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "d5e55361-d9ed-4d07-91b0-ec4d08b2e817" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:30:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "edd01413-1f8a-49e3-aa3c-ecb19c62afae" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:30:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "edd01413-1f8a-49e3-aa3c-ecb19c62afae" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:30:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "6c9fc5a9-8659-497c-bb07-af52fe2e1761" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:30:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "6c9fc5a9-8659-497c-bb07-af52fe2e1761" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:30:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:30:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:30:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "b91af786-36e3-4815-811f-fb3c055e758d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:30:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "b91af786-36e3-4815-811f-fb3c055e758d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:30:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "0b79d385-e512-4297-9aa4-2b9bb0cac23c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:30:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "0b79d385-e512-4297-9aa4-2b9bb0cac23c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:30:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "d00bbb1a-534b-4437-9b79-91870c5d8bb5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:30:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "d00bbb1a-534b-4437-9b79-91870c5d8bb5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:30:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "d5e55361-d9ed-4d07-91b0-ec4d08b2e817" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:30:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "18a77385-fab9-4ea0-8aa6-666cf7e798a6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.072s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:30:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "edd01413-1f8a-49e3-aa3c-ecb19c62afae" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.072s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:30:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "6c9fc5a9-8659-497c-bb07-af52fe2e1761" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:30:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.097s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:30:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "b91af786-36e3-4815-811f-fb3c055e758d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.092s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:30:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "0b79d385-e512-4297-9aa4-2b9bb0cac23c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.107s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:30:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "d00bbb1a-534b-4437-9b79-91870c5d8bb5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.117s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:30:03 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:30:08 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:30:10 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:30:10 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Starting heal instance info cache {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 11:30:10 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "refresh_cache-edd01413-1f8a-49e3-aa3c-ecb19c62afae" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:30:10 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquired lock "refresh_cache-edd01413-1f8a-49e3-aa3c-ecb19c62afae" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:30:10 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Forcefully refreshing network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 11:30:11 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Updating instance_info_cache with network_info: [{"id": "7ba36bb4-91c7-42ee-b592-6653e63a1d50", "address": "fa:16:3e:b4:d6:37", "network": {"id": "cd8cf08c-d79c-4d2e-b849-640c440e1498", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1091743670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcb8da41d6584a689e9b50155288aa5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba36bb4-91", "ovs_interfaceid": "7ba36bb4-91c7-42ee-b592-6653e63a1d50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:30:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Releasing lock "refresh_cache-edd01413-1f8a-49e3-aa3c-ecb19c62afae" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:30:11 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Updated the network info_cache for instance {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 11:30:13 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:30:13 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:30:13 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:30:14 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:30:16 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1e55c217-83f7-4767-bad6-be78f9855166 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Acquiring lock "d00bbb1a-534b-4437-9b79-91870c5d8bb5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:30:16 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1e55c217-83f7-4767-bad6-be78f9855166 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "d00bbb1a-534b-4437-9b79-91870c5d8bb5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:30:16 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1e55c217-83f7-4767-bad6-be78f9855166 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Acquiring lock "d00bbb1a-534b-4437-9b79-91870c5d8bb5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:30:16 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1e55c217-83f7-4767-bad6-be78f9855166 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "d00bbb1a-534b-4437-9b79-91870c5d8bb5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:30:16 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1e55c217-83f7-4767-bad6-be78f9855166 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "d00bbb1a-534b-4437-9b79-91870c5d8bb5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:30:16 user nova-compute[74683]: INFO nova.compute.manager [None req-1e55c217-83f7-4767-bad6-be78f9855166 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Terminating instance
Oct 16 11:30:16 user nova-compute[74683]: DEBUG nova.compute.manager [None req-1e55c217-83f7-4767-bad6-be78f9855166 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Start destroying the instance on the hypervisor. {{(pid=74683) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 11:30:16 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:30:16 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:30:16 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG nova.compute.manager [req-c2debc6c-72bc-471e-baad-06f1135601bf req-ca48ba15-0913-4091-bad8-6c76c2e69e7d service nova] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Received event network-vif-unplugged-3d2071d3-9bd0-4aa5-a909-889b3f3155db {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c2debc6c-72bc-471e-baad-06f1135601bf req-ca48ba15-0913-4091-bad8-6c76c2e69e7d service nova] Acquiring lock "d00bbb1a-534b-4437-9b79-91870c5d8bb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c2debc6c-72bc-471e-baad-06f1135601bf req-ca48ba15-0913-4091-bad8-6c76c2e69e7d service nova] Lock "d00bbb1a-534b-4437-9b79-91870c5d8bb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c2debc6c-72bc-471e-baad-06f1135601bf req-ca48ba15-0913-4091-bad8-6c76c2e69e7d service nova] Lock "d00bbb1a-534b-4437-9b79-91870c5d8bb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG nova.compute.manager [req-c2debc6c-72bc-471e-baad-06f1135601bf req-ca48ba15-0913-4091-bad8-6c76c2e69e7d service nova] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] No waiting events found dispatching network-vif-unplugged-3d2071d3-9bd0-4aa5-a909-889b3f3155db {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG nova.compute.manager [req-c2debc6c-72bc-471e-baad-06f1135601bf req-ca48ba15-0913-4091-bad8-6c76c2e69e7d service nova] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Received event network-vif-unplugged-3d2071d3-9bd0-4aa5-a909-889b3f3155db for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 11:30:17 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Instance destroyed successfully.
Oct 16 11:30:17 user nova-compute[74683]: DEBUG nova.objects.instance [None req-1e55c217-83f7-4767-bad6-be78f9855166 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lazy-loading 'resources' on Instance uuid d00bbb1a-534b-4437-9b79-91870c5d8bb5 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-1e55c217-83f7-4767-bad6-be78f9855166 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:24:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2068879379',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2068879379',id=29,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:26:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d6e0046017b4bba85caf2a39d1c67b3',ramdisk_id='',reservation_id='r-zizi1x7p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1787816377',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:28:30Z,user_data=None,user_id='76a41804541e4a259771702727d9993e',uuid=d00bbb1a-534b-4437-9b79-91870c5d8bb5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d2071d3-9bd0-4aa5-a909-889b3f3155db", "address": "fa:16:3e:53:66:36", "network": {"id": "4d43cc12-d2cd-4552-90a4-884a0ff3dc66", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-825513246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6e0046017b4bba85caf2a39d1c67b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d2071d3-9b", "ovs_interfaceid": "3d2071d3-9bd0-4aa5-a909-889b3f3155db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-1e55c217-83f7-4767-bad6-be78f9855166 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Converting VIF {"id": "3d2071d3-9bd0-4aa5-a909-889b3f3155db", "address": "fa:16:3e:53:66:36", "network": {"id": "4d43cc12-d2cd-4552-90a4-884a0ff3dc66", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-825513246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6e0046017b4bba85caf2a39d1c67b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d2071d3-9b", "ovs_interfaceid": "3d2071d3-9bd0-4aa5-a909-889b3f3155db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-1e55c217-83f7-4767-bad6-be78f9855166 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:66:36,bridge_name='br-int',has_traffic_filtering=True,id=3d2071d3-9bd0-4aa5-a909-889b3f3155db,network=Network(4d43cc12-d2cd-4552-90a4-884a0ff3dc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d2071d3-9b') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG os_vif [None req-1e55c217-83f7-4767-bad6-be78f9855166 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:66:36,bridge_name='br-int',has_traffic_filtering=True,id=3d2071d3-9bd0-4aa5-a909-889b3f3155db,network=Network(4d43cc12-d2cd-4552-90a4-884a0ff3dc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d2071d3-9b') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d2071d3-9b, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fb4ce0ef-242d-42ed-ac2a-3ed98333fcc2) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:30:17 user nova-compute[74683]: INFO os_vif [None req-1e55c217-83f7-4767-bad6-be78f9855166 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:66:36,bridge_name='br-int',has_traffic_filtering=True,id=3d2071d3-9bd0-4aa5-a909-889b3f3155db,network=Network(4d43cc12-d2cd-4552-90a4-884a0ff3dc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d2071d3-9b')
Oct 16 11:30:17 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e55c217-83f7-4767-bad6-be78f9855166 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] calling os-brick to detach iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e55c217-83f7-4767-bad6-be78f9855166 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, {'target_iqn': 'iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PSFCAUyR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:30:17 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-1e55c217-83f7-4767-bad6-be78f9855166 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:30:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-1e55c217-83f7-4767-bad6-be78f9855166 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-1e55c217-83f7-4767-bad6-be78f9855166 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed8a37c-e85c-46f0-a55c-804b825a4177]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e55c217-83f7-4767-bad6-be78f9855166 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 11:30:17 user nova-compute[74683]: No targets found.
Oct 16 11:30:17 user nova-compute[74683]: iSNS:
Oct 16 11:30:17 user nova-compute[74683]: No targets found.
Oct 16 11:30:17 user nova-compute[74683]: STATIC:
Oct 16 11:30:17 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354
Oct 16 11:30:17 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:30:17 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:30:17 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb
Oct 16 11:30:17 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:30:17 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:30:17 user nova-compute[74683]: FIRMWARE:
Oct 16 11:30:17 user nova-compute[74683]: No targets found.
Oct 16 11:30:17 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e55c217-83f7-4767-bad6-be78f9855166 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 11:30:17 user nova-compute[74683]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 11:30:17 user nova-compute[74683]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74683) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e55c217-83f7-4767-bad6-be78f9855166 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354', 0)] {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c01763-0d6c-4a39-ab2c-6fbcf298c2f5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[34441510-4a29-4233-9e38-819ef43c81ec]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e55c217-83f7-4767-bad6-be78f9855166 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:30:17 user nova-compute[74683]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)
Oct 16 11:30:17 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e55c217-83f7-4767-bad6-be78f9855166 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:30:17 user nova-compute[74683]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 (non-flash)
Oct 16 11:30:17 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e55c217-83f7-4767-bad6-be78f9855166 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda4c695240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354'): ({'sdd'}, set())}) {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-1e55c217-83f7-4767-bad6-be78f9855166 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Removing single pathed devices sdd {{(pid=74683) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e853a514-634b-4354-bb9a-d271c2681e93]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e895e81e-6e92-45e9-af3a-f5ec204b8e1e]: (4, ('ok\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-1e55c217-83f7-4767-bad6-be78f9855166 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Flushing IO for device /dev/sdd {{(pid=74683) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[407bac0a-3ecf-48e5-82c2-4cf206fa3e66]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-1e55c217-83f7-4767-bad6-be78f9855166 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74683) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[708df1f7-bae1-4832-96ae-7c1d0fb1b9d7]: (4, ('1', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-1e55c217-83f7-4767-bad6-be78f9855166 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-1e55c217-83f7-4767-bad6-be78f9855166 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] SCSI volumes sdd have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26366346562353433', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e8f8ea5', '/dev/disk/by-id/scsi-1SCST_BIOe8f8ea5-cf4eb5435af4a28e') {{(pid=85666) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[c761ce3f-30aa-420e-9c18-eb0ef122017f]: (4, None) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e55c217-83f7-4767-bad6-be78f9855166 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354')] {{(pid=74683) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc85b57-b102-4704-9328-0e7e67021c81]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e55c217-83f7-4767-bad6-be78f9855166 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 -p 172.16.0.220:3260 --logout {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[646bfe56-35cd-4227-ace2-bce8d711ff38]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e55c217-83f7-4767-bad6-be78f9855166 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354, portal: 172.16.0.220,3260]
Oct 16 11:30:17 user nova-compute[74683]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354, portal: 172.16.0.220,3260] successful.
Oct 16 11:30:17 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 -p 172.16.0.220:3260 --op delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89f4c36a-6914-44f0-b0ce-54415b3b2354 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03c9833-ef55-491b-8fbd-2fde1aeb316e]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e55c217-83f7-4767-bad6-be78f9855166 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-1e55c217-83f7-4767-bad6-be78f9855166 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e55c217-83f7-4767-bad6-be78f9855166 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] <== disconnect_volume: return (349ms) None {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e55c217-83f7-4767-bad6-be78f9855166 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Disconnected iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 11:30:17 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-1e55c217-83f7-4767-bad6-be78f9855166 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Deleting instance files /opt/stack/data/nova/instances/d00bbb1a-534b-4437-9b79-91870c5d8bb5_del
Oct 16 11:30:17 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-1e55c217-83f7-4767-bad6-be78f9855166 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Deletion of /opt/stack/data/nova/instances/d00bbb1a-534b-4437-9b79-91870c5d8bb5_del complete
Oct 16 11:30:17 user nova-compute[74683]: INFO nova.compute.manager [None req-1e55c217-83f7-4767-bad6-be78f9855166 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Took 1.18 seconds to destroy the instance on the hypervisor.
Oct 16 11:30:17 user nova-compute[74683]: DEBUG oslo.service.loopingcall [None req-1e55c217-83f7-4767-bad6-be78f9855166 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74683) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG nova.compute.manager [-] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Deallocating network for instance {{(pid=74683) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 11:30:17 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] deallocate_for_instance() {{(pid=74683) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 11:30:18 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:30:18 user nova-compute[74683]: INFO nova.compute.manager [-] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Took 0.46 seconds to deallocate network for instance.
Oct 16 11:30:18 user nova-compute[74683]: DEBUG nova.compute.manager [req-92d3ddf3-715c-4eea-8538-584afa647129 req-dec1ac0a-238e-44ea-b72a-f14631bf2e0c service nova] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Received event network-vif-deleted-3d2071d3-9bd0-4aa5-a909-889b3f3155db {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:30:18 user nova-compute[74683]: INFO nova.compute.manager [req-92d3ddf3-715c-4eea-8538-584afa647129 req-dec1ac0a-238e-44ea-b72a-f14631bf2e0c service nova] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Neutron deleted interface 3d2071d3-9bd0-4aa5-a909-889b3f3155db; detaching it from the instance and deleting it from the info cache
Oct 16 11:30:18 user nova-compute[74683]: DEBUG nova.network.neutron [req-92d3ddf3-715c-4eea-8538-584afa647129 req-dec1ac0a-238e-44ea-b72a-f14631bf2e0c service nova] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:30:18 user nova-compute[74683]: DEBUG nova.compute.manager [req-92d3ddf3-715c-4eea-8538-584afa647129 req-dec1ac0a-238e-44ea-b72a-f14631bf2e0c service nova] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Detach interface failed, port_id=3d2071d3-9bd0-4aa5-a909-889b3f3155db, reason: Instance d00bbb1a-534b-4437-9b79-91870c5d8bb5 could not be found. {{(pid=74683) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 16 11:30:18 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:30:18 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:30:18 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74683) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 11:30:19 user nova-compute[74683]: DEBUG nova.compute.manager [req-6d8b581f-e319-4378-8d03-501f70d49e7e req-208ebad7-3f8c-44cc-a0b4-384c1c4fc0ef service nova] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Received event network-vif-plugged-3d2071d3-9bd0-4aa5-a909-889b3f3155db {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:30:19 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-6d8b581f-e319-4378-8d03-501f70d49e7e req-208ebad7-3f8c-44cc-a0b4-384c1c4fc0ef service nova] Acquiring lock "d00bbb1a-534b-4437-9b79-91870c5d8bb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:30:19 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-6d8b581f-e319-4378-8d03-501f70d49e7e req-208ebad7-3f8c-44cc-a0b4-384c1c4fc0ef service nova] Lock "d00bbb1a-534b-4437-9b79-91870c5d8bb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:30:19 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-6d8b581f-e319-4378-8d03-501f70d49e7e req-208ebad7-3f8c-44cc-a0b4-384c1c4fc0ef service nova] Lock "d00bbb1a-534b-4437-9b79-91870c5d8bb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:30:19 user nova-compute[74683]: DEBUG nova.compute.manager [req-6d8b581f-e319-4378-8d03-501f70d49e7e req-208ebad7-3f8c-44cc-a0b4-384c1c4fc0ef service nova] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] No waiting events found dispatching network-vif-plugged-3d2071d3-9bd0-4aa5-a909-889b3f3155db {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:30:19 user nova-compute[74683]: WARNING nova.compute.manager [req-6d8b581f-e319-4378-8d03-501f70d49e7e req-208ebad7-3f8c-44cc-a0b4-384c1c4fc0ef service nova] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Received unexpected event network-vif-plugged-3d2071d3-9bd0-4aa5-a909-889b3f3155db for instance with vm_state active and task_state deleting.
Oct 16 11:30:19 user nova-compute[74683]: INFO nova.compute.manager [None req-1e55c217-83f7-4767-bad6-be78f9855166 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d00bbb1a-534b-4437-9b79-91870c5d8bb5] Took 0.83 seconds to detach 1 volumes for instance.
Oct 16 11:30:19 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1e55c217-83f7-4767-bad6-be78f9855166 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:30:19 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1e55c217-83f7-4767-bad6-be78f9855166 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:30:19 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-1e55c217-83f7-4767-bad6-be78f9855166 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:30:19 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-1e55c217-83f7-4767-bad6-be78f9855166 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:30:19 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1e55c217-83f7-4767-bad6-be78f9855166 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.275s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:30:19 user nova-compute[74683]: INFO nova.scheduler.client.report [None req-1e55c217-83f7-4767-bad6-be78f9855166 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Deleted allocations for instance d00bbb1a-534b-4437-9b79-91870c5d8bb5
Oct 16 11:30:19 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1e55c217-83f7-4767-bad6-be78f9855166 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "d00bbb1a-534b-4437-9b79-91870c5d8bb5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.974s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:30:21 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:30:21 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:30:21 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:30:21 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:30:21 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:30:21 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Auditing locally available compute resources for user (node: user) {{(pid=74683) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 11:30:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:30:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:30:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:30:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:30:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9fc5a9-8659-497c-bb07-af52fe2e1761/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:30:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:30:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9fc5a9-8659-497c-bb07-af52fe2e1761/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:30:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9fc5a9-8659-497c-bb07-af52fe2e1761/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:30:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9fc5a9-8659-497c-bb07-af52fe2e1761/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:30:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:30:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:30:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:30:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:30:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b79d385-e512-4297-9aa4-2b9bb0cac23c/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:30:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b79d385-e512-4297-9aa4-2b9bb0cac23c/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:30:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b79d385-e512-4297-9aa4-2b9bb0cac23c/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:30:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b79d385-e512-4297-9aa4-2b9bb0cac23c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:30:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.rescue --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:30:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:30:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.rescue --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:30:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:30:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:30:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:30:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:30:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:30:24 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:30:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:30:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:30:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:30:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:30:25 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:30:25 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:30:25 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Hypervisor/Node resource view: name=user free_ram=8194MB free_disk=25.067718505859375GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74683) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 11:30:25 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:30:25 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:30:25 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 18a77385-fab9-4ea0-8aa6-666cf7e798a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:30:25 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance d5e55361-d9ed-4d07-91b0-ec4d08b2e817 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:30:25 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance edd01413-1f8a-49e3-aa3c-ecb19c62afae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:30:25 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 6c9fc5a9-8659-497c-bb07-af52fe2e1761 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:30:25 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 9b8ba94f-43cc-4f06-bcd9-83935ccbe117 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:30:25 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance b91af786-36e3-4815-811f-fb3c055e758d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:30:25 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 0b79d385-e512-4297-9aa4-2b9bb0cac23c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:30:25 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 11:30:25 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 11:30:25 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:30:25 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:30:25 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Compute_service record updated for user:user {{(pid=74683) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 11:30:25 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.419s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:30:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:30:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:30:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Acquiring lock "9ece51b6-5cb3-4d79-acdb-ea4d895cdce8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:30:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "9ece51b6-5cb3-4d79-acdb-ea4d895cdce8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:30:30 user nova-compute[74683]: DEBUG nova.compute.manager [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Starting instance... {{(pid=74683) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 11:30:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:30:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:30:30 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74683) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 11:30:30 user nova-compute[74683]: INFO nova.compute.claims [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Claim successful on node user
Oct 16 11:30:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:30:31 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:30:31 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:30:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.500s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:30:31 user nova-compute[74683]: DEBUG nova.compute.manager [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Start building networks asynchronously for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 11:30:31 user nova-compute[74683]: DEBUG nova.compute.manager [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Allocating IP information in the background. {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 11:30:31 user nova-compute[74683]: DEBUG nova.network.neutron [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] allocate_for_instance() {{(pid=74683) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 11:30:31 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 11:30:31 user nova-compute[74683]: DEBUG nova.compute.manager [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Start building block device mappings for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 11:30:31 user nova-compute[74683]: DEBUG nova.policy [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3436197c787446d4a03fb7697d7999a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a49078f1240bd88207e487dd4951e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74683) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 11:30:31 user nova-compute[74683]: DEBUG nova.compute.manager [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Start spawning the instance on the hypervisor. {{(pid=74683) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 11:30:31 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Creating instance directory {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 11:30:31 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Creating image(s)
Oct 16 11:30:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Acquiring lock "/opt/stack/data/nova/instances/9ece51b6-5cb3-4d79-acdb-ea4d895cdce8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:30:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "/opt/stack/data/nova/instances/9ece51b6-5cb3-4d79-acdb-ea4d895cdce8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:30:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "/opt/stack/data/nova/instances/9ece51b6-5cb3-4d79-acdb-ea4d895cdce8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:30:31 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:30:31 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.196s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:30:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Acquiring lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:30:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:30:31 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:30:32 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.199s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:30:32 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/9ece51b6-5cb3-4d79-acdb-ea4d895cdce8/disk 1073741824 {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:30:32 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/9ece51b6-5cb3-4d79-acdb-ea4d895cdce8/disk 1073741824" returned: 0 in 0.046s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:30:32 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:30:32 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:30:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:30:32 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.234s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:30:32 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9ece51b6-5cb3-4d79-acdb-ea4d895cdce8/disk. size=1073741824 {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 11:30:32 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ece51b6-5cb3-4d79-acdb-ea4d895cdce8/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:30:32 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ece51b6-5cb3-4d79-acdb-ea4d895cdce8/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:30:32 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Cannot resize image /opt/stack/data/nova/instances/9ece51b6-5cb3-4d79-acdb-ea4d895cdce8/disk to a smaller size. {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 11:30:32 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Created local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 11:30:32 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Ensure instance console log exists: /opt/stack/data/nova/instances/9ece51b6-5cb3-4d79-acdb-ea4d895cdce8/console.log {{(pid=74683) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 11:30:32 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:30:32 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:30:32 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:30:32 user nova-compute[74683]: DEBUG nova.network.neutron [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Successfully created port: a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6 {{(pid=74683) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 11:30:33 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:30:33 user nova-compute[74683]: DEBUG nova.network.neutron [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Successfully updated port: a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6 {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:30:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Acquiring lock "refresh_cache-9ece51b6-5cb3-4d79-acdb-ea4d895cdce8" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:30:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Acquired lock "refresh_cache-9ece51b6-5cb3-4d79-acdb-ea4d895cdce8" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:30:33 user nova-compute[74683]: DEBUG nova.network.neutron [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:30:33 user nova-compute[74683]: DEBUG nova.compute.manager [req-4df0fdff-4788-44df-aba1-3c74251efb80 req-f3f41255-ffa7-42ea-b669-fec40d15dd3b service nova] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Received event network-changed-a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:30:33 user nova-compute[74683]: DEBUG nova.compute.manager [req-4df0fdff-4788-44df-aba1-3c74251efb80 req-f3f41255-ffa7-42ea-b669-fec40d15dd3b service nova] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Refreshing instance network info cache due to event network-changed-a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:30:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-4df0fdff-4788-44df-aba1-3c74251efb80 req-f3f41255-ffa7-42ea-b669-fec40d15dd3b service nova] Acquiring lock "refresh_cache-9ece51b6-5cb3-4d79-acdb-ea4d895cdce8" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:30:33 user nova-compute[74683]: DEBUG nova.network.neutron [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:30:34 user nova-compute[74683]: DEBUG nova.network.neutron [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Updating instance_info_cache with network_info: [{"id": "a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6", "address": "fa:16:3e:cf:8d:8b", "network": {"id": "fa128ba8-cd2f-4621-ac04-ecc21569bb68", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321708612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66a49078f1240bd88207e487dd4951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7bd5f8b-2b", "ovs_interfaceid": "a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:30:34 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Releasing lock "refresh_cache-9ece51b6-5cb3-4d79-acdb-ea4d895cdce8" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:30:34 user nova-compute[74683]: DEBUG nova.compute.manager [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Instance network_info: |[{"id": "a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6", "address": "fa:16:3e:cf:8d:8b", "network": {"id": "fa128ba8-cd2f-4621-ac04-ecc21569bb68", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321708612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66a49078f1240bd88207e487dd4951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7bd5f8b-2b", "ovs_interfaceid": "a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 11:30:34 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-4df0fdff-4788-44df-aba1-3c74251efb80 req-f3f41255-ffa7-42ea-b669-fec40d15dd3b service nova] Acquired lock "refresh_cache-9ece51b6-5cb3-4d79-acdb-ea4d895cdce8" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:30:34 user nova-compute[74683]: DEBUG nova.network.neutron [req-4df0fdff-4788-44df-aba1-3c74251efb80 req-f3f41255-ffa7-42ea-b669-fec40d15dd3b service nova] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Refreshing network info cache for port a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:30:34 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Start _get_guest_xml network_info=[{"id": "a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6", "address": "fa:16:3e:cf:8d:8b", "network": {"id": "fa128ba8-cd2f-4621-ac04-ecc21569bb68", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321708612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66a49078f1240bd88207e487dd4951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7bd5f8b-2b", "ovs_interfaceid": "a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:30:34 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:30:34 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:30:34 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:30:34 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:30:34 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:30:34 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:30:34 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:30:34 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:30:34 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:30:34 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:30:34 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:30:34 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:30:34 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:30:34 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:30:34 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:30:34 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:30:34 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:30:34 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:30:34 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:30:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-526350141',display_name='tempest-ServerRescueNegativeTestJSON-server-526350141',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-526350141',id=33,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNz1V1kjn+NusY2zgo3ikJiEK0+g7zHYU6qx9jtiB8KZYL8r9TMeQpPPNhfnwBaZYH54zgAqVMOORXAZv/pdJIJRHHUu3H3sIO4N1YDwfFsndK20Q/vGu2bvzF+wspuY3Q==',key_name='tempest-keypair-1176984004',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e66a49078f1240bd88207e487dd4951e',ramdisk_id='',reservation_id='r-8k60d1p0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1690011355',owner_user_name='tempest-ServerRescueNegativeTestJSON-1690011355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:30:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3436197c787446d4a03fb7697d7999a1',uuid=9ece51b6-5cb3-4d79-acdb-ea4d895cdce8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6", "address": "fa:16:3e:cf:8d:8b", "network": {"id": "fa128ba8-cd2f-4621-ac04-ecc21569bb68", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321708612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66a49078f1240bd88207e487dd4951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7bd5f8b-2b", "ovs_interfaceid": "a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:30:34 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Converting VIF {"id": "a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6", "address": "fa:16:3e:cf:8d:8b", "network": {"id": "fa128ba8-cd2f-4621-ac04-ecc21569bb68", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321708612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66a49078f1240bd88207e487dd4951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7bd5f8b-2b", "ovs_interfaceid": "a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:30:34 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:8d:8b,bridge_name='br-int',has_traffic_filtering=True,id=a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6,network=Network(fa128ba8-cd2f-4621-ac04-ecc21569bb68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7bd5f8b-2b') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:30:34 user nova-compute[74683]: DEBUG nova.objects.instance [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:30:34 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:30:34 user nova-compute[74683]:   <uuid>9ece51b6-5cb3-4d79-acdb-ea4d895cdce8</uuid>
Oct 16 11:30:34 user nova-compute[74683]:   <name>instance-00000021</name>
Oct 16 11:30:34 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:30:34 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:30:34 user nova-compute[74683]:   <metadata>
Oct 16 11:30:34 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:30:34 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:30:34 user nova-compute[74683]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-526350141</nova:name>
Oct 16 11:30:34 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:30:34</nova:creationTime>
Oct 16 11:30:34 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:30:34 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:30:34 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:30:34 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:30:34 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:30:34 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:30:34 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:30:34 user nova-compute[74683]:       <nova:owner>
Oct 16 11:30:34 user nova-compute[74683]:         <nova:user uuid="3436197c787446d4a03fb7697d7999a1">tempest-ServerRescueNegativeTestJSON-1690011355-project-member</nova:user>
Oct 16 11:30:34 user nova-compute[74683]:         <nova:project uuid="e66a49078f1240bd88207e487dd4951e">tempest-ServerRescueNegativeTestJSON-1690011355</nova:project>
Oct 16 11:30:34 user nova-compute[74683]:       </nova:owner>
Oct 16 11:30:34 user nova-compute[74683]:       <nova:root type="image" uuid="0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f"/>
Oct 16 11:30:34 user nova-compute[74683]:       <nova:ports>
Oct 16 11:30:34 user nova-compute[74683]:         <nova:port uuid="a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6">
Oct 16 11:30:34 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 16 11:30:34 user nova-compute[74683]:         </nova:port>
Oct 16 11:30:34 user nova-compute[74683]:       </nova:ports>
Oct 16 11:30:34 user nova-compute[74683]:     </nova:instance>
Oct 16 11:30:34 user nova-compute[74683]:   </metadata>
Oct 16 11:30:34 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:30:34 user nova-compute[74683]:     <system>
Oct 16 11:30:34 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:30:34 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:30:34 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:30:34 user nova-compute[74683]:       <entry name="serial">9ece51b6-5cb3-4d79-acdb-ea4d895cdce8</entry>
Oct 16 11:30:34 user nova-compute[74683]:       <entry name="uuid">9ece51b6-5cb3-4d79-acdb-ea4d895cdce8</entry>
Oct 16 11:30:34 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:30:34 user nova-compute[74683]:     </system>
Oct 16 11:30:34 user nova-compute[74683]:   </sysinfo>
Oct 16 11:30:34 user nova-compute[74683]:   <os>
Oct 16 11:30:34 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:30:34 user nova-compute[74683]:     <boot dev="hd"/>
Oct 16 11:30:34 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:30:34 user nova-compute[74683]:   </os>
Oct 16 11:30:34 user nova-compute[74683]:   <features>
Oct 16 11:30:34 user nova-compute[74683]:     <acpi/>
Oct 16 11:30:34 user nova-compute[74683]:     <apic/>
Oct 16 11:30:34 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:30:34 user nova-compute[74683]:   </features>
Oct 16 11:30:34 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:30:34 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:30:34 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:30:34 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:30:34 user nova-compute[74683]:   </clock>
Oct 16 11:30:34 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:30:34 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:30:34 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:30:34 user nova-compute[74683]:   </cpu>
Oct 16 11:30:34 user nova-compute[74683]:   <devices>
Oct 16 11:30:34 user nova-compute[74683]:     <disk type="file" device="disk">
Oct 16 11:30:34 user nova-compute[74683]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 11:30:34 user nova-compute[74683]:       <source file="/opt/stack/data/nova/instances/9ece51b6-5cb3-4d79-acdb-ea4d895cdce8/disk"/>
Oct 16 11:30:34 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:30:34 user nova-compute[74683]:     </disk>
Oct 16 11:30:34 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:30:34 user nova-compute[74683]:       <mac address="fa:16:3e:cf:8d:8b"/>
Oct 16 11:30:34 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:30:34 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:30:34 user nova-compute[74683]:       <target dev="tapa7bd5f8b-2b"/>
Oct 16 11:30:34 user nova-compute[74683]:     </interface>
Oct 16 11:30:34 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:30:34 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/9ece51b6-5cb3-4d79-acdb-ea4d895cdce8/console.log" append="off"/>
Oct 16 11:30:34 user nova-compute[74683]:     </serial>
Oct 16 11:30:34 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:30:34 user nova-compute[74683]:     <video>
Oct 16 11:30:34 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:30:34 user nova-compute[74683]:     </video>
Oct 16 11:30:34 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:30:34 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:30:34 user nova-compute[74683]:     </rng>
Oct 16 11:30:34 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:30:34 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:30:34 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:30:34 user nova-compute[74683]:     </memballoon>
Oct 16 11:30:34 user nova-compute[74683]:   </devices>
Oct 16 11:30:34 user nova-compute[74683]: </domain>
Oct 16 11:30:34 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:30:34 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:30:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-526350141',display_name='tempest-ServerRescueNegativeTestJSON-server-526350141',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-526350141',id=33,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNz1V1kjn+NusY2zgo3ikJiEK0+g7zHYU6qx9jtiB8KZYL8r9TMeQpPPNhfnwBaZYH54zgAqVMOORXAZv/pdJIJRHHUu3H3sIO4N1YDwfFsndK20Q/vGu2bvzF+wspuY3Q==',key_name='tempest-keypair-1176984004',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e66a49078f1240bd88207e487dd4951e',ramdisk_id='',reservation_id='r-8k60d1p0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1690011355',owner_user_name='tempest-ServerRescueNegativeTestJSON-1690011355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:30:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3436197c787446d4a03fb7697d7999a1',uuid=9ece51b6-5cb3-4d79-acdb-ea4d895cdce8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6", "address": "fa:16:3e:cf:8d:8b", "network": {"id": "fa128ba8-cd2f-4621-ac04-ecc21569bb68", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321708612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66a49078f1240bd88207e487dd4951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7bd5f8b-2b", "ovs_interfaceid": "a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:30:34 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Converting VIF {"id": "a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6", "address": "fa:16:3e:cf:8d:8b", "network": {"id": "fa128ba8-cd2f-4621-ac04-ecc21569bb68", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321708612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66a49078f1240bd88207e487dd4951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7bd5f8b-2b", "ovs_interfaceid": "a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:30:34 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:8d:8b,bridge_name='br-int',has_traffic_filtering=True,id=a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6,network=Network(fa128ba8-cd2f-4621-ac04-ecc21569bb68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7bd5f8b-2b') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:30:34 user nova-compute[74683]: DEBUG os_vif [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:8d:8b,bridge_name='br-int',has_traffic_filtering=True,id=a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6,network=Network(fa128ba8-cd2f-4621-ac04-ecc21569bb68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7bd5f8b-2b') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:30:34 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:30:34 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:30:34 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:30:34 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:30:34 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '51b5fd8c-0516-5acf-ae9f-37ba4d3f5db3', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:30:34 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:30:34 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:30:34 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:30:34 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa7bd5f8b-2b, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:30:34 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa7bd5f8b-2b, col_values=(('qos', UUID('733a2aee-4a92-4fdc-af43-588af0b9e770')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:30:34 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa7bd5f8b-2b, col_values=(('external_ids', {'iface-id': 'a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:8d:8b', 'vm-uuid': '9ece51b6-5cb3-4d79-acdb-ea4d895cdce8'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:30:34 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:30:34 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:30:34 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:30:34 user nova-compute[74683]: INFO os_vif [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:8d:8b,bridge_name='br-int',has_traffic_filtering=True,id=a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6,network=Network(fa128ba8-cd2f-4621-ac04-ecc21569bb68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7bd5f8b-2b')
Oct 16 11:30:34 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:30:34 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] No VIF found with MAC fa:16:3e:cf:8d:8b, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:30:34 user nova-compute[74683]: DEBUG nova.network.neutron [req-4df0fdff-4788-44df-aba1-3c74251efb80 req-f3f41255-ffa7-42ea-b669-fec40d15dd3b service nova] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Updated VIF entry in instance network info cache for port a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:30:34 user nova-compute[74683]: DEBUG nova.network.neutron [req-4df0fdff-4788-44df-aba1-3c74251efb80 req-f3f41255-ffa7-42ea-b669-fec40d15dd3b service nova] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Updating instance_info_cache with network_info: [{"id": "a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6", "address": "fa:16:3e:cf:8d:8b", "network": {"id": "fa128ba8-cd2f-4621-ac04-ecc21569bb68", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321708612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66a49078f1240bd88207e487dd4951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7bd5f8b-2b", "ovs_interfaceid": "a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:30:34 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-4df0fdff-4788-44df-aba1-3c74251efb80 req-f3f41255-ffa7-42ea-b669-fec40d15dd3b service nova] Releasing lock "refresh_cache-9ece51b6-5cb3-4d79-acdb-ea4d895cdce8" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:30:35 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:30:35 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:30:35 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:30:35 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:30:35 user nova-compute[74683]: DEBUG nova.compute.manager [req-5b53a61c-c580-4bb9-93f5-3d5b9b3b47c4 req-bc415ba1-6a41-4c0a-8b7f-a63ca287b835 service nova] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Received event network-vif-plugged-a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:30:35 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-5b53a61c-c580-4bb9-93f5-3d5b9b3b47c4 req-bc415ba1-6a41-4c0a-8b7f-a63ca287b835 service nova] Acquiring lock "9ece51b6-5cb3-4d79-acdb-ea4d895cdce8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:30:35 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-5b53a61c-c580-4bb9-93f5-3d5b9b3b47c4 req-bc415ba1-6a41-4c0a-8b7f-a63ca287b835 service nova] Lock "9ece51b6-5cb3-4d79-acdb-ea4d895cdce8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:30:35 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-5b53a61c-c580-4bb9-93f5-3d5b9b3b47c4 req-bc415ba1-6a41-4c0a-8b7f-a63ca287b835 service nova] Lock "9ece51b6-5cb3-4d79-acdb-ea4d895cdce8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:30:35 user nova-compute[74683]: DEBUG nova.compute.manager [req-5b53a61c-c580-4bb9-93f5-3d5b9b3b47c4 req-bc415ba1-6a41-4c0a-8b7f-a63ca287b835 service nova] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] No waiting events found dispatching network-vif-plugged-a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:30:35 user nova-compute[74683]: WARNING nova.compute.manager [req-5b53a61c-c580-4bb9-93f5-3d5b9b3b47c4 req-bc415ba1-6a41-4c0a-8b7f-a63ca287b835 service nova] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Received unexpected event network-vif-plugged-a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6 for instance with vm_state building and task_state spawning.
Oct 16 11:30:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:30:37 user nova-compute[74683]: DEBUG nova.compute.manager [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Instance event wait completed in 0 seconds for  {{(pid=74683) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 11:30:37 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Guest created on hypervisor {{(pid=74683) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 11:30:37 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Instance spawned successfully.
Oct 16 11:30:37 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 11:30:37 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Found default for hw_cdrom_bus of ide {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:30:37 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Found default for hw_disk_bus of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:30:37 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Found default for hw_input_bus of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:30:37 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Found default for hw_pointer_model of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:30:37 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Found default for hw_video_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:30:37 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Found default for hw_vif_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:30:37 user nova-compute[74683]: INFO nova.compute.manager [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Took 6.13 seconds to spawn the instance on the hypervisor.
Oct 16 11:30:37 user nova-compute[74683]: DEBUG nova.compute.manager [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:30:37 user nova-compute[74683]: DEBUG nova.compute.manager [req-12c21d6d-7963-4103-b458-8f2efd050e98 req-0e57e9ee-ed40-4d57-9048-ba433839b1c4 service nova] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Received event network-vif-plugged-a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:30:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-12c21d6d-7963-4103-b458-8f2efd050e98 req-0e57e9ee-ed40-4d57-9048-ba433839b1c4 service nova] Acquiring lock "9ece51b6-5cb3-4d79-acdb-ea4d895cdce8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:30:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-12c21d6d-7963-4103-b458-8f2efd050e98 req-0e57e9ee-ed40-4d57-9048-ba433839b1c4 service nova] Lock "9ece51b6-5cb3-4d79-acdb-ea4d895cdce8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:30:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-12c21d6d-7963-4103-b458-8f2efd050e98 req-0e57e9ee-ed40-4d57-9048-ba433839b1c4 service nova] Lock "9ece51b6-5cb3-4d79-acdb-ea4d895cdce8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:30:37 user nova-compute[74683]: DEBUG nova.compute.manager [req-12c21d6d-7963-4103-b458-8f2efd050e98 req-0e57e9ee-ed40-4d57-9048-ba433839b1c4 service nova] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] No waiting events found dispatching network-vif-plugged-a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:30:37 user nova-compute[74683]: WARNING nova.compute.manager [req-12c21d6d-7963-4103-b458-8f2efd050e98 req-0e57e9ee-ed40-4d57-9048-ba433839b1c4 service nova] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Received unexpected event network-vif-plugged-a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6 for instance with vm_state building and task_state spawning.
Oct 16 11:30:37 user nova-compute[74683]: INFO nova.compute.manager [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Took 7.02 seconds to build instance.
Oct 16 11:30:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-06a3065b-5012-4729-a863-1972c64b59e9 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "9ece51b6-5cb3-4d79-acdb-ea4d895cdce8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.114s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:30:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:30:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:30:44 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:30:46 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:30:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Acquiring lock "2fb10bb7-d421-40c6-be80-0e10138fc2b0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:30:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Lock "2fb10bb7-d421-40c6-be80-0e10138fc2b0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:30:48 user nova-compute[74683]: DEBUG nova.compute.manager [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 2fb10bb7-d421-40c6-be80-0e10138fc2b0] Starting instance... {{(pid=74683) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 11:30:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:30:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:30:48 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74683) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 11:30:48 user nova-compute[74683]: INFO nova.compute.claims [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 2fb10bb7-d421-40c6-be80-0e10138fc2b0] Claim successful on node user
Oct 16 11:30:48 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:30:48 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:30:49 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.446s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:30:49 user nova-compute[74683]: DEBUG nova.compute.manager [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 2fb10bb7-d421-40c6-be80-0e10138fc2b0] Start building networks asynchronously for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 11:30:49 user nova-compute[74683]: DEBUG nova.compute.manager [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 2fb10bb7-d421-40c6-be80-0e10138fc2b0] Allocating IP information in the background. {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 11:30:49 user nova-compute[74683]: DEBUG nova.network.neutron [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 2fb10bb7-d421-40c6-be80-0e10138fc2b0] allocate_for_instance() {{(pid=74683) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 11:30:49 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 2fb10bb7-d421-40c6-be80-0e10138fc2b0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 11:30:49 user nova-compute[74683]: DEBUG nova.compute.manager [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 2fb10bb7-d421-40c6-be80-0e10138fc2b0] Start building block device mappings for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 11:30:49 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:30:49 user nova-compute[74683]: DEBUG nova.policy [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2cb90c639a424b3ba9b7513aa6624334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c02c8882c3f4a2eac7d1f320c06899b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74683) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 11:30:49 user nova-compute[74683]: DEBUG nova.compute.manager [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 2fb10bb7-d421-40c6-be80-0e10138fc2b0] Start spawning the instance on the hypervisor. {{(pid=74683) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 11:30:49 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 2fb10bb7-d421-40c6-be80-0e10138fc2b0] Creating instance directory {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 11:30:49 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 2fb10bb7-d421-40c6-be80-0e10138fc2b0] Creating image(s)
Oct 16 11:30:49 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Acquiring lock "/opt/stack/data/nova/instances/2fb10bb7-d421-40c6-be80-0e10138fc2b0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:30:49 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Lock "/opt/stack/data/nova/instances/2fb10bb7-d421-40c6-be80-0e10138fc2b0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:30:49 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Lock "/opt/stack/data/nova/instances/2fb10bb7-d421-40c6-be80-0e10138fc2b0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:30:49 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:30:49 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.203s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:30:49 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Acquiring lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:30:49 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:30:49 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:30:49 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.189s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:30:49 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/2fb10bb7-d421-40c6-be80-0e10138fc2b0/disk 1073741824 {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:30:49 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/2fb10bb7-d421-40c6-be80-0e10138fc2b0/disk 1073741824" returned: 0 in 0.066s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:30:49 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:30:49 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:30:49 user nova-compute[74683]: DEBUG nova.network.neutron [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 2fb10bb7-d421-40c6-be80-0e10138fc2b0] Successfully created port: 36797039-dc96-40f6-b535-8e179243e791 {{(pid=74683) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 11:30:49 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.203s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:30:49 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2fb10bb7-d421-40c6-be80-0e10138fc2b0/disk. size=1073741824 {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 11:30:49 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb10bb7-d421-40c6-be80-0e10138fc2b0/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:30:50 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb10bb7-d421-40c6-be80-0e10138fc2b0/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:30:50 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Cannot resize image /opt/stack/data/nova/instances/2fb10bb7-d421-40c6-be80-0e10138fc2b0/disk to a smaller size. {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 11:30:50 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 2fb10bb7-d421-40c6-be80-0e10138fc2b0] Created local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 11:30:50 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 2fb10bb7-d421-40c6-be80-0e10138fc2b0] Ensure instance console log exists: /opt/stack/data/nova/instances/2fb10bb7-d421-40c6-be80-0e10138fc2b0/console.log {{(pid=74683) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 11:30:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:30:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:30:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:30:50 user nova-compute[74683]: DEBUG nova.network.neutron [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 2fb10bb7-d421-40c6-be80-0e10138fc2b0] Successfully updated port: 36797039-dc96-40f6-b535-8e179243e791 {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:30:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Acquiring lock "refresh_cache-2fb10bb7-d421-40c6-be80-0e10138fc2b0" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:30:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Acquired lock "refresh_cache-2fb10bb7-d421-40c6-be80-0e10138fc2b0" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:30:50 user nova-compute[74683]: DEBUG nova.network.neutron [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 2fb10bb7-d421-40c6-be80-0e10138fc2b0] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:30:50 user nova-compute[74683]: DEBUG nova.compute.manager [req-54d59ec7-ab93-4a04-b315-6035f3c83c46 req-750ab296-177e-4cc9-a4f6-6febb7fe75ab service nova] [instance: 2fb10bb7-d421-40c6-be80-0e10138fc2b0] Received event network-changed-36797039-dc96-40f6-b535-8e179243e791 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:30:50 user nova-compute[74683]: DEBUG nova.compute.manager [req-54d59ec7-ab93-4a04-b315-6035f3c83c46 req-750ab296-177e-4cc9-a4f6-6febb7fe75ab service nova] [instance: 2fb10bb7-d421-40c6-be80-0e10138fc2b0] Refreshing instance network info cache due to event network-changed-36797039-dc96-40f6-b535-8e179243e791. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:30:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-54d59ec7-ab93-4a04-b315-6035f3c83c46 req-750ab296-177e-4cc9-a4f6-6febb7fe75ab service nova] Acquiring lock "refresh_cache-2fb10bb7-d421-40c6-be80-0e10138fc2b0" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:30:50 user nova-compute[74683]: DEBUG nova.network.neutron [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 2fb10bb7-d421-40c6-be80-0e10138fc2b0] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:30:50 user nova-compute[74683]: DEBUG nova.network.neutron [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 2fb10bb7-d421-40c6-be80-0e10138fc2b0] Updating instance_info_cache with network_info: [{"id": "36797039-dc96-40f6-b535-8e179243e791", "address": "fa:16:3e:fd:71:e7", "network": {"id": "d2fbadd4-fd6d-4bbc-96eb-042f4fce1c04", "bridge": "br-int", "label": "tempest-VolumesActionsTest-888145232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c02c8882c3f4a2eac7d1f320c06899b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36797039-dc", "ovs_interfaceid": "36797039-dc96-40f6-b535-8e179243e791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:30:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Releasing lock "refresh_cache-2fb10bb7-d421-40c6-be80-0e10138fc2b0" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:30:50 user nova-compute[74683]: DEBUG nova.compute.manager [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 2fb10bb7-d421-40c6-be80-0e10138fc2b0] Instance network_info: |[{"id": "36797039-dc96-40f6-b535-8e179243e791", "address": "fa:16:3e:fd:71:e7", "network": {"id": "d2fbadd4-fd6d-4bbc-96eb-042f4fce1c04", "bridge": "br-int", "label": "tempest-VolumesActionsTest-888145232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c02c8882c3f4a2eac7d1f320c06899b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36797039-dc", "ovs_interfaceid": "36797039-dc96-40f6-b535-8e179243e791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 11:30:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-54d59ec7-ab93-4a04-b315-6035f3c83c46 req-750ab296-177e-4cc9-a4f6-6febb7fe75ab service nova] Acquired lock "refresh_cache-2fb10bb7-d421-40c6-be80-0e10138fc2b0" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:30:50 user nova-compute[74683]: DEBUG nova.network.neutron [req-54d59ec7-ab93-4a04-b315-6035f3c83c46 req-750ab296-177e-4cc9-a4f6-6febb7fe75ab service nova] [instance: 2fb10bb7-d421-40c6-be80-0e10138fc2b0] Refreshing network info cache for port 36797039-dc96-40f6-b535-8e179243e791 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:30:50 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 2fb10bb7-d421-40c6-be80-0e10138fc2b0] Start _get_guest_xml network_info=[{"id": "36797039-dc96-40f6-b535-8e179243e791", "address": "fa:16:3e:fd:71:e7", "network": {"id": "d2fbadd4-fd6d-4bbc-96eb-042f4fce1c04", "bridge": "br-int", "label": "tempest-VolumesActionsTest-888145232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c02c8882c3f4a2eac7d1f320c06899b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36797039-dc", "ovs_interfaceid": "36797039-dc96-40f6-b535-8e179243e791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:30:50 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:30:50 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:30:50 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:30:50 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:30:50 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:30:50 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:30:50 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:30:50 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:30:50 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:30:50 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:30:50 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:30:50 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:30:50 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:30:50 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:30:50 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:30:50 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:30:50 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:30:50 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:30:50 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:30:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-374649395',display_name='tempest-VolumesActionsTest-instance-374649395',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-374649395',id=34,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c02c8882c3f4a2eac7d1f320c06899b',ramdisk_id='',reservation_id='r-bxsodejc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1922089110',owner_user_name='tempest-VolumesActionsTest-1922089110-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:30:49Z,user_data=None,user_id='2cb90c639a424b3ba9b7513aa6624334',uuid=2fb10bb7-d421-40c6-be80-0e10138fc2b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36797039-dc96-40f6-b535-8e179243e791", "address": "fa:16:3e:fd:71:e7", "network": {"id": "d2fbadd4-fd6d-4bbc-96eb-042f4fce1c04", "bridge": "br-int", "label": "tempest-VolumesActionsTest-888145232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c02c8882c3f4a2eac7d1f320c06899b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36797039-dc", "ovs_interfaceid": "36797039-dc96-40f6-b535-8e179243e791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:30:50 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Converting VIF {"id": "36797039-dc96-40f6-b535-8e179243e791", "address": "fa:16:3e:fd:71:e7", "network": {"id": "d2fbadd4-fd6d-4bbc-96eb-042f4fce1c04", "bridge": "br-int", "label": "tempest-VolumesActionsTest-888145232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c02c8882c3f4a2eac7d1f320c06899b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36797039-dc", "ovs_interfaceid": "36797039-dc96-40f6-b535-8e179243e791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:30:50 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:71:e7,bridge_name='br-int',has_traffic_filtering=True,id=36797039-dc96-40f6-b535-8e179243e791,network=Network(d2fbadd4-fd6d-4bbc-96eb-042f4fce1c04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36797039-dc') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:30:50 user nova-compute[74683]: DEBUG nova.objects.instance [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Lazy-loading 'pci_devices' on Instance uuid 2fb10bb7-d421-40c6-be80-0e10138fc2b0 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:30:51 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 2fb10bb7-d421-40c6-be80-0e10138fc2b0] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:30:51 user nova-compute[74683]:   <uuid>2fb10bb7-d421-40c6-be80-0e10138fc2b0</uuid>
Oct 16 11:30:51 user nova-compute[74683]:   <name>instance-00000022</name>
Oct 16 11:30:51 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:30:51 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:30:51 user nova-compute[74683]:   <metadata>
Oct 16 11:30:51 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:30:51 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:30:51 user nova-compute[74683]:       <nova:name>tempest-VolumesActionsTest-instance-374649395</nova:name>
Oct 16 11:30:51 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:30:50</nova:creationTime>
Oct 16 11:30:51 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:30:51 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:30:51 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:30:51 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:30:51 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:30:51 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:30:51 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:30:51 user nova-compute[74683]:       <nova:owner>
Oct 16 11:30:51 user nova-compute[74683]:         <nova:user uuid="2cb90c639a424b3ba9b7513aa6624334">tempest-VolumesActionsTest-1922089110-project-member</nova:user>
Oct 16 11:30:51 user nova-compute[74683]:         <nova:project uuid="3c02c8882c3f4a2eac7d1f320c06899b">tempest-VolumesActionsTest-1922089110</nova:project>
Oct 16 11:30:51 user nova-compute[74683]:       </nova:owner>
Oct 16 11:30:51 user nova-compute[74683]:       <nova:root type="image" uuid="0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f"/>
Oct 16 11:30:51 user nova-compute[74683]:       <nova:ports>
Oct 16 11:30:51 user nova-compute[74683]:         <nova:port uuid="36797039-dc96-40f6-b535-8e179243e791">
Oct 16 11:30:51 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 16 11:30:51 user nova-compute[74683]:         </nova:port>
Oct 16 11:30:51 user nova-compute[74683]:       </nova:ports>
Oct 16 11:30:51 user nova-compute[74683]:     </nova:instance>
Oct 16 11:30:51 user nova-compute[74683]:   </metadata>
Oct 16 11:30:51 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:30:51 user nova-compute[74683]:     <system>
Oct 16 11:30:51 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:30:51 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:30:51 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:30:51 user nova-compute[74683]:       <entry name="serial">2fb10bb7-d421-40c6-be80-0e10138fc2b0</entry>
Oct 16 11:30:51 user nova-compute[74683]:       <entry name="uuid">2fb10bb7-d421-40c6-be80-0e10138fc2b0</entry>
Oct 16 11:30:51 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:30:51 user nova-compute[74683]:     </system>
Oct 16 11:30:51 user nova-compute[74683]:   </sysinfo>
Oct 16 11:30:51 user nova-compute[74683]:   <os>
Oct 16 11:30:51 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:30:51 user nova-compute[74683]:     <boot dev="hd"/>
Oct 16 11:30:51 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:30:51 user nova-compute[74683]:   </os>
Oct 16 11:30:51 user nova-compute[74683]:   <features>
Oct 16 11:30:51 user nova-compute[74683]:     <acpi/>
Oct 16 11:30:51 user nova-compute[74683]:     <apic/>
Oct 16 11:30:51 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:30:51 user nova-compute[74683]:   </features>
Oct 16 11:30:51 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:30:51 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:30:51 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:30:51 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:30:51 user nova-compute[74683]:   </clock>
Oct 16 11:30:51 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:30:51 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:30:51 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:30:51 user nova-compute[74683]:   </cpu>
Oct 16 11:30:51 user nova-compute[74683]:   <devices>
Oct 16 11:30:51 user nova-compute[74683]:     <disk type="file" device="disk">
Oct 16 11:30:51 user nova-compute[74683]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 11:30:51 user nova-compute[74683]:       <source file="/opt/stack/data/nova/instances/2fb10bb7-d421-40c6-be80-0e10138fc2b0/disk"/>
Oct 16 11:30:51 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:30:51 user nova-compute[74683]:     </disk>
Oct 16 11:30:51 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:30:51 user nova-compute[74683]:       <mac address="fa:16:3e:fd:71:e7"/>
Oct 16 11:30:51 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:30:51 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:30:51 user nova-compute[74683]:       <target dev="tap36797039-dc"/>
Oct 16 11:30:51 user nova-compute[74683]:     </interface>
Oct 16 11:30:51 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:30:51 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/2fb10bb7-d421-40c6-be80-0e10138fc2b0/console.log" append="off"/>
Oct 16 11:30:51 user nova-compute[74683]:     </serial>
Oct 16 11:30:51 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:30:51 user nova-compute[74683]:     <video>
Oct 16 11:30:51 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:30:51 user nova-compute[74683]:     </video>
Oct 16 11:30:51 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:30:51 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:30:51 user nova-compute[74683]:     </rng>
Oct 16 11:30:51 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:30:51 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:30:51 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:30:51 user nova-compute[74683]:     </memballoon>
Oct 16 11:30:51 user nova-compute[74683]:   </devices>
Oct 16 11:30:51 user nova-compute[74683]: </domain>
Oct 16 11:30:51 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:30:51 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:30:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-374649395',display_name='tempest-VolumesActionsTest-instance-374649395',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-374649395',id=34,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c02c8882c3f4a2eac7d1f320c06899b',ramdisk_id='',reservation_id='r-bxsodejc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1922089110',owner_user_name='tempest-VolumesActionsTest-1922089110-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:30:49Z,user_data=None,user_id='2cb90c639a424b3ba9b7513aa6624334',uuid=2fb10bb7-d421-40c6-be80-0e10138fc2b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36797039-dc96-40f6-b535-8e179243e791", "address": "fa:16:3e:fd:71:e7", "network": {"id": "d2fbadd4-fd6d-4bbc-96eb-042f4fce1c04", "bridge": "br-int", "label": "tempest-VolumesActionsTest-888145232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c02c8882c3f4a2eac7d1f320c06899b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36797039-dc", "ovs_interfaceid": "36797039-dc96-40f6-b535-8e179243e791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:30:51 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Converting VIF {"id": "36797039-dc96-40f6-b535-8e179243e791", "address": "fa:16:3e:fd:71:e7", "network": {"id": "d2fbadd4-fd6d-4bbc-96eb-042f4fce1c04", "bridge": "br-int", "label": "tempest-VolumesActionsTest-888145232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c02c8882c3f4a2eac7d1f320c06899b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36797039-dc", "ovs_interfaceid": "36797039-dc96-40f6-b535-8e179243e791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:30:51 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:71:e7,bridge_name='br-int',has_traffic_filtering=True,id=36797039-dc96-40f6-b535-8e179243e791,network=Network(d2fbadd4-fd6d-4bbc-96eb-042f4fce1c04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36797039-dc') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:30:51 user nova-compute[74683]: DEBUG os_vif [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:71:e7,bridge_name='br-int',has_traffic_filtering=True,id=36797039-dc96-40f6-b535-8e179243e791,network=Network(d2fbadd4-fd6d-4bbc-96eb-042f4fce1c04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36797039-dc') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:30:51 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:30:51 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:30:51 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:30:51 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:30:51 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a824fa74-499b-52b0-bf0c-3e178bbf996b', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:30:51 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:30:51 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:30:51 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:30:51 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap36797039-dc, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:30:51 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap36797039-dc, col_values=(('qos', UUID('abb96d8f-1410-4619-a16b-a8cd2ac6b378')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:30:51 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap36797039-dc, col_values=(('external_ids', {'iface-id': '36797039-dc96-40f6-b535-8e179243e791', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:71:e7', 'vm-uuid': '2fb10bb7-d421-40c6-be80-0e10138fc2b0'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:30:51 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:30:51 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:30:51 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:30:51 user nova-compute[74683]: INFO os_vif [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:71:e7,bridge_name='br-int',has_traffic_filtering=True,id=36797039-dc96-40f6-b535-8e179243e791,network=Network(d2fbadd4-fd6d-4bbc-96eb-042f4fce1c04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36797039-dc')
Oct 16 11:30:51 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:30:51 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] No VIF found with MAC fa:16:3e:fd:71:e7, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:30:51 user nova-compute[74683]: DEBUG nova.network.neutron [req-54d59ec7-ab93-4a04-b315-6035f3c83c46 req-750ab296-177e-4cc9-a4f6-6febb7fe75ab service nova] [instance: 2fb10bb7-d421-40c6-be80-0e10138fc2b0] Updated VIF entry in instance network info cache for port 36797039-dc96-40f6-b535-8e179243e791. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:30:51 user nova-compute[74683]: DEBUG nova.network.neutron [req-54d59ec7-ab93-4a04-b315-6035f3c83c46 req-750ab296-177e-4cc9-a4f6-6febb7fe75ab service nova] [instance: 2fb10bb7-d421-40c6-be80-0e10138fc2b0] Updating instance_info_cache with network_info: [{"id": "36797039-dc96-40f6-b535-8e179243e791", "address": "fa:16:3e:fd:71:e7", "network": {"id": "d2fbadd4-fd6d-4bbc-96eb-042f4fce1c04", "bridge": "br-int", "label": "tempest-VolumesActionsTest-888145232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c02c8882c3f4a2eac7d1f320c06899b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36797039-dc", "ovs_interfaceid": "36797039-dc96-40f6-b535-8e179243e791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:30:51 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-54d59ec7-ab93-4a04-b315-6035f3c83c46 req-750ab296-177e-4cc9-a4f6-6febb7fe75ab service nova] Releasing lock "refresh_cache-2fb10bb7-d421-40c6-be80-0e10138fc2b0" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:30:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:30:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:30:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:30:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:30:52 user nova-compute[74683]: DEBUG nova.compute.manager [req-9cca4c9a-7a67-4bbb-9873-1ab07c6dc0be req-4f55dd7c-4b7d-4462-bb00-6c149e17db4b service nova] [instance: 2fb10bb7-d421-40c6-be80-0e10138fc2b0] Received event network-vif-plugged-36797039-dc96-40f6-b535-8e179243e791 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:30:52 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-9cca4c9a-7a67-4bbb-9873-1ab07c6dc0be req-4f55dd7c-4b7d-4462-bb00-6c149e17db4b service nova] Acquiring lock "2fb10bb7-d421-40c6-be80-0e10138fc2b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:30:52 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-9cca4c9a-7a67-4bbb-9873-1ab07c6dc0be req-4f55dd7c-4b7d-4462-bb00-6c149e17db4b service nova] Lock "2fb10bb7-d421-40c6-be80-0e10138fc2b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:30:52 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-9cca4c9a-7a67-4bbb-9873-1ab07c6dc0be req-4f55dd7c-4b7d-4462-bb00-6c149e17db4b service nova] Lock "2fb10bb7-d421-40c6-be80-0e10138fc2b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:30:52 user nova-compute[74683]: DEBUG nova.compute.manager [req-9cca4c9a-7a67-4bbb-9873-1ab07c6dc0be req-4f55dd7c-4b7d-4462-bb00-6c149e17db4b service nova] [instance: 2fb10bb7-d421-40c6-be80-0e10138fc2b0] No waiting events found dispatching network-vif-plugged-36797039-dc96-40f6-b535-8e179243e791 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:30:52 user nova-compute[74683]: WARNING nova.compute.manager [req-9cca4c9a-7a67-4bbb-9873-1ab07c6dc0be req-4f55dd7c-4b7d-4462-bb00-6c149e17db4b service nova] [instance: 2fb10bb7-d421-40c6-be80-0e10138fc2b0] Received unexpected event network-vif-plugged-36797039-dc96-40f6-b535-8e179243e791 for instance with vm_state building and task_state spawning.
Oct 16 11:30:53 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:30:53 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:30:53 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:30:54 user nova-compute[74683]: DEBUG nova.compute.manager [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 2fb10bb7-d421-40c6-be80-0e10138fc2b0] Instance event wait completed in 0 seconds for  {{(pid=74683) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 11:30:54 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 2fb10bb7-d421-40c6-be80-0e10138fc2b0] Guest created on hypervisor {{(pid=74683) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 11:30:54 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 2fb10bb7-d421-40c6-be80-0e10138fc2b0] Instance spawned successfully.
Oct 16 11:30:54 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 2fb10bb7-d421-40c6-be80-0e10138fc2b0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 11:30:54 user nova-compute[74683]: DEBUG nova.compute.manager [req-d89c97aa-7972-4346-aed9-28e81fcf2b6b req-00a2326c-f0f2-4632-bef3-18f50faaa5cb service nova] [instance: 2fb10bb7-d421-40c6-be80-0e10138fc2b0] Received event network-vif-plugged-36797039-dc96-40f6-b535-8e179243e791 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:30:54 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-d89c97aa-7972-4346-aed9-28e81fcf2b6b req-00a2326c-f0f2-4632-bef3-18f50faaa5cb service nova] Acquiring lock "2fb10bb7-d421-40c6-be80-0e10138fc2b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:30:54 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-d89c97aa-7972-4346-aed9-28e81fcf2b6b req-00a2326c-f0f2-4632-bef3-18f50faaa5cb service nova] Lock "2fb10bb7-d421-40c6-be80-0e10138fc2b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:30:54 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-d89c97aa-7972-4346-aed9-28e81fcf2b6b req-00a2326c-f0f2-4632-bef3-18f50faaa5cb service nova] Lock "2fb10bb7-d421-40c6-be80-0e10138fc2b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:30:54 user nova-compute[74683]: DEBUG nova.compute.manager [req-d89c97aa-7972-4346-aed9-28e81fcf2b6b req-00a2326c-f0f2-4632-bef3-18f50faaa5cb service nova] [instance: 2fb10bb7-d421-40c6-be80-0e10138fc2b0] No waiting events found dispatching network-vif-plugged-36797039-dc96-40f6-b535-8e179243e791 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:30:54 user nova-compute[74683]: WARNING nova.compute.manager [req-d89c97aa-7972-4346-aed9-28e81fcf2b6b req-00a2326c-f0f2-4632-bef3-18f50faaa5cb service nova] [instance: 2fb10bb7-d421-40c6-be80-0e10138fc2b0] Received unexpected event network-vif-plugged-36797039-dc96-40f6-b535-8e179243e791 for instance with vm_state building and task_state spawning.
Oct 16 11:30:54 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 2fb10bb7-d421-40c6-be80-0e10138fc2b0] Found default for hw_cdrom_bus of ide {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:30:54 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 2fb10bb7-d421-40c6-be80-0e10138fc2b0] Found default for hw_disk_bus of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:30:54 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 2fb10bb7-d421-40c6-be80-0e10138fc2b0] Found default for hw_input_bus of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:30:54 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 2fb10bb7-d421-40c6-be80-0e10138fc2b0] Found default for hw_pointer_model of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:30:54 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 2fb10bb7-d421-40c6-be80-0e10138fc2b0] Found default for hw_video_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:30:54 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 2fb10bb7-d421-40c6-be80-0e10138fc2b0] Found default for hw_vif_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:30:55 user nova-compute[74683]: INFO nova.compute.manager [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 2fb10bb7-d421-40c6-be80-0e10138fc2b0] Took 5.77 seconds to spawn the instance on the hypervisor.
Oct 16 11:30:55 user nova-compute[74683]: DEBUG nova.compute.manager [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 2fb10bb7-d421-40c6-be80-0e10138fc2b0] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:30:55 user nova-compute[74683]: INFO nova.compute.manager [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 2fb10bb7-d421-40c6-be80-0e10138fc2b0] Took 6.60 seconds to build instance.
Oct 16 11:30:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-38852f22-2d67-478e-a53f-ad4ee254a7da tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Lock "2fb10bb7-d421-40c6-be80-0e10138fc2b0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.716s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:30:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:30:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:01 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:01 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquiring lock "45c24874-99be-41fc-a85f-27ea8ddcfc29" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:31:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "45c24874-99be-41fc-a85f-27ea8ddcfc29" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:31:03 user nova-compute[74683]: DEBUG nova.compute.manager [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Starting instance... {{(pid=74683) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 11:31:03 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:31:03 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:31:03 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74683) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 11:31:03 user nova-compute[74683]: INFO nova.compute.claims [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Claim successful on node user
Oct 16 11:31:03 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:31:03 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:31:03 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.608s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:31:03 user nova-compute[74683]: DEBUG nova.compute.manager [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Start building networks asynchronously for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 11:31:03 user nova-compute[74683]: DEBUG nova.compute.manager [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Allocating IP information in the background. {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 11:31:03 user nova-compute[74683]: DEBUG nova.network.neutron [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] allocate_for_instance() {{(pid=74683) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 11:31:03 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 11:31:03 user nova-compute[74683]: DEBUG nova.compute.manager [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Start building block device mappings for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 11:31:03 user nova-compute[74683]: DEBUG nova.policy [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a463a84e332543dfbc03b81518f82be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefabef9e42412f8309f490dcfecc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74683) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 11:31:03 user nova-compute[74683]: INFO nova.virt.block_device [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Booting with volume c6f05240-96d4-498f-9c29-f5888f6ed27f at /dev/vda
Oct 16 11:31:04 user nova-compute[74683]: DEBUG os_brick.utils [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:31:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:31:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:31:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0e339c-9186-4fe4-a75c-0b83ddc3eb8e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:70b9d336ab7d\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:31:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:31:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:31:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f172d3-2ca5-4fd2-bcd9-bfa48b545394]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:31:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:31:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:31:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[137c348b-5430-4903-a433-e4e8d3751171]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:31:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cea614e-2e68-4c2d-afa7-7cba005b6743]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:31:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Running cmd (subprocess): nvme version {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:31:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] 'nvme version' failed. Not Retrying. {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:31:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] nvme not present on system {{(pid=74683) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 11:31:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:31:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:31:04 user nova-compute[74683]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 11:31:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51432dc-d08e-4653-b883-1a84cd068407]: (4, '') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:31:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74683) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 11:31:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 11:31:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] LIGHTOS: no hostnqn found. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 11:31:04 user nova-compute[74683]: DEBUG os_brick.utils [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] <== get_connector_properties: return (163ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:70b9d336ab7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:31:04 user nova-compute[74683]: DEBUG nova.virt.block_device [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Updating existing volume attachment record: a54a0194-2dc1-42d9-96c5-853d60581723 {{(pid=74683) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 11:31:04 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-c1c17bb8-a9e4-4a5b-bf3b-f4bf49c0283a tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Acquiring lock "0b79d385-e512-4297-9aa4-2b9bb0cac23c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:31:04 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-c1c17bb8-a9e4-4a5b-bf3b-f4bf49c0283a tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Lock "0b79d385-e512-4297-9aa4-2b9bb0cac23c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:31:04 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-c1c17bb8-a9e4-4a5b-bf3b-f4bf49c0283a tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Acquiring lock "0b79d385-e512-4297-9aa4-2b9bb0cac23c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:31:04 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-c1c17bb8-a9e4-4a5b-bf3b-f4bf49c0283a tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Lock "0b79d385-e512-4297-9aa4-2b9bb0cac23c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:31:04 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-c1c17bb8-a9e4-4a5b-bf3b-f4bf49c0283a tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Lock "0b79d385-e512-4297-9aa4-2b9bb0cac23c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:31:04 user nova-compute[74683]: INFO nova.compute.manager [None req-c1c17bb8-a9e4-4a5b-bf3b-f4bf49c0283a tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Terminating instance
Oct 16 11:31:04 user nova-compute[74683]: DEBUG nova.compute.manager [None req-c1c17bb8-a9e4-4a5b-bf3b-f4bf49c0283a tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Start destroying the instance on the hypervisor. {{(pid=74683) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 11:31:04 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:04 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:04 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:04 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:05 user nova-compute[74683]: DEBUG nova.compute.manager [req-353d7d2e-735e-4d33-a1b7-4a2e3dbf4713 req-4adff3b5-2620-40bc-a2d6-ec00f65a75d5 service nova] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Received event network-vif-unplugged-c8345df8-9a3f-4261-a04c-59a0653140d0 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:31:05 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-353d7d2e-735e-4d33-a1b7-4a2e3dbf4713 req-4adff3b5-2620-40bc-a2d6-ec00f65a75d5 service nova] Acquiring lock "0b79d385-e512-4297-9aa4-2b9bb0cac23c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:31:05 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-353d7d2e-735e-4d33-a1b7-4a2e3dbf4713 req-4adff3b5-2620-40bc-a2d6-ec00f65a75d5 service nova] Lock "0b79d385-e512-4297-9aa4-2b9bb0cac23c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:31:05 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-353d7d2e-735e-4d33-a1b7-4a2e3dbf4713 req-4adff3b5-2620-40bc-a2d6-ec00f65a75d5 service nova] Lock "0b79d385-e512-4297-9aa4-2b9bb0cac23c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:31:05 user nova-compute[74683]: DEBUG nova.compute.manager [req-353d7d2e-735e-4d33-a1b7-4a2e3dbf4713 req-4adff3b5-2620-40bc-a2d6-ec00f65a75d5 service nova] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] No waiting events found dispatching network-vif-unplugged-c8345df8-9a3f-4261-a04c-59a0653140d0 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:31:05 user nova-compute[74683]: DEBUG nova.compute.manager [req-353d7d2e-735e-4d33-a1b7-4a2e3dbf4713 req-4adff3b5-2620-40bc-a2d6-ec00f65a75d5 service nova] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Received event network-vif-unplugged-c8345df8-9a3f-4261-a04c-59a0653140d0 for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 11:31:05 user nova-compute[74683]: DEBUG nova.network.neutron [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Successfully created port: 5adcf9f7-16fd-477b-87c9-e3329444b7b4 {{(pid=74683) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 11:31:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:05 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Instance destroyed successfully.
Oct 16 11:31:05 user nova-compute[74683]: DEBUG nova.objects.instance [None req-c1c17bb8-a9e4-4a5b-bf3b-f4bf49c0283a tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Lazy-loading 'resources' on Instance uuid 0b79d385-e512-4297-9aa4-2b9bb0cac23c {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:31:05 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-c1c17bb8-a9e4-4a5b-bf3b-f4bf49c0283a tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:21:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-237246197',display_name='tempest-ServersNegativeTestJSON-server-237246197',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-237246197',id=25,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:22:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='adfa96f9deab4c4eb584876b48e804e0',ramdisk_id='',reservation_id='r-jbap9cn6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-282145638',owner_user_name='tempest-ServersNegativeTestJSON-282145638-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:22:09Z,user_data=None,user_id='0c9a0c7b02744e87885fe8d252e88d1c',uuid=0b79d385-e512-4297-9aa4-2b9bb0cac23c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c8345df8-9a3f-4261-a04c-59a0653140d0", "address": "fa:16:3e:27:e5:1e", "network": {"id": "acc0dc8b-0dc9-47ad-8630-d9e91dd67dbc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-679008794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adfa96f9deab4c4eb584876b48e804e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8345df8-9a", "ovs_interfaceid": "c8345df8-9a3f-4261-a04c-59a0653140d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:31:05 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-c1c17bb8-a9e4-4a5b-bf3b-f4bf49c0283a tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Converting VIF {"id": "c8345df8-9a3f-4261-a04c-59a0653140d0", "address": "fa:16:3e:27:e5:1e", "network": {"id": "acc0dc8b-0dc9-47ad-8630-d9e91dd67dbc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-679008794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adfa96f9deab4c4eb584876b48e804e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8345df8-9a", "ovs_interfaceid": "c8345df8-9a3f-4261-a04c-59a0653140d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:31:05 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-c1c17bb8-a9e4-4a5b-bf3b-f4bf49c0283a tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:e5:1e,bridge_name='br-int',has_traffic_filtering=True,id=c8345df8-9a3f-4261-a04c-59a0653140d0,network=Network(acc0dc8b-0dc9-47ad-8630-d9e91dd67dbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8345df8-9a') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:31:05 user nova-compute[74683]: DEBUG os_vif [None req-c1c17bb8-a9e4-4a5b-bf3b-f4bf49c0283a tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:e5:1e,bridge_name='br-int',has_traffic_filtering=True,id=c8345df8-9a3f-4261-a04c-59a0653140d0,network=Network(acc0dc8b-0dc9-47ad-8630-d9e91dd67dbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8345df8-9a') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:31:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc8345df8-9a, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:31:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:31:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bbb00c2d-4c2c-4be5-a37e-b18fce00e162) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:31:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:05 user nova-compute[74683]: INFO os_vif [None req-c1c17bb8-a9e4-4a5b-bf3b-f4bf49c0283a tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:e5:1e,bridge_name='br-int',has_traffic_filtering=True,id=c8345df8-9a3f-4261-a04c-59a0653140d0,network=Network(acc0dc8b-0dc9-47ad-8630-d9e91dd67dbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8345df8-9a')
Oct 16 11:31:05 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-c1c17bb8-a9e4-4a5b-bf3b-f4bf49c0283a tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Deleting instance files /opt/stack/data/nova/instances/0b79d385-e512-4297-9aa4-2b9bb0cac23c_del
Oct 16 11:31:05 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-c1c17bb8-a9e4-4a5b-bf3b-f4bf49c0283a tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Deletion of /opt/stack/data/nova/instances/0b79d385-e512-4297-9aa4-2b9bb0cac23c_del complete
Oct 16 11:31:05 user nova-compute[74683]: INFO nova.compute.manager [None req-c1c17bb8-a9e4-4a5b-bf3b-f4bf49c0283a tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Took 0.88 seconds to destroy the instance on the hypervisor.
Oct 16 11:31:05 user nova-compute[74683]: DEBUG oslo.service.loopingcall [None req-c1c17bb8-a9e4-4a5b-bf3b-f4bf49c0283a tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74683) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 11:31:05 user nova-compute[74683]: DEBUG nova.compute.manager [-] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Deallocating network for instance {{(pid=74683) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 11:31:05 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] deallocate_for_instance() {{(pid=74683) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 11:31:06 user nova-compute[74683]: DEBUG nova.network.neutron [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Successfully updated port: 5adcf9f7-16fd-477b-87c9-e3329444b7b4 {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:31:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquiring lock "refresh_cache-45c24874-99be-41fc-a85f-27ea8ddcfc29" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:31:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquired lock "refresh_cache-45c24874-99be-41fc-a85f-27ea8ddcfc29" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:31:06 user nova-compute[74683]: DEBUG nova.network.neutron [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:31:06 user nova-compute[74683]: DEBUG nova.compute.manager [req-38b1ebce-8c13-499d-b833-a04e5e414acd req-ac6b47db-2dc0-45af-96f2-483c7fffcd77 service nova] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Received event network-changed-5adcf9f7-16fd-477b-87c9-e3329444b7b4 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:31:06 user nova-compute[74683]: DEBUG nova.compute.manager [req-38b1ebce-8c13-499d-b833-a04e5e414acd req-ac6b47db-2dc0-45af-96f2-483c7fffcd77 service nova] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Refreshing instance network info cache due to event network-changed-5adcf9f7-16fd-477b-87c9-e3329444b7b4. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:31:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-38b1ebce-8c13-499d-b833-a04e5e414acd req-ac6b47db-2dc0-45af-96f2-483c7fffcd77 service nova] Acquiring lock "refresh_cache-45c24874-99be-41fc-a85f-27ea8ddcfc29" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:31:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:06 user nova-compute[74683]: DEBUG nova.network.neutron [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:31:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:06 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:31:06 user nova-compute[74683]: INFO nova.compute.manager [-] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Took 0.82 seconds to deallocate network for instance.
Oct 16 11:31:06 user nova-compute[74683]: DEBUG nova.compute.manager [req-b78411b8-75f5-40f5-9045-bc0bedd536d0 req-f921102f-13b8-4813-bedd-8f4bf8c6ad09 service nova] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Received event network-vif-deleted-c8345df8-9a3f-4261-a04c-59a0653140d0 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:31:06 user nova-compute[74683]: INFO nova.compute.manager [req-b78411b8-75f5-40f5-9045-bc0bedd536d0 req-f921102f-13b8-4813-bedd-8f4bf8c6ad09 service nova] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Neutron deleted interface c8345df8-9a3f-4261-a04c-59a0653140d0; detaching it from the instance and deleting it from the info cache
Oct 16 11:31:06 user nova-compute[74683]: DEBUG nova.network.neutron [req-b78411b8-75f5-40f5-9045-bc0bedd536d0 req-f921102f-13b8-4813-bedd-8f4bf8c6ad09 service nova] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:31:06 user nova-compute[74683]: DEBUG nova.compute.manager [req-b78411b8-75f5-40f5-9045-bc0bedd536d0 req-f921102f-13b8-4813-bedd-8f4bf8c6ad09 service nova] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Detach interface failed, port_id=c8345df8-9a3f-4261-a04c-59a0653140d0, reason: Instance 0b79d385-e512-4297-9aa4-2b9bb0cac23c could not be found. {{(pid=74683) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 16 11:31:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-c1c17bb8-a9e4-4a5b-bf3b-f4bf49c0283a tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:31:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-c1c17bb8-a9e4-4a5b-bf3b-f4bf49c0283a tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:31:06 user nova-compute[74683]: DEBUG nova.network.neutron [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Updating instance_info_cache with network_info: [{"id": "5adcf9f7-16fd-477b-87c9-e3329444b7b4", "address": "fa:16:3e:10:f9:24", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5adcf9f7-16", "ovs_interfaceid": "5adcf9f7-16fd-477b-87c9-e3329444b7b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:31:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Releasing lock "refresh_cache-45c24874-99be-41fc-a85f-27ea8ddcfc29" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:31:06 user nova-compute[74683]: DEBUG nova.compute.manager [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Instance network_info: |[{"id": "5adcf9f7-16fd-477b-87c9-e3329444b7b4", "address": "fa:16:3e:10:f9:24", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5adcf9f7-16", "ovs_interfaceid": "5adcf9f7-16fd-477b-87c9-e3329444b7b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 11:31:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-38b1ebce-8c13-499d-b833-a04e5e414acd req-ac6b47db-2dc0-45af-96f2-483c7fffcd77 service nova] Acquired lock "refresh_cache-45c24874-99be-41fc-a85f-27ea8ddcfc29" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:31:06 user nova-compute[74683]: DEBUG nova.network.neutron [req-38b1ebce-8c13-499d-b833-a04e5e414acd req-ac6b47db-2dc0-45af-96f2-483c7fffcd77 service nova] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Refreshing network info cache for port 5adcf9f7-16fd-477b-87c9-e3329444b7b4 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:31:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:06 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-c1c17bb8-a9e4-4a5b-bf3b-f4bf49c0283a tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:31:06 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-c1c17bb8-a9e4-4a5b-bf3b-f4bf49c0283a tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:31:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-c1c17bb8-a9e4-4a5b-bf3b-f4bf49c0283a tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.459s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:31:06 user nova-compute[74683]: INFO nova.scheduler.client.report [None req-c1c17bb8-a9e4-4a5b-bf3b-f4bf49c0283a tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Deleted allocations for instance 0b79d385-e512-4297-9aa4-2b9bb0cac23c
Oct 16 11:31:07 user nova-compute[74683]: DEBUG nova.network.neutron [req-38b1ebce-8c13-499d-b833-a04e5e414acd req-ac6b47db-2dc0-45af-96f2-483c7fffcd77 service nova] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Updated VIF entry in instance network info cache for port 5adcf9f7-16fd-477b-87c9-e3329444b7b4. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:31:07 user nova-compute[74683]: DEBUG nova.network.neutron [req-38b1ebce-8c13-499d-b833-a04e5e414acd req-ac6b47db-2dc0-45af-96f2-483c7fffcd77 service nova] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Updating instance_info_cache with network_info: [{"id": "5adcf9f7-16fd-477b-87c9-e3329444b7b4", "address": "fa:16:3e:10:f9:24", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5adcf9f7-16", "ovs_interfaceid": "5adcf9f7-16fd-477b-87c9-e3329444b7b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:31:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-38b1ebce-8c13-499d-b833-a04e5e414acd req-ac6b47db-2dc0-45af-96f2-483c7fffcd77 service nova] Releasing lock "refresh_cache-45c24874-99be-41fc-a85f-27ea8ddcfc29" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:31:07 user nova-compute[74683]: DEBUG nova.compute.manager [req-b6c19ce8-76fa-4fcc-bd67-363e212f157b req-c02df98f-c99a-47fa-92ad-287facbf3d78 service nova] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Received event network-vif-plugged-c8345df8-9a3f-4261-a04c-59a0653140d0 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:31:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b6c19ce8-76fa-4fcc-bd67-363e212f157b req-c02df98f-c99a-47fa-92ad-287facbf3d78 service nova] Acquiring lock "0b79d385-e512-4297-9aa4-2b9bb0cac23c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:31:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b6c19ce8-76fa-4fcc-bd67-363e212f157b req-c02df98f-c99a-47fa-92ad-287facbf3d78 service nova] Lock "0b79d385-e512-4297-9aa4-2b9bb0cac23c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:31:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b6c19ce8-76fa-4fcc-bd67-363e212f157b req-c02df98f-c99a-47fa-92ad-287facbf3d78 service nova] Lock "0b79d385-e512-4297-9aa4-2b9bb0cac23c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:31:07 user nova-compute[74683]: DEBUG nova.compute.manager [req-b6c19ce8-76fa-4fcc-bd67-363e212f157b req-c02df98f-c99a-47fa-92ad-287facbf3d78 service nova] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] No waiting events found dispatching network-vif-plugged-c8345df8-9a3f-4261-a04c-59a0653140d0 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:31:07 user nova-compute[74683]: WARNING nova.compute.manager [req-b6c19ce8-76fa-4fcc-bd67-363e212f157b req-c02df98f-c99a-47fa-92ad-287facbf3d78 service nova] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Received unexpected event network-vif-plugged-c8345df8-9a3f-4261-a04c-59a0653140d0 for instance with vm_state deleted and task_state None.
Oct 16 11:31:07 user nova-compute[74683]: DEBUG nova.compute.manager [req-b6c19ce8-76fa-4fcc-bd67-363e212f157b req-c02df98f-c99a-47fa-92ad-287facbf3d78 service nova] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Received event network-vif-plugged-c8345df8-9a3f-4261-a04c-59a0653140d0 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:31:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b6c19ce8-76fa-4fcc-bd67-363e212f157b req-c02df98f-c99a-47fa-92ad-287facbf3d78 service nova] Acquiring lock "0b79d385-e512-4297-9aa4-2b9bb0cac23c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:31:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b6c19ce8-76fa-4fcc-bd67-363e212f157b req-c02df98f-c99a-47fa-92ad-287facbf3d78 service nova] Lock "0b79d385-e512-4297-9aa4-2b9bb0cac23c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:31:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b6c19ce8-76fa-4fcc-bd67-363e212f157b req-c02df98f-c99a-47fa-92ad-287facbf3d78 service nova] Lock "0b79d385-e512-4297-9aa4-2b9bb0cac23c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:31:07 user nova-compute[74683]: DEBUG nova.compute.manager [req-b6c19ce8-76fa-4fcc-bd67-363e212f157b req-c02df98f-c99a-47fa-92ad-287facbf3d78 service nova] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] No waiting events found dispatching network-vif-plugged-c8345df8-9a3f-4261-a04c-59a0653140d0 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:31:07 user nova-compute[74683]: WARNING nova.compute.manager [req-b6c19ce8-76fa-4fcc-bd67-363e212f157b req-c02df98f-c99a-47fa-92ad-287facbf3d78 service nova] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Received unexpected event network-vif-plugged-c8345df8-9a3f-4261-a04c-59a0653140d0 for instance with vm_state deleted and task_state None.
Oct 16 11:31:07 user nova-compute[74683]: DEBUG nova.compute.manager [req-b6c19ce8-76fa-4fcc-bd67-363e212f157b req-c02df98f-c99a-47fa-92ad-287facbf3d78 service nova] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Received event network-vif-plugged-c8345df8-9a3f-4261-a04c-59a0653140d0 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:31:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b6c19ce8-76fa-4fcc-bd67-363e212f157b req-c02df98f-c99a-47fa-92ad-287facbf3d78 service nova] Acquiring lock "0b79d385-e512-4297-9aa4-2b9bb0cac23c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:31:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b6c19ce8-76fa-4fcc-bd67-363e212f157b req-c02df98f-c99a-47fa-92ad-287facbf3d78 service nova] Lock "0b79d385-e512-4297-9aa4-2b9bb0cac23c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:31:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b6c19ce8-76fa-4fcc-bd67-363e212f157b req-c02df98f-c99a-47fa-92ad-287facbf3d78 service nova] Lock "0b79d385-e512-4297-9aa4-2b9bb0cac23c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:31:07 user nova-compute[74683]: DEBUG nova.compute.manager [req-b6c19ce8-76fa-4fcc-bd67-363e212f157b req-c02df98f-c99a-47fa-92ad-287facbf3d78 service nova] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] No waiting events found dispatching network-vif-plugged-c8345df8-9a3f-4261-a04c-59a0653140d0 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:31:07 user nova-compute[74683]: WARNING nova.compute.manager [req-b6c19ce8-76fa-4fcc-bd67-363e212f157b req-c02df98f-c99a-47fa-92ad-287facbf3d78 service nova] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Received unexpected event network-vif-plugged-c8345df8-9a3f-4261-a04c-59a0653140d0 for instance with vm_state deleted and task_state None.
Oct 16 11:31:07 user nova-compute[74683]: DEBUG nova.compute.manager [req-b6c19ce8-76fa-4fcc-bd67-363e212f157b req-c02df98f-c99a-47fa-92ad-287facbf3d78 service nova] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Received event network-vif-unplugged-c8345df8-9a3f-4261-a04c-59a0653140d0 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:31:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b6c19ce8-76fa-4fcc-bd67-363e212f157b req-c02df98f-c99a-47fa-92ad-287facbf3d78 service nova] Acquiring lock "0b79d385-e512-4297-9aa4-2b9bb0cac23c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:31:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b6c19ce8-76fa-4fcc-bd67-363e212f157b req-c02df98f-c99a-47fa-92ad-287facbf3d78 service nova] Lock "0b79d385-e512-4297-9aa4-2b9bb0cac23c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:31:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b6c19ce8-76fa-4fcc-bd67-363e212f157b req-c02df98f-c99a-47fa-92ad-287facbf3d78 service nova] Lock "0b79d385-e512-4297-9aa4-2b9bb0cac23c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:31:07 user nova-compute[74683]: DEBUG nova.compute.manager [req-b6c19ce8-76fa-4fcc-bd67-363e212f157b req-c02df98f-c99a-47fa-92ad-287facbf3d78 service nova] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] No waiting events found dispatching network-vif-unplugged-c8345df8-9a3f-4261-a04c-59a0653140d0 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:31:07 user nova-compute[74683]: WARNING nova.compute.manager [req-b6c19ce8-76fa-4fcc-bd67-363e212f157b req-c02df98f-c99a-47fa-92ad-287facbf3d78 service nova] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Received unexpected event network-vif-unplugged-c8345df8-9a3f-4261-a04c-59a0653140d0 for instance with vm_state deleted and task_state None.
Oct 16 11:31:07 user nova-compute[74683]: DEBUG nova.compute.manager [req-b6c19ce8-76fa-4fcc-bd67-363e212f157b req-c02df98f-c99a-47fa-92ad-287facbf3d78 service nova] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Received event network-vif-plugged-c8345df8-9a3f-4261-a04c-59a0653140d0 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:31:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b6c19ce8-76fa-4fcc-bd67-363e212f157b req-c02df98f-c99a-47fa-92ad-287facbf3d78 service nova] Acquiring lock "0b79d385-e512-4297-9aa4-2b9bb0cac23c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:31:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b6c19ce8-76fa-4fcc-bd67-363e212f157b req-c02df98f-c99a-47fa-92ad-287facbf3d78 service nova] Lock "0b79d385-e512-4297-9aa4-2b9bb0cac23c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:31:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b6c19ce8-76fa-4fcc-bd67-363e212f157b req-c02df98f-c99a-47fa-92ad-287facbf3d78 service nova] Lock "0b79d385-e512-4297-9aa4-2b9bb0cac23c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:31:07 user nova-compute[74683]: DEBUG nova.compute.manager [req-b6c19ce8-76fa-4fcc-bd67-363e212f157b req-c02df98f-c99a-47fa-92ad-287facbf3d78 service nova] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] No waiting events found dispatching network-vif-plugged-c8345df8-9a3f-4261-a04c-59a0653140d0 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:31:07 user nova-compute[74683]: WARNING nova.compute.manager [req-b6c19ce8-76fa-4fcc-bd67-363e212f157b req-c02df98f-c99a-47fa-92ad-287facbf3d78 service nova] [instance: 0b79d385-e512-4297-9aa4-2b9bb0cac23c] Received unexpected event network-vif-plugged-c8345df8-9a3f-4261-a04c-59a0653140d0 for instance with vm_state deleted and task_state None.
Oct 16 11:31:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-c1c17bb8-a9e4-4a5b-bf3b-f4bf49c0283a tempest-ServersNegativeTestJSON-282145638 tempest-ServersNegativeTestJSON-282145638-project-member] Lock "0b79d385-e512-4297-9aa4-2b9bb0cac23c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.498s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:31:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f0d3f094-bd3c-4b11-844c-b4125469d81b tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Acquiring lock "6c9fc5a9-8659-497c-bb07-af52fe2e1761" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:31:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f0d3f094-bd3c-4b11-844c-b4125469d81b tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "6c9fc5a9-8659-497c-bb07-af52fe2e1761" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:31:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f0d3f094-bd3c-4b11-844c-b4125469d81b tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Acquiring lock "6c9fc5a9-8659-497c-bb07-af52fe2e1761-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:31:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f0d3f094-bd3c-4b11-844c-b4125469d81b tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "6c9fc5a9-8659-497c-bb07-af52fe2e1761-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:31:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f0d3f094-bd3c-4b11-844c-b4125469d81b tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "6c9fc5a9-8659-497c-bb07-af52fe2e1761-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:31:07 user nova-compute[74683]: INFO nova.compute.manager [None req-f0d3f094-bd3c-4b11-844c-b4125469d81b tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] Terminating instance
Oct 16 11:31:07 user nova-compute[74683]: DEBUG nova.compute.manager [None req-f0d3f094-bd3c-4b11-844c-b4125469d81b tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] Start destroying the instance on the hypervisor. {{(pid=74683) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 11:31:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:08 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:08 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:08 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] Instance destroyed successfully.
Oct 16 11:31:08 user nova-compute[74683]: DEBUG nova.objects.instance [None req-f0d3f094-bd3c-4b11-844c-b4125469d81b tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lazy-loading 'resources' on Instance uuid 6c9fc5a9-8659-497c-bb07-af52fe2e1761 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:31:08 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-f0d3f094-bd3c-4b11-844c-b4125469d81b tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:21:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1879852068',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1879852068',id=22,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:21:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d6e0046017b4bba85caf2a39d1c67b3',ramdisk_id='',reservation_id='r-q5i6enbj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1787816377',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:23:41Z,user_data=None,user_id='76a41804541e4a259771702727d9993e',uuid=6c9fc5a9-8659-497c-bb07-af52fe2e1761,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c1c13166-923d-4839-963a-434a9ba38d94", "address": "fa:16:3e:d3:0f:d5", "network": {"id": "4d43cc12-d2cd-4552-90a4-884a0ff3dc66", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-825513246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6e0046017b4bba85caf2a39d1c67b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1c13166-92", "ovs_interfaceid": "c1c13166-923d-4839-963a-434a9ba38d94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:31:08 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-f0d3f094-bd3c-4b11-844c-b4125469d81b tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Converting VIF {"id": "c1c13166-923d-4839-963a-434a9ba38d94", "address": "fa:16:3e:d3:0f:d5", "network": {"id": "4d43cc12-d2cd-4552-90a4-884a0ff3dc66", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-825513246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6e0046017b4bba85caf2a39d1c67b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1c13166-92", "ovs_interfaceid": "c1c13166-923d-4839-963a-434a9ba38d94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:31:08 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-f0d3f094-bd3c-4b11-844c-b4125469d81b tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:0f:d5,bridge_name='br-int',has_traffic_filtering=True,id=c1c13166-923d-4839-963a-434a9ba38d94,network=Network(4d43cc12-d2cd-4552-90a4-884a0ff3dc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1c13166-92') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:31:08 user nova-compute[74683]: DEBUG os_vif [None req-f0d3f094-bd3c-4b11-844c-b4125469d81b tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:0f:d5,bridge_name='br-int',has_traffic_filtering=True,id=c1c13166-923d-4839-963a-434a9ba38d94,network=Network(4d43cc12-d2cd-4552-90a4-884a0ff3dc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1c13166-92') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:31:08 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:08 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc1c13166-92, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:31:08 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:08 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:08 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:08 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4a72af7b-5cbb-4608-8a3f-3b47510733d6) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:31:08 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:08 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:08 user nova-compute[74683]: INFO os_vif [None req-f0d3f094-bd3c-4b11-844c-b4125469d81b tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:0f:d5,bridge_name='br-int',has_traffic_filtering=True,id=c1c13166-923d-4839-963a-434a9ba38d94,network=Network(4d43cc12-d2cd-4552-90a4-884a0ff3dc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1c13166-92')
Oct 16 11:31:08 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-f0d3f094-bd3c-4b11-844c-b4125469d81b tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] Deleting instance files /opt/stack/data/nova/instances/6c9fc5a9-8659-497c-bb07-af52fe2e1761_del
Oct 16 11:31:08 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-f0d3f094-bd3c-4b11-844c-b4125469d81b tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] Deletion of /opt/stack/data/nova/instances/6c9fc5a9-8659-497c-bb07-af52fe2e1761_del complete
Oct 16 11:31:08 user nova-compute[74683]: INFO nova.compute.manager [None req-f0d3f094-bd3c-4b11-844c-b4125469d81b tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] Took 1.03 seconds to destroy the instance on the hypervisor.
Oct 16 11:31:08 user nova-compute[74683]: DEBUG oslo.service.loopingcall [None req-f0d3f094-bd3c-4b11-844c-b4125469d81b tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74683) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 11:31:08 user nova-compute[74683]: DEBUG nova.compute.manager [-] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] Deallocating network for instance {{(pid=74683) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 11:31:08 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] deallocate_for_instance() {{(pid=74683) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 11:31:09 user nova-compute[74683]: DEBUG nova.compute.manager [req-6fb72fc7-6dc3-40fb-93e2-e37339e27b1c req-35474613-185b-4e1f-88dd-fef5fbc6140d service nova] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] Received event network-vif-unplugged-c1c13166-923d-4839-963a-434a9ba38d94 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:31:09 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-6fb72fc7-6dc3-40fb-93e2-e37339e27b1c req-35474613-185b-4e1f-88dd-fef5fbc6140d service nova] Acquiring lock "6c9fc5a9-8659-497c-bb07-af52fe2e1761-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:31:09 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-6fb72fc7-6dc3-40fb-93e2-e37339e27b1c req-35474613-185b-4e1f-88dd-fef5fbc6140d service nova] Lock "6c9fc5a9-8659-497c-bb07-af52fe2e1761-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:31:09 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-6fb72fc7-6dc3-40fb-93e2-e37339e27b1c req-35474613-185b-4e1f-88dd-fef5fbc6140d service nova] Lock "6c9fc5a9-8659-497c-bb07-af52fe2e1761-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:31:09 user nova-compute[74683]: DEBUG nova.compute.manager [req-6fb72fc7-6dc3-40fb-93e2-e37339e27b1c req-35474613-185b-4e1f-88dd-fef5fbc6140d service nova] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] No waiting events found dispatching network-vif-unplugged-c1c13166-923d-4839-963a-434a9ba38d94 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:31:09 user nova-compute[74683]: DEBUG nova.compute.manager [req-6fb72fc7-6dc3-40fb-93e2-e37339e27b1c req-35474613-185b-4e1f-88dd-fef5fbc6140d service nova] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] Received event network-vif-unplugged-c1c13166-923d-4839-963a-434a9ba38d94 for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 11:31:09 user nova-compute[74683]: DEBUG nova.compute.manager [req-6fb72fc7-6dc3-40fb-93e2-e37339e27b1c req-35474613-185b-4e1f-88dd-fef5fbc6140d service nova] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] Received event network-vif-plugged-c1c13166-923d-4839-963a-434a9ba38d94 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:31:09 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-6fb72fc7-6dc3-40fb-93e2-e37339e27b1c req-35474613-185b-4e1f-88dd-fef5fbc6140d service nova] Acquiring lock "6c9fc5a9-8659-497c-bb07-af52fe2e1761-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:31:09 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-6fb72fc7-6dc3-40fb-93e2-e37339e27b1c req-35474613-185b-4e1f-88dd-fef5fbc6140d service nova] Lock "6c9fc5a9-8659-497c-bb07-af52fe2e1761-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:31:09 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-6fb72fc7-6dc3-40fb-93e2-e37339e27b1c req-35474613-185b-4e1f-88dd-fef5fbc6140d service nova] Lock "6c9fc5a9-8659-497c-bb07-af52fe2e1761-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:31:09 user nova-compute[74683]: DEBUG nova.compute.manager [req-6fb72fc7-6dc3-40fb-93e2-e37339e27b1c req-35474613-185b-4e1f-88dd-fef5fbc6140d service nova] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] No waiting events found dispatching network-vif-plugged-c1c13166-923d-4839-963a-434a9ba38d94 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:31:09 user nova-compute[74683]: WARNING nova.compute.manager [req-6fb72fc7-6dc3-40fb-93e2-e37339e27b1c req-35474613-185b-4e1f-88dd-fef5fbc6140d service nova] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] Received unexpected event network-vif-plugged-c1c13166-923d-4839-963a-434a9ba38d94 for instance with vm_state active and task_state deleting.
Oct 16 11:31:09 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:31:09 user nova-compute[74683]: INFO nova.compute.manager [-] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] Took 0.56 seconds to deallocate network for instance.
Oct 16 11:31:09 user nova-compute[74683]: DEBUG nova.compute.manager [req-9deae0d6-c2ec-4625-ac6f-a050a5441580 req-9fab49fa-8fc9-4ba5-88b3-2ff95081842b service nova] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] Received event network-vif-deleted-c1c13166-923d-4839-963a-434a9ba38d94 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:31:09 user nova-compute[74683]: INFO nova.compute.manager [req-9deae0d6-c2ec-4625-ac6f-a050a5441580 req-9fab49fa-8fc9-4ba5-88b3-2ff95081842b service nova] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] Neutron deleted interface c1c13166-923d-4839-963a-434a9ba38d94; detaching it from the instance and deleting it from the info cache
Oct 16 11:31:09 user nova-compute[74683]: DEBUG nova.network.neutron [req-9deae0d6-c2ec-4625-ac6f-a050a5441580 req-9fab49fa-8fc9-4ba5-88b3-2ff95081842b service nova] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:31:09 user nova-compute[74683]: DEBUG nova.compute.manager [req-9deae0d6-c2ec-4625-ac6f-a050a5441580 req-9fab49fa-8fc9-4ba5-88b3-2ff95081842b service nova] [instance: 6c9fc5a9-8659-497c-bb07-af52fe2e1761] Detach interface failed, port_id=c1c13166-923d-4839-963a-434a9ba38d94, reason: Instance 6c9fc5a9-8659-497c-bb07-af52fe2e1761 could not be found. {{(pid=74683) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 16 11:31:09 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f0d3f094-bd3c-4b11-844c-b4125469d81b tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:31:09 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f0d3f094-bd3c-4b11-844c-b4125469d81b tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.004s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:31:09 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-f0d3f094-bd3c-4b11-844c-b4125469d81b tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:31:09 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-f0d3f094-bd3c-4b11-844c-b4125469d81b tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:31:09 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f0d3f094-bd3c-4b11-844c-b4125469d81b tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.428s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:31:09 user nova-compute[74683]: INFO nova.scheduler.client.report [None req-f0d3f094-bd3c-4b11-844c-b4125469d81b tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Deleted allocations for instance 6c9fc5a9-8659-497c-bb07-af52fe2e1761
Oct 16 11:31:09 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f0d3f094-bd3c-4b11-844c-b4125469d81b tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "6c9fc5a9-8659-497c-bb07-af52fe2e1761" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.307s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:31:11 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:13 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:15 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:31:15 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Starting heal instance info cache {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 11:31:15 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "refresh_cache-9b8ba94f-43cc-4f06-bcd9-83935ccbe117" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:31:15 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquired lock "refresh_cache-9b8ba94f-43cc-4f06-bcd9-83935ccbe117" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:31:15 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Forcefully refreshing network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 11:31:16 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Updating instance_info_cache with network_info: [{"id": "ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665", "address": "fa:16:3e:d4:56:40", "network": {"id": "fa128ba8-cd2f-4621-ac04-ecc21569bb68", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321708612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66a49078f1240bd88207e487dd4951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff8b53f2-e6", "ovs_interfaceid": "ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:31:16 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Releasing lock "refresh_cache-9b8ba94f-43cc-4f06-bcd9-83935ccbe117" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:31:16 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Updated the network info_cache for instance {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 11:31:16 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:31:16 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:31:16 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:31:16 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:31:16 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:31:16 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:18 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:18 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:31:19 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:31:19 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74683) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 11:31:21 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:31:21 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:31:21 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:31:21 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:31:21 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:31:21 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Auditing locally available compute resources for user (node: user) {{(pid=74683) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 11:31:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:31:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG nova.compute.manager [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Start spawning the instance on the hypervisor. {{(pid=74683) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Creating instance directory {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 11:31:22 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Creating image(s)
Oct 16 11:31:22 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Did not create local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Ensure instance console log exists: /opt/stack/data/nova/instances/45c24874-99be-41fc-a85f-27ea8ddcfc29/console.log {{(pid=74683) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Start _get_guest_xml network_info=[{"id": "5adcf9f7-16fd-477b-87c9-e3329444b7b4", "address": "fa:16:3e:10:f9:24", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5adcf9f7-16", "ovs_interfaceid": "5adcf9f7-16fd-477b-87c9-e3329444b7b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YRKjTnxa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '45c24874-99be-41fc-a85f-27ea8ddcfc29', 'attached_at': '', 'detached_at': '', 'volume_id': 'c6f05240-96d4-498f-9c29-f5888f6ed27f', 'serial': 'c6f05240-96d4-498f-9c29-f5888f6ed27f'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': 'a54a0194-2dc1-42d9-96c5-853d60581723', 'volume_type': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:31:22 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:31:22 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:31:22 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Calling os-brick to attach iSCSI Volume {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YRKjTnxa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:31:22 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:31:22 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:31:22 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:31:22 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:31:22 user nova-compute[74683]: INFO os_brick.initiator.connectors.iscsi [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 11:31:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f -p 172.16.0.220:3260 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f245b1e0-5c14-4a56-911f-454c8807a964]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 11:31:22 user nova-compute[74683]:  {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f -p 172.16.0.220:3260 --interface default --op new {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b31b5f8-b190-4b23-9a5e-34bb04d55328]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f] added\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f] added
Oct 16 11:31:22 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb10bb7-d421-40c6-be80-0e10138fc2b0/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81e8807-bbc1-4790-af47-89e31d8f1813]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ce00c9-4804-410b-a0ed-a1c37e810a34]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YRKjTnxa {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YRKjTnxa" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf84b4ce-83d0-47bb-bf29-11e164fa19c6]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YRKjTnxa'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[117db7c8-d3ac-41bb-8aae-f488bb080bfa]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[38eef526-58f6-45ec-9501-a0ad70a424b7]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:31:22 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:31:22 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f -p 172.16.0.220:3260 --login {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[159a4c22-b432-43b1-bb52-f52053c071db]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f, portal: 172.16.0.220,3260]
Oct 16 11:31:22 user nova-compute[74683]: Login to [iface: default, target: iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f, portal: 172.16.0.220,3260] successful.
Oct 16 11:31:22 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24f06d9-6122-4810-b193-973cbf9d6571]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb10bb7-d421-40c6-be80-0e10138fc2b0/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb10bb7-d421-40c6-be80-0e10138fc2b0/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef9401b-3cb7-485b-a7ef-4ea4d3aa242f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:31:22 user nova-compute[74683]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)
Oct 16 11:31:22 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:31:22 user nova-compute[74683]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)
Oct 16 11:31:22 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Connected to 172.16.0.220:3260 {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] HCTL ('33', '-', '-', 0) found on session 36 with lun 0 {{(pid=74683) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74683) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ccc14dc-659e-4823-ac3a-eb4075c6701b]: (4, ('- - 0', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YRKjTnxa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb10bb7-d421-40c6-be80-0e10138fc2b0/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:31:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ece51b6-5cb3-4d79-acdb-ea4d895cdce8/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:31:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ece51b6-5cb3-4d79-acdb-ea4d895cdce8/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:31:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ece51b6-5cb3-4d79-acdb-ea4d895cdce8/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:31:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ece51b6-5cb3-4d79-acdb-ea4d895cdce8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:31:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.rescue --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:31:23 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:31:23 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '23932333132316237', 'path': '/dev/sdb'} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:31:23 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932333132316237', 'path': '/dev/sdb'} {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 11:31:23 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:31:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-715797157',display_name='tempest-TestVolumeBootPattern-server-715797157',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-715797157',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJbd1pnA0e+ubtg3c4vxF2Dxe/3H7OECUV6ZZvaa4rKNrKocz4jmO0SXeRO4F7NQHuYFrsF7rAUyRZ4V/U5HkEw1E5UZyfInFppdQCzqY7p8CVOHAXsTsTbK336AbWu7g==',key_name='tempest-TestVolumeBootPattern-1282364245',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2aefabef9e42412f8309f490dcfecc79',ramdisk_id='',reservation_id='r-clakg8q0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-953001121',owner_user_name='tempest-TestVolumeBootPattern-953001121-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:31:04Z,user_data=None,user_id='a463a84e332543dfbc03b81518f82be1',uuid=45c24874-99be-41fc-a85f-27ea8ddcfc29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5adcf9f7-16fd-477b-87c9-e3329444b7b4", "address": "fa:16:3e:10:f9:24", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5adcf9f7-16", "ovs_interfaceid": "5adcf9f7-16fd-477b-87c9-e3329444b7b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:31:23 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Converting VIF {"id": "5adcf9f7-16fd-477b-87c9-e3329444b7b4", "address": "fa:16:3e:10:f9:24", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5adcf9f7-16", "ovs_interfaceid": "5adcf9f7-16fd-477b-87c9-e3329444b7b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:31:23 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:f9:24,bridge_name='br-int',has_traffic_filtering=True,id=5adcf9f7-16fd-477b-87c9-e3329444b7b4,network=Network(00883fc4-0b74-4afd-9043-82e2933faab3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5adcf9f7-16') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:31:23 user nova-compute[74683]: DEBUG nova.objects.instance [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lazy-loading 'pci_devices' on Instance uuid 45c24874-99be-41fc-a85f-27ea8ddcfc29 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:31:23 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:31:23 user nova-compute[74683]:   <uuid>45c24874-99be-41fc-a85f-27ea8ddcfc29</uuid>
Oct 16 11:31:23 user nova-compute[74683]:   <name>instance-00000023</name>
Oct 16 11:31:23 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:31:23 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:31:23 user nova-compute[74683]:   <metadata>
Oct 16 11:31:23 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:31:23 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:31:23 user nova-compute[74683]:       <nova:name>tempest-TestVolumeBootPattern-server-715797157</nova:name>
Oct 16 11:31:23 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:31:22</nova:creationTime>
Oct 16 11:31:23 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:31:23 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:31:23 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:31:23 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:31:23 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:31:23 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:31:23 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:31:23 user nova-compute[74683]:       <nova:owner>
Oct 16 11:31:23 user nova-compute[74683]:         <nova:user uuid="a463a84e332543dfbc03b81518f82be1">tempest-TestVolumeBootPattern-953001121-project-member</nova:user>
Oct 16 11:31:23 user nova-compute[74683]:         <nova:project uuid="2aefabef9e42412f8309f490dcfecc79">tempest-TestVolumeBootPattern-953001121</nova:project>
Oct 16 11:31:23 user nova-compute[74683]:       </nova:owner>
Oct 16 11:31:23 user nova-compute[74683]:       <nova:ports>
Oct 16 11:31:23 user nova-compute[74683]:         <nova:port uuid="5adcf9f7-16fd-477b-87c9-e3329444b7b4">
Oct 16 11:31:23 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 16 11:31:23 user nova-compute[74683]:         </nova:port>
Oct 16 11:31:23 user nova-compute[74683]:       </nova:ports>
Oct 16 11:31:23 user nova-compute[74683]:     </nova:instance>
Oct 16 11:31:23 user nova-compute[74683]:   </metadata>
Oct 16 11:31:23 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:31:23 user nova-compute[74683]:     <system>
Oct 16 11:31:23 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:31:23 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:31:23 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:31:23 user nova-compute[74683]:       <entry name="serial">45c24874-99be-41fc-a85f-27ea8ddcfc29</entry>
Oct 16 11:31:23 user nova-compute[74683]:       <entry name="uuid">45c24874-99be-41fc-a85f-27ea8ddcfc29</entry>
Oct 16 11:31:23 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:31:23 user nova-compute[74683]:     </system>
Oct 16 11:31:23 user nova-compute[74683]:   </sysinfo>
Oct 16 11:31:23 user nova-compute[74683]:   <os>
Oct 16 11:31:23 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:31:23 user nova-compute[74683]:     <boot dev="hd"/>
Oct 16 11:31:23 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:31:23 user nova-compute[74683]:   </os>
Oct 16 11:31:23 user nova-compute[74683]:   <features>
Oct 16 11:31:23 user nova-compute[74683]:     <acpi/>
Oct 16 11:31:23 user nova-compute[74683]:     <apic/>
Oct 16 11:31:23 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:31:23 user nova-compute[74683]:   </features>
Oct 16 11:31:23 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:31:23 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:31:23 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:31:23 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:31:23 user nova-compute[74683]:   </clock>
Oct 16 11:31:23 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:31:23 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:31:23 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:31:23 user nova-compute[74683]:   </cpu>
Oct 16 11:31:23 user nova-compute[74683]:   <devices>
Oct 16 11:31:23 user nova-compute[74683]:     <disk type="block" device="disk">
Oct 16 11:31:23 user nova-compute[74683]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:31:23 user nova-compute[74683]:       <source dev="/dev/sdb"/>
Oct 16 11:31:23 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:31:23 user nova-compute[74683]:       <serial>c6f05240-96d4-498f-9c29-f5888f6ed27f</serial>
Oct 16 11:31:23 user nova-compute[74683]:     </disk>
Oct 16 11:31:23 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:31:23 user nova-compute[74683]:       <mac address="fa:16:3e:10:f9:24"/>
Oct 16 11:31:23 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:31:23 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:31:23 user nova-compute[74683]:       <target dev="tap5adcf9f7-16"/>
Oct 16 11:31:23 user nova-compute[74683]:     </interface>
Oct 16 11:31:23 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:31:23 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/45c24874-99be-41fc-a85f-27ea8ddcfc29/console.log" append="off"/>
Oct 16 11:31:23 user nova-compute[74683]:     </serial>
Oct 16 11:31:23 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:31:23 user nova-compute[74683]:     <video>
Oct 16 11:31:23 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:31:23 user nova-compute[74683]:     </video>
Oct 16 11:31:23 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:31:23 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:31:23 user nova-compute[74683]:     </rng>
Oct 16 11:31:23 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:31:23 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:31:23 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:31:23 user nova-compute[74683]:     </memballoon>
Oct 16 11:31:23 user nova-compute[74683]:   </devices>
Oct 16 11:31:23 user nova-compute[74683]: </domain>
Oct 16 11:31:23 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:31:23 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:31:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-715797157',display_name='tempest-TestVolumeBootPattern-server-715797157',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-715797157',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJbd1pnA0e+ubtg3c4vxF2Dxe/3H7OECUV6ZZvaa4rKNrKocz4jmO0SXeRO4F7NQHuYFrsF7rAUyRZ4V/U5HkEw1E5UZyfInFppdQCzqY7p8CVOHAXsTsTbK336AbWu7g==',key_name='tempest-TestVolumeBootPattern-1282364245',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2aefabef9e42412f8309f490dcfecc79',ramdisk_id='',reservation_id='r-clakg8q0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-953001121',owner_user_name='tempest-TestVolumeBootPattern-953001121-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:31:04Z,user_data=None,user_id='a463a84e332543dfbc03b81518f82be1',uuid=45c24874-99be-41fc-a85f-27ea8ddcfc29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5adcf9f7-16fd-477b-87c9-e3329444b7b4", "address": "fa:16:3e:10:f9:24", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5adcf9f7-16", "ovs_interfaceid": "5adcf9f7-16fd-477b-87c9-e3329444b7b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:31:23 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Converting VIF {"id": "5adcf9f7-16fd-477b-87c9-e3329444b7b4", "address": "fa:16:3e:10:f9:24", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5adcf9f7-16", "ovs_interfaceid": "5adcf9f7-16fd-477b-87c9-e3329444b7b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:31:23 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:f9:24,bridge_name='br-int',has_traffic_filtering=True,id=5adcf9f7-16fd-477b-87c9-e3329444b7b4,network=Network(00883fc4-0b74-4afd-9043-82e2933faab3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5adcf9f7-16') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:31:23 user nova-compute[74683]: DEBUG os_vif [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:f9:24,bridge_name='br-int',has_traffic_filtering=True,id=5adcf9f7-16fd-477b-87c9-e3329444b7b4,network=Network(00883fc4-0b74-4afd-9043-82e2933faab3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5adcf9f7-16') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:31:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:31:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:31:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '486ed818-baaa-5c2d-9414-b28555e7d67a', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:31:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:31:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.rescue --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:31:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:31:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5adcf9f7-16, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:31:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5adcf9f7-16, col_values=(('qos', UUID('d59268f9-3fe4-4a03-85f5-38f9a0c8ecd0')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:31:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5adcf9f7-16, col_values=(('external_ids', {'iface-id': '5adcf9f7-16fd-477b-87c9-e3329444b7b4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:f9:24', 'vm-uuid': '45c24874-99be-41fc-a85f-27ea8ddcfc29'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:31:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:31:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:23 user nova-compute[74683]: INFO os_vif [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:f9:24,bridge_name='br-int',has_traffic_filtering=True,id=5adcf9f7-16fd-477b-87c9-e3329444b7b4,network=Network(00883fc4-0b74-4afd-9043-82e2933faab3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5adcf9f7-16')
Oct 16 11:31:23 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:31:23 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] No VIF found with MAC fa:16:3e:10:f9:24, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:31:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:31:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:31:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:31:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:31:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:31:24 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:31:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:31:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:31:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:31:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:31:25 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:31:25 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:31:25 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Hypervisor/Node resource view: name=user free_ram=7998MB free_disk=25.150714874267578GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74683) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 11:31:25 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:31:25 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:31:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:25 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 18a77385-fab9-4ea0-8aa6-666cf7e798a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:31:25 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance d5e55361-d9ed-4d07-91b0-ec4d08b2e817 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:31:25 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance edd01413-1f8a-49e3-aa3c-ecb19c62afae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:31:25 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 9b8ba94f-43cc-4f06-bcd9-83935ccbe117 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:31:25 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance b91af786-36e3-4815-811f-fb3c055e758d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:31:25 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:31:25 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 2fb10bb7-d421-40c6-be80-0e10138fc2b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:31:25 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 45c24874-99be-41fc-a85f-27ea8ddcfc29 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:31:25 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 11:31:25 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 11:31:25 user nova-compute[74683]: DEBUG nova.compute.manager [req-fad48dd4-3d0e-4cfc-a743-7c704f252d0e req-bf376c0a-a412-4af5-8267-3005a58f34d3 service nova] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Received event network-vif-plugged-5adcf9f7-16fd-477b-87c9-e3329444b7b4 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:31:25 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-fad48dd4-3d0e-4cfc-a743-7c704f252d0e req-bf376c0a-a412-4af5-8267-3005a58f34d3 service nova] Acquiring lock "45c24874-99be-41fc-a85f-27ea8ddcfc29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:31:25 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-fad48dd4-3d0e-4cfc-a743-7c704f252d0e req-bf376c0a-a412-4af5-8267-3005a58f34d3 service nova] Lock "45c24874-99be-41fc-a85f-27ea8ddcfc29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:31:25 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-fad48dd4-3d0e-4cfc-a743-7c704f252d0e req-bf376c0a-a412-4af5-8267-3005a58f34d3 service nova] Lock "45c24874-99be-41fc-a85f-27ea8ddcfc29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:31:25 user nova-compute[74683]: DEBUG nova.compute.manager [req-fad48dd4-3d0e-4cfc-a743-7c704f252d0e req-bf376c0a-a412-4af5-8267-3005a58f34d3 service nova] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] No waiting events found dispatching network-vif-plugged-5adcf9f7-16fd-477b-87c9-e3329444b7b4 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:31:25 user nova-compute[74683]: WARNING nova.compute.manager [req-fad48dd4-3d0e-4cfc-a743-7c704f252d0e req-bf376c0a-a412-4af5-8267-3005a58f34d3 service nova] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Received unexpected event network-vif-plugged-5adcf9f7-16fd-477b-87c9-e3329444b7b4 for instance with vm_state building and task_state spawning.
Oct 16 11:31:25 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:31:25 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:31:25 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Compute_service record updated for user:user {{(pid=74683) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 11:31:25 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.728s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:31:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:27 user nova-compute[74683]: DEBUG nova.compute.manager [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Instance event wait completed in 0 seconds for  {{(pid=74683) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 11:31:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Guest created on hypervisor {{(pid=74683) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 11:31:27 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Instance spawned successfully.
Oct 16 11:31:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 11:31:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Found default for hw_cdrom_bus of ide {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:31:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Found default for hw_disk_bus of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:31:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Found default for hw_input_bus of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:31:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Found default for hw_pointer_model of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:31:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Found default for hw_video_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:31:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Found default for hw_vif_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:31:27 user nova-compute[74683]: INFO nova.compute.manager [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Took 5.58 seconds to spawn the instance on the hypervisor.
Oct 16 11:31:27 user nova-compute[74683]: DEBUG nova.compute.manager [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:31:27 user nova-compute[74683]: DEBUG nova.compute.manager [req-45ba451f-5cad-403d-863c-b2d11b18987c req-bcd41467-eeb4-4626-992d-0d6ffccf47f1 service nova] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Received event network-vif-plugged-5adcf9f7-16fd-477b-87c9-e3329444b7b4 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:31:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-45ba451f-5cad-403d-863c-b2d11b18987c req-bcd41467-eeb4-4626-992d-0d6ffccf47f1 service nova] Acquiring lock "45c24874-99be-41fc-a85f-27ea8ddcfc29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:31:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-45ba451f-5cad-403d-863c-b2d11b18987c req-bcd41467-eeb4-4626-992d-0d6ffccf47f1 service nova] Lock "45c24874-99be-41fc-a85f-27ea8ddcfc29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:31:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-45ba451f-5cad-403d-863c-b2d11b18987c req-bcd41467-eeb4-4626-992d-0d6ffccf47f1 service nova] Lock "45c24874-99be-41fc-a85f-27ea8ddcfc29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:31:27 user nova-compute[74683]: DEBUG nova.compute.manager [req-45ba451f-5cad-403d-863c-b2d11b18987c req-bcd41467-eeb4-4626-992d-0d6ffccf47f1 service nova] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] No waiting events found dispatching network-vif-plugged-5adcf9f7-16fd-477b-87c9-e3329444b7b4 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:31:27 user nova-compute[74683]: WARNING nova.compute.manager [req-45ba451f-5cad-403d-863c-b2d11b18987c req-bcd41467-eeb4-4626-992d-0d6ffccf47f1 service nova] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Received unexpected event network-vif-plugged-5adcf9f7-16fd-477b-87c9-e3329444b7b4 for instance with vm_state building and task_state spawning.
Oct 16 11:31:27 user nova-compute[74683]: INFO nova.compute.manager [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Took 24.69 seconds to build instance.
Oct 16 11:31:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-4306f568-2632-4703-a3e1-8805ec4a6570 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "45c24874-99be-41fc-a85f-27ea8ddcfc29" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.826s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:31:28 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Acquiring lock "43d35d0e-acc5-4076-8641-73b4704f1028" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:31:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "43d35d0e-acc5-4076-8641-73b4704f1028" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:31:30 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Starting instance... {{(pid=74683) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 11:31:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:31:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:31:30 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74683) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 11:31:30 user nova-compute[74683]: INFO nova.compute.claims [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Claim successful on node user
Oct 16 11:31:30 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:31:30 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:31:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.443s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:31:30 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Start building networks asynchronously for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 11:31:31 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Allocating IP information in the background. {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 11:31:31 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] allocate_for_instance() {{(pid=74683) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 11:31:31 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 11:31:31 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Start building block device mappings for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 11:31:31 user nova-compute[74683]: DEBUG nova.policy [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6a55641a42b142ea9fb6c6c1fdb9963e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb8da41d6584a689e9b50155288aa5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74683) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 11:31:31 user nova-compute[74683]: INFO nova.virt.block_device [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Booting with volume 64115bde-e392-4631-bc47-a4b9b829eb44 at /dev/vda
Oct 16 11:31:31 user nova-compute[74683]: DEBUG os_brick.utils [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:31:31 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:31:31 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:31:31 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[dedbaa51-5c5b-41ea-9a36-bb3aed0c64a7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:70b9d336ab7d\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:31:31 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:31:31 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:31:31 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54ade58-43a6-41ba-b685-a8f9b35ecd79]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:31:31 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:31:31 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.039s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:31:31 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb92f1f9-7aab-4ced-b003-77334ec557fe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:31:31 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[dedc2dd9-4027-47bb-bbcc-059b1cdb63fe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:31:31 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Running cmd (subprocess): nvme version {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:31:31 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] 'nvme version' failed. Not Retrying. {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:31:31 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] nvme not present on system {{(pid=74683) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 11:31:31 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:31:31 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:31:31 user nova-compute[74683]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 11:31:31 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce8d1f8-15ac-4a55-9040-db712617821b]: (4, '') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:31:31 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74683) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 11:31:31 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 11:31:31 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] LIGHTOS: no hostnqn found. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 11:31:31 user nova-compute[74683]: DEBUG os_brick.utils [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:70b9d336ab7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:31:31 user nova-compute[74683]: DEBUG nova.virt.block_device [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Updating existing volume attachment record: 75463038-296b-4fdc-be7a-2f23b91a81ac {{(pid=74683) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 11:31:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:31 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Successfully created port: 8bc348fc-b8e3-40da-a8a1-70bd70c3fffe {{(pid=74683) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 11:31:32 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Successfully updated port: 8bc348fc-b8e3-40da-a8a1-70bd70c3fffe {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:31:32 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Acquiring lock "refresh_cache-43d35d0e-acc5-4076-8641-73b4704f1028" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:31:32 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Acquired lock "refresh_cache-43d35d0e-acc5-4076-8641-73b4704f1028" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:31:32 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:31:33 user nova-compute[74683]: DEBUG nova.compute.manager [req-19f10d2f-083f-4b23-a7b7-f2662846fc9e req-9e2b29e7-546c-4528-b4c0-c09b8ab8a098 service nova] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Received event network-changed-8bc348fc-b8e3-40da-a8a1-70bd70c3fffe {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:31:33 user nova-compute[74683]: DEBUG nova.compute.manager [req-19f10d2f-083f-4b23-a7b7-f2662846fc9e req-9e2b29e7-546c-4528-b4c0-c09b8ab8a098 service nova] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Refreshing instance network info cache due to event network-changed-8bc348fc-b8e3-40da-a8a1-70bd70c3fffe. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:31:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-19f10d2f-083f-4b23-a7b7-f2662846fc9e req-9e2b29e7-546c-4528-b4c0-c09b8ab8a098 service nova] Acquiring lock "refresh_cache-43d35d0e-acc5-4076-8641-73b4704f1028" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:31:33 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:31:33 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Updating instance_info_cache with network_info: [{"id": "8bc348fc-b8e3-40da-a8a1-70bd70c3fffe", "address": "fa:16:3e:37:bc:60", "network": {"id": "cd8cf08c-d79c-4d2e-b849-640c440e1498", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1091743670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcb8da41d6584a689e9b50155288aa5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc348fc-b8", "ovs_interfaceid": "8bc348fc-b8e3-40da-a8a1-70bd70c3fffe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:31:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Releasing lock "refresh_cache-43d35d0e-acc5-4076-8641-73b4704f1028" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:31:33 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Instance network_info: |[{"id": "8bc348fc-b8e3-40da-a8a1-70bd70c3fffe", "address": "fa:16:3e:37:bc:60", "network": {"id": "cd8cf08c-d79c-4d2e-b849-640c440e1498", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1091743670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcb8da41d6584a689e9b50155288aa5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc348fc-b8", "ovs_interfaceid": "8bc348fc-b8e3-40da-a8a1-70bd70c3fffe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 11:31:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-19f10d2f-083f-4b23-a7b7-f2662846fc9e req-9e2b29e7-546c-4528-b4c0-c09b8ab8a098 service nova] Acquired lock "refresh_cache-43d35d0e-acc5-4076-8641-73b4704f1028" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:31:33 user nova-compute[74683]: DEBUG nova.network.neutron [req-19f10d2f-083f-4b23-a7b7-f2662846fc9e req-9e2b29e7-546c-4528-b4c0-c09b8ab8a098 service nova] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Refreshing network info cache for port 8bc348fc-b8e3-40da-a8a1-70bd70c3fffe {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:31:33 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:34 user nova-compute[74683]: DEBUG nova.network.neutron [req-19f10d2f-083f-4b23-a7b7-f2662846fc9e req-9e2b29e7-546c-4528-b4c0-c09b8ab8a098 service nova] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Updated VIF entry in instance network info cache for port 8bc348fc-b8e3-40da-a8a1-70bd70c3fffe. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:31:34 user nova-compute[74683]: DEBUG nova.network.neutron [req-19f10d2f-083f-4b23-a7b7-f2662846fc9e req-9e2b29e7-546c-4528-b4c0-c09b8ab8a098 service nova] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Updating instance_info_cache with network_info: [{"id": "8bc348fc-b8e3-40da-a8a1-70bd70c3fffe", "address": "fa:16:3e:37:bc:60", "network": {"id": "cd8cf08c-d79c-4d2e-b849-640c440e1498", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1091743670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcb8da41d6584a689e9b50155288aa5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc348fc-b8", "ovs_interfaceid": "8bc348fc-b8e3-40da-a8a1-70bd70c3fffe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:31:34 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-19f10d2f-083f-4b23-a7b7-f2662846fc9e req-9e2b29e7-546c-4528-b4c0-c09b8ab8a098 service nova] Releasing lock "refresh_cache-43d35d0e-acc5-4076-8641-73b4704f1028" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:31:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:31:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74683) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 11:31:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:31:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:31:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:46 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:48 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:51 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:53 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:58 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-71903510-9347-49e6-a7af-55358726c1e7 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Acquiring lock "d5e55361-d9ed-4d07-91b0-ec4d08b2e817" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:31:58 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-71903510-9347-49e6-a7af-55358726c1e7 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "d5e55361-d9ed-4d07-91b0-ec4d08b2e817" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:31:58 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-71903510-9347-49e6-a7af-55358726c1e7 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Acquiring lock "d5e55361-d9ed-4d07-91b0-ec4d08b2e817-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:31:58 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-71903510-9347-49e6-a7af-55358726c1e7 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "d5e55361-d9ed-4d07-91b0-ec4d08b2e817-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:31:58 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-71903510-9347-49e6-a7af-55358726c1e7 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "d5e55361-d9ed-4d07-91b0-ec4d08b2e817-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:31:58 user nova-compute[74683]: INFO nova.compute.manager [None req-71903510-9347-49e6-a7af-55358726c1e7 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Terminating instance
Oct 16 11:31:58 user nova-compute[74683]: DEBUG nova.compute.manager [None req-71903510-9347-49e6-a7af-55358726c1e7 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Start destroying the instance on the hypervisor. {{(pid=74683) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 11:31:58 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:58 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:58 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:58 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:58 user nova-compute[74683]: DEBUG nova.compute.manager [req-7f91343e-5f1e-4778-b37d-0f2599c6267c req-dea6cec5-95c0-4771-84c4-d9f198de3319 service nova] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Received event network-vif-unplugged-ade44b63-49bb-4dbc-b0f9-95156f4fd6db {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:31:58 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-7f91343e-5f1e-4778-b37d-0f2599c6267c req-dea6cec5-95c0-4771-84c4-d9f198de3319 service nova] Acquiring lock "d5e55361-d9ed-4d07-91b0-ec4d08b2e817-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:31:58 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-7f91343e-5f1e-4778-b37d-0f2599c6267c req-dea6cec5-95c0-4771-84c4-d9f198de3319 service nova] Lock "d5e55361-d9ed-4d07-91b0-ec4d08b2e817-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:31:58 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-7f91343e-5f1e-4778-b37d-0f2599c6267c req-dea6cec5-95c0-4771-84c4-d9f198de3319 service nova] Lock "d5e55361-d9ed-4d07-91b0-ec4d08b2e817-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:31:58 user nova-compute[74683]: DEBUG nova.compute.manager [req-7f91343e-5f1e-4778-b37d-0f2599c6267c req-dea6cec5-95c0-4771-84c4-d9f198de3319 service nova] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] No waiting events found dispatching network-vif-unplugged-ade44b63-49bb-4dbc-b0f9-95156f4fd6db {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:31:58 user nova-compute[74683]: DEBUG nova.compute.manager [req-7f91343e-5f1e-4778-b37d-0f2599c6267c req-dea6cec5-95c0-4771-84c4-d9f198de3319 service nova] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Received event network-vif-unplugged-ade44b63-49bb-4dbc-b0f9-95156f4fd6db for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 11:31:58 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:58 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Instance destroyed successfully.
Oct 16 11:31:58 user nova-compute[74683]: DEBUG nova.objects.instance [None req-71903510-9347-49e6-a7af-55358726c1e7 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lazy-loading 'resources' on Instance uuid d5e55361-d9ed-4d07-91b0-ec4d08b2e817 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:31:58 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-71903510-9347-49e6-a7af-55358726c1e7 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:16:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1230353272',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1230353272',id=12,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:18:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d6e0046017b4bba85caf2a39d1c67b3',ramdisk_id='',reservation_id='r-ve22na1w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1787816377',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:19:56Z,user_data=None,user_id='76a41804541e4a259771702727d9993e',uuid=d5e55361-d9ed-4d07-91b0-ec4d08b2e817,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ade44b63-49bb-4dbc-b0f9-95156f4fd6db", "address": "fa:16:3e:ad:0a:5c", "network": {"id": "4d43cc12-d2cd-4552-90a4-884a0ff3dc66", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-825513246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6e0046017b4bba85caf2a39d1c67b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade44b63-49", "ovs_interfaceid": "ade44b63-49bb-4dbc-b0f9-95156f4fd6db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:31:58 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-71903510-9347-49e6-a7af-55358726c1e7 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Converting VIF {"id": "ade44b63-49bb-4dbc-b0f9-95156f4fd6db", "address": "fa:16:3e:ad:0a:5c", "network": {"id": "4d43cc12-d2cd-4552-90a4-884a0ff3dc66", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-825513246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6e0046017b4bba85caf2a39d1c67b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade44b63-49", "ovs_interfaceid": "ade44b63-49bb-4dbc-b0f9-95156f4fd6db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:31:58 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-71903510-9347-49e6-a7af-55358726c1e7 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ad:0a:5c,bridge_name='br-int',has_traffic_filtering=True,id=ade44b63-49bb-4dbc-b0f9-95156f4fd6db,network=Network(4d43cc12-d2cd-4552-90a4-884a0ff3dc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapade44b63-49') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:31:58 user nova-compute[74683]: DEBUG os_vif [None req-71903510-9347-49e6-a7af-55358726c1e7 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:0a:5c,bridge_name='br-int',has_traffic_filtering=True,id=ade44b63-49bb-4dbc-b0f9-95156f4fd6db,network=Network(4d43cc12-d2cd-4552-90a4-884a0ff3dc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapade44b63-49') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:31:58 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:58 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapade44b63-49, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:31:58 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:59 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:31:59 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:59 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dd88bc0d-d92e-41be-9321-a289735be46b) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:31:59 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:59 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:31:59 user nova-compute[74683]: INFO os_vif [None req-71903510-9347-49e6-a7af-55358726c1e7 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:0a:5c,bridge_name='br-int',has_traffic_filtering=True,id=ade44b63-49bb-4dbc-b0f9-95156f4fd6db,network=Network(4d43cc12-d2cd-4552-90a4-884a0ff3dc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapade44b63-49')
Oct 16 11:31:59 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71903510-9347-49e6-a7af-55358726c1e7 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] calling os-brick to detach iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 11:31:59 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-71903510-9347-49e6-a7af-55358726c1e7 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, {'target_iqn': 'iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yuvqsfmL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:31:59 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-71903510-9347-49e6-a7af-55358726c1e7 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:31:59 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-71903510-9347-49e6-a7af-55358726c1e7 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:31:59 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-71903510-9347-49e6-a7af-55358726c1e7 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:31:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:31:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:31:59 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[4437b5ce-bf3e-442a-ab12-5d7d4fe914e5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:31:59 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-71903510-9347-49e6-a7af-55358726c1e7 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 11:31:59 user nova-compute[74683]: No targets found.
Oct 16 11:31:59 user nova-compute[74683]: iSNS:
Oct 16 11:31:59 user nova-compute[74683]: No targets found.
Oct 16 11:31:59 user nova-compute[74683]: STATIC:
Oct 16 11:31:59 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb
Oct 16 11:31:59 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:31:59 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:31:59 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f
Oct 16 11:31:59 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:31:59 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:31:59 user nova-compute[74683]: FIRMWARE:
Oct 16 11:31:59 user nova-compute[74683]: No targets found.
Oct 16 11:31:59 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:31:59 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-71903510-9347-49e6-a7af-55358726c1e7 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 11:31:59 user nova-compute[74683]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 11:31:59 user nova-compute[74683]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74683) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 11:31:59 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-71903510-9347-49e6-a7af-55358726c1e7 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb', 0)] {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 11:31:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:31:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:31:59 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3da1872-f1ba-4ae9-830c-0381228b9abe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:31:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:31:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:31:59 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe21b448-f44b-482c-890e-fc26464cd976]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:31:59 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-71903510-9347-49e6-a7af-55358726c1e7 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:31:59 user nova-compute[74683]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)
Oct 16 11:31:59 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:31:59 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-71903510-9347-49e6-a7af-55358726c1e7 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb (non-flash)
Oct 16 11:31:59 user nova-compute[74683]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)
Oct 16 11:31:59 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:31:59 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-71903510-9347-49e6-a7af-55358726c1e7 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda6c295ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb'): ({'sdf'}, set())}) {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 11:31:59 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-71903510-9347-49e6-a7af-55358726c1e7 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Removing single pathed devices sdf {{(pid=74683) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 11:31:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:31:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:31:59 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47c0d7e-ee3d-4274-88dd-2d93107c6edc]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:31:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:31:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:31:59 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[438dd86a-13e6-4acd-a534-032a4932852f]: (4, ('ok\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:31:59 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-71903510-9347-49e6-a7af-55358726c1e7 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Flushing IO for device /dev/sdf {{(pid=74683) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 11:31:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:31:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:31:59 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[58de6b9e-00a0-419f-a95a-2e079bb2ccc9]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:31:59 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-71903510-9347-49e6-a7af-55358726c1e7 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74683) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 11:31:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:31:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.035s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:31:59 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f312bf34-cf5b-47ca-b50d-966da4bf1375]: (4, ('1', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:31:59 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-71903510-9347-49e6-a7af-55358726c1e7 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 11:31:59 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-71903510-9347-49e6-a7af-55358726c1e7 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] SCSI volumes sdf have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 11:31:59 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-71903510-9347-49e6-a7af-55358726c1e7 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb')] {{(pid=74683) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 11:31:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:31:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.037s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:31:59 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2365d98-8bc9-44a2-ac88-a41201da2a5f]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:31:59 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-71903510-9347-49e6-a7af-55358726c1e7 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:31:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb -p 172.16.0.220:3260 --logout {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:31:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:31:59 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[326cd62d-2542-4927-9a3d-cf0d08ed9c0e]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:31:59 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-71903510-9347-49e6-a7af-55358726c1e7 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb, portal: 172.16.0.220,3260]
Oct 16 11:31:59 user nova-compute[74683]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb, portal: 172.16.0.220,3260] successful.
Oct 16 11:31:59 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:31:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb -p 172.16.0.220:3260 --op delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:31:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6adf91a-024f-493b-9a81-eef3c4ca39fb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:31:59 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed3a3cb-4c53-425b-a6bb-a9d4d5d2ffc1]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:31:59 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-71903510-9347-49e6-a7af-55358726c1e7 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:31:59 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-71903510-9347-49e6-a7af-55358726c1e7 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:31:59 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-71903510-9347-49e6-a7af-55358726c1e7 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] <== disconnect_volume: return (318ms) None {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:31:59 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71903510-9347-49e6-a7af-55358726c1e7 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Disconnected iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 11:31:59 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-71903510-9347-49e6-a7af-55358726c1e7 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Deleting instance files /opt/stack/data/nova/instances/d5e55361-d9ed-4d07-91b0-ec4d08b2e817_del
Oct 16 11:31:59 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-71903510-9347-49e6-a7af-55358726c1e7 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Deletion of /opt/stack/data/nova/instances/d5e55361-d9ed-4d07-91b0-ec4d08b2e817_del complete
Oct 16 11:31:59 user nova-compute[74683]: INFO nova.compute.manager [None req-71903510-9347-49e6-a7af-55358726c1e7 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Took 1.20 seconds to destroy the instance on the hypervisor.
Oct 16 11:31:59 user nova-compute[74683]: DEBUG oslo.service.loopingcall [None req-71903510-9347-49e6-a7af-55358726c1e7 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74683) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 11:31:59 user nova-compute[74683]: DEBUG nova.compute.manager [-] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Deallocating network for instance {{(pid=74683) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 11:31:59 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] deallocate_for_instance() {{(pid=74683) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 11:31:59 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:31:59 user nova-compute[74683]: INFO nova.compute.manager [-] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Took 0.48 seconds to deallocate network for instance.
Oct 16 11:31:59 user nova-compute[74683]: DEBUG nova.compute.manager [req-e69c90fd-3a86-4d83-ba12-1068b4c0c38b req-d66985d9-2b9a-42af-89a2-02458e689a35 service nova] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Received event network-vif-deleted-ade44b63-49bb-4dbc-b0f9-95156f4fd6db {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:31:59 user nova-compute[74683]: INFO nova.compute.manager [req-e69c90fd-3a86-4d83-ba12-1068b4c0c38b req-d66985d9-2b9a-42af-89a2-02458e689a35 service nova] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Neutron deleted interface ade44b63-49bb-4dbc-b0f9-95156f4fd6db; detaching it from the instance and deleting it from the info cache
Oct 16 11:31:59 user nova-compute[74683]: DEBUG nova.network.neutron [req-e69c90fd-3a86-4d83-ba12-1068b4c0c38b req-d66985d9-2b9a-42af-89a2-02458e689a35 service nova] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:31:59 user nova-compute[74683]: DEBUG nova.compute.manager [req-e69c90fd-3a86-4d83-ba12-1068b4c0c38b req-d66985d9-2b9a-42af-89a2-02458e689a35 service nova] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Detach interface failed, port_id=ade44b63-49bb-4dbc-b0f9-95156f4fd6db, reason: Instance d5e55361-d9ed-4d07-91b0-ec4d08b2e817 could not be found. {{(pid=74683) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 16 11:32:00 user nova-compute[74683]: DEBUG nova.compute.manager [req-1f8c1d8b-b503-4ebd-86c3-58a16c5637fb req-81ec3fd4-80da-444a-9fb4-8858720c4570 service nova] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Received event network-vif-plugged-ade44b63-49bb-4dbc-b0f9-95156f4fd6db {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:32:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-1f8c1d8b-b503-4ebd-86c3-58a16c5637fb req-81ec3fd4-80da-444a-9fb4-8858720c4570 service nova] Acquiring lock "d5e55361-d9ed-4d07-91b0-ec4d08b2e817-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:32:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-1f8c1d8b-b503-4ebd-86c3-58a16c5637fb req-81ec3fd4-80da-444a-9fb4-8858720c4570 service nova] Lock "d5e55361-d9ed-4d07-91b0-ec4d08b2e817-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:32:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-1f8c1d8b-b503-4ebd-86c3-58a16c5637fb req-81ec3fd4-80da-444a-9fb4-8858720c4570 service nova] Lock "d5e55361-d9ed-4d07-91b0-ec4d08b2e817-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:32:00 user nova-compute[74683]: DEBUG nova.compute.manager [req-1f8c1d8b-b503-4ebd-86c3-58a16c5637fb req-81ec3fd4-80da-444a-9fb4-8858720c4570 service nova] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] No waiting events found dispatching network-vif-plugged-ade44b63-49bb-4dbc-b0f9-95156f4fd6db {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:32:00 user nova-compute[74683]: WARNING nova.compute.manager [req-1f8c1d8b-b503-4ebd-86c3-58a16c5637fb req-81ec3fd4-80da-444a-9fb4-8858720c4570 service nova] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Received unexpected event network-vif-plugged-ade44b63-49bb-4dbc-b0f9-95156f4fd6db for instance with vm_state active and task_state deleting.
Oct 16 11:32:03 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:04 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Start spawning the instance on the hypervisor. {{(pid=74683) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Creating instance directory {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 11:32:06 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Creating image(s)
Oct 16 11:32:06 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Did not create local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Ensure instance console log exists: /opt/stack/data/nova/instances/43d35d0e-acc5-4076-8641-73b4704f1028/console.log {{(pid=74683) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Start _get_guest_xml network_info=[{"id": "8bc348fc-b8e3-40da-a8a1-70bd70c3fffe", "address": "fa:16:3e:37:bc:60", "network": {"id": "cd8cf08c-d79c-4d2e-b849-640c440e1498", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1091743670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcb8da41d6584a689e9b50155288aa5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc348fc-b8", "ovs_interfaceid": "8bc348fc-b8e3-40da-a8a1-70bd70c3fffe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qDUviZHh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '43d35d0e-acc5-4076-8641-73b4704f1028', 'attached_at': '', 'detached_at': '', 'volume_id': '64115bde-e392-4631-bc47-a4b9b829eb44', 'serial': '64115bde-e392-4631-bc47-a4b9b829eb44'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': '75463038-296b-4fdc-be7a-2f23b91a81ac', 'volume_type': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:32:06 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:32:06 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:32:06 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Calling os-brick to attach iSCSI Volume {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qDUviZHh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:32:06 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:32:06 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:32:06 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:32:06 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:32:06 user nova-compute[74683]: INFO os_brick.initiator.connectors.iscsi [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 11:32:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 -p 172.16.0.220:3260 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[077b5a8c-6134-445d-b3df-d8a41bc43e9a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 11:32:06 user nova-compute[74683]:  {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 -p 172.16.0.220:3260 --interface default --op new {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeae9298-891f-4788-b83f-d4944608b614]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44] added\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44] added
Oct 16 11:32:06 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.040s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ce3a34-1100-4459-86fe-4af781dec517]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f63c3b4-076f-4a07-a2f3-ddbda90317b0]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qDUviZHh {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qDUviZHh" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce2c26d-8293-4e7a-95c8-a61dfa111346]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qDUviZHh'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[31765ab6-5054-4045-bbc3-342fd7e398a3]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[23da3e03-5165-4e49-92d9-fadf6573a2bc]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)
Oct 16 11:32:06 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)
Oct 16 11:32:06 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 -p 172.16.0.220:3260 --login {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe07e37-4498-483b-926f-0d66d769e0d4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44, portal: 172.16.0.220,3260]
Oct 16 11:32:06 user nova-compute[74683]: Login to [iface: default, target: iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44, portal: 172.16.0.220,3260] successful.
Oct 16 11:32:06 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d522795-c2fa-4716-bdb3-7e3a8f3019ca]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d36ed8-59cc-4e89-8a39-8ff396d2e48a]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)
Oct 16 11:32:06 user nova-compute[74683]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)
Oct 16 11:32:06 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)
Oct 16 11:32:06 user nova-compute[74683]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)
Oct 16 11:32:06 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Connected to 172.16.0.220:3260 {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] HCTL ('34', '-', '-', 0) found on session 37 with lun 0 {{(pid=74683) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74683) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac74e89c-fbe1-4044-ad70-61b81c3dc219]: (4, ('- - 0', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:32:06 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Searching for a device in session 37 and hctl ['34', '*', '*', 0] yield: None {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:32:07 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Searching for a device in session 37 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:32:07 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qDUviZHh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 11:32:07 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:32:07 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '23763333465303433', 'path': '/dev/sdc'} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:32:07 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763333465303433', 'path': '/dev/sdc'} {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 11:32:07 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:31:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1789370996',display_name='tempest-ServerActionsTestOtherA-server-1789370996',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1789370996',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBEVF+XohWeGna7xpASkIb8CQzH1AhAApSWM489KR3Xw5eNUrWHdrfnFEDLkNX5O9VFz9JiKaf+QhMQdRVklpUzwWiktfTm3fcbGcjt8FS9CdAQjTtJZQ2xWrypXQEhUiQ==',key_name='tempest-keypair-1801585168',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fcb8da41d6584a689e9b50155288aa5e',ramdisk_id='',reservation_id='r-ydo0ajxm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-327072564',owner_user_name='tempest-ServerActionsTestOtherA-327072564-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:31:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a55641a42b142ea9fb6c6c1fdb9963e',uuid=43d35d0e-acc5-4076-8641-73b4704f1028,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8bc348fc-b8e3-40da-a8a1-70bd70c3fffe", "address": "fa:16:3e:37:bc:60", "network": {"id": "cd8cf08c-d79c-4d2e-b849-640c440e1498", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1091743670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcb8da41d6584a689e9b50155288aa5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc348fc-b8", "ovs_interfaceid": "8bc348fc-b8e3-40da-a8a1-70bd70c3fffe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:32:07 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Converting VIF {"id": "8bc348fc-b8e3-40da-a8a1-70bd70c3fffe", "address": "fa:16:3e:37:bc:60", "network": {"id": "cd8cf08c-d79c-4d2e-b849-640c440e1498", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1091743670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcb8da41d6584a689e9b50155288aa5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc348fc-b8", "ovs_interfaceid": "8bc348fc-b8e3-40da-a8a1-70bd70c3fffe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:32:07 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:bc:60,bridge_name='br-int',has_traffic_filtering=True,id=8bc348fc-b8e3-40da-a8a1-70bd70c3fffe,network=Network(cd8cf08c-d79c-4d2e-b849-640c440e1498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bc348fc-b8') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:32:07 user nova-compute[74683]: DEBUG nova.objects.instance [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lazy-loading 'pci_devices' on Instance uuid 43d35d0e-acc5-4076-8641-73b4704f1028 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:32:07 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:32:07 user nova-compute[74683]:   <uuid>43d35d0e-acc5-4076-8641-73b4704f1028</uuid>
Oct 16 11:32:07 user nova-compute[74683]:   <name>instance-00000024</name>
Oct 16 11:32:07 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:32:07 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:32:07 user nova-compute[74683]:   <metadata>
Oct 16 11:32:07 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:32:07 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:32:07 user nova-compute[74683]:       <nova:name>tempest-ServerActionsTestOtherA-server-1789370996</nova:name>
Oct 16 11:32:07 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:32:06</nova:creationTime>
Oct 16 11:32:07 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:32:07 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:32:07 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:32:07 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:32:07 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:32:07 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:32:07 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:32:07 user nova-compute[74683]:       <nova:owner>
Oct 16 11:32:07 user nova-compute[74683]:         <nova:user uuid="6a55641a42b142ea9fb6c6c1fdb9963e">tempest-ServerActionsTestOtherA-327072564-project-member</nova:user>
Oct 16 11:32:07 user nova-compute[74683]:         <nova:project uuid="fcb8da41d6584a689e9b50155288aa5e">tempest-ServerActionsTestOtherA-327072564</nova:project>
Oct 16 11:32:07 user nova-compute[74683]:       </nova:owner>
Oct 16 11:32:07 user nova-compute[74683]:       <nova:ports>
Oct 16 11:32:07 user nova-compute[74683]:         <nova:port uuid="8bc348fc-b8e3-40da-a8a1-70bd70c3fffe">
Oct 16 11:32:07 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 16 11:32:07 user nova-compute[74683]:         </nova:port>
Oct 16 11:32:07 user nova-compute[74683]:       </nova:ports>
Oct 16 11:32:07 user nova-compute[74683]:     </nova:instance>
Oct 16 11:32:07 user nova-compute[74683]:   </metadata>
Oct 16 11:32:07 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:32:07 user nova-compute[74683]:     <system>
Oct 16 11:32:07 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:32:07 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:32:07 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:32:07 user nova-compute[74683]:       <entry name="serial">43d35d0e-acc5-4076-8641-73b4704f1028</entry>
Oct 16 11:32:07 user nova-compute[74683]:       <entry name="uuid">43d35d0e-acc5-4076-8641-73b4704f1028</entry>
Oct 16 11:32:07 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:32:07 user nova-compute[74683]:     </system>
Oct 16 11:32:07 user nova-compute[74683]:   </sysinfo>
Oct 16 11:32:07 user nova-compute[74683]:   <os>
Oct 16 11:32:07 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:32:07 user nova-compute[74683]:     <boot dev="hd"/>
Oct 16 11:32:07 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:32:07 user nova-compute[74683]:   </os>
Oct 16 11:32:07 user nova-compute[74683]:   <features>
Oct 16 11:32:07 user nova-compute[74683]:     <acpi/>
Oct 16 11:32:07 user nova-compute[74683]:     <apic/>
Oct 16 11:32:07 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:32:07 user nova-compute[74683]:   </features>
Oct 16 11:32:07 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:32:07 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:32:07 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:32:07 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:32:07 user nova-compute[74683]:   </clock>
Oct 16 11:32:07 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:32:07 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:32:07 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:32:07 user nova-compute[74683]:   </cpu>
Oct 16 11:32:07 user nova-compute[74683]:   <devices>
Oct 16 11:32:07 user nova-compute[74683]:     <disk type="block" device="disk">
Oct 16 11:32:07 user nova-compute[74683]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:32:07 user nova-compute[74683]:       <source dev="/dev/sdc"/>
Oct 16 11:32:07 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:32:07 user nova-compute[74683]:       <serial>64115bde-e392-4631-bc47-a4b9b829eb44</serial>
Oct 16 11:32:07 user nova-compute[74683]:     </disk>
Oct 16 11:32:07 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:32:07 user nova-compute[74683]:       <mac address="fa:16:3e:37:bc:60"/>
Oct 16 11:32:07 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:32:07 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:32:07 user nova-compute[74683]:       <target dev="tap8bc348fc-b8"/>
Oct 16 11:32:07 user nova-compute[74683]:     </interface>
Oct 16 11:32:07 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:32:07 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/43d35d0e-acc5-4076-8641-73b4704f1028/console.log" append="off"/>
Oct 16 11:32:07 user nova-compute[74683]:     </serial>
Oct 16 11:32:07 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:32:07 user nova-compute[74683]:     <video>
Oct 16 11:32:07 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:32:07 user nova-compute[74683]:     </video>
Oct 16 11:32:07 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:32:07 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:32:07 user nova-compute[74683]:     </rng>
Oct 16 11:32:07 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:32:07 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:32:07 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:32:07 user nova-compute[74683]:     </memballoon>
Oct 16 11:32:07 user nova-compute[74683]:   </devices>
Oct 16 11:32:07 user nova-compute[74683]: </domain>
Oct 16 11:32:07 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:32:08 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:31:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1789370996',display_name='tempest-ServerActionsTestOtherA-server-1789370996',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1789370996',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBEVF+XohWeGna7xpASkIb8CQzH1AhAApSWM489KR3Xw5eNUrWHdrfnFEDLkNX5O9VFz9JiKaf+QhMQdRVklpUzwWiktfTm3fcbGcjt8FS9CdAQjTtJZQ2xWrypXQEhUiQ==',key_name='tempest-keypair-1801585168',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fcb8da41d6584a689e9b50155288aa5e',ramdisk_id='',reservation_id='r-ydo0ajxm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-327072564',owner_user_name='tempest-ServerActionsTestOtherA-327072564-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:31:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a55641a42b142ea9fb6c6c1fdb9963e',uuid=43d35d0e-acc5-4076-8641-73b4704f1028,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8bc348fc-b8e3-40da-a8a1-70bd70c3fffe", "address": "fa:16:3e:37:bc:60", "network": {"id": "cd8cf08c-d79c-4d2e-b849-640c440e1498", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1091743670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcb8da41d6584a689e9b50155288aa5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc348fc-b8", "ovs_interfaceid": "8bc348fc-b8e3-40da-a8a1-70bd70c3fffe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:32:08 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Converting VIF {"id": "8bc348fc-b8e3-40da-a8a1-70bd70c3fffe", "address": "fa:16:3e:37:bc:60", "network": {"id": "cd8cf08c-d79c-4d2e-b849-640c440e1498", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1091743670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcb8da41d6584a689e9b50155288aa5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc348fc-b8", "ovs_interfaceid": "8bc348fc-b8e3-40da-a8a1-70bd70c3fffe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:32:08 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:bc:60,bridge_name='br-int',has_traffic_filtering=True,id=8bc348fc-b8e3-40da-a8a1-70bd70c3fffe,network=Network(cd8cf08c-d79c-4d2e-b849-640c440e1498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bc348fc-b8') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:32:08 user nova-compute[74683]: DEBUG os_vif [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:bc:60,bridge_name='br-int',has_traffic_filtering=True,id=8bc348fc-b8e3-40da-a8a1-70bd70c3fffe,network=Network(cd8cf08c-d79c-4d2e-b849-640c440e1498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bc348fc-b8') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:32:08 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:08 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:32:08 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:32:08 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:08 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9278e6d8-6b66-51da-94ef-811d467413c0', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:32:08 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:32:08 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:08 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8bc348fc-b8, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:32:08 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8bc348fc-b8, col_values=(('qos', UUID('4e32d66d-f9a5-45d4-8a36-69f3913dd941')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:32:08 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8bc348fc-b8, col_values=(('external_ids', {'iface-id': '8bc348fc-b8e3-40da-a8a1-70bd70c3fffe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:bc:60', 'vm-uuid': '43d35d0e-acc5-4076-8641-73b4704f1028'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:32:08 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:32:08 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:08 user nova-compute[74683]: INFO os_vif [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:bc:60,bridge_name='br-int',has_traffic_filtering=True,id=8bc348fc-b8e3-40da-a8a1-70bd70c3fffe,network=Network(cd8cf08c-d79c-4d2e-b849-640c440e1498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bc348fc-b8')
Oct 16 11:32:08 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:32:08 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] No VIF found with MAC fa:16:3e:37:bc:60, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:32:09 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Acquiring lock "f5ad764c-638d-4dac-b032-6680917e46df" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:32:09 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "f5ad764c-638d-4dac-b032-6680917e46df" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:32:09 user nova-compute[74683]: DEBUG nova.compute.manager [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Starting instance... {{(pid=74683) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 11:32:09 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:32:09 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:32:09 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74683) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 11:32:09 user nova-compute[74683]: INFO nova.compute.claims [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Claim successful on node user
Oct 16 11:32:09 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:09 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:09 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:09 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:09 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:09 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:32:09 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:32:09 user nova-compute[74683]: INFO nova.compute.manager [None req-71903510-9347-49e6-a7af-55358726c1e7 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: d5e55361-d9ed-4d07-91b0-ec4d08b2e817] Took 9.99 seconds to detach 1 volumes for instance.
Oct 16 11:32:09 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.515s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:32:09 user nova-compute[74683]: DEBUG nova.compute.manager [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Start building networks asynchronously for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 11:32:09 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-71903510-9347-49e6-a7af-55358726c1e7 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:32:09 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-71903510-9347-49e6-a7af-55358726c1e7 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:32:09 user nova-compute[74683]: DEBUG nova.compute.manager [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Allocating IP information in the background. {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 11:32:09 user nova-compute[74683]: DEBUG nova.network.neutron [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] allocate_for_instance() {{(pid=74683) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 11:32:09 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 11:32:10 user nova-compute[74683]: DEBUG nova.compute.manager [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Start building block device mappings for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 11:32:10 user nova-compute[74683]: DEBUG nova.policy [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c38fd3bc86ba4b7a95e06b926d22e60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889cb980200446c0933fe965738a62df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74683) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 11:32:10 user nova-compute[74683]: DEBUG nova.compute.manager [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Start spawning the instance on the hypervisor. {{(pid=74683) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 11:32:10 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Creating instance directory {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 11:32:10 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Creating image(s)
Oct 16 11:32:10 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Acquiring lock "/opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:32:10 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "/opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:32:10 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "/opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:32:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:32:10 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-71903510-9347-49e6-a7af-55358726c1e7 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:32:10 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-71903510-9347-49e6-a7af-55358726c1e7 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:32:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.215s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:32:10 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Acquiring lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:32:10 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:32:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:32:10 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-71903510-9347-49e6-a7af-55358726c1e7 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.506s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:32:10 user nova-compute[74683]: INFO nova.scheduler.client.report [None req-71903510-9347-49e6-a7af-55358726c1e7 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Deleted allocations for instance d5e55361-d9ed-4d07-91b0-ec4d08b2e817
Oct 16 11:32:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.185s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:32:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk 1073741824 {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:32:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk 1073741824" returned: 0 in 0.053s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:32:10 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-71903510-9347-49e6-a7af-55358726c1e7 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "d5e55361-d9ed-4d07-91b0-ec4d08b2e817" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.447s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:32:10 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:32:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:32:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.215s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:32:10 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk. size=1073741824 {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 11:32:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:32:11 user nova-compute[74683]: DEBUG nova.network.neutron [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Successfully created port: eb80f49f-da30-478a-900a-5d3da8ec7fa9 {{(pid=74683) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 11:32:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:32:11 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Cannot resize image /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk to a smaller size. {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 11:32:11 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Created local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 11:32:11 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Ensure instance console log exists: /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/console.log {{(pid=74683) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 11:32:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:32:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:32:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:32:11 user nova-compute[74683]: DEBUG nova.compute.manager [req-787de1ad-398b-4e13-bb4f-e610359827c4 req-eab78e08-1463-4e6e-a555-70dc3474b8ac service nova] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Received event network-vif-plugged-8bc348fc-b8e3-40da-a8a1-70bd70c3fffe {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:32:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-787de1ad-398b-4e13-bb4f-e610359827c4 req-eab78e08-1463-4e6e-a555-70dc3474b8ac service nova] Acquiring lock "43d35d0e-acc5-4076-8641-73b4704f1028-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:32:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-787de1ad-398b-4e13-bb4f-e610359827c4 req-eab78e08-1463-4e6e-a555-70dc3474b8ac service nova] Lock "43d35d0e-acc5-4076-8641-73b4704f1028-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:32:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-787de1ad-398b-4e13-bb4f-e610359827c4 req-eab78e08-1463-4e6e-a555-70dc3474b8ac service nova] Lock "43d35d0e-acc5-4076-8641-73b4704f1028-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:32:11 user nova-compute[74683]: DEBUG nova.compute.manager [req-787de1ad-398b-4e13-bb4f-e610359827c4 req-eab78e08-1463-4e6e-a555-70dc3474b8ac service nova] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] No waiting events found dispatching network-vif-plugged-8bc348fc-b8e3-40da-a8a1-70bd70c3fffe {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:32:11 user nova-compute[74683]: WARNING nova.compute.manager [req-787de1ad-398b-4e13-bb4f-e610359827c4 req-eab78e08-1463-4e6e-a555-70dc3474b8ac service nova] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Received unexpected event network-vif-plugged-8bc348fc-b8e3-40da-a8a1-70bd70c3fffe for instance with vm_state building and task_state spawning.
Oct 16 11:32:11 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Instance event wait completed in 0 seconds for  {{(pid=74683) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 11:32:11 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Guest created on hypervisor {{(pid=74683) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 11:32:11 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Instance spawned successfully.
Oct 16 11:32:11 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 11:32:11 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Found default for hw_cdrom_bus of ide {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:32:11 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Found default for hw_disk_bus of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:32:11 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Found default for hw_input_bus of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:32:11 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Found default for hw_pointer_model of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:32:11 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Found default for hw_video_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:32:11 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Found default for hw_vif_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:32:11 user nova-compute[74683]: INFO nova.compute.manager [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Took 5.25 seconds to spawn the instance on the hypervisor.
Oct 16 11:32:11 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:32:11 user nova-compute[74683]: DEBUG nova.network.neutron [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Successfully updated port: eb80f49f-da30-478a-900a-5d3da8ec7fa9 {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:32:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Acquiring lock "refresh_cache-f5ad764c-638d-4dac-b032-6680917e46df" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:32:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Acquired lock "refresh_cache-f5ad764c-638d-4dac-b032-6680917e46df" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:32:11 user nova-compute[74683]: DEBUG nova.network.neutron [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:32:11 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:11 user nova-compute[74683]: INFO nova.compute.manager [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Took 41.42 seconds to build instance.
Oct 16 11:32:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9cc164d2-3714-46a3-b9d1-048d029917f5 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "43d35d0e-acc5-4076-8641-73b4704f1028" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 41.537s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:32:11 user nova-compute[74683]: DEBUG nova.network.neutron [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:32:12 user nova-compute[74683]: DEBUG nova.network.neutron [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Updating instance_info_cache with network_info: [{"id": "eb80f49f-da30-478a-900a-5d3da8ec7fa9", "address": "fa:16:3e:c8:02:4d", "network": {"id": "badd2db9-6c0f-40cc-afe9-a199e040399a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1368098259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "889cb980200446c0933fe965738a62df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb80f49f-da", "ovs_interfaceid": "eb80f49f-da30-478a-900a-5d3da8ec7fa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:32:12 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Releasing lock "refresh_cache-f5ad764c-638d-4dac-b032-6680917e46df" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:32:12 user nova-compute[74683]: DEBUG nova.compute.manager [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Instance network_info: |[{"id": "eb80f49f-da30-478a-900a-5d3da8ec7fa9", "address": "fa:16:3e:c8:02:4d", "network": {"id": "badd2db9-6c0f-40cc-afe9-a199e040399a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1368098259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "889cb980200446c0933fe965738a62df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb80f49f-da", "ovs_interfaceid": "eb80f49f-da30-478a-900a-5d3da8ec7fa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 11:32:12 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Start _get_guest_xml network_info=[{"id": "eb80f49f-da30-478a-900a-5d3da8ec7fa9", "address": "fa:16:3e:c8:02:4d", "network": {"id": "badd2db9-6c0f-40cc-afe9-a199e040399a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1368098259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "889cb980200446c0933fe965738a62df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb80f49f-da", "ovs_interfaceid": "eb80f49f-da30-478a-900a-5d3da8ec7fa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:32:12 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:32:12 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:32:12 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:32:12 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:32:12 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:32:12 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:32:12 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:32:12 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:32:12 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:32:12 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:32:12 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:32:12 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:32:12 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:32:12 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:32:12 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:32:12 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:32:12 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:32:12 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:32:12 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:32:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1312798176',display_name='tempest-AttachVolumeTestJSON-server-1312798176',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1312798176',id=37,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK71ozq2/KpO5RlTCFqfn2Y2zadWP27MahKIqPNvvjn6AoGcB4vtAlejjcQWpo0ZyUGWpGjLegzCVDVvdR5EwjFBNV5GDYZr2laQXH53s66DwTCeGEg2DbbqZiQTOGLfAw==',key_name='tempest-keypair-1447279783',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='889cb980200446c0933fe965738a62df',ramdisk_id='',reservation_id='r-acd30a2f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-263939305',owner_user_name='tempest-AttachVolumeTestJSON-263939305-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:32:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c38fd3bc86ba4b7a95e06b926d22e60f',uuid=f5ad764c-638d-4dac-b032-6680917e46df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb80f49f-da30-478a-900a-5d3da8ec7fa9", "address": "fa:16:3e:c8:02:4d", "network": {"id": "badd2db9-6c0f-40cc-afe9-a199e040399a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1368098259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "889cb980200446c0933fe965738a62df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb80f49f-da", "ovs_interfaceid": "eb80f49f-da30-478a-900a-5d3da8ec7fa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:32:12 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Converting VIF {"id": "eb80f49f-da30-478a-900a-5d3da8ec7fa9", "address": "fa:16:3e:c8:02:4d", "network": {"id": "badd2db9-6c0f-40cc-afe9-a199e040399a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1368098259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "889cb980200446c0933fe965738a62df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb80f49f-da", "ovs_interfaceid": "eb80f49f-da30-478a-900a-5d3da8ec7fa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:32:12 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:02:4d,bridge_name='br-int',has_traffic_filtering=True,id=eb80f49f-da30-478a-900a-5d3da8ec7fa9,network=Network(badd2db9-6c0f-40cc-afe9-a199e040399a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb80f49f-da') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:32:12 user nova-compute[74683]: DEBUG nova.objects.instance [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lazy-loading 'pci_devices' on Instance uuid f5ad764c-638d-4dac-b032-6680917e46df {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:32:12 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:32:12 user nova-compute[74683]:   <uuid>f5ad764c-638d-4dac-b032-6680917e46df</uuid>
Oct 16 11:32:12 user nova-compute[74683]:   <name>instance-00000025</name>
Oct 16 11:32:12 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:32:12 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:32:12 user nova-compute[74683]:   <metadata>
Oct 16 11:32:12 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:32:12 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:32:12 user nova-compute[74683]:       <nova:name>tempest-AttachVolumeTestJSON-server-1312798176</nova:name>
Oct 16 11:32:12 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:32:12</nova:creationTime>
Oct 16 11:32:12 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:32:12 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:32:12 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:32:12 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:32:12 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:32:12 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:32:12 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:32:12 user nova-compute[74683]:       <nova:owner>
Oct 16 11:32:12 user nova-compute[74683]:         <nova:user uuid="c38fd3bc86ba4b7a95e06b926d22e60f">tempest-AttachVolumeTestJSON-263939305-project-member</nova:user>
Oct 16 11:32:12 user nova-compute[74683]:         <nova:project uuid="889cb980200446c0933fe965738a62df">tempest-AttachVolumeTestJSON-263939305</nova:project>
Oct 16 11:32:12 user nova-compute[74683]:       </nova:owner>
Oct 16 11:32:12 user nova-compute[74683]:       <nova:root type="image" uuid="0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f"/>
Oct 16 11:32:12 user nova-compute[74683]:       <nova:ports>
Oct 16 11:32:12 user nova-compute[74683]:         <nova:port uuid="eb80f49f-da30-478a-900a-5d3da8ec7fa9">
Oct 16 11:32:12 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 16 11:32:12 user nova-compute[74683]:         </nova:port>
Oct 16 11:32:12 user nova-compute[74683]:       </nova:ports>
Oct 16 11:32:12 user nova-compute[74683]:     </nova:instance>
Oct 16 11:32:12 user nova-compute[74683]:   </metadata>
Oct 16 11:32:12 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:32:12 user nova-compute[74683]:     <system>
Oct 16 11:32:12 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:32:12 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:32:12 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:32:12 user nova-compute[74683]:       <entry name="serial">f5ad764c-638d-4dac-b032-6680917e46df</entry>
Oct 16 11:32:12 user nova-compute[74683]:       <entry name="uuid">f5ad764c-638d-4dac-b032-6680917e46df</entry>
Oct 16 11:32:12 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:32:12 user nova-compute[74683]:     </system>
Oct 16 11:32:12 user nova-compute[74683]:   </sysinfo>
Oct 16 11:32:12 user nova-compute[74683]:   <os>
Oct 16 11:32:12 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:32:12 user nova-compute[74683]:     <boot dev="hd"/>
Oct 16 11:32:12 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:32:12 user nova-compute[74683]:   </os>
Oct 16 11:32:12 user nova-compute[74683]:   <features>
Oct 16 11:32:12 user nova-compute[74683]:     <acpi/>
Oct 16 11:32:12 user nova-compute[74683]:     <apic/>
Oct 16 11:32:12 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:32:12 user nova-compute[74683]:   </features>
Oct 16 11:32:12 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:32:12 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:32:12 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:32:12 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:32:12 user nova-compute[74683]:   </clock>
Oct 16 11:32:12 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:32:12 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:32:12 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:32:12 user nova-compute[74683]:   </cpu>
Oct 16 11:32:12 user nova-compute[74683]:   <devices>
Oct 16 11:32:12 user nova-compute[74683]:     <disk type="file" device="disk">
Oct 16 11:32:12 user nova-compute[74683]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 11:32:12 user nova-compute[74683]:       <source file="/opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk"/>
Oct 16 11:32:12 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:32:12 user nova-compute[74683]:     </disk>
Oct 16 11:32:12 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:32:12 user nova-compute[74683]:       <mac address="fa:16:3e:c8:02:4d"/>
Oct 16 11:32:12 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:32:12 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:32:12 user nova-compute[74683]:       <target dev="tapeb80f49f-da"/>
Oct 16 11:32:12 user nova-compute[74683]:     </interface>
Oct 16 11:32:12 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:32:12 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/console.log" append="off"/>
Oct 16 11:32:12 user nova-compute[74683]:     </serial>
Oct 16 11:32:12 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:32:12 user nova-compute[74683]:     <video>
Oct 16 11:32:12 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:32:12 user nova-compute[74683]:     </video>
Oct 16 11:32:12 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:32:12 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:32:12 user nova-compute[74683]:     </rng>
Oct 16 11:32:12 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:32:12 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:32:12 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:32:12 user nova-compute[74683]:     </memballoon>
Oct 16 11:32:12 user nova-compute[74683]:   </devices>
Oct 16 11:32:12 user nova-compute[74683]: </domain>
Oct 16 11:32:12 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:32:12 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:32:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1312798176',display_name='tempest-AttachVolumeTestJSON-server-1312798176',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1312798176',id=37,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK71ozq2/KpO5RlTCFqfn2Y2zadWP27MahKIqPNvvjn6AoGcB4vtAlejjcQWpo0ZyUGWpGjLegzCVDVvdR5EwjFBNV5GDYZr2laQXH53s66DwTCeGEg2DbbqZiQTOGLfAw==',key_name='tempest-keypair-1447279783',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='889cb980200446c0933fe965738a62df',ramdisk_id='',reservation_id='r-acd30a2f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-263939305',owner_user_name='tempest-AttachVolumeTestJSON-263939305-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:32:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c38fd3bc86ba4b7a95e06b926d22e60f',uuid=f5ad764c-638d-4dac-b032-6680917e46df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb80f49f-da30-478a-900a-5d3da8ec7fa9", "address": "fa:16:3e:c8:02:4d", "network": {"id": "badd2db9-6c0f-40cc-afe9-a199e040399a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1368098259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "889cb980200446c0933fe965738a62df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb80f49f-da", "ovs_interfaceid": "eb80f49f-da30-478a-900a-5d3da8ec7fa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:32:12 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Converting VIF {"id": "eb80f49f-da30-478a-900a-5d3da8ec7fa9", "address": "fa:16:3e:c8:02:4d", "network": {"id": "badd2db9-6c0f-40cc-afe9-a199e040399a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1368098259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "889cb980200446c0933fe965738a62df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb80f49f-da", "ovs_interfaceid": "eb80f49f-da30-478a-900a-5d3da8ec7fa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:32:12 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:02:4d,bridge_name='br-int',has_traffic_filtering=True,id=eb80f49f-da30-478a-900a-5d3da8ec7fa9,network=Network(badd2db9-6c0f-40cc-afe9-a199e040399a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb80f49f-da') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:32:12 user nova-compute[74683]: DEBUG os_vif [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:02:4d,bridge_name='br-int',has_traffic_filtering=True,id=eb80f49f-da30-478a-900a-5d3da8ec7fa9,network=Network(badd2db9-6c0f-40cc-afe9-a199e040399a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb80f49f-da') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:32:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:32:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:32:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '62e33a0e-1db6-509e-9031-ed30d2e60514', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:32:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeb80f49f-da, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:32:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeb80f49f-da, col_values=(('qos', UUID('7e530e55-9597-4dd5-b3ab-26570d287753')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:32:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeb80f49f-da, col_values=(('external_ids', {'iface-id': 'eb80f49f-da30-478a-900a-5d3da8ec7fa9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:02:4d', 'vm-uuid': 'f5ad764c-638d-4dac-b032-6680917e46df'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:32:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:32:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:12 user nova-compute[74683]: INFO os_vif [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:02:4d,bridge_name='br-int',has_traffic_filtering=True,id=eb80f49f-da30-478a-900a-5d3da8ec7fa9,network=Network(badd2db9-6c0f-40cc-afe9-a199e040399a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb80f49f-da')
Oct 16 11:32:12 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:32:12 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] No VIF found with MAC fa:16:3e:c8:02:4d, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:32:13 user nova-compute[74683]: DEBUG nova.compute.manager [req-8658e30a-13de-4a4f-a86d-dbe817a3dfff req-e1409e5e-d4b1-40cd-9283-ec1724411851 service nova] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Received event network-vif-plugged-8bc348fc-b8e3-40da-a8a1-70bd70c3fffe {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:32:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-8658e30a-13de-4a4f-a86d-dbe817a3dfff req-e1409e5e-d4b1-40cd-9283-ec1724411851 service nova] Acquiring lock "43d35d0e-acc5-4076-8641-73b4704f1028-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:32:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-8658e30a-13de-4a4f-a86d-dbe817a3dfff req-e1409e5e-d4b1-40cd-9283-ec1724411851 service nova] Lock "43d35d0e-acc5-4076-8641-73b4704f1028-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:32:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-8658e30a-13de-4a4f-a86d-dbe817a3dfff req-e1409e5e-d4b1-40cd-9283-ec1724411851 service nova] Lock "43d35d0e-acc5-4076-8641-73b4704f1028-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:32:13 user nova-compute[74683]: DEBUG nova.compute.manager [req-8658e30a-13de-4a4f-a86d-dbe817a3dfff req-e1409e5e-d4b1-40cd-9283-ec1724411851 service nova] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] No waiting events found dispatching network-vif-plugged-8bc348fc-b8e3-40da-a8a1-70bd70c3fffe {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:32:13 user nova-compute[74683]: WARNING nova.compute.manager [req-8658e30a-13de-4a4f-a86d-dbe817a3dfff req-e1409e5e-d4b1-40cd-9283-ec1724411851 service nova] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Received unexpected event network-vif-plugged-8bc348fc-b8e3-40da-a8a1-70bd70c3fffe for instance with vm_state active and task_state None.
Oct 16 11:32:13 user nova-compute[74683]: DEBUG nova.compute.manager [req-8658e30a-13de-4a4f-a86d-dbe817a3dfff req-e1409e5e-d4b1-40cd-9283-ec1724411851 service nova] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Received event network-changed-eb80f49f-da30-478a-900a-5d3da8ec7fa9 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:32:13 user nova-compute[74683]: DEBUG nova.compute.manager [req-8658e30a-13de-4a4f-a86d-dbe817a3dfff req-e1409e5e-d4b1-40cd-9283-ec1724411851 service nova] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Refreshing instance network info cache due to event network-changed-eb80f49f-da30-478a-900a-5d3da8ec7fa9. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:32:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-8658e30a-13de-4a4f-a86d-dbe817a3dfff req-e1409e5e-d4b1-40cd-9283-ec1724411851 service nova] Acquiring lock "refresh_cache-f5ad764c-638d-4dac-b032-6680917e46df" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:32:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-8658e30a-13de-4a4f-a86d-dbe817a3dfff req-e1409e5e-d4b1-40cd-9283-ec1724411851 service nova] Acquired lock "refresh_cache-f5ad764c-638d-4dac-b032-6680917e46df" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:32:13 user nova-compute[74683]: DEBUG nova.network.neutron [req-8658e30a-13de-4a4f-a86d-dbe817a3dfff req-e1409e5e-d4b1-40cd-9283-ec1724411851 service nova] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Refreshing network info cache for port eb80f49f-da30-478a-900a-5d3da8ec7fa9 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:32:13 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:13 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:13 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:13 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:14 user nova-compute[74683]: DEBUG nova.network.neutron [req-8658e30a-13de-4a4f-a86d-dbe817a3dfff req-e1409e5e-d4b1-40cd-9283-ec1724411851 service nova] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Updated VIF entry in instance network info cache for port eb80f49f-da30-478a-900a-5d3da8ec7fa9. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:32:14 user nova-compute[74683]: DEBUG nova.network.neutron [req-8658e30a-13de-4a4f-a86d-dbe817a3dfff req-e1409e5e-d4b1-40cd-9283-ec1724411851 service nova] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Updating instance_info_cache with network_info: [{"id": "eb80f49f-da30-478a-900a-5d3da8ec7fa9", "address": "fa:16:3e:c8:02:4d", "network": {"id": "badd2db9-6c0f-40cc-afe9-a199e040399a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1368098259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "889cb980200446c0933fe965738a62df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb80f49f-da", "ovs_interfaceid": "eb80f49f-da30-478a-900a-5d3da8ec7fa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:32:14 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-8658e30a-13de-4a4f-a86d-dbe817a3dfff req-e1409e5e-d4b1-40cd-9283-ec1724411851 service nova] Releasing lock "refresh_cache-f5ad764c-638d-4dac-b032-6680917e46df" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:32:14 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:14 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:14 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:14 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:15 user nova-compute[74683]: DEBUG nova.compute.manager [req-2ade6a66-8cae-4e6e-b56c-f160ed84f96b req-828e1ecf-dae2-49f0-ae09-c3640e3830c8 service nova] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Received event network-vif-plugged-eb80f49f-da30-478a-900a-5d3da8ec7fa9 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:32:15 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-2ade6a66-8cae-4e6e-b56c-f160ed84f96b req-828e1ecf-dae2-49f0-ae09-c3640e3830c8 service nova] Acquiring lock "f5ad764c-638d-4dac-b032-6680917e46df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:32:15 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-2ade6a66-8cae-4e6e-b56c-f160ed84f96b req-828e1ecf-dae2-49f0-ae09-c3640e3830c8 service nova] Lock "f5ad764c-638d-4dac-b032-6680917e46df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:32:15 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-2ade6a66-8cae-4e6e-b56c-f160ed84f96b req-828e1ecf-dae2-49f0-ae09-c3640e3830c8 service nova] Lock "f5ad764c-638d-4dac-b032-6680917e46df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:32:15 user nova-compute[74683]: DEBUG nova.compute.manager [req-2ade6a66-8cae-4e6e-b56c-f160ed84f96b req-828e1ecf-dae2-49f0-ae09-c3640e3830c8 service nova] [instance: f5ad764c-638d-4dac-b032-6680917e46df] No waiting events found dispatching network-vif-plugged-eb80f49f-da30-478a-900a-5d3da8ec7fa9 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:32:15 user nova-compute[74683]: WARNING nova.compute.manager [req-2ade6a66-8cae-4e6e-b56c-f160ed84f96b req-828e1ecf-dae2-49f0-ae09-c3640e3830c8 service nova] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Received unexpected event network-vif-plugged-eb80f49f-da30-478a-900a-5d3da8ec7fa9 for instance with vm_state building and task_state spawning.
Oct 16 11:32:15 user nova-compute[74683]: DEBUG nova.compute.manager [req-2ade6a66-8cae-4e6e-b56c-f160ed84f96b req-828e1ecf-dae2-49f0-ae09-c3640e3830c8 service nova] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Received event network-vif-plugged-eb80f49f-da30-478a-900a-5d3da8ec7fa9 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:32:15 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-2ade6a66-8cae-4e6e-b56c-f160ed84f96b req-828e1ecf-dae2-49f0-ae09-c3640e3830c8 service nova] Acquiring lock "f5ad764c-638d-4dac-b032-6680917e46df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:32:15 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-2ade6a66-8cae-4e6e-b56c-f160ed84f96b req-828e1ecf-dae2-49f0-ae09-c3640e3830c8 service nova] Lock "f5ad764c-638d-4dac-b032-6680917e46df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:32:15 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-2ade6a66-8cae-4e6e-b56c-f160ed84f96b req-828e1ecf-dae2-49f0-ae09-c3640e3830c8 service nova] Lock "f5ad764c-638d-4dac-b032-6680917e46df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:32:15 user nova-compute[74683]: DEBUG nova.compute.manager [req-2ade6a66-8cae-4e6e-b56c-f160ed84f96b req-828e1ecf-dae2-49f0-ae09-c3640e3830c8 service nova] [instance: f5ad764c-638d-4dac-b032-6680917e46df] No waiting events found dispatching network-vif-plugged-eb80f49f-da30-478a-900a-5d3da8ec7fa9 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:32:15 user nova-compute[74683]: WARNING nova.compute.manager [req-2ade6a66-8cae-4e6e-b56c-f160ed84f96b req-828e1ecf-dae2-49f0-ae09-c3640e3830c8 service nova] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Received unexpected event network-vif-plugged-eb80f49f-da30-478a-900a-5d3da8ec7fa9 for instance with vm_state building and task_state spawning.
Oct 16 11:32:16 user nova-compute[74683]: DEBUG nova.compute.manager [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Instance event wait completed in 0 seconds for  {{(pid=74683) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 11:32:16 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Guest created on hypervisor {{(pid=74683) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 11:32:16 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Instance spawned successfully.
Oct 16 11:32:16 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 11:32:16 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Found default for hw_cdrom_bus of ide {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:32:16 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Found default for hw_disk_bus of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:32:16 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Found default for hw_input_bus of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:32:16 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Found default for hw_pointer_model of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:32:16 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Found default for hw_video_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:32:16 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Found default for hw_vif_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:32:16 user nova-compute[74683]: INFO nova.compute.manager [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Took 6.03 seconds to spawn the instance on the hypervisor.
Oct 16 11:32:16 user nova-compute[74683]: DEBUG nova.compute.manager [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:32:16 user nova-compute[74683]: INFO nova.compute.manager [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Took 7.00 seconds to build instance.
Oct 16 11:32:16 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-af45229a-18cb-435d-aca7-73f8430c245e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "f5ad764c-638d-4dac-b032-6680917e46df" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.147s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:32:16 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:32:16 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Starting heal instance info cache {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 11:32:16 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "refresh_cache-b91af786-36e3-4815-811f-fb3c055e758d" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:32:16 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquired lock "refresh_cache-b91af786-36e3-4815-811f-fb3c055e758d" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:32:16 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Forcefully refreshing network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 11:32:16 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:17 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Updating instance_info_cache with network_info: [{"id": "abc9cf45-e4f5-4a33-9ffc-dab110e73398", "address": "fa:16:3e:03:03:02", "network": {"id": "fa128ba8-cd2f-4621-ac04-ecc21569bb68", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321708612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66a49078f1240bd88207e487dd4951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc9cf45-e4", "ovs_interfaceid": "abc9cf45-e4f5-4a33-9ffc-dab110e73398", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:32:17 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Releasing lock "refresh_cache-b91af786-36e3-4815-811f-fb3c055e758d" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:32:17 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Updated the network info_cache for instance {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 11:32:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:17 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:32:17 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:32:17 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:32:19 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:32:20 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:32:20 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:32:20 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74683) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 11:32:21 user nova-compute[74683]: DEBUG nova.compute.manager [req-ba5dd342-00d0-47a2-8f64-9417205ad80d req-61c8f3e9-98bc-4094-9d1c-aa612a96eba2 service nova] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Received event network-changed-a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:32:21 user nova-compute[74683]: DEBUG nova.compute.manager [req-ba5dd342-00d0-47a2-8f64-9417205ad80d req-61c8f3e9-98bc-4094-9d1c-aa612a96eba2 service nova] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Refreshing instance network info cache due to event network-changed-a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:32:21 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-ba5dd342-00d0-47a2-8f64-9417205ad80d req-61c8f3e9-98bc-4094-9d1c-aa612a96eba2 service nova] Acquiring lock "refresh_cache-9ece51b6-5cb3-4d79-acdb-ea4d895cdce8" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:32:21 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-ba5dd342-00d0-47a2-8f64-9417205ad80d req-61c8f3e9-98bc-4094-9d1c-aa612a96eba2 service nova] Acquired lock "refresh_cache-9ece51b6-5cb3-4d79-acdb-ea4d895cdce8" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:32:21 user nova-compute[74683]: DEBUG nova.network.neutron [req-ba5dd342-00d0-47a2-8f64-9417205ad80d req-61c8f3e9-98bc-4094-9d1c-aa612a96eba2 service nova] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Refreshing network info cache for port a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:32:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-bd34d552-bf1d-4177-a3d6-01fb2e7e943c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Acquiring lock "9ece51b6-5cb3-4d79-acdb-ea4d895cdce8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:32:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-bd34d552-bf1d-4177-a3d6-01fb2e7e943c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "9ece51b6-5cb3-4d79-acdb-ea4d895cdce8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:32:22 user nova-compute[74683]: DEBUG nova.objects.instance [None req-bd34d552-bf1d-4177-a3d6-01fb2e7e943c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lazy-loading 'flavor' on Instance uuid 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:32:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-bd34d552-bf1d-4177-a3d6-01fb2e7e943c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "9ece51b6-5cb3-4d79-acdb-ea4d895cdce8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.272s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:32:22 user nova-compute[74683]: DEBUG nova.network.neutron [req-ba5dd342-00d0-47a2-8f64-9417205ad80d req-61c8f3e9-98bc-4094-9d1c-aa612a96eba2 service nova] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Updated VIF entry in instance network info cache for port a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:32:22 user nova-compute[74683]: DEBUG nova.network.neutron [req-ba5dd342-00d0-47a2-8f64-9417205ad80d req-61c8f3e9-98bc-4094-9d1c-aa612a96eba2 service nova] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Updating instance_info_cache with network_info: [{"id": "a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6", "address": "fa:16:3e:cf:8d:8b", "network": {"id": "fa128ba8-cd2f-4621-ac04-ecc21569bb68", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321708612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66a49078f1240bd88207e487dd4951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7bd5f8b-2b", "ovs_interfaceid": "a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:32:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-ba5dd342-00d0-47a2-8f64-9417205ad80d req-61c8f3e9-98bc-4094-9d1c-aa612a96eba2 service nova] Releasing lock "refresh_cache-9ece51b6-5cb3-4d79-acdb-ea4d895cdce8" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:32:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-bd34d552-bf1d-4177-a3d6-01fb2e7e943c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Acquiring lock "9ece51b6-5cb3-4d79-acdb-ea4d895cdce8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:32:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-bd34d552-bf1d-4177-a3d6-01fb2e7e943c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "9ece51b6-5cb3-4d79-acdb-ea4d895cdce8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:32:22 user nova-compute[74683]: INFO nova.compute.manager [None req-bd34d552-bf1d-4177-a3d6-01fb2e7e943c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Attaching volume 6d40c601-cae7-44b2-b5a1-10ddadfb2b2b to /dev/vdb
Oct 16 11:32:22 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:32:22 user nova-compute[74683]: DEBUG os_brick.utils [None req-bd34d552-bf1d-4177-a3d6-01fb2e7e943c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:32:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:32:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:32:22 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cee1f5c-c243-46f5-94e3-02235dfdd97a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:70b9d336ab7d\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:32:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:32:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:32:22 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f97e2b-c780-47c8-8264-fd83c35380f5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:32:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:32:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:32:22 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5655383-a8c1-4be0-9950-aa0ba4366add]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:32:22 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[c492a5de-fd65-4e50-886f-b9e793ad7d4b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:32:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-bd34d552-bf1d-4177-a3d6-01fb2e7e943c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Running cmd (subprocess): nvme version {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:32:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-bd34d552-bf1d-4177-a3d6-01fb2e7e943c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] 'nvme version' failed. Not Retrying. {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:32:22 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bd34d552-bf1d-4177-a3d6-01fb2e7e943c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] nvme not present on system {{(pid=74683) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 11:32:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:32:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:32:22 user nova-compute[74683]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 11:32:22 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e82b45-e430-465f-b3d4-098e244e6b95]: (4, '') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:32:22 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-bd34d552-bf1d-4177-a3d6-01fb2e7e943c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74683) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 11:32:22 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-bd34d552-bf1d-4177-a3d6-01fb2e7e943c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 11:32:22 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-bd34d552-bf1d-4177-a3d6-01fb2e7e943c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] LIGHTOS: no hostnqn found. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 11:32:22 user nova-compute[74683]: DEBUG os_brick.utils [None req-bd34d552-bf1d-4177-a3d6-01fb2e7e943c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:70b9d336ab7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:32:22 user nova-compute[74683]: DEBUG nova.virt.block_device [None req-bd34d552-bf1d-4177-a3d6-01fb2e7e943c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Updating existing volume attachment record: 883d1e4a-fce2-4266-ae05-b61aadb7284f {{(pid=74683) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 11:32:23 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:32:23 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:32:23 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:32:23 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:32:23 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Auditing locally available compute resources for user (node: user) {{(pid=74683) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 11:32:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:32:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:32:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:32:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:32:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb10bb7-d421-40c6-be80-0e10138fc2b0/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:32:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb10bb7-d421-40c6-be80-0e10138fc2b0/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:32:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb10bb7-d421-40c6-be80-0e10138fc2b0/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:32:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb10bb7-d421-40c6-be80-0e10138fc2b0/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:32:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:32:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:32:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:32:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:32:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:32:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:32:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:32:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:32:25 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:32:25 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:32:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ece51b6-5cb3-4d79-acdb-ea4d895cdce8/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:32:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ece51b6-5cb3-4d79-acdb-ea4d895cdce8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:32:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ece51b6-5cb3-4d79-acdb-ea4d895cdce8/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:32:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ece51b6-5cb3-4d79-acdb-ea4d895cdce8/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:32:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.rescue --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:32:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:32:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.rescue --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:32:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:32:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:32:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:32:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:32:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:32:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:32:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:32:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:32:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:32:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:27 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:32:27 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:32:27 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Hypervisor/Node resource view: name=user free_ram=7709MB free_disk=25.12909698486328GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74683) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 11:32:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:32:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:32:27 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 18a77385-fab9-4ea0-8aa6-666cf7e798a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:32:27 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance edd01413-1f8a-49e3-aa3c-ecb19c62afae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:32:27 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 9b8ba94f-43cc-4f06-bcd9-83935ccbe117 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:32:27 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance b91af786-36e3-4815-811f-fb3c055e758d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:32:27 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:32:27 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 2fb10bb7-d421-40c6-be80-0e10138fc2b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:32:27 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 45c24874-99be-41fc-a85f-27ea8ddcfc29 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:32:27 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 43d35d0e-acc5-4076-8641-73b4704f1028 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:32:27 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance f5ad764c-638d-4dac-b032-6680917e46df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:32:27 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 11:32:27 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 11:32:28 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:32:28 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:32:28 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Compute_service record updated for user:user {{(pid=74683) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 11:32:28 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.499s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:32:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-4eaf2763-7f9b-4fec-9ab9-3bd83236bfb7 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Acquiring lock "2fb10bb7-d421-40c6-be80-0e10138fc2b0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:32:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-4eaf2763-7f9b-4fec-9ab9-3bd83236bfb7 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Lock "2fb10bb7-d421-40c6-be80-0e10138fc2b0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:32:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-4eaf2763-7f9b-4fec-9ab9-3bd83236bfb7 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Acquiring lock "2fb10bb7-d421-40c6-be80-0e10138fc2b0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:32:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-4eaf2763-7f9b-4fec-9ab9-3bd83236bfb7 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Lock "2fb10bb7-d421-40c6-be80-0e10138fc2b0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:32:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-4eaf2763-7f9b-4fec-9ab9-3bd83236bfb7 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Lock "2fb10bb7-d421-40c6-be80-0e10138fc2b0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:32:39 user nova-compute[74683]: INFO nova.compute.manager [None req-4eaf2763-7f9b-4fec-9ab9-3bd83236bfb7 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 2fb10bb7-d421-40c6-be80-0e10138fc2b0] Terminating instance
Oct 16 11:32:39 user nova-compute[74683]: DEBUG nova.compute.manager [None req-4eaf2763-7f9b-4fec-9ab9-3bd83236bfb7 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 2fb10bb7-d421-40c6-be80-0e10138fc2b0] Start destroying the instance on the hypervisor. {{(pid=74683) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 11:32:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:39 user nova-compute[74683]: DEBUG nova.compute.manager [req-dbcedab2-1877-4123-933e-623acf4c08a5 req-0a467d0b-e51c-46ba-beba-30d2de929a7c service nova] [instance: 2fb10bb7-d421-40c6-be80-0e10138fc2b0] Received event network-vif-unplugged-36797039-dc96-40f6-b535-8e179243e791 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:32:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-dbcedab2-1877-4123-933e-623acf4c08a5 req-0a467d0b-e51c-46ba-beba-30d2de929a7c service nova] Acquiring lock "2fb10bb7-d421-40c6-be80-0e10138fc2b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:32:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-dbcedab2-1877-4123-933e-623acf4c08a5 req-0a467d0b-e51c-46ba-beba-30d2de929a7c service nova] Lock "2fb10bb7-d421-40c6-be80-0e10138fc2b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:32:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-dbcedab2-1877-4123-933e-623acf4c08a5 req-0a467d0b-e51c-46ba-beba-30d2de929a7c service nova] Lock "2fb10bb7-d421-40c6-be80-0e10138fc2b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:32:39 user nova-compute[74683]: DEBUG nova.compute.manager [req-dbcedab2-1877-4123-933e-623acf4c08a5 req-0a467d0b-e51c-46ba-beba-30d2de929a7c service nova] [instance: 2fb10bb7-d421-40c6-be80-0e10138fc2b0] No waiting events found dispatching network-vif-unplugged-36797039-dc96-40f6-b535-8e179243e791 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:32:39 user nova-compute[74683]: DEBUG nova.compute.manager [req-dbcedab2-1877-4123-933e-623acf4c08a5 req-0a467d0b-e51c-46ba-beba-30d2de929a7c service nova] [instance: 2fb10bb7-d421-40c6-be80-0e10138fc2b0] Received event network-vif-unplugged-36797039-dc96-40f6-b535-8e179243e791 for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 11:32:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:39 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 2fb10bb7-d421-40c6-be80-0e10138fc2b0] Instance destroyed successfully.
Oct 16 11:32:39 user nova-compute[74683]: DEBUG nova.objects.instance [None req-4eaf2763-7f9b-4fec-9ab9-3bd83236bfb7 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Lazy-loading 'resources' on Instance uuid 2fb10bb7-d421-40c6-be80-0e10138fc2b0 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:32:39 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-4eaf2763-7f9b-4fec-9ab9-3bd83236bfb7 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:30:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-374649395',display_name='tempest-VolumesActionsTest-instance-374649395',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-374649395',id=34,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:30:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c02c8882c3f4a2eac7d1f320c06899b',ramdisk_id='',reservation_id='r-bxsodejc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1922089110',owner_user_name='tempest-VolumesActionsTest-1922089110-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:30:55Z,user_data=None,user_id='2cb90c639a424b3ba9b7513aa6624334',uuid=2fb10bb7-d421-40c6-be80-0e10138fc2b0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "36797039-dc96-40f6-b535-8e179243e791", "address": "fa:16:3e:fd:71:e7", "network": {"id": "d2fbadd4-fd6d-4bbc-96eb-042f4fce1c04", "bridge": "br-int", "label": "tempest-VolumesActionsTest-888145232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c02c8882c3f4a2eac7d1f320c06899b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36797039-dc", "ovs_interfaceid": "36797039-dc96-40f6-b535-8e179243e791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:32:39 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-4eaf2763-7f9b-4fec-9ab9-3bd83236bfb7 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Converting VIF {"id": "36797039-dc96-40f6-b535-8e179243e791", "address": "fa:16:3e:fd:71:e7", "network": {"id": "d2fbadd4-fd6d-4bbc-96eb-042f4fce1c04", "bridge": "br-int", "label": "tempest-VolumesActionsTest-888145232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c02c8882c3f4a2eac7d1f320c06899b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36797039-dc", "ovs_interfaceid": "36797039-dc96-40f6-b535-8e179243e791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:32:39 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-4eaf2763-7f9b-4fec-9ab9-3bd83236bfb7 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:71:e7,bridge_name='br-int',has_traffic_filtering=True,id=36797039-dc96-40f6-b535-8e179243e791,network=Network(d2fbadd4-fd6d-4bbc-96eb-042f4fce1c04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36797039-dc') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:32:39 user nova-compute[74683]: DEBUG os_vif [None req-4eaf2763-7f9b-4fec-9ab9-3bd83236bfb7 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:71:e7,bridge_name='br-int',has_traffic_filtering=True,id=36797039-dc96-40f6-b535-8e179243e791,network=Network(d2fbadd4-fd6d-4bbc-96eb-042f4fce1c04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36797039-dc') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:32:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap36797039-dc, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:32:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=abb96d8f-1410-4619-a16b-a8cd2ac6b378) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:32:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:39 user nova-compute[74683]: INFO os_vif [None req-4eaf2763-7f9b-4fec-9ab9-3bd83236bfb7 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:71:e7,bridge_name='br-int',has_traffic_filtering=True,id=36797039-dc96-40f6-b535-8e179243e791,network=Network(d2fbadd4-fd6d-4bbc-96eb-042f4fce1c04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36797039-dc')
Oct 16 11:32:39 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-4eaf2763-7f9b-4fec-9ab9-3bd83236bfb7 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 2fb10bb7-d421-40c6-be80-0e10138fc2b0] Deleting instance files /opt/stack/data/nova/instances/2fb10bb7-d421-40c6-be80-0e10138fc2b0_del
Oct 16 11:32:39 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-4eaf2763-7f9b-4fec-9ab9-3bd83236bfb7 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 2fb10bb7-d421-40c6-be80-0e10138fc2b0] Deletion of /opt/stack/data/nova/instances/2fb10bb7-d421-40c6-be80-0e10138fc2b0_del complete
Oct 16 11:32:39 user nova-compute[74683]: INFO nova.compute.manager [None req-4eaf2763-7f9b-4fec-9ab9-3bd83236bfb7 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 2fb10bb7-d421-40c6-be80-0e10138fc2b0] Took 0.89 seconds to destroy the instance on the hypervisor.
Oct 16 11:32:39 user nova-compute[74683]: DEBUG oslo.service.loopingcall [None req-4eaf2763-7f9b-4fec-9ab9-3bd83236bfb7 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74683) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 11:32:39 user nova-compute[74683]: DEBUG nova.compute.manager [-] [instance: 2fb10bb7-d421-40c6-be80-0e10138fc2b0] Deallocating network for instance {{(pid=74683) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 11:32:39 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: 2fb10bb7-d421-40c6-be80-0e10138fc2b0] deallocate_for_instance() {{(pid=74683) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 11:32:40 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:40 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: 2fb10bb7-d421-40c6-be80-0e10138fc2b0] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:32:40 user nova-compute[74683]: INFO nova.compute.manager [-] [instance: 2fb10bb7-d421-40c6-be80-0e10138fc2b0] Took 0.59 seconds to deallocate network for instance.
Oct 16 11:32:40 user nova-compute[74683]: DEBUG nova.compute.manager [req-6ef90319-fa01-4922-bd1a-c56de36b4aba req-e670be40-01c6-42fa-8d93-cfa9516a5dd5 service nova] [instance: 2fb10bb7-d421-40c6-be80-0e10138fc2b0] Received event network-vif-deleted-36797039-dc96-40f6-b535-8e179243e791 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:32:40 user nova-compute[74683]: INFO nova.compute.manager [req-6ef90319-fa01-4922-bd1a-c56de36b4aba req-e670be40-01c6-42fa-8d93-cfa9516a5dd5 service nova] [instance: 2fb10bb7-d421-40c6-be80-0e10138fc2b0] Neutron deleted interface 36797039-dc96-40f6-b535-8e179243e791; detaching it from the instance and deleting it from the info cache
Oct 16 11:32:40 user nova-compute[74683]: DEBUG nova.network.neutron [req-6ef90319-fa01-4922-bd1a-c56de36b4aba req-e670be40-01c6-42fa-8d93-cfa9516a5dd5 service nova] [instance: 2fb10bb7-d421-40c6-be80-0e10138fc2b0] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:32:40 user nova-compute[74683]: DEBUG nova.compute.manager [req-6ef90319-fa01-4922-bd1a-c56de36b4aba req-e670be40-01c6-42fa-8d93-cfa9516a5dd5 service nova] [instance: 2fb10bb7-d421-40c6-be80-0e10138fc2b0] Detach interface failed, port_id=36797039-dc96-40f6-b535-8e179243e791, reason: Instance 2fb10bb7-d421-40c6-be80-0e10138fc2b0 could not be found. {{(pid=74683) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 16 11:32:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-4eaf2763-7f9b-4fec-9ab9-3bd83236bfb7 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:32:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-4eaf2763-7f9b-4fec-9ab9-3bd83236bfb7 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:32:40 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-4eaf2763-7f9b-4fec-9ab9-3bd83236bfb7 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:32:40 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-4eaf2763-7f9b-4fec-9ab9-3bd83236bfb7 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:32:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-4eaf2763-7f9b-4fec-9ab9-3bd83236bfb7 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.313s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:32:40 user nova-compute[74683]: INFO nova.scheduler.client.report [None req-4eaf2763-7f9b-4fec-9ab9-3bd83236bfb7 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Deleted allocations for instance 2fb10bb7-d421-40c6-be80-0e10138fc2b0
Oct 16 11:32:40 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd34d552-bf1d-4177-a3d6-01fb2e7e943c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Calling os-brick to attach iSCSI Volume {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 11:32:40 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd34d552-bf1d-4177-a3d6-01fb2e7e943c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sABuomcZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:32:40 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-bd34d552-bf1d-4177-a3d6-01fb2e7e943c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:32:40 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-bd34d552-bf1d-4177-a3d6-01fb2e7e943c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:32:40 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-bd34d552-bf1d-4177-a3d6-01fb2e7e943c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:32:40 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-bd34d552-bf1d-4177-a3d6-01fb2e7e943c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:32:40 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-bd34d552-bf1d-4177-a3d6-01fb2e7e943c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:32:40 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-bd34d552-bf1d-4177-a3d6-01fb2e7e943c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:32:40 user nova-compute[74683]: INFO os_brick.initiator.connectors.iscsi [None req-bd34d552-bf1d-4177-a3d6-01fb2e7e943c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 11:32:40 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b -p 172.16.0.220:3260 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:32:40 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:32:40 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6512996-4926-4466-8f51-c0a2cb7b0e6d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:32:40 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd34d552-bf1d-4177-a3d6-01fb2e7e943c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 11:32:40 user nova-compute[74683]:  {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:32:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b -p 172.16.0.220:3260 --interface default --op new {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:32:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-4eaf2763-7f9b-4fec-9ab9-3bd83236bfb7 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Lock "2fb10bb7-d421-40c6-be80-0e10138fc2b0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.988s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:32:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:32:41 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b174543-8992-4cd9-ae83-83399b722ec3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b] added\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:32:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd34d552-bf1d-4177-a3d6-01fb2e7e943c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b] added
Oct 16 11:32:41 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:32:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:32:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:32:41 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4db911-96f6-4bc0-8979-35436a73ee1b]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:32:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd34d552-bf1d-4177-a3d6-01fb2e7e943c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:32:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:32:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:32:41 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[4888b1a6-9b31-4462-8601-2ca0c03077b1]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:32:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd34d552-bf1d-4177-a3d6-01fb2e7e943c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:32:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sABuomcZ {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:32:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sABuomcZ" returned: 0 in 0.023s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:32:41 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e5c61a-94cc-4352-8a3e-95bf1d060f75]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:32:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd34d552-bf1d-4177-a3d6-01fb2e7e943c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sABuomcZ'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:32:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:32:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:32:41 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[de573302-dfd8-46bd-9fbc-93af86b59a77]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:32:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd34d552-bf1d-4177-a3d6-01fb2e7e943c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:32:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:32:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:32:41 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f0f952-0fec-49c9-b299-9efb9e4080e0]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:32:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd34d552-bf1d-4177-a3d6-01fb2e7e943c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)
Oct 16 11:32:41 user nova-compute[74683]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)
Oct 16 11:32:41 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:32:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd34d552-bf1d-4177-a3d6-01fb2e7e943c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)
Oct 16 11:32:41 user nova-compute[74683]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)
Oct 16 11:32:41 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:32:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b -p 172.16.0.220:3260 --login {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:32:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:32:41 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd99118d-9d22-4f8b-b7aa-736a16c792e8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:32:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd34d552-bf1d-4177-a3d6-01fb2e7e943c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b, portal: 172.16.0.220,3260]
Oct 16 11:32:41 user nova-compute[74683]: Login to [iface: default, target: iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b, portal: 172.16.0.220,3260] successful.
Oct 16 11:32:41 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:32:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:32:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:32:41 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c843f96-c7e6-4f4e-aeb0-2ec6482fc9f6]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:32:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd34d552-bf1d-4177-a3d6-01fb2e7e943c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:32:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:32:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:32:41 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa1a9f5-93ad-4561-983b-1d907913ade1]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:32:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd34d552-bf1d-4177-a3d6-01fb2e7e943c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)
Oct 16 11:32:41 user nova-compute[74683]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)
Oct 16 11:32:41 user nova-compute[74683]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b (non-flash)
Oct 16 11:32:41 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:32:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd34d552-bf1d-4177-a3d6-01fb2e7e943c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)
Oct 16 11:32:41 user nova-compute[74683]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)
Oct 16 11:32:41 user nova-compute[74683]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b (non-flash)
Oct 16 11:32:41 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:32:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-bd34d552-bf1d-4177-a3d6-01fb2e7e943c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:32:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd34d552-bf1d-4177-a3d6-01fb2e7e943c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Connected to 172.16.0.220:3260 {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 11:32:41 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-bd34d552-bf1d-4177-a3d6-01fb2e7e943c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] HCTL ('35', '-', '-', 0) found on session 38 with lun 0 {{(pid=74683) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 11:32:41 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-bd34d552-bf1d-4177-a3d6-01fb2e7e943c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74683) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 11:32:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:32:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.083s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:32:41 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bdf8de3-2874-446b-9b0a-0231e1e2ffc4]: (4, ('- - 0', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:32:41 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-bd34d552-bf1d-4177-a3d6-01fb2e7e943c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:32:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd34d552-bf1d-4177-a3d6-01fb2e7e943c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sABuomcZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 11:32:41 user nova-compute[74683]: DEBUG nova.compute.manager [req-0fbe03fc-5efb-4545-934d-56aeca56ae6e req-fd60edc7-61ae-4551-9df4-5e58af6bc6d7 service nova] [instance: 2fb10bb7-d421-40c6-be80-0e10138fc2b0] Received event network-vif-plugged-36797039-dc96-40f6-b535-8e179243e791 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:32:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-0fbe03fc-5efb-4545-934d-56aeca56ae6e req-fd60edc7-61ae-4551-9df4-5e58af6bc6d7 service nova] Acquiring lock "2fb10bb7-d421-40c6-be80-0e10138fc2b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:32:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-0fbe03fc-5efb-4545-934d-56aeca56ae6e req-fd60edc7-61ae-4551-9df4-5e58af6bc6d7 service nova] Lock "2fb10bb7-d421-40c6-be80-0e10138fc2b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:32:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-0fbe03fc-5efb-4545-934d-56aeca56ae6e req-fd60edc7-61ae-4551-9df4-5e58af6bc6d7 service nova] Lock "2fb10bb7-d421-40c6-be80-0e10138fc2b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:32:41 user nova-compute[74683]: DEBUG nova.compute.manager [req-0fbe03fc-5efb-4545-934d-56aeca56ae6e req-fd60edc7-61ae-4551-9df4-5e58af6bc6d7 service nova] [instance: 2fb10bb7-d421-40c6-be80-0e10138fc2b0] No waiting events found dispatching network-vif-plugged-36797039-dc96-40f6-b535-8e179243e791 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:32:41 user nova-compute[74683]: WARNING nova.compute.manager [req-0fbe03fc-5efb-4545-934d-56aeca56ae6e req-fd60edc7-61ae-4551-9df4-5e58af6bc6d7 service nova] [instance: 2fb10bb7-d421-40c6-be80-0e10138fc2b0] Received unexpected event network-vif-plugged-36797039-dc96-40f6-b535-8e179243e791 for instance with vm_state deleted and task_state None.
Oct 16 11:32:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:42 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-bd34d552-bf1d-4177-a3d6-01fb2e7e943c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.391s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:32:42 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd34d552-bf1d-4177-a3d6-01fb2e7e943c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] <== connect_volume: return (1393ms) {'type': 'block', 'scsi_wwn': '26634323766626536', 'path': '/dev/sdd'} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:32:42 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd34d552-bf1d-4177-a3d6-01fb2e7e943c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634323766626536', 'path': '/dev/sdd'} {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 11:32:42 user nova-compute[74683]: DEBUG nova.objects.instance [None req-bd34d552-bf1d-4177-a3d6-01fb2e7e943c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lazy-loading 'flavor' on Instance uuid 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:32:42 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-bd34d552-bf1d-4177-a3d6-01fb2e7e943c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 11:32:42 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:32:42 user nova-compute[74683]:   <source dev="/dev/sdd"/>
Oct 16 11:32:42 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:32:42 user nova-compute[74683]:   <serial>6d40c601-cae7-44b2-b5a1-10ddadfb2b2b</serial>
Oct 16 11:32:42 user nova-compute[74683]: </disk>
Oct 16 11:32:42 user nova-compute[74683]:  {{(pid=74683) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 11:32:42 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-bd34d552-bf1d-4177-a3d6-01fb2e7e943c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:32:42 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-bd34d552-bf1d-4177-a3d6-01fb2e7e943c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:32:42 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-bd34d552-bf1d-4177-a3d6-01fb2e7e943c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] No VIF found with MAC fa:16:3e:cf:8d:8b, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:32:42 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-bd34d552-bf1d-4177-a3d6-01fb2e7e943c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "9ece51b6-5cb3-4d79-acdb-ea4d895cdce8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.324s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:32:43 user nova-compute[74683]: INFO nova.compute.manager [None req-71f9facd-f44f-4993-95f5-f004ba3de004 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Rescuing
Oct 16 11:32:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-71f9facd-f44f-4993-95f5-f004ba3de004 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Acquiring lock "refresh_cache-9ece51b6-5cb3-4d79-acdb-ea4d895cdce8" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:32:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-71f9facd-f44f-4993-95f5-f004ba3de004 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Acquired lock "refresh_cache-9ece51b6-5cb3-4d79-acdb-ea4d895cdce8" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:32:43 user nova-compute[74683]: DEBUG nova.network.neutron [None req-71f9facd-f44f-4993-95f5-f004ba3de004 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:32:44 user nova-compute[74683]: DEBUG nova.network.neutron [None req-71f9facd-f44f-4993-95f5-f004ba3de004 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Updating instance_info_cache with network_info: [{"id": "a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6", "address": "fa:16:3e:cf:8d:8b", "network": {"id": "fa128ba8-cd2f-4621-ac04-ecc21569bb68", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321708612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66a49078f1240bd88207e487dd4951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7bd5f8b-2b", "ovs_interfaceid": "a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:32:44 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-71f9facd-f44f-4993-95f5-f004ba3de004 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Releasing lock "refresh_cache-9ece51b6-5cb3-4d79-acdb-ea4d895cdce8" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:32:44 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:44 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:44 user nova-compute[74683]: DEBUG nova.compute.manager [req-9a87a3bf-0ea4-441e-841c-416b588accad req-094c31ce-1026-4aaf-b0ec-9c56ea9f6744 service nova] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Received event network-vif-unplugged-a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:32:44 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-9a87a3bf-0ea4-441e-841c-416b588accad req-094c31ce-1026-4aaf-b0ec-9c56ea9f6744 service nova] Acquiring lock "9ece51b6-5cb3-4d79-acdb-ea4d895cdce8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:32:44 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-9a87a3bf-0ea4-441e-841c-416b588accad req-094c31ce-1026-4aaf-b0ec-9c56ea9f6744 service nova] Lock "9ece51b6-5cb3-4d79-acdb-ea4d895cdce8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:32:44 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-9a87a3bf-0ea4-441e-841c-416b588accad req-094c31ce-1026-4aaf-b0ec-9c56ea9f6744 service nova] Lock "9ece51b6-5cb3-4d79-acdb-ea4d895cdce8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:32:44 user nova-compute[74683]: DEBUG nova.compute.manager [req-9a87a3bf-0ea4-441e-841c-416b588accad req-094c31ce-1026-4aaf-b0ec-9c56ea9f6744 service nova] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] No waiting events found dispatching network-vif-unplugged-a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:32:44 user nova-compute[74683]: WARNING nova.compute.manager [req-9a87a3bf-0ea4-441e-841c-416b588accad req-094c31ce-1026-4aaf-b0ec-9c56ea9f6744 service nova] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Received unexpected event network-vif-unplugged-a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6 for instance with vm_state active and task_state rescuing.
Oct 16 11:32:44 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:44 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:44 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:45 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Instance destroyed successfully.
Oct 16 11:32:45 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-71f9facd-f44f-4993-95f5-f004ba3de004 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Attempting rescue
Oct 16 11:32:45 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-71f9facd-f44f-4993-95f5-f004ba3de004 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74683) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 16 11:32:45 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-71f9facd-f44f-4993-95f5-f004ba3de004 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Instance directory exists: not creating {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 16 11:32:45 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-71f9facd-f44f-4993-95f5-f004ba3de004 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Creating image(s)
Oct 16 11:32:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-71f9facd-f44f-4993-95f5-f004ba3de004 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Acquiring lock "/opt/stack/data/nova/instances/9ece51b6-5cb3-4d79-acdb-ea4d895cdce8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:32:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-71f9facd-f44f-4993-95f5-f004ba3de004 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "/opt/stack/data/nova/instances/9ece51b6-5cb3-4d79-acdb-ea4d895cdce8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:32:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-71f9facd-f44f-4993-95f5-f004ba3de004 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "/opt/stack/data/nova/instances/9ece51b6-5cb3-4d79-acdb-ea4d895cdce8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:32:45 user nova-compute[74683]: DEBUG nova.objects.instance [None req-71f9facd-f44f-4993-95f5-f004ba3de004 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:32:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-71f9facd-f44f-4993-95f5-f004ba3de004 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Acquiring lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:32:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-71f9facd-f44f-4993-95f5-f004ba3de004 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:32:45 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-71f9facd-f44f-4993-95f5-f004ba3de004 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:32:45 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-71f9facd-f44f-4993-95f5-f004ba3de004 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.190s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:32:45 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-71f9facd-f44f-4993-95f5-f004ba3de004 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/9ece51b6-5cb3-4d79-acdb-ea4d895cdce8/disk.rescue {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:32:45 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-71f9facd-f44f-4993-95f5-f004ba3de004 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/9ece51b6-5cb3-4d79-acdb-ea4d895cdce8/disk.rescue" returned: 0 in 0.059s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:32:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-71f9facd-f44f-4993-95f5-f004ba3de004 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:32:45 user nova-compute[74683]: DEBUG nova.objects.instance [None req-71f9facd-f44f-4993-95f5-f004ba3de004 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lazy-loading 'migration_context' on Instance uuid 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:32:45 user nova-compute[74683]: DEBUG nova.objects.base [None req-71f9facd-f44f-4993-95f5-f004ba3de004 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Object Instance<9ece51b6-5cb3-4d79-acdb-ea4d895cdce8> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:32:45 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-71f9facd-f44f-4993-95f5-f004ba3de004 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Created local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 11:32:45 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-71f9facd-f44f-4993-95f5-f004ba3de004 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Start _get_guest_xml network_info=[{"id": "a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6", "address": "fa:16:3e:cf:8d:8b", "network": {"id": "fa128ba8-cd2f-4621-ac04-ecc21569bb68", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321708612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1321708612-network", "vif_mac": "fa:16:3e:cf:8d:8b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66a49078f1240bd88207e487dd4951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7bd5f8b-2b", "ovs_interfaceid": "a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:32:45 user nova-compute[74683]: DEBUG nova.objects.instance [None req-71f9facd-f44f-4993-95f5-f004ba3de004 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lazy-loading 'resources' on Instance uuid 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:32:45 user nova-compute[74683]: DEBUG nova.objects.base [None req-71f9facd-f44f-4993-95f5-f004ba3de004 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Object Instance<9ece51b6-5cb3-4d79-acdb-ea4d895cdce8> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:32:45 user nova-compute[74683]: DEBUG nova.objects.instance [None req-71f9facd-f44f-4993-95f5-f004ba3de004 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lazy-loading 'numa_topology' on Instance uuid 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:32:45 user nova-compute[74683]: DEBUG nova.objects.base [None req-71f9facd-f44f-4993-95f5-f004ba3de004 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Object Instance<9ece51b6-5cb3-4d79-acdb-ea4d895cdce8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:32:45 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-71f9facd-f44f-4993-95f5-f004ba3de004 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:32:45 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-71f9facd-f44f-4993-95f5-f004ba3de004 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:32:45 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-71f9facd-f44f-4993-95f5-f004ba3de004 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:32:45 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-71f9facd-f44f-4993-95f5-f004ba3de004 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:32:45 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-71f9facd-f44f-4993-95f5-f004ba3de004 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:32:45 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-71f9facd-f44f-4993-95f5-f004ba3de004 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:32:45 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-71f9facd-f44f-4993-95f5-f004ba3de004 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:32:45 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-71f9facd-f44f-4993-95f5-f004ba3de004 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:32:45 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-71f9facd-f44f-4993-95f5-f004ba3de004 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:32:45 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-71f9facd-f44f-4993-95f5-f004ba3de004 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:32:45 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-71f9facd-f44f-4993-95f5-f004ba3de004 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:32:45 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-71f9facd-f44f-4993-95f5-f004ba3de004 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:32:45 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-71f9facd-f44f-4993-95f5-f004ba3de004 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:32:45 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-71f9facd-f44f-4993-95f5-f004ba3de004 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:32:45 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-71f9facd-f44f-4993-95f5-f004ba3de004 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:32:45 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-71f9facd-f44f-4993-95f5-f004ba3de004 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:32:45 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-71f9facd-f44f-4993-95f5-f004ba3de004 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:32:45 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-71f9facd-f44f-4993-95f5-f004ba3de004 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:32:45 user nova-compute[74683]: DEBUG nova.objects.instance [None req-71f9facd-f44f-4993-95f5-f004ba3de004 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:32:45 user nova-compute[74683]: DEBUG nova.objects.base [None req-71f9facd-f44f-4993-95f5-f004ba3de004 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Object Instance<9ece51b6-5cb3-4d79-acdb-ea4d895cdce8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:32:45 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-71f9facd-f44f-4993-95f5-f004ba3de004 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:30:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-526350141',display_name='tempest-ServerRescueNegativeTestJSON-server-526350141',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-526350141',id=33,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNz1V1kjn+NusY2zgo3ikJiEK0+g7zHYU6qx9jtiB8KZYL8r9TMeQpPPNhfnwBaZYH54zgAqVMOORXAZv/pdJIJRHHUu3H3sIO4N1YDwfFsndK20Q/vGu2bvzF+wspuY3Q==',key_name='tempest-keypair-1176984004',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:30:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e66a49078f1240bd88207e487dd4951e',ramdisk_id='',reservation_id='r-8k60d1p0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1690011355',owner_user_name='tempest-ServerRescueNegativeTestJSON-1690011355-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:30:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3436197c787446d4a03fb7697d7999a1',uuid=9ece51b6-5cb3-4d79-acdb-ea4d895cdce8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6", "address": "fa:16:3e:cf:8d:8b", "network": {"id": "fa128ba8-cd2f-4621-ac04-ecc21569bb68", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321708612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1321708612-network", "vif_mac": "fa:16:3e:cf:8d:8b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66a49078f1240bd88207e487dd4951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7bd5f8b-2b", "ovs_interfaceid": "a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:32:45 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-71f9facd-f44f-4993-95f5-f004ba3de004 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Converting VIF {"id": "a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6", "address": "fa:16:3e:cf:8d:8b", "network": {"id": "fa128ba8-cd2f-4621-ac04-ecc21569bb68", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321708612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1321708612-network", "vif_mac": "fa:16:3e:cf:8d:8b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66a49078f1240bd88207e487dd4951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7bd5f8b-2b", "ovs_interfaceid": "a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:32:45 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-71f9facd-f44f-4993-95f5-f004ba3de004 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cf:8d:8b,bridge_name='br-int',has_traffic_filtering=True,id=a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6,network=Network(fa128ba8-cd2f-4621-ac04-ecc21569bb68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7bd5f8b-2b') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:32:45 user nova-compute[74683]: DEBUG nova.objects.instance [None req-71f9facd-f44f-4993-95f5-f004ba3de004 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:32:45 user nova-compute[74683]: DEBUG nova.objects.base [None req-71f9facd-f44f-4993-95f5-f004ba3de004 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Object Instance<9ece51b6-5cb3-4d79-acdb-ea4d895cdce8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:32:45 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-71f9facd-f44f-4993-95f5-f004ba3de004 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:32:45 user nova-compute[74683]:   <uuid>9ece51b6-5cb3-4d79-acdb-ea4d895cdce8</uuid>
Oct 16 11:32:45 user nova-compute[74683]:   <name>instance-00000021</name>
Oct 16 11:32:45 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:32:45 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:32:45 user nova-compute[74683]:   <metadata>
Oct 16 11:32:45 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:32:45 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:32:45 user nova-compute[74683]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-526350141</nova:name>
Oct 16 11:32:45 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:32:45</nova:creationTime>
Oct 16 11:32:45 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:32:45 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:32:45 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:32:45 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:32:45 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:32:45 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:32:45 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:32:45 user nova-compute[74683]:       <nova:owner>
Oct 16 11:32:45 user nova-compute[74683]:         <nova:user uuid="3436197c787446d4a03fb7697d7999a1">tempest-ServerRescueNegativeTestJSON-1690011355-project-member</nova:user>
Oct 16 11:32:45 user nova-compute[74683]:         <nova:project uuid="e66a49078f1240bd88207e487dd4951e">tempest-ServerRescueNegativeTestJSON-1690011355</nova:project>
Oct 16 11:32:45 user nova-compute[74683]:       </nova:owner>
Oct 16 11:32:45 user nova-compute[74683]:       <nova:root type="image" uuid="0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f"/>
Oct 16 11:32:45 user nova-compute[74683]:       <nova:ports>
Oct 16 11:32:45 user nova-compute[74683]:         <nova:port uuid="a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6">
Oct 16 11:32:45 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 16 11:32:45 user nova-compute[74683]:         </nova:port>
Oct 16 11:32:45 user nova-compute[74683]:       </nova:ports>
Oct 16 11:32:45 user nova-compute[74683]:     </nova:instance>
Oct 16 11:32:45 user nova-compute[74683]:   </metadata>
Oct 16 11:32:45 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:32:45 user nova-compute[74683]:     <system>
Oct 16 11:32:45 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:32:45 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:32:45 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:32:45 user nova-compute[74683]:       <entry name="serial">9ece51b6-5cb3-4d79-acdb-ea4d895cdce8</entry>
Oct 16 11:32:45 user nova-compute[74683]:       <entry name="uuid">9ece51b6-5cb3-4d79-acdb-ea4d895cdce8</entry>
Oct 16 11:32:45 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:32:45 user nova-compute[74683]:     </system>
Oct 16 11:32:45 user nova-compute[74683]:   </sysinfo>
Oct 16 11:32:45 user nova-compute[74683]:   <os>
Oct 16 11:32:45 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:32:45 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:32:45 user nova-compute[74683]:   </os>
Oct 16 11:32:45 user nova-compute[74683]:   <features>
Oct 16 11:32:45 user nova-compute[74683]:     <acpi/>
Oct 16 11:32:45 user nova-compute[74683]:     <apic/>
Oct 16 11:32:45 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:32:45 user nova-compute[74683]:   </features>
Oct 16 11:32:45 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:32:45 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:32:45 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:32:45 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:32:45 user nova-compute[74683]:   </clock>
Oct 16 11:32:45 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:32:45 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:32:45 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:32:45 user nova-compute[74683]:   </cpu>
Oct 16 11:32:45 user nova-compute[74683]:   <devices>
Oct 16 11:32:45 user nova-compute[74683]:     <disk type="file" device="disk">
Oct 16 11:32:45 user nova-compute[74683]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 11:32:45 user nova-compute[74683]:       <source file="/opt/stack/data/nova/instances/9ece51b6-5cb3-4d79-acdb-ea4d895cdce8/disk.rescue"/>
Oct 16 11:32:45 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:32:45 user nova-compute[74683]:     </disk>
Oct 16 11:32:45 user nova-compute[74683]:     <disk type="file" device="disk">
Oct 16 11:32:45 user nova-compute[74683]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 11:32:45 user nova-compute[74683]:       <source file="/opt/stack/data/nova/instances/9ece51b6-5cb3-4d79-acdb-ea4d895cdce8/disk"/>
Oct 16 11:32:45 user nova-compute[74683]:       <target dev="vdb" bus="virtio"/>
Oct 16 11:32:45 user nova-compute[74683]:     </disk>
Oct 16 11:32:45 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:32:45 user nova-compute[74683]:       <mac address="fa:16:3e:cf:8d:8b"/>
Oct 16 11:32:45 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:32:45 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:32:45 user nova-compute[74683]:       <target dev="tapa7bd5f8b-2b"/>
Oct 16 11:32:45 user nova-compute[74683]:     </interface>
Oct 16 11:32:45 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:32:45 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/9ece51b6-5cb3-4d79-acdb-ea4d895cdce8/console.log" append="off"/>
Oct 16 11:32:45 user nova-compute[74683]:     </serial>
Oct 16 11:32:45 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:32:45 user nova-compute[74683]:     <video>
Oct 16 11:32:45 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:32:45 user nova-compute[74683]:     </video>
Oct 16 11:32:45 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:32:45 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:32:45 user nova-compute[74683]:     </rng>
Oct 16 11:32:45 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:32:45 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:32:45 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:32:45 user nova-compute[74683]:     </memballoon>
Oct 16 11:32:45 user nova-compute[74683]:   </devices>
Oct 16 11:32:45 user nova-compute[74683]: </domain>
Oct 16 11:32:45 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:32:45 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Instance destroyed successfully.
Oct 16 11:32:45 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-71f9facd-f44f-4993-95f5-f004ba3de004 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:32:45 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-71f9facd-f44f-4993-95f5-f004ba3de004 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:32:45 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-71f9facd-f44f-4993-95f5-f004ba3de004 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] No VIF found with MAC fa:16:3e:cf:8d:8b, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:32:46 user nova-compute[74683]: DEBUG nova.compute.manager [req-d60e2b73-a5cc-4d39-b218-f704acd2a8df req-a77c8950-4863-4998-80cf-ed8c4b7c2b21 service nova] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Received event network-vif-plugged-a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:32:46 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-d60e2b73-a5cc-4d39-b218-f704acd2a8df req-a77c8950-4863-4998-80cf-ed8c4b7c2b21 service nova] Acquiring lock "9ece51b6-5cb3-4d79-acdb-ea4d895cdce8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:32:46 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-d60e2b73-a5cc-4d39-b218-f704acd2a8df req-a77c8950-4863-4998-80cf-ed8c4b7c2b21 service nova] Lock "9ece51b6-5cb3-4d79-acdb-ea4d895cdce8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:32:46 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-d60e2b73-a5cc-4d39-b218-f704acd2a8df req-a77c8950-4863-4998-80cf-ed8c4b7c2b21 service nova] Lock "9ece51b6-5cb3-4d79-acdb-ea4d895cdce8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:32:46 user nova-compute[74683]: DEBUG nova.compute.manager [req-d60e2b73-a5cc-4d39-b218-f704acd2a8df req-a77c8950-4863-4998-80cf-ed8c4b7c2b21 service nova] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] No waiting events found dispatching network-vif-plugged-a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:32:46 user nova-compute[74683]: WARNING nova.compute.manager [req-d60e2b73-a5cc-4d39-b218-f704acd2a8df req-a77c8950-4863-4998-80cf-ed8c4b7c2b21 service nova] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Received unexpected event network-vif-plugged-a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6 for instance with vm_state active and task_state rescuing.
Oct 16 11:32:46 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:48 user nova-compute[74683]: DEBUG nova.compute.manager [req-22f380eb-2b53-4d86-9b9f-7a76667f6ee2 req-46f54893-2455-4018-bdfb-c29ec856ef38 service nova] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Received event network-vif-plugged-a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:32:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-22f380eb-2b53-4d86-9b9f-7a76667f6ee2 req-46f54893-2455-4018-bdfb-c29ec856ef38 service nova] Acquiring lock "9ece51b6-5cb3-4d79-acdb-ea4d895cdce8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:32:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-22f380eb-2b53-4d86-9b9f-7a76667f6ee2 req-46f54893-2455-4018-bdfb-c29ec856ef38 service nova] Lock "9ece51b6-5cb3-4d79-acdb-ea4d895cdce8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:32:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-22f380eb-2b53-4d86-9b9f-7a76667f6ee2 req-46f54893-2455-4018-bdfb-c29ec856ef38 service nova] Lock "9ece51b6-5cb3-4d79-acdb-ea4d895cdce8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:32:48 user nova-compute[74683]: DEBUG nova.compute.manager [req-22f380eb-2b53-4d86-9b9f-7a76667f6ee2 req-46f54893-2455-4018-bdfb-c29ec856ef38 service nova] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] No waiting events found dispatching network-vif-plugged-a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:32:48 user nova-compute[74683]: WARNING nova.compute.manager [req-22f380eb-2b53-4d86-9b9f-7a76667f6ee2 req-46f54893-2455-4018-bdfb-c29ec856ef38 service nova] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Received unexpected event network-vif-plugged-a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6 for instance with vm_state active and task_state rescuing.
Oct 16 11:32:48 user nova-compute[74683]: DEBUG nova.compute.manager [req-22f380eb-2b53-4d86-9b9f-7a76667f6ee2 req-46f54893-2455-4018-bdfb-c29ec856ef38 service nova] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Received event network-vif-plugged-a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:32:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-22f380eb-2b53-4d86-9b9f-7a76667f6ee2 req-46f54893-2455-4018-bdfb-c29ec856ef38 service nova] Acquiring lock "9ece51b6-5cb3-4d79-acdb-ea4d895cdce8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:32:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-22f380eb-2b53-4d86-9b9f-7a76667f6ee2 req-46f54893-2455-4018-bdfb-c29ec856ef38 service nova] Lock "9ece51b6-5cb3-4d79-acdb-ea4d895cdce8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:32:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-22f380eb-2b53-4d86-9b9f-7a76667f6ee2 req-46f54893-2455-4018-bdfb-c29ec856ef38 service nova] Lock "9ece51b6-5cb3-4d79-acdb-ea4d895cdce8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:32:48 user nova-compute[74683]: DEBUG nova.compute.manager [req-22f380eb-2b53-4d86-9b9f-7a76667f6ee2 req-46f54893-2455-4018-bdfb-c29ec856ef38 service nova] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] No waiting events found dispatching network-vif-plugged-a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:32:48 user nova-compute[74683]: WARNING nova.compute.manager [req-22f380eb-2b53-4d86-9b9f-7a76667f6ee2 req-46f54893-2455-4018-bdfb-c29ec856ef38 service nova] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Received unexpected event network-vif-plugged-a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6 for instance with vm_state active and task_state rescuing.
Oct 16 11:32:49 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-c3ead975-9a95-4375-85b6-9aedea2dfd78 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Acquiring lock "18a77385-fab9-4ea0-8aa6-666cf7e798a6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:32:49 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-c3ead975-9a95-4375-85b6-9aedea2dfd78 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "18a77385-fab9-4ea0-8aa6-666cf7e798a6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:32:49 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-c3ead975-9a95-4375-85b6-9aedea2dfd78 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Acquiring lock "18a77385-fab9-4ea0-8aa6-666cf7e798a6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:32:49 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-c3ead975-9a95-4375-85b6-9aedea2dfd78 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "18a77385-fab9-4ea0-8aa6-666cf7e798a6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:32:49 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-c3ead975-9a95-4375-85b6-9aedea2dfd78 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "18a77385-fab9-4ea0-8aa6-666cf7e798a6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:32:49 user nova-compute[74683]: INFO nova.compute.manager [None req-c3ead975-9a95-4375-85b6-9aedea2dfd78 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Terminating instance
Oct 16 11:32:49 user nova-compute[74683]: DEBUG nova.compute.manager [None req-c3ead975-9a95-4375-85b6-9aedea2dfd78 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Start destroying the instance on the hypervisor. {{(pid=74683) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 11:32:49 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:49 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:49 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:49 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:49 user nova-compute[74683]: DEBUG nova.compute.manager [None req-71f9facd-f44f-4993-95f5-f004ba3de004 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:32:49 user nova-compute[74683]: DEBUG nova.compute.manager [req-a1012ff9-f0bf-4b76-912f-1b18b3b59b44 req-4fe229bb-90be-4792-a5aa-c020b7ee38fb service nova] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Received event network-vif-unplugged-fab663e7-134f-4cde-8cf1-2ccb1c83a812 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:32:49 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a1012ff9-f0bf-4b76-912f-1b18b3b59b44 req-4fe229bb-90be-4792-a5aa-c020b7ee38fb service nova] Acquiring lock "18a77385-fab9-4ea0-8aa6-666cf7e798a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:32:49 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a1012ff9-f0bf-4b76-912f-1b18b3b59b44 req-4fe229bb-90be-4792-a5aa-c020b7ee38fb service nova] Lock "18a77385-fab9-4ea0-8aa6-666cf7e798a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:32:49 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a1012ff9-f0bf-4b76-912f-1b18b3b59b44 req-4fe229bb-90be-4792-a5aa-c020b7ee38fb service nova] Lock "18a77385-fab9-4ea0-8aa6-666cf7e798a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:32:49 user nova-compute[74683]: DEBUG nova.compute.manager [req-a1012ff9-f0bf-4b76-912f-1b18b3b59b44 req-4fe229bb-90be-4792-a5aa-c020b7ee38fb service nova] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] No waiting events found dispatching network-vif-unplugged-fab663e7-134f-4cde-8cf1-2ccb1c83a812 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:32:49 user nova-compute[74683]: DEBUG nova.compute.manager [req-a1012ff9-f0bf-4b76-912f-1b18b3b59b44 req-4fe229bb-90be-4792-a5aa-c020b7ee38fb service nova] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Received event network-vif-unplugged-fab663e7-134f-4cde-8cf1-2ccb1c83a812 for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 11:32:49 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:50 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Instance destroyed successfully.
Oct 16 11:32:50 user nova-compute[74683]: DEBUG nova.objects.instance [None req-c3ead975-9a95-4375-85b6-9aedea2dfd78 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lazy-loading 'resources' on Instance uuid 18a77385-fab9-4ea0-8aa6-666cf7e798a6 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:32:50 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-c3ead975-9a95-4375-85b6-9aedea2dfd78 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:13:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1157992863',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1157992863',id=2,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:13:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d6e0046017b4bba85caf2a39d1c67b3',ramdisk_id='',reservation_id='r-3ht96uco',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1787816377',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:15:06Z,user_data=None,user_id='76a41804541e4a259771702727d9993e',uuid=18a77385-fab9-4ea0-8aa6-666cf7e798a6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fab663e7-134f-4cde-8cf1-2ccb1c83a812", "address": "fa:16:3e:8c:d5:b1", "network": {"id": "4d43cc12-d2cd-4552-90a4-884a0ff3dc66", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-825513246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6e0046017b4bba85caf2a39d1c67b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfab663e7-13", "ovs_interfaceid": "fab663e7-134f-4cde-8cf1-2ccb1c83a812", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:32:50 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-c3ead975-9a95-4375-85b6-9aedea2dfd78 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Converting VIF {"id": "fab663e7-134f-4cde-8cf1-2ccb1c83a812", "address": "fa:16:3e:8c:d5:b1", "network": {"id": "4d43cc12-d2cd-4552-90a4-884a0ff3dc66", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-825513246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d6e0046017b4bba85caf2a39d1c67b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfab663e7-13", "ovs_interfaceid": "fab663e7-134f-4cde-8cf1-2ccb1c83a812", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:32:50 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-c3ead975-9a95-4375-85b6-9aedea2dfd78 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:d5:b1,bridge_name='br-int',has_traffic_filtering=True,id=fab663e7-134f-4cde-8cf1-2ccb1c83a812,network=Network(4d43cc12-d2cd-4552-90a4-884a0ff3dc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfab663e7-13') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:32:50 user nova-compute[74683]: DEBUG os_vif [None req-c3ead975-9a95-4375-85b6-9aedea2dfd78 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:d5:b1,bridge_name='br-int',has_traffic_filtering=True,id=fab663e7-134f-4cde-8cf1-2ccb1c83a812,network=Network(4d43cc12-d2cd-4552-90a4-884a0ff3dc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfab663e7-13') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:32:50 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:50 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfab663e7-13, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:32:50 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:50 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:32:50 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:50 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ea005057-2c13-40e5-9274-01eca46ad78d) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:32:50 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:50 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:32:50 user nova-compute[74683]: INFO os_vif [None req-c3ead975-9a95-4375-85b6-9aedea2dfd78 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:d5:b1,bridge_name='br-int',has_traffic_filtering=True,id=fab663e7-134f-4cde-8cf1-2ccb1c83a812,network=Network(4d43cc12-d2cd-4552-90a4-884a0ff3dc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfab663e7-13')
Oct 16 11:32:50 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-c3ead975-9a95-4375-85b6-9aedea2dfd78 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Deleting instance files /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6_del
Oct 16 11:32:50 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-c3ead975-9a95-4375-85b6-9aedea2dfd78 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Deletion of /opt/stack/data/nova/instances/18a77385-fab9-4ea0-8aa6-666cf7e798a6_del complete
Oct 16 11:32:50 user nova-compute[74683]: INFO nova.compute.manager [None req-c3ead975-9a95-4375-85b6-9aedea2dfd78 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Took 0.95 seconds to destroy the instance on the hypervisor.
Oct 16 11:32:50 user nova-compute[74683]: DEBUG oslo.service.loopingcall [None req-c3ead975-9a95-4375-85b6-9aedea2dfd78 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74683) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 11:32:50 user nova-compute[74683]: DEBUG nova.compute.manager [-] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Deallocating network for instance {{(pid=74683) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 11:32:50 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] deallocate_for_instance() {{(pid=74683) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 11:32:50 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:32:50 user nova-compute[74683]: INFO nova.compute.manager [-] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Took 0.63 seconds to deallocate network for instance.
Oct 16 11:32:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-c3ead975-9a95-4375-85b6-9aedea2dfd78 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:32:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-c3ead975-9a95-4375-85b6-9aedea2dfd78 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:32:50 user nova-compute[74683]: DEBUG nova.compute.manager [req-d7bbce4a-1099-4bbd-a4f2-a71c01d5c1fa req-f24a5fa3-a3dd-46bc-b1a7-b7b33daca00a service nova] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Received event network-vif-deleted-fab663e7-134f-4cde-8cf1-2ccb1c83a812 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:32:51 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-c3ead975-9a95-4375-85b6-9aedea2dfd78 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:32:51 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-c3ead975-9a95-4375-85b6-9aedea2dfd78 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:32:51 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-c3ead975-9a95-4375-85b6-9aedea2dfd78 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.345s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:32:51 user nova-compute[74683]: INFO nova.scheduler.client.report [None req-c3ead975-9a95-4375-85b6-9aedea2dfd78 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Deleted allocations for instance 18a77385-fab9-4ea0-8aa6-666cf7e798a6
Oct 16 11:32:51 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-c3ead975-9a95-4375-85b6-9aedea2dfd78 tempest-ServerBootFromVolumeStableRescueTest-1787816377 tempest-ServerBootFromVolumeStableRescueTest-1787816377-project-member] Lock "18a77385-fab9-4ea0-8aa6-666cf7e798a6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.365s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:32:51 user nova-compute[74683]: DEBUG nova.compute.manager [req-eaa71832-3571-408b-9c99-523a658acba7 req-e28d48f5-435f-454e-b723-4240ac4bdaf6 service nova] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Received event network-vif-plugged-fab663e7-134f-4cde-8cf1-2ccb1c83a812 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:32:51 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-eaa71832-3571-408b-9c99-523a658acba7 req-e28d48f5-435f-454e-b723-4240ac4bdaf6 service nova] Acquiring lock "18a77385-fab9-4ea0-8aa6-666cf7e798a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:32:51 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-eaa71832-3571-408b-9c99-523a658acba7 req-e28d48f5-435f-454e-b723-4240ac4bdaf6 service nova] Lock "18a77385-fab9-4ea0-8aa6-666cf7e798a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:32:51 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-eaa71832-3571-408b-9c99-523a658acba7 req-e28d48f5-435f-454e-b723-4240ac4bdaf6 service nova] Lock "18a77385-fab9-4ea0-8aa6-666cf7e798a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:32:51 user nova-compute[74683]: DEBUG nova.compute.manager [req-eaa71832-3571-408b-9c99-523a658acba7 req-e28d48f5-435f-454e-b723-4240ac4bdaf6 service nova] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] No waiting events found dispatching network-vif-plugged-fab663e7-134f-4cde-8cf1-2ccb1c83a812 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:32:51 user nova-compute[74683]: WARNING nova.compute.manager [req-eaa71832-3571-408b-9c99-523a658acba7 req-e28d48f5-435f-454e-b723-4240ac4bdaf6 service nova] [instance: 18a77385-fab9-4ea0-8aa6-666cf7e798a6] Received unexpected event network-vif-plugged-fab663e7-134f-4cde-8cf1-2ccb1c83a812 for instance with vm_state deleted and task_state None.
Oct 16 11:32:51 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:54 user nova-compute[74683]: DEBUG nova.compute.manager [req-78329744-aad1-4e34-a17d-e96d227c18b5 req-7e16e179-76f0-42fe-b5f8-436529a9571e service nova] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Received event network-changed-5adcf9f7-16fd-477b-87c9-e3329444b7b4 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:32:54 user nova-compute[74683]: DEBUG nova.compute.manager [req-78329744-aad1-4e34-a17d-e96d227c18b5 req-7e16e179-76f0-42fe-b5f8-436529a9571e service nova] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Refreshing instance network info cache due to event network-changed-5adcf9f7-16fd-477b-87c9-e3329444b7b4. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:32:54 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-78329744-aad1-4e34-a17d-e96d227c18b5 req-7e16e179-76f0-42fe-b5f8-436529a9571e service nova] Acquiring lock "refresh_cache-45c24874-99be-41fc-a85f-27ea8ddcfc29" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:32:54 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-78329744-aad1-4e34-a17d-e96d227c18b5 req-7e16e179-76f0-42fe-b5f8-436529a9571e service nova] Acquired lock "refresh_cache-45c24874-99be-41fc-a85f-27ea8ddcfc29" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:32:54 user nova-compute[74683]: DEBUG nova.network.neutron [req-78329744-aad1-4e34-a17d-e96d227c18b5 req-7e16e179-76f0-42fe-b5f8-436529a9571e service nova] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Refreshing network info cache for port 5adcf9f7-16fd-477b-87c9-e3329444b7b4 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:32:55 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:55 user nova-compute[74683]: DEBUG nova.network.neutron [req-78329744-aad1-4e34-a17d-e96d227c18b5 req-7e16e179-76f0-42fe-b5f8-436529a9571e service nova] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Updated VIF entry in instance network info cache for port 5adcf9f7-16fd-477b-87c9-e3329444b7b4. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:32:55 user nova-compute[74683]: DEBUG nova.network.neutron [req-78329744-aad1-4e34-a17d-e96d227c18b5 req-7e16e179-76f0-42fe-b5f8-436529a9571e service nova] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Updating instance_info_cache with network_info: [{"id": "5adcf9f7-16fd-477b-87c9-e3329444b7b4", "address": "fa:16:3e:10:f9:24", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5adcf9f7-16", "ovs_interfaceid": "5adcf9f7-16fd-477b-87c9-e3329444b7b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:32:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-78329744-aad1-4e34-a17d-e96d227c18b5 req-7e16e179-76f0-42fe-b5f8-436529a9571e service nova] Releasing lock "refresh_cache-45c24874-99be-41fc-a85f-27ea8ddcfc29" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:32:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ce346b8e-0fd0-44ef-919d-38ed201a38ac tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquiring lock "45c24874-99be-41fc-a85f-27ea8ddcfc29" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:32:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ce346b8e-0fd0-44ef-919d-38ed201a38ac tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "45c24874-99be-41fc-a85f-27ea8ddcfc29" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:32:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ce346b8e-0fd0-44ef-919d-38ed201a38ac tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquiring lock "45c24874-99be-41fc-a85f-27ea8ddcfc29-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:32:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ce346b8e-0fd0-44ef-919d-38ed201a38ac tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "45c24874-99be-41fc-a85f-27ea8ddcfc29-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:32:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ce346b8e-0fd0-44ef-919d-38ed201a38ac tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "45c24874-99be-41fc-a85f-27ea8ddcfc29-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:32:55 user nova-compute[74683]: INFO nova.compute.manager [None req-ce346b8e-0fd0-44ef-919d-38ed201a38ac tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Terminating instance
Oct 16 11:32:55 user nova-compute[74683]: DEBUG nova.compute.manager [None req-ce346b8e-0fd0-44ef-919d-38ed201a38ac tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Start destroying the instance on the hypervisor. {{(pid=74683) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 11:32:55 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:55 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:55 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:55 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:55 user nova-compute[74683]: DEBUG nova.compute.manager [req-f8092d2b-576a-445f-aa1a-6e1f5d57e98d req-f5479b52-b8d7-4564-a3cc-f75de77e46c8 service nova] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Received event network-vif-unplugged-5adcf9f7-16fd-477b-87c9-e3329444b7b4 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:32:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f8092d2b-576a-445f-aa1a-6e1f5d57e98d req-f5479b52-b8d7-4564-a3cc-f75de77e46c8 service nova] Acquiring lock "45c24874-99be-41fc-a85f-27ea8ddcfc29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:32:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f8092d2b-576a-445f-aa1a-6e1f5d57e98d req-f5479b52-b8d7-4564-a3cc-f75de77e46c8 service nova] Lock "45c24874-99be-41fc-a85f-27ea8ddcfc29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:32:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f8092d2b-576a-445f-aa1a-6e1f5d57e98d req-f5479b52-b8d7-4564-a3cc-f75de77e46c8 service nova] Lock "45c24874-99be-41fc-a85f-27ea8ddcfc29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:32:55 user nova-compute[74683]: DEBUG nova.compute.manager [req-f8092d2b-576a-445f-aa1a-6e1f5d57e98d req-f5479b52-b8d7-4564-a3cc-f75de77e46c8 service nova] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] No waiting events found dispatching network-vif-unplugged-5adcf9f7-16fd-477b-87c9-e3329444b7b4 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:32:55 user nova-compute[74683]: DEBUG nova.compute.manager [req-f8092d2b-576a-445f-aa1a-6e1f5d57e98d req-f5479b52-b8d7-4564-a3cc-f75de77e46c8 service nova] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Received event network-vif-unplugged-5adcf9f7-16fd-477b-87c9-e3329444b7b4 for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 11:32:56 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Instance destroyed successfully.
Oct 16 11:32:56 user nova-compute[74683]: DEBUG nova.objects.instance [None req-ce346b8e-0fd0-44ef-919d-38ed201a38ac tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lazy-loading 'resources' on Instance uuid 45c24874-99be-41fc-a85f-27ea8ddcfc29 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-ce346b8e-0fd0-44ef-919d-38ed201a38ac tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:31:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-715797157',display_name='tempest-TestVolumeBootPattern-server-715797157',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-715797157',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJbd1pnA0e+ubtg3c4vxF2Dxe/3H7OECUV6ZZvaa4rKNrKocz4jmO0SXeRO4F7NQHuYFrsF7rAUyRZ4V/U5HkEw1E5UZyfInFppdQCzqY7p8CVOHAXsTsTbK336AbWu7g==',key_name='tempest-TestVolumeBootPattern-1282364245',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:31:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2aefabef9e42412f8309f490dcfecc79',ramdisk_id='',reservation_id='r-clakg8q0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-953001121',owner_user_name='tempest-TestVolumeBootPattern-953001121-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:31:28Z,user_data=None,user_id='a463a84e332543dfbc03b81518f82be1',uuid=45c24874-99be-41fc-a85f-27ea8ddcfc29,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5adcf9f7-16fd-477b-87c9-e3329444b7b4", "address": "fa:16:3e:10:f9:24", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5adcf9f7-16", "ovs_interfaceid": "5adcf9f7-16fd-477b-87c9-e3329444b7b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-ce346b8e-0fd0-44ef-919d-38ed201a38ac tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Converting VIF {"id": "5adcf9f7-16fd-477b-87c9-e3329444b7b4", "address": "fa:16:3e:10:f9:24", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5adcf9f7-16", "ovs_interfaceid": "5adcf9f7-16fd-477b-87c9-e3329444b7b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-ce346b8e-0fd0-44ef-919d-38ed201a38ac tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:f9:24,bridge_name='br-int',has_traffic_filtering=True,id=5adcf9f7-16fd-477b-87c9-e3329444b7b4,network=Network(00883fc4-0b74-4afd-9043-82e2933faab3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5adcf9f7-16') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG os_vif [None req-ce346b8e-0fd0-44ef-919d-38ed201a38ac tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:f9:24,bridge_name='br-int',has_traffic_filtering=True,id=5adcf9f7-16fd-477b-87c9-e3329444b7b4,network=Network(00883fc4-0b74-4afd-9043-82e2933faab3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5adcf9f7-16') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5adcf9f7-16, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d59268f9-3fe4-4a03-85f5-38f9a0c8ecd0) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:32:56 user nova-compute[74683]: INFO os_vif [None req-ce346b8e-0fd0-44ef-919d-38ed201a38ac tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:f9:24,bridge_name='br-int',has_traffic_filtering=True,id=5adcf9f7-16fd-477b-87c9-e3329444b7b4,network=Network(00883fc4-0b74-4afd-9043-82e2933faab3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5adcf9f7-16')
Oct 16 11:32:56 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce346b8e-0fd0-44ef-919d-38ed201a38ac tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] calling os-brick to detach iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce346b8e-0fd0-44ef-919d-38ed201a38ac tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, {'target_iqn': 'iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YRKjTnxa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:32:56 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-ce346b8e-0fd0-44ef-919d-38ed201a38ac tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:32:56 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-ce346b8e-0fd0-44ef-919d-38ed201a38ac tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-ce346b8e-0fd0-44ef-919d-38ed201a38ac tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3637985-97b6-4b41-9b89-6cb2f6abc6f8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce346b8e-0fd0-44ef-919d-38ed201a38ac tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 11:32:56 user nova-compute[74683]: No targets found.
Oct 16 11:32:56 user nova-compute[74683]: iSNS:
Oct 16 11:32:56 user nova-compute[74683]: No targets found.
Oct 16 11:32:56 user nova-compute[74683]: STATIC:
Oct 16 11:32:56 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f
Oct 16 11:32:56 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:32:56 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:32:56 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b
Oct 16 11:32:56 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:32:56 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:32:56 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44
Oct 16 11:32:56 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:32:56 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:32:56 user nova-compute[74683]: FIRMWARE:
Oct 16 11:32:56 user nova-compute[74683]: No targets found.
Oct 16 11:32:56 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce346b8e-0fd0-44ef-919d-38ed201a38ac tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 11:32:56 user nova-compute[74683]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 11:32:56 user nova-compute[74683]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74683) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce346b8e-0fd0-44ef-919d-38ed201a38ac tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f', 0)] {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b08b63-f032-4dd8-ac64-14d697355925]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e36b1e-3636-49ed-86be-dfd9ca9bef9c]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce346b8e-0fd0-44ef-919d-38ed201a38ac tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)
Oct 16 11:32:56 user nova-compute[74683]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)
Oct 16 11:32:56 user nova-compute[74683]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b (non-flash)
Oct 16 11:32:56 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce346b8e-0fd0-44ef-919d-38ed201a38ac tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)
Oct 16 11:32:56 user nova-compute[74683]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)
Oct 16 11:32:56 user nova-compute[74683]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b (non-flash)
Oct 16 11:32:56 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce346b8e-0fd0-44ef-919d-38ed201a38ac tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda6c443880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f'): ({'sdb'}, set())}) {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-ce346b8e-0fd0-44ef-919d-38ed201a38ac tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Removing single pathed devices sdb {{(pid=74683) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af23190-313b-42d6-bd56-354616afc4fe]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b761907-78d2-452e-9427-c5f79b8a8a55]: (4, ('ok\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-ce346b8e-0fd0-44ef-919d-38ed201a38ac tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Flushing IO for device /dev/sdb {{(pid=74683) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9683f10-0b5c-4efd-91b9-db08b6a2a541]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-ce346b8e-0fd0-44ef-919d-38ed201a38ac tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74683) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b87664-7539-4737-8b6b-7efeaf7495e2]: (4, ('1', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-ce346b8e-0fd0-44ef-919d-38ed201a38ac tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-ce346b8e-0fd0-44ef-919d-38ed201a38ac tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] SCSI volumes sdb have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_d3cc3eef', '/dev/disk/by-id/scsi-1SCST_BIOd3cc3eef-923121b7d95ae178', '/dev/disk/by-id/scsi-23932333132316237') {{(pid=85666) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5aee4b-e0bb-4ab0-a479-1dfa8f5e1c6b]: (4, None) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce346b8e-0fd0-44ef-919d-38ed201a38ac tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f')] {{(pid=74683) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[11af880e-a740-4284-b4e4-d846b8919465]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce346b8e-0fd0-44ef-919d-38ed201a38ac tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f -p 172.16.0.220:3260 --logout {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[29023ef9-a4a9-4880-8f93-8474215ed633]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce346b8e-0fd0-44ef-919d-38ed201a38ac tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f, portal: 172.16.0.220,3260]
Oct 16 11:32:56 user nova-compute[74683]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f, portal: 172.16.0.220,3260] successful.
Oct 16 11:32:56 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f -p 172.16.0.220:3260 --op delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02fa213-ef94-40c1-aae3-50850cb69e55]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce346b8e-0fd0-44ef-919d-38ed201a38ac tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-ce346b8e-0fd0-44ef-919d-38ed201a38ac tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce346b8e-0fd0-44ef-919d-38ed201a38ac tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] <== disconnect_volume: return (344ms) None {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce346b8e-0fd0-44ef-919d-38ed201a38ac tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Disconnected iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 11:32:56 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-ce346b8e-0fd0-44ef-919d-38ed201a38ac tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Deleting instance files /opt/stack/data/nova/instances/45c24874-99be-41fc-a85f-27ea8ddcfc29_del
Oct 16 11:32:56 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-ce346b8e-0fd0-44ef-919d-38ed201a38ac tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Deletion of /opt/stack/data/nova/instances/45c24874-99be-41fc-a85f-27ea8ddcfc29_del complete
Oct 16 11:32:56 user nova-compute[74683]: INFO nova.compute.manager [None req-ce346b8e-0fd0-44ef-919d-38ed201a38ac tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Took 1.23 seconds to destroy the instance on the hypervisor.
Oct 16 11:32:56 user nova-compute[74683]: DEBUG oslo.service.loopingcall [None req-ce346b8e-0fd0-44ef-919d-38ed201a38ac tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74683) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG nova.compute.manager [-] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Deallocating network for instance {{(pid=74683) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] deallocate_for_instance() {{(pid=74683) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 11:32:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:32:57 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:32:57 user nova-compute[74683]: INFO nova.compute.manager [-] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Took 0.76 seconds to deallocate network for instance.
Oct 16 11:32:57 user nova-compute[74683]: DEBUG nova.compute.manager [req-71f23a99-77cf-4fff-8191-7b872e255054 req-b77efae9-6ea1-45c9-a337-24d1576dd5e6 service nova] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Received event network-vif-deleted-5adcf9f7-16fd-477b-87c9-e3329444b7b4 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:32:57 user nova-compute[74683]: DEBUG nova.compute.manager [req-976449bd-2097-47ff-87da-5e1a0ae9a4bf req-524c9c9f-3c3b-4e4a-b370-3dbdee1ef4cc service nova] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Received event network-vif-plugged-5adcf9f7-16fd-477b-87c9-e3329444b7b4 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:32:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-976449bd-2097-47ff-87da-5e1a0ae9a4bf req-524c9c9f-3c3b-4e4a-b370-3dbdee1ef4cc service nova] Acquiring lock "45c24874-99be-41fc-a85f-27ea8ddcfc29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:32:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-976449bd-2097-47ff-87da-5e1a0ae9a4bf req-524c9c9f-3c3b-4e4a-b370-3dbdee1ef4cc service nova] Lock "45c24874-99be-41fc-a85f-27ea8ddcfc29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:32:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-976449bd-2097-47ff-87da-5e1a0ae9a4bf req-524c9c9f-3c3b-4e4a-b370-3dbdee1ef4cc service nova] Lock "45c24874-99be-41fc-a85f-27ea8ddcfc29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:32:57 user nova-compute[74683]: DEBUG nova.compute.manager [req-976449bd-2097-47ff-87da-5e1a0ae9a4bf req-524c9c9f-3c3b-4e4a-b370-3dbdee1ef4cc service nova] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] No waiting events found dispatching network-vif-plugged-5adcf9f7-16fd-477b-87c9-e3329444b7b4 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:32:57 user nova-compute[74683]: WARNING nova.compute.manager [req-976449bd-2097-47ff-87da-5e1a0ae9a4bf req-524c9c9f-3c3b-4e4a-b370-3dbdee1ef4cc service nova] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Received unexpected event network-vif-plugged-5adcf9f7-16fd-477b-87c9-e3329444b7b4 for instance with vm_state active and task_state deleting.
Oct 16 11:32:58 user nova-compute[74683]: INFO nova.compute.manager [None req-ce346b8e-0fd0-44ef-919d-38ed201a38ac tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 45c24874-99be-41fc-a85f-27ea8ddcfc29] Took 1.00 seconds to detach 1 volumes for instance.
Oct 16 11:32:58 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ce346b8e-0fd0-44ef-919d-38ed201a38ac tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:32:58 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ce346b8e-0fd0-44ef-919d-38ed201a38ac tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:32:58 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-ce346b8e-0fd0-44ef-919d-38ed201a38ac tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:32:58 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-ce346b8e-0fd0-44ef-919d-38ed201a38ac tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:32:58 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ce346b8e-0fd0-44ef-919d-38ed201a38ac tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.251s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:32:58 user nova-compute[74683]: INFO nova.scheduler.client.report [None req-ce346b8e-0fd0-44ef-919d-38ed201a38ac tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Deleted allocations for instance 45c24874-99be-41fc-a85f-27ea8ddcfc29
Oct 16 11:32:59 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ce346b8e-0fd0-44ef-919d-38ed201a38ac tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "45c24874-99be-41fc-a85f-27ea8ddcfc29" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.791s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:33:01 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:33:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:33:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:33:11 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:33:11 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:33:16 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:33:16 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:33:19 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:33:19 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Starting heal instance info cache {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 11:33:19 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Didn't find any instances for network info cache update. {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 16 11:33:19 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:33:19 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:33:19 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:33:19 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:33:19 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:33:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:33:21 user nova-compute[74683]: DEBUG nova.compute.manager [req-f3d3cae9-1a9c-4a92-be11-449038ec56e2 req-8cd5ad9c-2b20-4e1e-ae88-3c8e12367fbe service nova] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Received event network-changed-7ba36bb4-91c7-42ee-b592-6653e63a1d50 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:33:21 user nova-compute[74683]: DEBUG nova.compute.manager [req-f3d3cae9-1a9c-4a92-be11-449038ec56e2 req-8cd5ad9c-2b20-4e1e-ae88-3c8e12367fbe service nova] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Refreshing instance network info cache due to event network-changed-7ba36bb4-91c7-42ee-b592-6653e63a1d50. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:33:21 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f3d3cae9-1a9c-4a92-be11-449038ec56e2 req-8cd5ad9c-2b20-4e1e-ae88-3c8e12367fbe service nova] Acquiring lock "refresh_cache-edd01413-1f8a-49e3-aa3c-ecb19c62afae" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:33:21 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f3d3cae9-1a9c-4a92-be11-449038ec56e2 req-8cd5ad9c-2b20-4e1e-ae88-3c8e12367fbe service nova] Acquired lock "refresh_cache-edd01413-1f8a-49e3-aa3c-ecb19c62afae" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:33:21 user nova-compute[74683]: DEBUG nova.network.neutron [req-f3d3cae9-1a9c-4a92-be11-449038ec56e2 req-8cd5ad9c-2b20-4e1e-ae88-3c8e12367fbe service nova] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Refreshing network info cache for port 7ba36bb4-91c7-42ee-b592-6653e63a1d50 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:33:21 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:33:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:33:22 user nova-compute[74683]: DEBUG nova.network.neutron [req-f3d3cae9-1a9c-4a92-be11-449038ec56e2 req-8cd5ad9c-2b20-4e1e-ae88-3c8e12367fbe service nova] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Updated VIF entry in instance network info cache for port 7ba36bb4-91c7-42ee-b592-6653e63a1d50. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:33:22 user nova-compute[74683]: DEBUG nova.network.neutron [req-f3d3cae9-1a9c-4a92-be11-449038ec56e2 req-8cd5ad9c-2b20-4e1e-ae88-3c8e12367fbe service nova] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Updating instance_info_cache with network_info: [{"id": "7ba36bb4-91c7-42ee-b592-6653e63a1d50", "address": "fa:16:3e:b4:d6:37", "network": {"id": "cd8cf08c-d79c-4d2e-b849-640c440e1498", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1091743670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcb8da41d6584a689e9b50155288aa5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba36bb4-91", "ovs_interfaceid": "7ba36bb4-91c7-42ee-b592-6653e63a1d50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:33:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f3d3cae9-1a9c-4a92-be11-449038ec56e2 req-8cd5ad9c-2b20-4e1e-ae88-3c8e12367fbe service nova] Releasing lock "refresh_cache-edd01413-1f8a-49e3-aa3c-ecb19c62afae" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:33:22 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:33:22 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:33:22 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74683) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 11:33:23 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:33:23 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:33:23 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:33:23 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:33:23 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Auditing locally available compute resources for user (node: user) {{(pid=74683) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 11:33:23 user nova-compute[74683]: DEBUG nova.compute.manager [req-23e886e9-0a0b-47f5-ab9e-daf26f46c9ea req-2807fb28-7774-4556-b153-5a578992cd62 service nova] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Received event network-changed-8bc348fc-b8e3-40da-a8a1-70bd70c3fffe {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:33:23 user nova-compute[74683]: DEBUG nova.compute.manager [req-23e886e9-0a0b-47f5-ab9e-daf26f46c9ea req-2807fb28-7774-4556-b153-5a578992cd62 service nova] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Refreshing instance network info cache due to event network-changed-8bc348fc-b8e3-40da-a8a1-70bd70c3fffe. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:33:23 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-23e886e9-0a0b-47f5-ab9e-daf26f46c9ea req-2807fb28-7774-4556-b153-5a578992cd62 service nova] Acquiring lock "refresh_cache-43d35d0e-acc5-4076-8641-73b4704f1028" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:33:23 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-23e886e9-0a0b-47f5-ab9e-daf26f46c9ea req-2807fb28-7774-4556-b153-5a578992cd62 service nova] Acquired lock "refresh_cache-43d35d0e-acc5-4076-8641-73b4704f1028" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:33:23 user nova-compute[74683]: DEBUG nova.network.neutron [req-23e886e9-0a0b-47f5-ab9e-daf26f46c9ea req-2807fb28-7774-4556-b153-5a578992cd62 service nova] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Refreshing network info cache for port 8bc348fc-b8e3-40da-a8a1-70bd70c3fffe {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:33:23 user nova-compute[74683]: DEBUG nova.compute.manager [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Stashing vm_state: active {{(pid=74683) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 16 11:33:23 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:33:23 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:33:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:33:23 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74683) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 11:33:23 user nova-compute[74683]: INFO nova.compute.claims [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Claim successful on node user
Oct 16 11:33:24 user nova-compute[74683]: INFO nova.compute.resource_tracker [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Updating resource usage from migration 32b4eb0a-efa9-489c-ad77-be06c666769f
Oct 16 11:33:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:33:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:33:24 user nova-compute[74683]: DEBUG nova.network.neutron [req-23e886e9-0a0b-47f5-ab9e-daf26f46c9ea req-2807fb28-7774-4556-b153-5a578992cd62 service nova] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Updated VIF entry in instance network info cache for port 8bc348fc-b8e3-40da-a8a1-70bd70c3fffe. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:33:24 user nova-compute[74683]: DEBUG nova.network.neutron [req-23e886e9-0a0b-47f5-ab9e-daf26f46c9ea req-2807fb28-7774-4556-b153-5a578992cd62 service nova] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Updating instance_info_cache with network_info: [{"id": "8bc348fc-b8e3-40da-a8a1-70bd70c3fffe", "address": "fa:16:3e:37:bc:60", "network": {"id": "cd8cf08c-d79c-4d2e-b849-640c440e1498", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1091743670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcb8da41d6584a689e9b50155288aa5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc348fc-b8", "ovs_interfaceid": "8bc348fc-b8e3-40da-a8a1-70bd70c3fffe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:33:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:33:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:33:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-23e886e9-0a0b-47f5-ab9e-daf26f46c9ea req-2807fb28-7774-4556-b153-5a578992cd62 service nova] Releasing lock "refresh_cache-43d35d0e-acc5-4076-8641-73b4704f1028" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:33:24 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:33:24 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:33:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.507s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:33:24 user nova-compute[74683]: INFO nova.compute.manager [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Migrating
Oct 16 11:33:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Acquiring lock "refresh_cache-43d35d0e-acc5-4076-8641-73b4704f1028" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:33:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Acquired lock "refresh_cache-43d35d0e-acc5-4076-8641-73b4704f1028" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:33:24 user nova-compute[74683]: DEBUG nova.network.neutron [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:33:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:33:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:33:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:33:24 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:33:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ece51b6-5cb3-4d79-acdb-ea4d895cdce8/disk.rescue --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:33:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ece51b6-5cb3-4d79-acdb-ea4d895cdce8/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:33:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ece51b6-5cb3-4d79-acdb-ea4d895cdce8/disk.rescue --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:33:24 user nova-compute[74683]: DEBUG nova.network.neutron [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Updating instance_info_cache with network_info: [{"id": "8bc348fc-b8e3-40da-a8a1-70bd70c3fffe", "address": "fa:16:3e:37:bc:60", "network": {"id": "cd8cf08c-d79c-4d2e-b849-640c440e1498", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1091743670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcb8da41d6584a689e9b50155288aa5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc348fc-b8", "ovs_interfaceid": "8bc348fc-b8e3-40da-a8a1-70bd70c3fffe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:33:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Releasing lock "refresh_cache-43d35d0e-acc5-4076-8641-73b4704f1028" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:33:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ece51b6-5cb3-4d79-acdb-ea4d895cdce8/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:33:25 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /opt/stack/data/nova/instances/9ece51b6-5cb3-4d79-acdb-ea4d895cdce8/disk (vdb) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:33:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.rescue --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:33:25 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Starting migrate_disk_and_power_off {{(pid=74683) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 16 11:33:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:33:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:33:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:33:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.rescue --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:33:25 user nova-compute[74683]: DEBUG nova.compute.manager [req-60f70524-a051-44ba-9027-fd22a3426ac2 req-a290fd6e-6ee8-4612-9c53-c9af70a54c5b service nova] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Received event network-vif-unplugged-8bc348fc-b8e3-40da-a8a1-70bd70c3fffe {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:33:25 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-60f70524-a051-44ba-9027-fd22a3426ac2 req-a290fd6e-6ee8-4612-9c53-c9af70a54c5b service nova] Acquiring lock "43d35d0e-acc5-4076-8641-73b4704f1028-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:33:25 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-60f70524-a051-44ba-9027-fd22a3426ac2 req-a290fd6e-6ee8-4612-9c53-c9af70a54c5b service nova] Lock "43d35d0e-acc5-4076-8641-73b4704f1028-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:33:25 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-60f70524-a051-44ba-9027-fd22a3426ac2 req-a290fd6e-6ee8-4612-9c53-c9af70a54c5b service nova] Lock "43d35d0e-acc5-4076-8641-73b4704f1028-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:33:25 user nova-compute[74683]: DEBUG nova.compute.manager [req-60f70524-a051-44ba-9027-fd22a3426ac2 req-a290fd6e-6ee8-4612-9c53-c9af70a54c5b service nova] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] No waiting events found dispatching network-vif-unplugged-8bc348fc-b8e3-40da-a8a1-70bd70c3fffe {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:33:25 user nova-compute[74683]: WARNING nova.compute.manager [req-60f70524-a051-44ba-9027-fd22a3426ac2 req-a290fd6e-6ee8-4612-9c53-c9af70a54c5b service nova] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Received unexpected event network-vif-unplugged-8bc348fc-b8e3-40da-a8a1-70bd70c3fffe for instance with vm_state active and task_state resize_migrating.
Oct 16 11:33:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:33:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:33:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.rescue --force-share --output=json" returned: 0 in 0.232s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:33:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:33:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:33:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:33:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:33:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:33:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:33:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:33:25 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Instance destroyed successfully.
Oct 16 11:33:25 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:31:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1789370996',display_name='tempest-ServerActionsTestOtherA-server-1789370996',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1789370996',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBEVF+XohWeGna7xpASkIb8CQzH1AhAApSWM489KR3Xw5eNUrWHdrfnFEDLkNX5O9VFz9JiKaf+QhMQdRVklpUzwWiktfTm3fcbGcjt8FS9CdAQjTtJZQ2xWrypXQEhUiQ==',key_name='tempest-keypair-1801585168',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:32:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fcb8da41d6584a689e9b50155288aa5e',ramdisk_id='',reservation_id='r-ydo0ajxm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-327072564',owner_user_name='tempest-ServerActionsTestOtherA-327072564-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:33:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a55641a42b142ea9fb6c6c1fdb9963e',uuid=43d35d0e-acc5-4076-8641-73b4704f1028,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8bc348fc-b8e3-40da-a8a1-70bd70c3fffe", "address": "fa:16:3e:37:bc:60", "network": {"id": "cd8cf08c-d79c-4d2e-b849-640c440e1498", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1091743670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1091743670-network", "vif_mac": "fa:16:3e:37:bc:60"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcb8da41d6584a689e9b50155288aa5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc348fc-b8", "ovs_interfaceid": "8bc348fc-b8e3-40da-a8a1-70bd70c3fffe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:33:25 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Converting VIF {"id": "8bc348fc-b8e3-40da-a8a1-70bd70c3fffe", "address": "fa:16:3e:37:bc:60", "network": {"id": "cd8cf08c-d79c-4d2e-b849-640c440e1498", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1091743670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1091743670-network", "vif_mac": "fa:16:3e:37:bc:60"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcb8da41d6584a689e9b50155288aa5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc348fc-b8", "ovs_interfaceid": "8bc348fc-b8e3-40da-a8a1-70bd70c3fffe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:33:25 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:37:bc:60,bridge_name='br-int',has_traffic_filtering=True,id=8bc348fc-b8e3-40da-a8a1-70bd70c3fffe,network=Network(cd8cf08c-d79c-4d2e-b849-640c440e1498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bc348fc-b8') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:33:25 user nova-compute[74683]: DEBUG os_vif [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:bc:60,bridge_name='br-int',has_traffic_filtering=True,id=8bc348fc-b8e3-40da-a8a1-70bd70c3fffe,network=Network(cd8cf08c-d79c-4d2e-b849-640c440e1498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bc348fc-b8') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:33:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:33:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8bc348fc-b8, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:33:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:33:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:33:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:33:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4e32d66d-f9a5-45d4-8a36-69f3913dd941) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:33:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:33:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:33:25 user nova-compute[74683]: INFO os_vif [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:bc:60,bridge_name='br-int',has_traffic_filtering=True,id=8bc348fc-b8e3-40da-a8a1-70bd70c3fffe,network=Network(cd8cf08c-d79c-4d2e-b849-640c440e1498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bc348fc-b8')
Oct 16 11:33:25 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] calling os-brick to detach iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 11:33:25 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, {'target_iqn': 'iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qDUviZHh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:33:25 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:33:25 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:33:25 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:33:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:33:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:33:26 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c274cd0-3939-4bf1-ab94-b0e607f9ac0c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:33:26 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 11:33:26 user nova-compute[74683]: No targets found.
Oct 16 11:33:26 user nova-compute[74683]: iSNS:
Oct 16 11:33:26 user nova-compute[74683]: No targets found.
Oct 16 11:33:26 user nova-compute[74683]: STATIC:
Oct 16 11:33:26 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b
Oct 16 11:33:26 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:33:26 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:33:26 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44
Oct 16 11:33:26 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:33:26 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:33:26 user nova-compute[74683]: FIRMWARE:
Oct 16 11:33:26 user nova-compute[74683]: No targets found.
Oct 16 11:33:26 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:33:26 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 11:33:26 user nova-compute[74683]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 11:33:26 user nova-compute[74683]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74683) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 11:33:26 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44', 0)] {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 11:33:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:33:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:33:26 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[566158b4-add2-4347-8110-01a379b85520]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:33:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:33:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:33:26 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2b7260-7c21-4a4e-a324-f08d9eab6dcb]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:33:26 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)
Oct 16 11:33:26 user nova-compute[74683]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b (non-flash)
Oct 16 11:33:26 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:33:26 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)
Oct 16 11:33:26 user nova-compute[74683]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b (non-flash)
Oct 16 11:33:26 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:33:26 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda4c688dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44'): ({'sdc'}, set())}) {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 11:33:26 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Removing single pathed devices sdc {{(pid=74683) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 11:33:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:33:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:33:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:33:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:33:26 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34ec0e0-0aa2-4add-92ab-2bea0a635239]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:33:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:33:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:33:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:33:26 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[55761164-1112-44d5-9f4f-901543e2fd81]: (4, ('ok\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:33:26 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Flushing IO for device /dev/sdc {{(pid=74683) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 11:33:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:33:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:33:26 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61ff520-1837-4fe7-8b02-fd8236d83662]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:33:26 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74683) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 11:33:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:33:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.055s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:33:26 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[51902731-9c02-405e-afa0-04fd654d0d63]: (4, ('1', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:33:26 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 11:33:26 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] SCSI volumes sdc have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 11:33:26 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44')] {{(pid=74683) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 11:33:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:33:26 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:33:26 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:33:26 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Hypervisor/Node resource view: name=user free_ram=8104MB free_disk=25.241931915283203GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74683) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 11:33:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:33:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:33:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:33:26 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[90166690-58f4-478f-a3b6-0a5e5dacded1]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:33:26 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:33:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 -p 172.16.0.220:3260 --logout {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:33:26 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Applying migration context for instance 43d35d0e-acc5-4076-8641-73b4704f1028 as it has an incoming, in-progress migration 32b4eb0a-efa9-489c-ad77-be06c666769f. Migration status is migrating {{(pid=74683) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 16 11:33:26 user nova-compute[74683]: INFO nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Updating resource usage from migration 32b4eb0a-efa9-489c-ad77-be06c666769f
Oct 16 11:33:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:33:26 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[172473c9-f0af-4a7a-b99f-415bfde36a67]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:33:26 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44, portal: 172.16.0.220,3260]
Oct 16 11:33:26 user nova-compute[74683]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44, portal: 172.16.0.220,3260] successful.
Oct 16 11:33:26 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:33:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 -p 172.16.0.220:3260 --op delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:33:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:33:26 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d1f17f-8ed2-476b-8de9-d11651b36804]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:33:26 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:33:26 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.875s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:33:26 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] <== disconnect_volume: return (877ms) None {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:33:26 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Disconnected iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 11:33:26 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance edd01413-1f8a-49e3-aa3c-ecb19c62afae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:33:26 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 9b8ba94f-43cc-4f06-bcd9-83935ccbe117 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:33:26 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance b91af786-36e3-4815-811f-fb3c055e758d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:33:26 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:33:26 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance f5ad764c-638d-4dac-b032-6680917e46df actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:33:26 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Migration 32b4eb0a-efa9-489c-ad77-be06c666769f is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 16 11:33:26 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 43d35d0e-acc5-4076-8641-73b4704f1028 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:33:26 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 11:33:26 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 11:33:26 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:33:27 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:33:27 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:33:27 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Compute_service record updated for user:user {{(pid=74683) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 11:33:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.448s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:33:27 user nova-compute[74683]: DEBUG nova.compute.manager [req-e26a7177-aca4-4d2a-ae8c-3c81ff522ab7 req-6d680ccf-970d-4032-b586-f7da37447c3e service nova] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Received event network-vif-plugged-8bc348fc-b8e3-40da-a8a1-70bd70c3fffe {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:33:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e26a7177-aca4-4d2a-ae8c-3c81ff522ab7 req-6d680ccf-970d-4032-b586-f7da37447c3e service nova] Acquiring lock "43d35d0e-acc5-4076-8641-73b4704f1028-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:33:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e26a7177-aca4-4d2a-ae8c-3c81ff522ab7 req-6d680ccf-970d-4032-b586-f7da37447c3e service nova] Lock "43d35d0e-acc5-4076-8641-73b4704f1028-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:33:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e26a7177-aca4-4d2a-ae8c-3c81ff522ab7 req-6d680ccf-970d-4032-b586-f7da37447c3e service nova] Lock "43d35d0e-acc5-4076-8641-73b4704f1028-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:33:27 user nova-compute[74683]: DEBUG nova.compute.manager [req-e26a7177-aca4-4d2a-ae8c-3c81ff522ab7 req-6d680ccf-970d-4032-b586-f7da37447c3e service nova] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] No waiting events found dispatching network-vif-plugged-8bc348fc-b8e3-40da-a8a1-70bd70c3fffe {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:33:27 user nova-compute[74683]: WARNING nova.compute.manager [req-e26a7177-aca4-4d2a-ae8c-3c81ff522ab7 req-6d680ccf-970d-4032-b586-f7da37447c3e service nova] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Received unexpected event network-vif-plugged-8bc348fc-b8e3-40da-a8a1-70bd70c3fffe for instance with vm_state active and task_state resize_migrating.
Oct 16 11:33:28 user nova-compute[74683]: DEBUG nova.network.neutron [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Port 8bc348fc-b8e3-40da-a8a1-70bd70c3fffe binding to destination host user is already ACTIVE {{(pid=74683) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Oct 16 11:33:28 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Acquiring lock "43d35d0e-acc5-4076-8641-73b4704f1028-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:33:28 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "43d35d0e-acc5-4076-8641-73b4704f1028-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:33:28 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "43d35d0e-acc5-4076-8641-73b4704f1028-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:33:28 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Acquiring lock "refresh_cache-43d35d0e-acc5-4076-8641-73b4704f1028" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:33:28 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Acquired lock "refresh_cache-43d35d0e-acc5-4076-8641-73b4704f1028" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:33:28 user nova-compute[74683]: DEBUG nova.network.neutron [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:33:29 user nova-compute[74683]: DEBUG nova.network.neutron [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Updating instance_info_cache with network_info: [{"id": "8bc348fc-b8e3-40da-a8a1-70bd70c3fffe", "address": "fa:16:3e:37:bc:60", "network": {"id": "cd8cf08c-d79c-4d2e-b849-640c440e1498", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1091743670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcb8da41d6584a689e9b50155288aa5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc348fc-b8", "ovs_interfaceid": "8bc348fc-b8e3-40da-a8a1-70bd70c3fffe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:33:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Releasing lock "refresh_cache-43d35d0e-acc5-4076-8641-73b4704f1028" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:33:29 user nova-compute[74683]: DEBUG os_brick.utils [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:33:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:33:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:33:29 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[11fb18ff-7959-4a19-af8d-57dc40d065e2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:70b9d336ab7d\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:33:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:33:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:33:29 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[8639993d-8438-4e08-a743-8ce34ea3fa3c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:33:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:33:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:33:29 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4bba123-cea2-40c1-b247-9cab027034a1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:33:29 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb2ac398-cef8-4d96-97ac-cda26d0e2c6c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:33:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Running cmd (subprocess): nvme version {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:33:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] 'nvme version' failed. Not Retrying. {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:33:29 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] nvme not present on system {{(pid=74683) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 11:33:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:33:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:33:29 user nova-compute[74683]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 11:33:29 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ca2fa4-1ae0-4eef-809c-6cd54a05ccbc]: (4, '') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:33:29 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74683) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 11:33:29 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 11:33:29 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] LIGHTOS: no hostnqn found. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 11:33:29 user nova-compute[74683]: DEBUG os_brick.utils [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:70b9d336ab7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:33:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Acquiring lock "6d2a30dc-36e8-4582-a236-821e9f87a687" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:33:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Lock "6d2a30dc-36e8-4582-a236-821e9f87a687" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:33:30 user nova-compute[74683]: DEBUG nova.compute.manager [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 6d2a30dc-36e8-4582-a236-821e9f87a687] Starting instance... {{(pid=74683) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 11:33:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:33:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:33:30 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74683) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 11:33:30 user nova-compute[74683]: INFO nova.compute.claims [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 6d2a30dc-36e8-4582-a236-821e9f87a687] Claim successful on node user
Oct 16 11:33:30 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:33:31 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:33:31 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:33:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.408s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:33:31 user nova-compute[74683]: DEBUG nova.compute.manager [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 6d2a30dc-36e8-4582-a236-821e9f87a687] Start building networks asynchronously for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 11:33:31 user nova-compute[74683]: DEBUG nova.compute.manager [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 6d2a30dc-36e8-4582-a236-821e9f87a687] Allocating IP information in the background. {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 11:33:31 user nova-compute[74683]: DEBUG nova.network.neutron [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 6d2a30dc-36e8-4582-a236-821e9f87a687] allocate_for_instance() {{(pid=74683) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 11:33:31 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 6d2a30dc-36e8-4582-a236-821e9f87a687] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 11:33:31 user nova-compute[74683]: DEBUG nova.compute.manager [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 6d2a30dc-36e8-4582-a236-821e9f87a687] Start building block device mappings for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 11:33:31 user nova-compute[74683]: DEBUG nova.policy [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2cb90c639a424b3ba9b7513aa6624334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c02c8882c3f4a2eac7d1f320c06899b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74683) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 11:33:31 user nova-compute[74683]: DEBUG nova.compute.manager [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 6d2a30dc-36e8-4582-a236-821e9f87a687] Start spawning the instance on the hypervisor. {{(pid=74683) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 11:33:31 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 6d2a30dc-36e8-4582-a236-821e9f87a687] Creating instance directory {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 11:33:31 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 6d2a30dc-36e8-4582-a236-821e9f87a687] Creating image(s)
Oct 16 11:33:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Acquiring lock "/opt/stack/data/nova/instances/6d2a30dc-36e8-4582-a236-821e9f87a687/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:33:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Lock "/opt/stack/data/nova/instances/6d2a30dc-36e8-4582-a236-821e9f87a687/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:33:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Lock "/opt/stack/data/nova/instances/6d2a30dc-36e8-4582-a236-821e9f87a687/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:33:31 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:33:31 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.177s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:33:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Acquiring lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:33:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:33:31 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:33:31 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.218s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:33:31 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/6d2a30dc-36e8-4582-a236-821e9f87a687/disk 1073741824 {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:33:31 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/6d2a30dc-36e8-4582-a236-821e9f87a687/disk 1073741824" returned: 0 in 0.062s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:33:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.288s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:33:31 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:33:32 user nova-compute[74683]: DEBUG nova.network.neutron [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 6d2a30dc-36e8-4582-a236-821e9f87a687] Successfully created port: c49145a9-b1ae-42b4-8e12-54b00715e0d6 {{(pid=74683) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 11:33:32 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.251s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:33:32 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6d2a30dc-36e8-4582-a236-821e9f87a687/disk. size=1073741824 {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 11:33:32 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d2a30dc-36e8-4582-a236-821e9f87a687/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:33:32 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d2a30dc-36e8-4582-a236-821e9f87a687/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:33:32 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Cannot resize image /opt/stack/data/nova/instances/6d2a30dc-36e8-4582-a236-821e9f87a687/disk to a smaller size. {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 11:33:32 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 6d2a30dc-36e8-4582-a236-821e9f87a687] Created local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 11:33:32 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 6d2a30dc-36e8-4582-a236-821e9f87a687] Ensure instance console log exists: /opt/stack/data/nova/instances/6d2a30dc-36e8-4582-a236-821e9f87a687/console.log {{(pid=74683) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 11:33:32 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:33:32 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:33:32 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:33:32 user nova-compute[74683]: DEBUG nova.network.neutron [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 6d2a30dc-36e8-4582-a236-821e9f87a687] Successfully updated port: c49145a9-b1ae-42b4-8e12-54b00715e0d6 {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:33:32 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Acquiring lock "refresh_cache-6d2a30dc-36e8-4582-a236-821e9f87a687" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:33:32 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Acquired lock "refresh_cache-6d2a30dc-36e8-4582-a236-821e9f87a687" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:33:32 user nova-compute[74683]: DEBUG nova.network.neutron [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 6d2a30dc-36e8-4582-a236-821e9f87a687] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:33:32 user nova-compute[74683]: DEBUG nova.compute.manager [req-926a9cc3-a05b-4e9c-883d-ffec2defdd94 req-7c704b02-a0dc-4f8b-95fc-29725805425f service nova] [instance: 6d2a30dc-36e8-4582-a236-821e9f87a687] Received event network-changed-c49145a9-b1ae-42b4-8e12-54b00715e0d6 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:33:32 user nova-compute[74683]: DEBUG nova.compute.manager [req-926a9cc3-a05b-4e9c-883d-ffec2defdd94 req-7c704b02-a0dc-4f8b-95fc-29725805425f service nova] [instance: 6d2a30dc-36e8-4582-a236-821e9f87a687] Refreshing instance network info cache due to event network-changed-c49145a9-b1ae-42b4-8e12-54b00715e0d6. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:33:32 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-926a9cc3-a05b-4e9c-883d-ffec2defdd94 req-7c704b02-a0dc-4f8b-95fc-29725805425f service nova] Acquiring lock "refresh_cache-6d2a30dc-36e8-4582-a236-821e9f87a687" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:33:32 user nova-compute[74683]: DEBUG nova.network.neutron [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 6d2a30dc-36e8-4582-a236-821e9f87a687] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:33:33 user nova-compute[74683]: DEBUG nova.network.neutron [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 6d2a30dc-36e8-4582-a236-821e9f87a687] Updating instance_info_cache with network_info: [{"id": "c49145a9-b1ae-42b4-8e12-54b00715e0d6", "address": "fa:16:3e:c6:5c:ab", "network": {"id": "d2fbadd4-fd6d-4bbc-96eb-042f4fce1c04", "bridge": "br-int", "label": "tempest-VolumesActionsTest-888145232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c02c8882c3f4a2eac7d1f320c06899b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc49145a9-b1", "ovs_interfaceid": "c49145a9-b1ae-42b4-8e12-54b00715e0d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:33:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Releasing lock "refresh_cache-6d2a30dc-36e8-4582-a236-821e9f87a687" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:33:33 user nova-compute[74683]: DEBUG nova.compute.manager [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 6d2a30dc-36e8-4582-a236-821e9f87a687] Instance network_info: |[{"id": "c49145a9-b1ae-42b4-8e12-54b00715e0d6", "address": "fa:16:3e:c6:5c:ab", "network": {"id": "d2fbadd4-fd6d-4bbc-96eb-042f4fce1c04", "bridge": "br-int", "label": "tempest-VolumesActionsTest-888145232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c02c8882c3f4a2eac7d1f320c06899b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc49145a9-b1", "ovs_interfaceid": "c49145a9-b1ae-42b4-8e12-54b00715e0d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 11:33:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-926a9cc3-a05b-4e9c-883d-ffec2defdd94 req-7c704b02-a0dc-4f8b-95fc-29725805425f service nova] Acquired lock "refresh_cache-6d2a30dc-36e8-4582-a236-821e9f87a687" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:33:33 user nova-compute[74683]: DEBUG nova.network.neutron [req-926a9cc3-a05b-4e9c-883d-ffec2defdd94 req-7c704b02-a0dc-4f8b-95fc-29725805425f service nova] [instance: 6d2a30dc-36e8-4582-a236-821e9f87a687] Refreshing network info cache for port c49145a9-b1ae-42b4-8e12-54b00715e0d6 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:33:33 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 6d2a30dc-36e8-4582-a236-821e9f87a687] Start _get_guest_xml network_info=[{"id": "c49145a9-b1ae-42b4-8e12-54b00715e0d6", "address": "fa:16:3e:c6:5c:ab", "network": {"id": "d2fbadd4-fd6d-4bbc-96eb-042f4fce1c04", "bridge": "br-int", "label": "tempest-VolumesActionsTest-888145232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c02c8882c3f4a2eac7d1f320c06899b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc49145a9-b1", "ovs_interfaceid": "c49145a9-b1ae-42b4-8e12-54b00715e0d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:33:33 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:33:33 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:33:33 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:33:33 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:33:33 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:33:33 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:33:33 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:33:33 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:33:33 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:33:33 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:33:33 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:33:33 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:33:33 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:33:33 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:33:33 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:33:33 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:33:33 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:33:33 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:33:33 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:33:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1351527279',display_name='tempest-VolumesActionsTest-instance-1351527279',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1351527279',id=38,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c02c8882c3f4a2eac7d1f320c06899b',ramdisk_id='',reservation_id='r-ztd5tvv5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1922089110',owner_user_name='tempest-VolumesActionsTest-1922089110-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:33:31Z,user_data=None,user_id='2cb90c639a424b3ba9b7513aa6624334',uuid=6d2a30dc-36e8-4582-a236-821e9f87a687,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c49145a9-b1ae-42b4-8e12-54b00715e0d6", "address": "fa:16:3e:c6:5c:ab", "network": {"id": "d2fbadd4-fd6d-4bbc-96eb-042f4fce1c04", "bridge": "br-int", "label": "tempest-VolumesActionsTest-888145232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c02c8882c3f4a2eac7d1f320c06899b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc49145a9-b1", "ovs_interfaceid": "c49145a9-b1ae-42b4-8e12-54b00715e0d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:33:33 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Converting VIF {"id": "c49145a9-b1ae-42b4-8e12-54b00715e0d6", "address": "fa:16:3e:c6:5c:ab", "network": {"id": "d2fbadd4-fd6d-4bbc-96eb-042f4fce1c04", "bridge": "br-int", "label": "tempest-VolumesActionsTest-888145232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c02c8882c3f4a2eac7d1f320c06899b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc49145a9-b1", "ovs_interfaceid": "c49145a9-b1ae-42b4-8e12-54b00715e0d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:33:33 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:5c:ab,bridge_name='br-int',has_traffic_filtering=True,id=c49145a9-b1ae-42b4-8e12-54b00715e0d6,network=Network(d2fbadd4-fd6d-4bbc-96eb-042f4fce1c04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc49145a9-b1') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:33:33 user nova-compute[74683]: DEBUG nova.objects.instance [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Lazy-loading 'pci_devices' on Instance uuid 6d2a30dc-36e8-4582-a236-821e9f87a687 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:33:33 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 6d2a30dc-36e8-4582-a236-821e9f87a687] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:33:33 user nova-compute[74683]:   <uuid>6d2a30dc-36e8-4582-a236-821e9f87a687</uuid>
Oct 16 11:33:33 user nova-compute[74683]:   <name>instance-00000026</name>
Oct 16 11:33:33 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:33:33 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:33:33 user nova-compute[74683]:   <metadata>
Oct 16 11:33:33 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:33:33 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:33:33 user nova-compute[74683]:       <nova:name>tempest-VolumesActionsTest-instance-1351527279</nova:name>
Oct 16 11:33:33 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:33:33</nova:creationTime>
Oct 16 11:33:33 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:33:33 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:33:33 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:33:33 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:33:33 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:33:33 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:33:33 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:33:33 user nova-compute[74683]:       <nova:owner>
Oct 16 11:33:33 user nova-compute[74683]:         <nova:user uuid="2cb90c639a424b3ba9b7513aa6624334">tempest-VolumesActionsTest-1922089110-project-member</nova:user>
Oct 16 11:33:33 user nova-compute[74683]:         <nova:project uuid="3c02c8882c3f4a2eac7d1f320c06899b">tempest-VolumesActionsTest-1922089110</nova:project>
Oct 16 11:33:33 user nova-compute[74683]:       </nova:owner>
Oct 16 11:33:33 user nova-compute[74683]:       <nova:root type="image" uuid="0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f"/>
Oct 16 11:33:33 user nova-compute[74683]:       <nova:ports>
Oct 16 11:33:33 user nova-compute[74683]:         <nova:port uuid="c49145a9-b1ae-42b4-8e12-54b00715e0d6">
Oct 16 11:33:33 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 16 11:33:33 user nova-compute[74683]:         </nova:port>
Oct 16 11:33:33 user nova-compute[74683]:       </nova:ports>
Oct 16 11:33:33 user nova-compute[74683]:     </nova:instance>
Oct 16 11:33:33 user nova-compute[74683]:   </metadata>
Oct 16 11:33:33 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:33:33 user nova-compute[74683]:     <system>
Oct 16 11:33:33 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:33:33 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:33:33 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:33:33 user nova-compute[74683]:       <entry name="serial">6d2a30dc-36e8-4582-a236-821e9f87a687</entry>
Oct 16 11:33:33 user nova-compute[74683]:       <entry name="uuid">6d2a30dc-36e8-4582-a236-821e9f87a687</entry>
Oct 16 11:33:33 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:33:33 user nova-compute[74683]:     </system>
Oct 16 11:33:33 user nova-compute[74683]:   </sysinfo>
Oct 16 11:33:33 user nova-compute[74683]:   <os>
Oct 16 11:33:33 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:33:33 user nova-compute[74683]:     <boot dev="hd"/>
Oct 16 11:33:33 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:33:33 user nova-compute[74683]:   </os>
Oct 16 11:33:33 user nova-compute[74683]:   <features>
Oct 16 11:33:33 user nova-compute[74683]:     <acpi/>
Oct 16 11:33:33 user nova-compute[74683]:     <apic/>
Oct 16 11:33:33 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:33:33 user nova-compute[74683]:   </features>
Oct 16 11:33:33 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:33:33 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:33:33 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:33:33 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:33:33 user nova-compute[74683]:   </clock>
Oct 16 11:33:33 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:33:33 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:33:33 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:33:33 user nova-compute[74683]:   </cpu>
Oct 16 11:33:33 user nova-compute[74683]:   <devices>
Oct 16 11:33:33 user nova-compute[74683]:     <disk type="file" device="disk">
Oct 16 11:33:33 user nova-compute[74683]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 11:33:33 user nova-compute[74683]:       <source file="/opt/stack/data/nova/instances/6d2a30dc-36e8-4582-a236-821e9f87a687/disk"/>
Oct 16 11:33:33 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:33:33 user nova-compute[74683]:     </disk>
Oct 16 11:33:33 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:33:33 user nova-compute[74683]:       <mac address="fa:16:3e:c6:5c:ab"/>
Oct 16 11:33:33 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:33:33 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:33:33 user nova-compute[74683]:       <target dev="tapc49145a9-b1"/>
Oct 16 11:33:33 user nova-compute[74683]:     </interface>
Oct 16 11:33:33 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:33:33 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/6d2a30dc-36e8-4582-a236-821e9f87a687/console.log" append="off"/>
Oct 16 11:33:33 user nova-compute[74683]:     </serial>
Oct 16 11:33:33 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:33:33 user nova-compute[74683]:     <video>
Oct 16 11:33:33 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:33:33 user nova-compute[74683]:     </video>
Oct 16 11:33:33 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:33:33 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:33:33 user nova-compute[74683]:     </rng>
Oct 16 11:33:33 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:33:33 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:33:33 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:33:33 user nova-compute[74683]:     </memballoon>
Oct 16 11:33:33 user nova-compute[74683]:   </devices>
Oct 16 11:33:33 user nova-compute[74683]: </domain>
Oct 16 11:33:33 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:33:33 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:33:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1351527279',display_name='tempest-VolumesActionsTest-instance-1351527279',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1351527279',id=38,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c02c8882c3f4a2eac7d1f320c06899b',ramdisk_id='',reservation_id='r-ztd5tvv5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1922089110',owner_user_name='tempest-VolumesActionsTest-1922089110-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:33:31Z,user_data=None,user_id='2cb90c639a424b3ba9b7513aa6624334',uuid=6d2a30dc-36e8-4582-a236-821e9f87a687,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c49145a9-b1ae-42b4-8e12-54b00715e0d6", "address": "fa:16:3e:c6:5c:ab", "network": {"id": "d2fbadd4-fd6d-4bbc-96eb-042f4fce1c04", "bridge": "br-int", "label": "tempest-VolumesActionsTest-888145232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c02c8882c3f4a2eac7d1f320c06899b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc49145a9-b1", "ovs_interfaceid": "c49145a9-b1ae-42b4-8e12-54b00715e0d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:33:33 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Converting VIF {"id": "c49145a9-b1ae-42b4-8e12-54b00715e0d6", "address": "fa:16:3e:c6:5c:ab", "network": {"id": "d2fbadd4-fd6d-4bbc-96eb-042f4fce1c04", "bridge": "br-int", "label": "tempest-VolumesActionsTest-888145232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c02c8882c3f4a2eac7d1f320c06899b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc49145a9-b1", "ovs_interfaceid": "c49145a9-b1ae-42b4-8e12-54b00715e0d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:33:33 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:5c:ab,bridge_name='br-int',has_traffic_filtering=True,id=c49145a9-b1ae-42b4-8e12-54b00715e0d6,network=Network(d2fbadd4-fd6d-4bbc-96eb-042f4fce1c04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc49145a9-b1') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:33:33 user nova-compute[74683]: DEBUG os_vif [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:5c:ab,bridge_name='br-int',has_traffic_filtering=True,id=c49145a9-b1ae-42b4-8e12-54b00715e0d6,network=Network(d2fbadd4-fd6d-4bbc-96eb-042f4fce1c04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc49145a9-b1') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:33:33 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:33:33 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:33:33 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:33:33 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:33:33 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '76b77f8d-9002-5502-9aca-561ee404cc12', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:33:33 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:33:33 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:33:33 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:33:33 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc49145a9-b1, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:33:33 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc49145a9-b1, col_values=(('qos', UUID('e98ed737-548f-4697-99bc-70370a9d6647')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:33:33 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc49145a9-b1, col_values=(('external_ids', {'iface-id': 'c49145a9-b1ae-42b4-8e12-54b00715e0d6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:5c:ab', 'vm-uuid': '6d2a30dc-36e8-4582-a236-821e9f87a687'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:33:33 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:33:33 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:33:33 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:33:33 user nova-compute[74683]: INFO os_vif [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:5c:ab,bridge_name='br-int',has_traffic_filtering=True,id=c49145a9-b1ae-42b4-8e12-54b00715e0d6,network=Network(d2fbadd4-fd6d-4bbc-96eb-042f4fce1c04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc49145a9-b1')
Oct 16 11:33:33 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:33:33 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] No VIF found with MAC fa:16:3e:c6:5c:ab, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:33:33 user nova-compute[74683]: DEBUG nova.network.neutron [req-926a9cc3-a05b-4e9c-883d-ffec2defdd94 req-7c704b02-a0dc-4f8b-95fc-29725805425f service nova] [instance: 6d2a30dc-36e8-4582-a236-821e9f87a687] Updated VIF entry in instance network info cache for port c49145a9-b1ae-42b4-8e12-54b00715e0d6. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:33:33 user nova-compute[74683]: DEBUG nova.network.neutron [req-926a9cc3-a05b-4e9c-883d-ffec2defdd94 req-7c704b02-a0dc-4f8b-95fc-29725805425f service nova] [instance: 6d2a30dc-36e8-4582-a236-821e9f87a687] Updating instance_info_cache with network_info: [{"id": "c49145a9-b1ae-42b4-8e12-54b00715e0d6", "address": "fa:16:3e:c6:5c:ab", "network": {"id": "d2fbadd4-fd6d-4bbc-96eb-042f4fce1c04", "bridge": "br-int", "label": "tempest-VolumesActionsTest-888145232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c02c8882c3f4a2eac7d1f320c06899b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc49145a9-b1", "ovs_interfaceid": "c49145a9-b1ae-42b4-8e12-54b00715e0d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:33:34 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-926a9cc3-a05b-4e9c-883d-ffec2defdd94 req-7c704b02-a0dc-4f8b-95fc-29725805425f service nova] Releasing lock "refresh_cache-6d2a30dc-36e8-4582-a236-821e9f87a687" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:33:35 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:33:35 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:33:35 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:33:35 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:33:35 user nova-compute[74683]: DEBUG nova.compute.manager [req-eea788a4-2f8c-40a7-b256-4f135075205a req-a45cddf8-3994-4e66-a8d6-2e74bbcfabfd service nova] [instance: 6d2a30dc-36e8-4582-a236-821e9f87a687] Received event network-vif-plugged-c49145a9-b1ae-42b4-8e12-54b00715e0d6 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:33:35 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-eea788a4-2f8c-40a7-b256-4f135075205a req-a45cddf8-3994-4e66-a8d6-2e74bbcfabfd service nova] Acquiring lock "6d2a30dc-36e8-4582-a236-821e9f87a687-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:33:35 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-eea788a4-2f8c-40a7-b256-4f135075205a req-a45cddf8-3994-4e66-a8d6-2e74bbcfabfd service nova] Lock "6d2a30dc-36e8-4582-a236-821e9f87a687-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:33:35 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-eea788a4-2f8c-40a7-b256-4f135075205a req-a45cddf8-3994-4e66-a8d6-2e74bbcfabfd service nova] Lock "6d2a30dc-36e8-4582-a236-821e9f87a687-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:33:35 user nova-compute[74683]: DEBUG nova.compute.manager [req-eea788a4-2f8c-40a7-b256-4f135075205a req-a45cddf8-3994-4e66-a8d6-2e74bbcfabfd service nova] [instance: 6d2a30dc-36e8-4582-a236-821e9f87a687] No waiting events found dispatching network-vif-plugged-c49145a9-b1ae-42b4-8e12-54b00715e0d6 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:33:35 user nova-compute[74683]: WARNING nova.compute.manager [req-eea788a4-2f8c-40a7-b256-4f135075205a req-a45cddf8-3994-4e66-a8d6-2e74bbcfabfd service nova] [instance: 6d2a30dc-36e8-4582-a236-821e9f87a687] Received unexpected event network-vif-plugged-c49145a9-b1ae-42b4-8e12-54b00715e0d6 for instance with vm_state building and task_state spawning.
Oct 16 11:33:35 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:33:35 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:33:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:33:37 user nova-compute[74683]: DEBUG nova.compute.manager [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 6d2a30dc-36e8-4582-a236-821e9f87a687] Instance event wait completed in 0 seconds for  {{(pid=74683) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 11:33:37 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 6d2a30dc-36e8-4582-a236-821e9f87a687] Guest created on hypervisor {{(pid=74683) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 11:33:37 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 6d2a30dc-36e8-4582-a236-821e9f87a687] Instance spawned successfully.
Oct 16 11:33:37 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 6d2a30dc-36e8-4582-a236-821e9f87a687] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 11:33:37 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 6d2a30dc-36e8-4582-a236-821e9f87a687] Found default for hw_cdrom_bus of ide {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:33:37 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 6d2a30dc-36e8-4582-a236-821e9f87a687] Found default for hw_disk_bus of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:33:37 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 6d2a30dc-36e8-4582-a236-821e9f87a687] Found default for hw_input_bus of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:33:37 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 6d2a30dc-36e8-4582-a236-821e9f87a687] Found default for hw_pointer_model of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:33:37 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 6d2a30dc-36e8-4582-a236-821e9f87a687] Found default for hw_video_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:33:37 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 6d2a30dc-36e8-4582-a236-821e9f87a687] Found default for hw_vif_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:33:37 user nova-compute[74683]: INFO nova.compute.manager [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 6d2a30dc-36e8-4582-a236-821e9f87a687] Took 6.06 seconds to spawn the instance on the hypervisor.
Oct 16 11:33:37 user nova-compute[74683]: DEBUG nova.compute.manager [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 6d2a30dc-36e8-4582-a236-821e9f87a687] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:33:37 user nova-compute[74683]: INFO nova.compute.manager [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 6d2a30dc-36e8-4582-a236-821e9f87a687] Took 6.88 seconds to build instance.
Oct 16 11:33:37 user nova-compute[74683]: DEBUG nova.compute.manager [req-d7306ecf-5d51-4f66-99bd-3ef03525994e req-c669c9cc-6ba0-4998-81b1-ab29234bd4b7 service nova] [instance: 6d2a30dc-36e8-4582-a236-821e9f87a687] Received event network-vif-plugged-c49145a9-b1ae-42b4-8e12-54b00715e0d6 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:33:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-d7306ecf-5d51-4f66-99bd-3ef03525994e req-c669c9cc-6ba0-4998-81b1-ab29234bd4b7 service nova] Acquiring lock "6d2a30dc-36e8-4582-a236-821e9f87a687-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:33:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-d7306ecf-5d51-4f66-99bd-3ef03525994e req-c669c9cc-6ba0-4998-81b1-ab29234bd4b7 service nova] Lock "6d2a30dc-36e8-4582-a236-821e9f87a687-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:33:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-d7306ecf-5d51-4f66-99bd-3ef03525994e req-c669c9cc-6ba0-4998-81b1-ab29234bd4b7 service nova] Lock "6d2a30dc-36e8-4582-a236-821e9f87a687-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:33:37 user nova-compute[74683]: DEBUG nova.compute.manager [req-d7306ecf-5d51-4f66-99bd-3ef03525994e req-c669c9cc-6ba0-4998-81b1-ab29234bd4b7 service nova] [instance: 6d2a30dc-36e8-4582-a236-821e9f87a687] No waiting events found dispatching network-vif-plugged-c49145a9-b1ae-42b4-8e12-54b00715e0d6 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:33:37 user nova-compute[74683]: WARNING nova.compute.manager [req-d7306ecf-5d51-4f66-99bd-3ef03525994e req-c669c9cc-6ba0-4998-81b1-ab29234bd4b7 service nova] [instance: 6d2a30dc-36e8-4582-a236-821e9f87a687] Received unexpected event network-vif-plugged-c49145a9-b1ae-42b4-8e12-54b00715e0d6 for instance with vm_state active and task_state None.
Oct 16 11:33:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1b8a3aaa-5fad-4b71-a664-4c1ffb6effa2 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Lock "6d2a30dc-36e8-4582-a236-821e9f87a687" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:33:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:33:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:33:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:33:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:33:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquiring lock "6d3528c9-50dd-4f9e-ab92-2f885662bff7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:33:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "6d3528c9-50dd-4f9e-ab92-2f885662bff7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:33:47 user nova-compute[74683]: DEBUG nova.compute.manager [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Starting instance... {{(pid=74683) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 11:33:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:33:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:33:47 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74683) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 11:33:47 user nova-compute[74683]: INFO nova.compute.claims [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Claim successful on node user
Oct 16 11:33:48 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:33:48 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:33:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.441s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:33:48 user nova-compute[74683]: DEBUG nova.compute.manager [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Start building networks asynchronously for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 11:33:48 user nova-compute[74683]: DEBUG nova.compute.manager [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Allocating IP information in the background. {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 11:33:48 user nova-compute[74683]: DEBUG nova.network.neutron [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] allocate_for_instance() {{(pid=74683) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 11:33:48 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 11:33:48 user nova-compute[74683]: DEBUG nova.compute.manager [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Start building block device mappings for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 11:33:48 user nova-compute[74683]: DEBUG nova.policy [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a463a84e332543dfbc03b81518f82be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefabef9e42412f8309f490dcfecc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74683) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 11:33:48 user nova-compute[74683]: INFO nova.virt.block_device [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Booting with volume c6f05240-96d4-498f-9c29-f5888f6ed27f at /dev/vda
Oct 16 11:33:48 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:33:48 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:33:48 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5010 ms, sending inactivity probe {{(pid=74683) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 11:33:48 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:33:48 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:33:48 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:33:48 user nova-compute[74683]: DEBUG os_brick.utils [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:33:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:33:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:33:48 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[030d0957-394b-4366-b699-6e65fbffb01c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:70b9d336ab7d\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:33:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:33:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:33:48 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f89df0-7f58-498d-84bd-1cfd4767bbde]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:33:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:33:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:33:48 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[83412d2a-0b90-4320-927e-21e749903374]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:33:48 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[39eaf3dd-f7dc-41b8-b2ce-3196dd5fb888]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:33:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Running cmd (subprocess): nvme version {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:33:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] 'nvme version' failed. Not Retrying. {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:33:48 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.nvmeof [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] nvme not present on system {{(pid=74683) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 11:33:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:33:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:33:48 user nova-compute[74683]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 11:33:48 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[889d0f41-8b74-41bc-a9f5-2c6dc3f19ba3]: (4, '') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:33:48 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74683) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 11:33:48 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 11:33:48 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] LIGHTOS: no hostnqn found. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 11:33:48 user nova-compute[74683]: DEBUG os_brick.utils [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:70b9d336ab7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:33:48 user nova-compute[74683]: DEBUG nova.virt.block_device [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Updating existing volume attachment record: 19f4acfc-2ae5-45a6-b96e-4e9c9c5e1c07 {{(pid=74683) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 11:33:49 user nova-compute[74683]: DEBUG nova.network.neutron [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Successfully created port: d29ea840-0505-4827-b11f-2caa7b0f6faa {{(pid=74683) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 11:33:49 user nova-compute[74683]: DEBUG nova.network.neutron [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Successfully updated port: d29ea840-0505-4827-b11f-2caa7b0f6faa {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:33:49 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquiring lock "refresh_cache-6d3528c9-50dd-4f9e-ab92-2f885662bff7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:33:49 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquired lock "refresh_cache-6d3528c9-50dd-4f9e-ab92-2f885662bff7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:33:49 user nova-compute[74683]: DEBUG nova.network.neutron [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:33:50 user nova-compute[74683]: DEBUG nova.compute.manager [req-f1a3c479-1b26-4b16-95cf-1c9ddc9c1eb9 req-8a14fd09-8da3-428f-aa78-d20001b06117 service nova] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Received event network-changed-d29ea840-0505-4827-b11f-2caa7b0f6faa {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:33:50 user nova-compute[74683]: DEBUG nova.compute.manager [req-f1a3c479-1b26-4b16-95cf-1c9ddc9c1eb9 req-8a14fd09-8da3-428f-aa78-d20001b06117 service nova] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Refreshing instance network info cache due to event network-changed-d29ea840-0505-4827-b11f-2caa7b0f6faa. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:33:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f1a3c479-1b26-4b16-95cf-1c9ddc9c1eb9 req-8a14fd09-8da3-428f-aa78-d20001b06117 service nova] Acquiring lock "refresh_cache-6d3528c9-50dd-4f9e-ab92-2f885662bff7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:33:50 user nova-compute[74683]: DEBUG nova.network.neutron [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:33:50 user nova-compute[74683]: DEBUG nova.network.neutron [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Updating instance_info_cache with network_info: [{"id": "d29ea840-0505-4827-b11f-2caa7b0f6faa", "address": "fa:16:3e:12:a3:80", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd29ea840-05", "ovs_interfaceid": "d29ea840-0505-4827-b11f-2caa7b0f6faa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:33:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Releasing lock "refresh_cache-6d3528c9-50dd-4f9e-ab92-2f885662bff7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:33:50 user nova-compute[74683]: DEBUG nova.compute.manager [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Instance network_info: |[{"id": "d29ea840-0505-4827-b11f-2caa7b0f6faa", "address": "fa:16:3e:12:a3:80", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd29ea840-05", "ovs_interfaceid": "d29ea840-0505-4827-b11f-2caa7b0f6faa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 11:33:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f1a3c479-1b26-4b16-95cf-1c9ddc9c1eb9 req-8a14fd09-8da3-428f-aa78-d20001b06117 service nova] Acquired lock "refresh_cache-6d3528c9-50dd-4f9e-ab92-2f885662bff7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:33:50 user nova-compute[74683]: DEBUG nova.network.neutron [req-f1a3c479-1b26-4b16-95cf-1c9ddc9c1eb9 req-8a14fd09-8da3-428f-aa78-d20001b06117 service nova] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Refreshing network info cache for port d29ea840-0505-4827-b11f-2caa7b0f6faa {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:33:50 user nova-compute[74683]: DEBUG nova.network.neutron [req-f1a3c479-1b26-4b16-95cf-1c9ddc9c1eb9 req-8a14fd09-8da3-428f-aa78-d20001b06117 service nova] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Updated VIF entry in instance network info cache for port d29ea840-0505-4827-b11f-2caa7b0f6faa. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:33:50 user nova-compute[74683]: DEBUG nova.network.neutron [req-f1a3c479-1b26-4b16-95cf-1c9ddc9c1eb9 req-8a14fd09-8da3-428f-aa78-d20001b06117 service nova] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Updating instance_info_cache with network_info: [{"id": "d29ea840-0505-4827-b11f-2caa7b0f6faa", "address": "fa:16:3e:12:a3:80", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd29ea840-05", "ovs_interfaceid": "d29ea840-0505-4827-b11f-2caa7b0f6faa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:33:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f1a3c479-1b26-4b16-95cf-1c9ddc9c1eb9 req-8a14fd09-8da3-428f-aa78-d20001b06117 service nova] Releasing lock "refresh_cache-6d3528c9-50dd-4f9e-ab92-2f885662bff7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:33:51 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Starting finish_migration {{(pid=74683) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Instance directory exists: not creating {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 16 11:33:52 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Creating image(s)
Oct 16 11:33:52 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Did not create local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Ensure instance console log exists: /opt/stack/data/nova/instances/43d35d0e-acc5-4076-8641-73b4704f1028/console.log {{(pid=74683) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Start _get_guest_xml network_info=[{"id": "8bc348fc-b8e3-40da-a8a1-70bd70c3fffe", "address": "fa:16:3e:37:bc:60", "network": {"id": "cd8cf08c-d79c-4d2e-b849-640c440e1498", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1091743670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1091743670-network", "vif_mac": "fa:16:3e:37:bc:60"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcb8da41d6584a689e9b50155288aa5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc348fc-b8", "ovs_interfaceid": "8bc348fc-b8e3-40da-a8a1-70bd70c3fffe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qDUviZHh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '43d35d0e-acc5-4076-8641-73b4704f1028', 'attached_at': '2023-10-16T11:33:52.000000', 'detached_at': '', 'volume_id': '64115bde-e392-4631-bc47-a4b9b829eb44', 'serial': '64115bde-e392-4631-bc47-a4b9b829eb44'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': '42ac649c-8a71-4e39-bedf-b869bcf4b7b5', 'volume_type': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:33:52 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:33:52 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:33:52 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Calling os-brick to attach iSCSI Volume {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qDUviZHh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:33:52 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:33:52 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:33:52 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:33:52 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:33:52 user nova-compute[74683]: INFO os_brick.initiator.connectors.iscsi [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 11:33:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 -p 172.16.0.220:3260 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a835ef9d-684a-4f3d-a18f-321c43f0330d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 11:33:52 user nova-compute[74683]:  {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 -p 172.16.0.220:3260 --interface default --op new {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c48401e-c483-4425-a5d0-db82c6ded3e1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44] added\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44] added
Oct 16 11:33:52 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea33ff0b-5446-463e-ad78-d7cdeb4a6bc4]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eee5630-d880-4df3-8f39-8cc5ad79d774]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qDUviZHh {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qDUviZHh" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bce056f-4d3b-47f7-9352-d0b5bc8a44ad]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qDUviZHh'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.047s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f26ea1-d2fc-4107-8a36-efc9d8e9277c]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23e9160-4936-4706-8272-e5eafeed4dcd]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b (non-flash)
Oct 16 11:33:52 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b (non-flash)
Oct 16 11:33:52 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 -p 172.16.0.220:3260 --login {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[642fb036-da63-4641-bade-a979fb0e578c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44, portal: 172.16.0.220,3260]
Oct 16 11:33:52 user nova-compute[74683]: Login to [iface: default, target: iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44, portal: 172.16.0.220,3260] successful.
Oct 16 11:33:52 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad02fc9-f219-49cd-b1c8-bc445888dd48]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f470c4-f70d-4d1b-89d4-d1f6ef29c2b3]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b (non-flash)
Oct 16 11:33:52 user nova-compute[74683]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)
Oct 16 11:33:52 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b (non-flash)
Oct 16 11:33:52 user nova-compute[74683]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)
Oct 16 11:33:52 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Connected to 172.16.0.220:3260 {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=74683) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74683) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.026s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f2dbae-15be-4683-975c-56343f55dd95]: (4, ('- - 0', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:33:52 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: None {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:33:53 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:33:53 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:33:53 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qDUviZHh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 11:33:53 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:33:53 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '23763333465303433', 'path': '/dev/sdb'} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:33:53 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763333465303433', 'path': '/dev/sdb'} {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 11:33:53 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:31:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1789370996',display_name='tempest-ServerActionsTestOtherA-server-1789370996',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1789370996',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBEVF+XohWeGna7xpASkIb8CQzH1AhAApSWM489KR3Xw5eNUrWHdrfnFEDLkNX5O9VFz9JiKaf+QhMQdRVklpUzwWiktfTm3fcbGcjt8FS9CdAQjTtJZQ2xWrypXQEhUiQ==',key_name='tempest-keypair-1801585168',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:32:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fcb8da41d6584a689e9b50155288aa5e',ramdisk_id='',reservation_id='r-ydo0ajxm',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-327072564',owner_user_name='tempest-ServerActionsTestOtherA-327072564-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:33:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a55641a42b142ea9fb6c6c1fdb9963e',uuid=43d35d0e-acc5-4076-8641-73b4704f1028,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8bc348fc-b8e3-40da-a8a1-70bd70c3fffe", "address": "fa:16:3e:37:bc:60", "network": {"id": "cd8cf08c-d79c-4d2e-b849-640c440e1498", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1091743670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1091743670-network", "vif_mac": "fa:16:3e:37:bc:60"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcb8da41d6584a689e9b50155288aa5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc348fc-b8", "ovs_interfaceid": "8bc348fc-b8e3-40da-a8a1-70bd70c3fffe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:33:53 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Converting VIF {"id": "8bc348fc-b8e3-40da-a8a1-70bd70c3fffe", "address": "fa:16:3e:37:bc:60", "network": {"id": "cd8cf08c-d79c-4d2e-b849-640c440e1498", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1091743670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1091743670-network", "vif_mac": "fa:16:3e:37:bc:60"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcb8da41d6584a689e9b50155288aa5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc348fc-b8", "ovs_interfaceid": "8bc348fc-b8e3-40da-a8a1-70bd70c3fffe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:33:53 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:bc:60,bridge_name='br-int',has_traffic_filtering=True,id=8bc348fc-b8e3-40da-a8a1-70bd70c3fffe,network=Network(cd8cf08c-d79c-4d2e-b849-640c440e1498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bc348fc-b8') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:33:53 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:33:53 user nova-compute[74683]:   <uuid>43d35d0e-acc5-4076-8641-73b4704f1028</uuid>
Oct 16 11:33:53 user nova-compute[74683]:   <name>instance-00000024</name>
Oct 16 11:33:53 user nova-compute[74683]:   <memory>2097152</memory>
Oct 16 11:33:53 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:33:53 user nova-compute[74683]:   <metadata>
Oct 16 11:33:53 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:33:53 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:33:53 user nova-compute[74683]:       <nova:name>tempest-ServerActionsTestOtherA-server-1789370996</nova:name>
Oct 16 11:33:53 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:33:52</nova:creationTime>
Oct 16 11:33:53 user nova-compute[74683]:       <nova:flavor name="m1.small">
Oct 16 11:33:53 user nova-compute[74683]:         <nova:memory>2048</nova:memory>
Oct 16 11:33:53 user nova-compute[74683]:         <nova:disk>20</nova:disk>
Oct 16 11:33:53 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:33:53 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:33:53 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:33:53 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:33:53 user nova-compute[74683]:       <nova:owner>
Oct 16 11:33:53 user nova-compute[74683]:         <nova:user uuid="6a55641a42b142ea9fb6c6c1fdb9963e">tempest-ServerActionsTestOtherA-327072564-project-member</nova:user>
Oct 16 11:33:53 user nova-compute[74683]:         <nova:project uuid="fcb8da41d6584a689e9b50155288aa5e">tempest-ServerActionsTestOtherA-327072564</nova:project>
Oct 16 11:33:53 user nova-compute[74683]:       </nova:owner>
Oct 16 11:33:53 user nova-compute[74683]:       <nova:ports>
Oct 16 11:33:53 user nova-compute[74683]:         <nova:port uuid="8bc348fc-b8e3-40da-a8a1-70bd70c3fffe">
Oct 16 11:33:53 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 16 11:33:53 user nova-compute[74683]:         </nova:port>
Oct 16 11:33:53 user nova-compute[74683]:       </nova:ports>
Oct 16 11:33:53 user nova-compute[74683]:     </nova:instance>
Oct 16 11:33:53 user nova-compute[74683]:   </metadata>
Oct 16 11:33:53 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:33:53 user nova-compute[74683]:     <system>
Oct 16 11:33:53 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:33:53 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:33:53 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:33:53 user nova-compute[74683]:       <entry name="serial">43d35d0e-acc5-4076-8641-73b4704f1028</entry>
Oct 16 11:33:53 user nova-compute[74683]:       <entry name="uuid">43d35d0e-acc5-4076-8641-73b4704f1028</entry>
Oct 16 11:33:53 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:33:53 user nova-compute[74683]:     </system>
Oct 16 11:33:53 user nova-compute[74683]:   </sysinfo>
Oct 16 11:33:53 user nova-compute[74683]:   <os>
Oct 16 11:33:53 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:33:53 user nova-compute[74683]:     <boot dev="hd"/>
Oct 16 11:33:53 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:33:53 user nova-compute[74683]:   </os>
Oct 16 11:33:53 user nova-compute[74683]:   <features>
Oct 16 11:33:53 user nova-compute[74683]:     <acpi/>
Oct 16 11:33:53 user nova-compute[74683]:     <apic/>
Oct 16 11:33:53 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:33:53 user nova-compute[74683]:   </features>
Oct 16 11:33:53 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:33:53 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:33:53 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:33:53 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:33:53 user nova-compute[74683]:   </clock>
Oct 16 11:33:53 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:33:53 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:33:53 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:33:53 user nova-compute[74683]:   </cpu>
Oct 16 11:33:53 user nova-compute[74683]:   <devices>
Oct 16 11:33:53 user nova-compute[74683]:     <disk type="block" device="disk">
Oct 16 11:33:53 user nova-compute[74683]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:33:53 user nova-compute[74683]:       <source dev="/dev/sdb"/>
Oct 16 11:33:53 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:33:53 user nova-compute[74683]:       <serial>64115bde-e392-4631-bc47-a4b9b829eb44</serial>
Oct 16 11:33:53 user nova-compute[74683]:     </disk>
Oct 16 11:33:53 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:33:53 user nova-compute[74683]:       <mac address="fa:16:3e:37:bc:60"/>
Oct 16 11:33:53 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:33:53 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:33:53 user nova-compute[74683]:       <target dev="tap8bc348fc-b8"/>
Oct 16 11:33:53 user nova-compute[74683]:     </interface>
Oct 16 11:33:53 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:33:53 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/43d35d0e-acc5-4076-8641-73b4704f1028/console.log" append="off"/>
Oct 16 11:33:53 user nova-compute[74683]:     </serial>
Oct 16 11:33:53 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:33:53 user nova-compute[74683]:     <video>
Oct 16 11:33:53 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:33:53 user nova-compute[74683]:     </video>
Oct 16 11:33:53 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:33:53 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:33:53 user nova-compute[74683]:     </rng>
Oct 16 11:33:53 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:33:53 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:33:53 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:33:53 user nova-compute[74683]:     </memballoon>
Oct 16 11:33:53 user nova-compute[74683]:   </devices>
Oct 16 11:33:53 user nova-compute[74683]: </domain>
Oct 16 11:33:53 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:33:53 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:31:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1789370996',display_name='tempest-ServerActionsTestOtherA-server-1789370996',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1789370996',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBEVF+XohWeGna7xpASkIb8CQzH1AhAApSWM489KR3Xw5eNUrWHdrfnFEDLkNX5O9VFz9JiKaf+QhMQdRVklpUzwWiktfTm3fcbGcjt8FS9CdAQjTtJZQ2xWrypXQEhUiQ==',key_name='tempest-keypair-1801585168',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:32:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fcb8da41d6584a689e9b50155288aa5e',ramdisk_id='',reservation_id='r-ydo0ajxm',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-327072564',owner_user_name='tempest-ServerActionsTestOtherA-327072564-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:33:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a55641a42b142ea9fb6c6c1fdb9963e',uuid=43d35d0e-acc5-4076-8641-73b4704f1028,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8bc348fc-b8e3-40da-a8a1-70bd70c3fffe", "address": "fa:16:3e:37:bc:60", "network": {"id": "cd8cf08c-d79c-4d2e-b849-640c440e1498", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1091743670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1091743670-network", "vif_mac": "fa:16:3e:37:bc:60"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcb8da41d6584a689e9b50155288aa5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc348fc-b8", "ovs_interfaceid": "8bc348fc-b8e3-40da-a8a1-70bd70c3fffe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:33:53 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Converting VIF {"id": "8bc348fc-b8e3-40da-a8a1-70bd70c3fffe", "address": "fa:16:3e:37:bc:60", "network": {"id": "cd8cf08c-d79c-4d2e-b849-640c440e1498", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1091743670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1091743670-network", "vif_mac": "fa:16:3e:37:bc:60"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcb8da41d6584a689e9b50155288aa5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc348fc-b8", "ovs_interfaceid": "8bc348fc-b8e3-40da-a8a1-70bd70c3fffe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:33:53 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:bc:60,bridge_name='br-int',has_traffic_filtering=True,id=8bc348fc-b8e3-40da-a8a1-70bd70c3fffe,network=Network(cd8cf08c-d79c-4d2e-b849-640c440e1498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bc348fc-b8') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:33:53 user nova-compute[74683]: DEBUG os_vif [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:bc:60,bridge_name='br-int',has_traffic_filtering=True,id=8bc348fc-b8e3-40da-a8a1-70bd70c3fffe,network=Network(cd8cf08c-d79c-4d2e-b849-640c440e1498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bc348fc-b8') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:33:53 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:33:53 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:33:53 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:33:53 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:33:53 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9278e6d8-6b66-51da-94ef-811d467413c0', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:33:53 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:33:53 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:33:53 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:33:53 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8bc348fc-b8, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:33:53 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8bc348fc-b8, col_values=(('qos', UUID('17d69c37-86da-4534-995e-1d7ec2ee4b67')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:33:53 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8bc348fc-b8, col_values=(('external_ids', {'iface-id': '8bc348fc-b8e3-40da-a8a1-70bd70c3fffe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:bc:60', 'vm-uuid': '43d35d0e-acc5-4076-8641-73b4704f1028'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:33:53 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:33:53 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:33:53 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:33:53 user nova-compute[74683]: INFO os_vif [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:bc:60,bridge_name='br-int',has_traffic_filtering=True,id=8bc348fc-b8e3-40da-a8a1-70bd70c3fffe,network=Network(cd8cf08c-d79c-4d2e-b849-640c440e1498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bc348fc-b8')
Oct 16 11:33:53 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:33:53 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] No VIF found with MAC fa:16:3e:37:bc:60, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:33:55 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:33:55 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:33:55 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:33:55 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:33:55 user nova-compute[74683]: DEBUG nova.compute.manager [req-cbf2000a-3bd4-4e5d-a081-b8af088d819c req-2b0c9f27-c565-42fc-af06-76ddbba93e62 service nova] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Received event network-vif-plugged-8bc348fc-b8e3-40da-a8a1-70bd70c3fffe {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:33:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-cbf2000a-3bd4-4e5d-a081-b8af088d819c req-2b0c9f27-c565-42fc-af06-76ddbba93e62 service nova] Acquiring lock "43d35d0e-acc5-4076-8641-73b4704f1028-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:33:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-cbf2000a-3bd4-4e5d-a081-b8af088d819c req-2b0c9f27-c565-42fc-af06-76ddbba93e62 service nova] Lock "43d35d0e-acc5-4076-8641-73b4704f1028-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:33:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-cbf2000a-3bd4-4e5d-a081-b8af088d819c req-2b0c9f27-c565-42fc-af06-76ddbba93e62 service nova] Lock "43d35d0e-acc5-4076-8641-73b4704f1028-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:33:55 user nova-compute[74683]: DEBUG nova.compute.manager [req-cbf2000a-3bd4-4e5d-a081-b8af088d819c req-2b0c9f27-c565-42fc-af06-76ddbba93e62 service nova] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] No waiting events found dispatching network-vif-plugged-8bc348fc-b8e3-40da-a8a1-70bd70c3fffe {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:33:55 user nova-compute[74683]: WARNING nova.compute.manager [req-cbf2000a-3bd4-4e5d-a081-b8af088d819c req-2b0c9f27-c565-42fc-af06-76ddbba93e62 service nova] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Received unexpected event network-vif-plugged-8bc348fc-b8e3-40da-a8a1-70bd70c3fffe for instance with vm_state active and task_state resize_finish.
Oct 16 11:33:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:33:57 user nova-compute[74683]: DEBUG nova.compute.manager [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Instance event wait completed in 0 seconds for  {{(pid=74683) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 11:33:57 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Instance running successfully.
Oct 16 11:33:57 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Failed to set time: agent not configured {{(pid=74683) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Oct 16 11:33:57 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-e54ab59b-fc20-47a4-9678-4c87768f8744 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] finish_migration finished successfully. {{(pid=74683) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Oct 16 11:33:57 user nova-compute[74683]: DEBUG nova.compute.manager [req-e504ef77-bee6-4d60-a50f-0bac7e4df235 req-de6841c6-6c3a-4986-8230-ecd4b7246b49 service nova] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Received event network-vif-plugged-8bc348fc-b8e3-40da-a8a1-70bd70c3fffe {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:33:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e504ef77-bee6-4d60-a50f-0bac7e4df235 req-de6841c6-6c3a-4986-8230-ecd4b7246b49 service nova] Acquiring lock "43d35d0e-acc5-4076-8641-73b4704f1028-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:33:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e504ef77-bee6-4d60-a50f-0bac7e4df235 req-de6841c6-6c3a-4986-8230-ecd4b7246b49 service nova] Lock "43d35d0e-acc5-4076-8641-73b4704f1028-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:33:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e504ef77-bee6-4d60-a50f-0bac7e4df235 req-de6841c6-6c3a-4986-8230-ecd4b7246b49 service nova] Lock "43d35d0e-acc5-4076-8641-73b4704f1028-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:33:57 user nova-compute[74683]: DEBUG nova.compute.manager [req-e504ef77-bee6-4d60-a50f-0bac7e4df235 req-de6841c6-6c3a-4986-8230-ecd4b7246b49 service nova] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] No waiting events found dispatching network-vif-plugged-8bc348fc-b8e3-40da-a8a1-70bd70c3fffe {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:33:57 user nova-compute[74683]: WARNING nova.compute.manager [req-e504ef77-bee6-4d60-a50f-0bac7e4df235 req-de6841c6-6c3a-4986-8230-ecd4b7246b49 service nova] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Received unexpected event network-vif-plugged-8bc348fc-b8e3-40da-a8a1-70bd70c3fffe for instance with vm_state active and task_state resize_finish.
Oct 16 11:33:58 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:00 user nova-compute[74683]: DEBUG nova.compute.manager [req-49ea7558-5d8c-4c17-a5d0-4f25afffc413 req-53e381b1-9a0a-4ec7-b2aa-7f1bec82745a service nova] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Received event network-changed-eb80f49f-da30-478a-900a-5d3da8ec7fa9 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:34:00 user nova-compute[74683]: DEBUG nova.compute.manager [req-49ea7558-5d8c-4c17-a5d0-4f25afffc413 req-53e381b1-9a0a-4ec7-b2aa-7f1bec82745a service nova] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Refreshing instance network info cache due to event network-changed-eb80f49f-da30-478a-900a-5d3da8ec7fa9. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:34:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-49ea7558-5d8c-4c17-a5d0-4f25afffc413 req-53e381b1-9a0a-4ec7-b2aa-7f1bec82745a service nova] Acquiring lock "refresh_cache-f5ad764c-638d-4dac-b032-6680917e46df" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:34:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-49ea7558-5d8c-4c17-a5d0-4f25afffc413 req-53e381b1-9a0a-4ec7-b2aa-7f1bec82745a service nova] Acquired lock "refresh_cache-f5ad764c-638d-4dac-b032-6680917e46df" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:34:00 user nova-compute[74683]: DEBUG nova.network.neutron [req-49ea7558-5d8c-4c17-a5d0-4f25afffc413 req-53e381b1-9a0a-4ec7-b2aa-7f1bec82745a service nova] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Refreshing network info cache for port eb80f49f-da30-478a-900a-5d3da8ec7fa9 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:34:00 user nova-compute[74683]: DEBUG nova.network.neutron [req-49ea7558-5d8c-4c17-a5d0-4f25afffc413 req-53e381b1-9a0a-4ec7-b2aa-7f1bec82745a service nova] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Updated VIF entry in instance network info cache for port eb80f49f-da30-478a-900a-5d3da8ec7fa9. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:34:00 user nova-compute[74683]: DEBUG nova.network.neutron [req-49ea7558-5d8c-4c17-a5d0-4f25afffc413 req-53e381b1-9a0a-4ec7-b2aa-7f1bec82745a service nova] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Updating instance_info_cache with network_info: [{"id": "eb80f49f-da30-478a-900a-5d3da8ec7fa9", "address": "fa:16:3e:c8:02:4d", "network": {"id": "badd2db9-6c0f-40cc-afe9-a199e040399a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1368098259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "889cb980200446c0933fe965738a62df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb80f49f-da", "ovs_interfaceid": "eb80f49f-da30-478a-900a-5d3da8ec7fa9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:34:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-49ea7558-5d8c-4c17-a5d0-4f25afffc413 req-53e381b1-9a0a-4ec7-b2aa-7f1bec82745a service nova] Releasing lock "refresh_cache-f5ad764c-638d-4dac-b032-6680917e46df" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:34:01 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:01 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:03 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-753e873f-382d-4084-a537-cd47ca593dee tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Acquiring lock "f5ad764c-638d-4dac-b032-6680917e46df" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:34:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-753e873f-382d-4084-a537-cd47ca593dee tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "f5ad764c-638d-4dac-b032-6680917e46df" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG nova.objects.instance [None req-753e873f-382d-4084-a537-cd47ca593dee tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lazy-loading 'flavor' on Instance uuid f5ad764c-638d-4dac-b032-6680917e46df {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-753e873f-382d-4084-a537-cd47ca593dee tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "f5ad764c-638d-4dac-b032-6680917e46df" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.135s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-753e873f-382d-4084-a537-cd47ca593dee tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Acquiring lock "f5ad764c-638d-4dac-b032-6680917e46df" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-753e873f-382d-4084-a537-cd47ca593dee tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "f5ad764c-638d-4dac-b032-6680917e46df" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:34:07 user nova-compute[74683]: INFO nova.compute.manager [None req-753e873f-382d-4084-a537-cd47ca593dee tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Attaching volume 22c582f7-e7ab-4c14-a3e5-2d52b953051e to /dev/vdb
Oct 16 11:34:07 user nova-compute[74683]: DEBUG os_brick.utils [None req-753e873f-382d-4084-a537-cd47ca593dee tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f3d0a6-c213-4b4c-b64f-ecafa541ac63]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:70b9d336ab7d\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[0edfa95c-e1f1-4f75-832f-283402862d09]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de92156-1587-4e11-9533-f2b3f23281ee]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf73d9db-0919-4adf-ac29-b2076fc3bc7d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-753e873f-382d-4084-a537-cd47ca593dee tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Running cmd (subprocess): nvme version {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-753e873f-382d-4084-a537-cd47ca593dee tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] 'nvme version' failed. Not Retrying. {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.nvmeof [None req-753e873f-382d-4084-a537-cd47ca593dee tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] nvme not present on system {{(pid=74683) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:34:07 user nova-compute[74683]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 11:34:07 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[8587a1a1-9a5d-4e6b-b2cd-c0dff2eee759]: (4, '') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-753e873f-382d-4084-a537-cd47ca593dee tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74683) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-753e873f-382d-4084-a537-cd47ca593dee tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-753e873f-382d-4084-a537-cd47ca593dee tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] LIGHTOS: no hostnqn found. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG os_brick.utils [None req-753e873f-382d-4084-a537-cd47ca593dee tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:70b9d336ab7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG nova.virt.block_device [None req-753e873f-382d-4084-a537-cd47ca593dee tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Updating existing volume attachment record: 4dcc279c-936d-4432-a0de-4efb1a3d6aba {{(pid=74683) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG nova.compute.manager [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Start spawning the instance on the hypervisor. {{(pid=74683) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Creating instance directory {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 11:34:07 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Creating image(s)
Oct 16 11:34:07 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Did not create local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Ensure instance console log exists: /opt/stack/data/nova/instances/6d3528c9-50dd-4f9e-ab92-2f885662bff7/console.log {{(pid=74683) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Start _get_guest_xml network_info=[{"id": "d29ea840-0505-4827-b11f-2caa7b0f6faa", "address": "fa:16:3e:12:a3:80", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd29ea840-05", "ovs_interfaceid": "d29ea840-0505-4827-b11f-2caa7b0f6faa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YRKjTnxa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6d3528c9-50dd-4f9e-ab92-2f885662bff7', 'attached_at': '', 'detached_at': '', 'volume_id': 'c6f05240-96d4-498f-9c29-f5888f6ed27f', 'serial': 'c6f05240-96d4-498f-9c29-f5888f6ed27f'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': '19f4acfc-2ae5-45a6-b96e-4e9c9c5e1c07', 'volume_type': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:34:07 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:34:07 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:34:07 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Calling os-brick to attach iSCSI Volume {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YRKjTnxa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:34:07 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:34:07 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:34:07 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:34:07 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:34:07 user nova-compute[74683]: INFO os_brick.initiator.connectors.iscsi [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 11:34:07 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f -p 172.16.0.220:3260 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8e939b-cd65-49b7-9c1b-bbc70569aad1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 11:34:07 user nova-compute[74683]:  {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f -p 172.16.0.220:3260 --interface default --op new {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2fc3c8-e158-409c-99d2-d9c14324262e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f] added\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f] added
Oct 16 11:34:07 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[8501260a-fbe7-4b10-9d99-1f6192b41676]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1f8241-8d38-41ca-b226-6f7ac7e79199]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YRKjTnxa {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YRKjTnxa" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c1c588-0463-40b8-beb6-3c18140f2172]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YRKjTnxa'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d911037-5460-46b3-8548-1d997814d878]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6ff0f3-8af7-4c79-a2a4-293722d0aad1]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b (non-flash)
Oct 16 11:34:07 user nova-compute[74683]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)
Oct 16 11:34:07 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b (non-flash)
Oct 16 11:34:07 user nova-compute[74683]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)
Oct 16 11:34:07 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:34:07 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f -p 172.16.0.220:3260 --login {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:34:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:34:08 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6cf1cf8-d92f-45d7-bb15-7548223c2f72]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:34:08 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f, portal: 172.16.0.220,3260]
Oct 16 11:34:08 user nova-compute[74683]: Login to [iface: default, target: iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f, portal: 172.16.0.220,3260] successful.
Oct 16 11:34:08 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:34:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:34:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:34:08 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[90270d9a-15d1-40d9-870b-9fb689f2e0b5]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:34:08 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:34:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:34:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:34:08 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[79db5082-d929-4017-8fb9-35df8976a91c]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:34:08 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b (non-flash)
Oct 16 11:34:08 user nova-compute[74683]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)
Oct 16 11:34:08 user nova-compute[74683]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)
Oct 16 11:34:08 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:34:08 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b (non-flash)
Oct 16 11:34:08 user nova-compute[74683]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)
Oct 16 11:34:08 user nova-compute[74683]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)
Oct 16 11:34:08 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:34:08 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:34:08 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Connected to 172.16.0.220:3260 {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 11:34:08 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] HCTL ('34', '-', '-', 0) found on session 40 with lun 0 {{(pid=74683) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 11:34:08 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74683) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 11:34:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:34:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:34:08 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[6768764c-5b03-4cb1-8bcc-1a3f3a200ff1]: (4, ('- - 0', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:34:08 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: None {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:34:08 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:09 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:34:09 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YRKjTnxa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 11:34:09 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:34:09 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23932333132316237', 'path': '/dev/sdc'} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:34:09 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932333132316237', 'path': '/dev/sdc'} {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 11:34:09 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:33:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-835993735',display_name='tempest-TestVolumeBootPattern-server-835993735',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-835993735',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJbd1pnA0e+ubtg3c4vxF2Dxe/3H7OECUV6ZZvaa4rKNrKocz4jmO0SXeRO4F7NQHuYFrsF7rAUyRZ4V/U5HkEw1E5UZyfInFppdQCzqY7p8CVOHAXsTsTbK336AbWu7g==',key_name='tempest-TestVolumeBootPattern-1282364245',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2aefabef9e42412f8309f490dcfecc79',ramdisk_id='',reservation_id='r-3jw043ei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-953001121',owner_user_name='tempest-TestVolumeBootPattern-953001121-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:33:48Z,user_data=None,user_id='a463a84e332543dfbc03b81518f82be1',uuid=6d3528c9-50dd-4f9e-ab92-2f885662bff7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d29ea840-0505-4827-b11f-2caa7b0f6faa", "address": "fa:16:3e:12:a3:80", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd29ea840-05", "ovs_interfaceid": "d29ea840-0505-4827-b11f-2caa7b0f6faa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:34:09 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Converting VIF {"id": "d29ea840-0505-4827-b11f-2caa7b0f6faa", "address": "fa:16:3e:12:a3:80", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd29ea840-05", "ovs_interfaceid": "d29ea840-0505-4827-b11f-2caa7b0f6faa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:34:09 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:a3:80,bridge_name='br-int',has_traffic_filtering=True,id=d29ea840-0505-4827-b11f-2caa7b0f6faa,network=Network(00883fc4-0b74-4afd-9043-82e2933faab3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd29ea840-05') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:34:09 user nova-compute[74683]: DEBUG nova.objects.instance [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lazy-loading 'pci_devices' on Instance uuid 6d3528c9-50dd-4f9e-ab92-2f885662bff7 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:34:09 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:34:09 user nova-compute[74683]:   <uuid>6d3528c9-50dd-4f9e-ab92-2f885662bff7</uuid>
Oct 16 11:34:09 user nova-compute[74683]:   <name>instance-00000027</name>
Oct 16 11:34:09 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:34:09 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:34:09 user nova-compute[74683]:   <metadata>
Oct 16 11:34:09 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:34:09 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:34:09 user nova-compute[74683]:       <nova:name>tempest-TestVolumeBootPattern-server-835993735</nova:name>
Oct 16 11:34:09 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:34:07</nova:creationTime>
Oct 16 11:34:09 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:34:09 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:34:09 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:34:09 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:34:09 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:34:09 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:34:09 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:34:09 user nova-compute[74683]:       <nova:owner>
Oct 16 11:34:09 user nova-compute[74683]:         <nova:user uuid="a463a84e332543dfbc03b81518f82be1">tempest-TestVolumeBootPattern-953001121-project-member</nova:user>
Oct 16 11:34:09 user nova-compute[74683]:         <nova:project uuid="2aefabef9e42412f8309f490dcfecc79">tempest-TestVolumeBootPattern-953001121</nova:project>
Oct 16 11:34:09 user nova-compute[74683]:       </nova:owner>
Oct 16 11:34:09 user nova-compute[74683]:       <nova:ports>
Oct 16 11:34:09 user nova-compute[74683]:         <nova:port uuid="d29ea840-0505-4827-b11f-2caa7b0f6faa">
Oct 16 11:34:09 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 16 11:34:09 user nova-compute[74683]:         </nova:port>
Oct 16 11:34:09 user nova-compute[74683]:       </nova:ports>
Oct 16 11:34:09 user nova-compute[74683]:     </nova:instance>
Oct 16 11:34:09 user nova-compute[74683]:   </metadata>
Oct 16 11:34:09 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:34:09 user nova-compute[74683]:     <system>
Oct 16 11:34:09 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:34:09 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:34:09 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:34:09 user nova-compute[74683]:       <entry name="serial">6d3528c9-50dd-4f9e-ab92-2f885662bff7</entry>
Oct 16 11:34:09 user nova-compute[74683]:       <entry name="uuid">6d3528c9-50dd-4f9e-ab92-2f885662bff7</entry>
Oct 16 11:34:09 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:34:09 user nova-compute[74683]:     </system>
Oct 16 11:34:09 user nova-compute[74683]:   </sysinfo>
Oct 16 11:34:09 user nova-compute[74683]:   <os>
Oct 16 11:34:09 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:34:09 user nova-compute[74683]:     <boot dev="hd"/>
Oct 16 11:34:09 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:34:09 user nova-compute[74683]:   </os>
Oct 16 11:34:09 user nova-compute[74683]:   <features>
Oct 16 11:34:09 user nova-compute[74683]:     <acpi/>
Oct 16 11:34:09 user nova-compute[74683]:     <apic/>
Oct 16 11:34:09 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:34:09 user nova-compute[74683]:   </features>
Oct 16 11:34:09 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:34:09 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:34:09 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:34:09 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:34:09 user nova-compute[74683]:   </clock>
Oct 16 11:34:09 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:34:09 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:34:09 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:34:09 user nova-compute[74683]:   </cpu>
Oct 16 11:34:09 user nova-compute[74683]:   <devices>
Oct 16 11:34:09 user nova-compute[74683]:     <disk type="block" device="disk">
Oct 16 11:34:09 user nova-compute[74683]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:34:09 user nova-compute[74683]:       <source dev="/dev/sdc"/>
Oct 16 11:34:09 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:34:09 user nova-compute[74683]:       <serial>c6f05240-96d4-498f-9c29-f5888f6ed27f</serial>
Oct 16 11:34:09 user nova-compute[74683]:     </disk>
Oct 16 11:34:09 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:34:09 user nova-compute[74683]:       <mac address="fa:16:3e:12:a3:80"/>
Oct 16 11:34:09 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:34:09 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:34:09 user nova-compute[74683]:       <target dev="tapd29ea840-05"/>
Oct 16 11:34:09 user nova-compute[74683]:     </interface>
Oct 16 11:34:09 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:34:09 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/6d3528c9-50dd-4f9e-ab92-2f885662bff7/console.log" append="off"/>
Oct 16 11:34:09 user nova-compute[74683]:     </serial>
Oct 16 11:34:09 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:34:09 user nova-compute[74683]:     <video>
Oct 16 11:34:09 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:34:09 user nova-compute[74683]:     </video>
Oct 16 11:34:09 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:34:09 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:34:09 user nova-compute[74683]:     </rng>
Oct 16 11:34:09 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:34:09 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:34:09 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:34:09 user nova-compute[74683]:     </memballoon>
Oct 16 11:34:09 user nova-compute[74683]:   </devices>
Oct 16 11:34:09 user nova-compute[74683]: </domain>
Oct 16 11:34:09 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:34:09 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:33:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-835993735',display_name='tempest-TestVolumeBootPattern-server-835993735',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-835993735',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJbd1pnA0e+ubtg3c4vxF2Dxe/3H7OECUV6ZZvaa4rKNrKocz4jmO0SXeRO4F7NQHuYFrsF7rAUyRZ4V/U5HkEw1E5UZyfInFppdQCzqY7p8CVOHAXsTsTbK336AbWu7g==',key_name='tempest-TestVolumeBootPattern-1282364245',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2aefabef9e42412f8309f490dcfecc79',ramdisk_id='',reservation_id='r-3jw043ei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-953001121',owner_user_name='tempest-TestVolumeBootPattern-953001121-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:33:48Z,user_data=None,user_id='a463a84e332543dfbc03b81518f82be1',uuid=6d3528c9-50dd-4f9e-ab92-2f885662bff7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d29ea840-0505-4827-b11f-2caa7b0f6faa", "address": "fa:16:3e:12:a3:80", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd29ea840-05", "ovs_interfaceid": "d29ea840-0505-4827-b11f-2caa7b0f6faa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:34:09 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Converting VIF {"id": "d29ea840-0505-4827-b11f-2caa7b0f6faa", "address": "fa:16:3e:12:a3:80", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd29ea840-05", "ovs_interfaceid": "d29ea840-0505-4827-b11f-2caa7b0f6faa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:34:09 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:a3:80,bridge_name='br-int',has_traffic_filtering=True,id=d29ea840-0505-4827-b11f-2caa7b0f6faa,network=Network(00883fc4-0b74-4afd-9043-82e2933faab3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd29ea840-05') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:34:09 user nova-compute[74683]: DEBUG os_vif [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:a3:80,bridge_name='br-int',has_traffic_filtering=True,id=d29ea840-0505-4827-b11f-2caa7b0f6faa,network=Network(00883fc4-0b74-4afd-9043-82e2933faab3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd29ea840-05') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:34:09 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:09 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:34:09 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:34:09 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:09 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f2104a3f-3c2d-588a-af35-3e8425e346b8', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:34:09 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:09 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:34:09 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:09 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd29ea840-05, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:34:09 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd29ea840-05, col_values=(('qos', UUID('7ea19daf-770d-4a06-979d-4f3086bd1702')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:34:09 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd29ea840-05, col_values=(('external_ids', {'iface-id': 'd29ea840-0505-4827-b11f-2caa7b0f6faa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:a3:80', 'vm-uuid': '6d3528c9-50dd-4f9e-ab92-2f885662bff7'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:34:09 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:09 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:34:09 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:09 user nova-compute[74683]: INFO os_vif [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:a3:80,bridge_name='br-int',has_traffic_filtering=True,id=d29ea840-0505-4827-b11f-2caa7b0f6faa,network=Network(00883fc4-0b74-4afd-9043-82e2933faab3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd29ea840-05')
Oct 16 11:34:09 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:34:09 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] No VIF found with MAC fa:16:3e:12:a3:80, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:34:10 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:10 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:10 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:10 user nova-compute[74683]: DEBUG nova.compute.manager [req-604bb845-7d5b-4239-b9f2-75cce23af2c1 req-15f780a4-359b-4b7f-a68b-8f00571335ee service nova] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Received event network-vif-plugged-d29ea840-0505-4827-b11f-2caa7b0f6faa {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:34:10 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-604bb845-7d5b-4239-b9f2-75cce23af2c1 req-15f780a4-359b-4b7f-a68b-8f00571335ee service nova] Acquiring lock "6d3528c9-50dd-4f9e-ab92-2f885662bff7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:34:10 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-604bb845-7d5b-4239-b9f2-75cce23af2c1 req-15f780a4-359b-4b7f-a68b-8f00571335ee service nova] Lock "6d3528c9-50dd-4f9e-ab92-2f885662bff7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:34:10 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-604bb845-7d5b-4239-b9f2-75cce23af2c1 req-15f780a4-359b-4b7f-a68b-8f00571335ee service nova] Lock "6d3528c9-50dd-4f9e-ab92-2f885662bff7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:34:10 user nova-compute[74683]: DEBUG nova.compute.manager [req-604bb845-7d5b-4239-b9f2-75cce23af2c1 req-15f780a4-359b-4b7f-a68b-8f00571335ee service nova] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] No waiting events found dispatching network-vif-plugged-d29ea840-0505-4827-b11f-2caa7b0f6faa {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:34:10 user nova-compute[74683]: WARNING nova.compute.manager [req-604bb845-7d5b-4239-b9f2-75cce23af2c1 req-15f780a4-359b-4b7f-a68b-8f00571335ee service nova] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Received unexpected event network-vif-plugged-d29ea840-0505-4827-b11f-2caa7b0f6faa for instance with vm_state building and task_state spawning.
Oct 16 11:34:11 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:11 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:11 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:12 user nova-compute[74683]: DEBUG nova.compute.manager [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Instance event wait completed in 0 seconds for  {{(pid=74683) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 11:34:12 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Guest created on hypervisor {{(pid=74683) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 11:34:12 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Instance spawned successfully.
Oct 16 11:34:12 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 11:34:12 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Found default for hw_cdrom_bus of ide {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:34:12 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Found default for hw_disk_bus of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:34:12 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Found default for hw_input_bus of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:34:12 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Found default for hw_pointer_model of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:34:12 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Found default for hw_video_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:34:12 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Found default for hw_vif_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:34:12 user nova-compute[74683]: DEBUG nova.compute.manager [req-b6d13a7a-e81d-4461-9a0b-3a38b4387cf7 req-ee93aaaf-bb41-45cb-b768-1747ede264a4 service nova] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Received event network-vif-plugged-d29ea840-0505-4827-b11f-2caa7b0f6faa {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:34:12 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b6d13a7a-e81d-4461-9a0b-3a38b4387cf7 req-ee93aaaf-bb41-45cb-b768-1747ede264a4 service nova] Acquiring lock "6d3528c9-50dd-4f9e-ab92-2f885662bff7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:34:12 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b6d13a7a-e81d-4461-9a0b-3a38b4387cf7 req-ee93aaaf-bb41-45cb-b768-1747ede264a4 service nova] Lock "6d3528c9-50dd-4f9e-ab92-2f885662bff7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:34:12 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b6d13a7a-e81d-4461-9a0b-3a38b4387cf7 req-ee93aaaf-bb41-45cb-b768-1747ede264a4 service nova] Lock "6d3528c9-50dd-4f9e-ab92-2f885662bff7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:34:12 user nova-compute[74683]: DEBUG nova.compute.manager [req-b6d13a7a-e81d-4461-9a0b-3a38b4387cf7 req-ee93aaaf-bb41-45cb-b768-1747ede264a4 service nova] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] No waiting events found dispatching network-vif-plugged-d29ea840-0505-4827-b11f-2caa7b0f6faa {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:34:12 user nova-compute[74683]: WARNING nova.compute.manager [req-b6d13a7a-e81d-4461-9a0b-3a38b4387cf7 req-ee93aaaf-bb41-45cb-b768-1747ede264a4 service nova] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Received unexpected event network-vif-plugged-d29ea840-0505-4827-b11f-2caa7b0f6faa for instance with vm_state building and task_state spawning.
Oct 16 11:34:12 user nova-compute[74683]: INFO nova.compute.manager [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Took 5.27 seconds to spawn the instance on the hypervisor.
Oct 16 11:34:12 user nova-compute[74683]: DEBUG nova.compute.manager [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:34:13 user nova-compute[74683]: INFO nova.compute.manager [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Took 25.38 seconds to build instance.
Oct 16 11:34:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-017690e3-5583-4f86-8564-76a095e6eac3 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "6d3528c9-50dd-4f9e-ab92-2f885662bff7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.493s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:34:13 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:34:13 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Cleaning up deleted instances with incomplete migration  {{(pid=74683) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 16 11:34:14 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:14 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:34:16 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:34:16 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Starting heal instance info cache {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 11:34:16 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Rebuilding the list of instances to heal {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 11:34:16 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "refresh_cache-edd01413-1f8a-49e3-aa3c-ecb19c62afae" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:34:16 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquired lock "refresh_cache-edd01413-1f8a-49e3-aa3c-ecb19c62afae" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:34:16 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Forcefully refreshing network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 11:34:16 user nova-compute[74683]: DEBUG nova.objects.instance [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lazy-loading 'info_cache' on Instance uuid edd01413-1f8a-49e3-aa3c-ecb19c62afae {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:34:16 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:17 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Updating instance_info_cache with network_info: [{"id": "7ba36bb4-91c7-42ee-b592-6653e63a1d50", "address": "fa:16:3e:b4:d6:37", "network": {"id": "cd8cf08c-d79c-4d2e-b849-640c440e1498", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1091743670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcb8da41d6584a689e9b50155288aa5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba36bb4-91", "ovs_interfaceid": "7ba36bb4-91c7-42ee-b592-6653e63a1d50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:34:17 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Releasing lock "refresh_cache-edd01413-1f8a-49e3-aa3c-ecb19c62afae" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:34:17 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Updated the network info_cache for instance {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 11:34:17 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:34:17 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:34:17 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:34:19 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:20 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:20 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:34:21 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:34:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:22 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:34:22 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74683) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 11:34:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:23 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:34:23 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:34:23 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:34:23 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:34:23 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:34:23 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Auditing locally available compute resources for user (node: user) {{(pid=74683) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 11:34:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:34:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:34:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:34:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:34:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:34:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:34:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:34:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:34:24 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:34:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ece51b6-5cb3-4d79-acdb-ea4d895cdce8/disk.rescue --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:34:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ece51b6-5cb3-4d79-acdb-ea4d895cdce8/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:34:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ece51b6-5cb3-4d79-acdb-ea4d895cdce8/disk.rescue --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:34:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ece51b6-5cb3-4d79-acdb-ea4d895cdce8/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:34:25 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /opt/stack/data/nova/instances/9ece51b6-5cb3-4d79-acdb-ea4d895cdce8/disk (vdb) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:34:25 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:34:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.rescue --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:34:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:34:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.rescue --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:34:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.rescue --force-share --output=json" returned: 0 in 0.224s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:34:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:34:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:34:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:34:25 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-753e873f-382d-4084-a537-cd47ca593dee tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Calling os-brick to attach iSCSI Volume {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 11:34:25 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-753e873f-382d-4084-a537-cd47ca593dee tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JjfbFZCq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:34:25 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-753e873f-382d-4084-a537-cd47ca593dee tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:34:25 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-753e873f-382d-4084-a537-cd47ca593dee tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:34:25 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-753e873f-382d-4084-a537-cd47ca593dee tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:34:25 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-753e873f-382d-4084-a537-cd47ca593dee tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:34:25 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-753e873f-382d-4084-a537-cd47ca593dee tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:34:25 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-753e873f-382d-4084-a537-cd47ca593dee tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:34:25 user nova-compute[74683]: INFO os_brick.initiator.connectors.iscsi [None req-753e873f-382d-4084-a537-cd47ca593dee tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 11:34:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e -p 172.16.0.220:3260 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:34:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:34:25 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa4902c-d05f-4954-b93e-33efcbbc50d0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:34:25 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-753e873f-382d-4084-a537-cd47ca593dee tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 11:34:25 user nova-compute[74683]:  {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:34:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e -p 172.16.0.220:3260 --interface default --op new {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:34:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:34:25 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d138fa-f1aa-4fdd-9a64-6e8ebd65647f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e] added\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:34:25 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-753e873f-382d-4084-a537-cd47ca593dee tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e] added
Oct 16 11:34:25 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:34:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:34:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:34:25 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0648adf-612e-4169-b7e8-4b3ccbbf8efe]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:34:25 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-753e873f-382d-4084-a537-cd47ca593dee tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:34:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:34:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:34:26 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51dfc68-e76d-4348-bece-16450b4ab1e9]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:34:26 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-753e873f-382d-4084-a537-cd47ca593dee tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:34:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JjfbFZCq {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:34:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JjfbFZCq" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:34:26 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[32265f65-20e3-47e1-8ec6-bf4a5ae28ce8]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:34:26 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-753e873f-382d-4084-a537-cd47ca593dee tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JjfbFZCq'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:34:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:34:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.036s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:34:26 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a732afed-d555-4fbb-bf85-f864895f2699]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:34:26 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-753e873f-382d-4084-a537-cd47ca593dee tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:34:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:34:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:34:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:34:26 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0d8aa0-2b22-4387-ac7f-2f841e7ebecf]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:34:26 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-753e873f-382d-4084-a537-cd47ca593dee tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b (non-flash)
Oct 16 11:34:26 user nova-compute[74683]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)
Oct 16 11:34:26 user nova-compute[74683]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)
Oct 16 11:34:26 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:34:26 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-753e873f-382d-4084-a537-cd47ca593dee tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b (non-flash)
Oct 16 11:34:26 user nova-compute[74683]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)
Oct 16 11:34:26 user nova-compute[74683]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)
Oct 16 11:34:26 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:34:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e -p 172.16.0.220:3260 --login {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:34:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:34:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:34:26 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[5499c776-c189-4bc1-9a7d-773a6b6928e1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:34:26 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-753e873f-382d-4084-a537-cd47ca593dee tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e, portal: 172.16.0.220,3260]
Oct 16 11:34:26 user nova-compute[74683]: Login to [iface: default, target: iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e, portal: 172.16.0.220,3260] successful.
Oct 16 11:34:26 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:34:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:34:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:34:26 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[156c1385-1b5d-4be9-a6e4-2d2a5dd81de3]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:34:26 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-753e873f-382d-4084-a537-cd47ca593dee tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:34:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:34:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:34:26 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad7642a-67f9-481b-aa12-71ac5b23561f]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:34:26 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-753e873f-382d-4084-a537-cd47ca593dee tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b (non-flash)
Oct 16 11:34:26 user nova-compute[74683]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)
Oct 16 11:34:26 user nova-compute[74683]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)
Oct 16 11:34:26 user nova-compute[74683]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e (non-flash)
Oct 16 11:34:26 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:34:26 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-753e873f-382d-4084-a537-cd47ca593dee tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b (non-flash)
Oct 16 11:34:26 user nova-compute[74683]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)
Oct 16 11:34:26 user nova-compute[74683]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)
Oct 16 11:34:26 user nova-compute[74683]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e (non-flash)
Oct 16 11:34:26 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:34:26 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-753e873f-382d-4084-a537-cd47ca593dee tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:34:26 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-753e873f-382d-4084-a537-cd47ca593dee tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Connected to 172.16.0.220:3260 {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 11:34:26 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-753e873f-382d-4084-a537-cd47ca593dee tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] HCTL ('36', '-', '-', 0) found on session 41 with lun 0 {{(pid=74683) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 11:34:26 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-753e873f-382d-4084-a537-cd47ca593dee tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74683) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 11:34:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:34:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:34:26 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7789fc-64a8-4925-a8d1-8409a27b537a]: (4, ('- - 0', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:34:26 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-753e873f-382d-4084-a537-cd47ca593dee tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Searching for a device in session 41 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:34:26 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-753e873f-382d-4084-a537-cd47ca593dee tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JjfbFZCq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 11:34:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:34:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:34:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:34:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d2a30dc-36e8-4582-a236-821e9f87a687/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:34:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d2a30dc-36e8-4582-a236-821e9f87a687/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:34:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d2a30dc-36e8-4582-a236-821e9f87a687/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:34:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d2a30dc-36e8-4582-a236-821e9f87a687/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:34:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:27 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-753e873f-382d-4084-a537-cd47ca593dee tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.618s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:34:27 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-753e873f-382d-4084-a537-cd47ca593dee tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] <== connect_volume: return (1620ms) {'type': 'block', 'scsi_wwn': '26630613737363966', 'path': '/dev/sde'} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:34:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-753e873f-382d-4084-a537-cd47ca593dee tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630613737363966', 'path': '/dev/sde'} {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 11:34:27 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:34:27 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:34:27 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Hypervisor/Node resource view: name=user free_ram=7820MB free_disk=25.19910430908203GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74683) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 11:34:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:34:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:34:27 user nova-compute[74683]: DEBUG nova.objects.instance [None req-753e873f-382d-4084-a537-cd47ca593dee tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lazy-loading 'flavor' on Instance uuid f5ad764c-638d-4dac-b032-6680917e46df {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:34:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-753e873f-382d-4084-a537-cd47ca593dee tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 11:34:27 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:34:27 user nova-compute[74683]:   <source dev="/dev/sde"/>
Oct 16 11:34:27 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:34:27 user nova-compute[74683]:   <serial>22c582f7-e7ab-4c14-a3e5-2d52b953051e</serial>
Oct 16 11:34:27 user nova-compute[74683]: </disk>
Oct 16 11:34:27 user nova-compute[74683]:  {{(pid=74683) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 11:34:27 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Applying migration context for instance 43d35d0e-acc5-4076-8641-73b4704f1028 as it has an incoming, in-progress migration 32b4eb0a-efa9-489c-ad77-be06c666769f. Migration status is finished {{(pid=74683) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 16 11:34:27 user nova-compute[74683]: INFO nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Updating resource usage from migration 32b4eb0a-efa9-489c-ad77-be06c666769f
Oct 16 11:34:27 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance edd01413-1f8a-49e3-aa3c-ecb19c62afae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:34:27 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 9b8ba94f-43cc-4f06-bcd9-83935ccbe117 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:34:27 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance b91af786-36e3-4815-811f-fb3c055e758d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:34:27 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:34:27 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance f5ad764c-638d-4dac-b032-6680917e46df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:34:27 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Migration 32b4eb0a-efa9-489c-ad77-be06c666769f is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 16 11:34:27 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 43d35d0e-acc5-4076-8641-73b4704f1028 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:34:27 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 6d2a30dc-36e8-4582-a236-821e9f87a687 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:34:27 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 6d3528c9-50dd-4f9e-ab92-2f885662bff7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:34:27 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 11:34:27 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 11:34:28 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Refreshing inventories for resource provider 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 16 11:34:28 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Updating ProviderTree inventory for provider 7142d606-df50-4cbe-b5ed-1802caa31862 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 16 11:34:28 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Updating inventory in ProviderTree for provider 7142d606-df50-4cbe-b5ed-1802caa31862 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 16 11:34:28 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Refreshing aggregate associations for resource provider 7142d606-df50-4cbe-b5ed-1802caa31862, aggregates: None {{(pid=74683) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 16 11:34:28 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Refreshing trait associations for resource provider 7142d606-df50-4cbe-b5ed-1802caa31862, traits: COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VMVGA {{(pid=74683) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 16 11:34:28 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-753e873f-382d-4084-a537-cd47ca593dee tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:34:28 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-753e873f-382d-4084-a537-cd47ca593dee tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:34:28 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-753e873f-382d-4084-a537-cd47ca593dee tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] No VIF found with MAC fa:16:3e:c8:02:4d, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:34:28 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-753e873f-382d-4084-a537-cd47ca593dee tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "f5ad764c-638d-4dac-b032-6680917e46df" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.184s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:34:28 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:34:28 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:34:28 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Compute_service record updated for user:user {{(pid=74683) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 11:34:28 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.056s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:34:28 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:34:28 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Cleaning up deleted instances {{(pid=74683) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 16 11:34:28 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] There are 0 instances to clean {{(pid=74683) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 16 11:34:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-d17e0453-f4dc-4276-b0f6-186c43ebeba7 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Acquiring lock "f5ad764c-638d-4dac-b032-6680917e46df" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:34:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-d17e0453-f4dc-4276-b0f6-186c43ebeba7 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "f5ad764c-638d-4dac-b032-6680917e46df" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:34:29 user nova-compute[74683]: DEBUG nova.compute.manager [None req-d17e0453-f4dc-4276-b0f6-186c43ebeba7 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:34:29 user nova-compute[74683]: DEBUG nova.compute.manager [None req-d17e0453-f4dc-4276-b0f6-186c43ebeba7 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74683) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Oct 16 11:34:29 user nova-compute[74683]: DEBUG nova.objects.instance [None req-d17e0453-f4dc-4276-b0f6-186c43ebeba7 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lazy-loading 'flavor' on Instance uuid f5ad764c-638d-4dac-b032-6680917e46df {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:34:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:34:29 user nova-compute[74683]: DEBUG nova.compute.manager [req-c40fb1a8-55f2-4ab1-a011-59e38c73b999 req-7def49b1-96ad-43c3-b1da-ef9fe332093e service nova] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Received event network-vif-unplugged-eb80f49f-da30-478a-900a-5d3da8ec7fa9 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:34:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c40fb1a8-55f2-4ab1-a011-59e38c73b999 req-7def49b1-96ad-43c3-b1da-ef9fe332093e service nova] Acquiring lock "f5ad764c-638d-4dac-b032-6680917e46df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:34:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c40fb1a8-55f2-4ab1-a011-59e38c73b999 req-7def49b1-96ad-43c3-b1da-ef9fe332093e service nova] Lock "f5ad764c-638d-4dac-b032-6680917e46df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:34:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c40fb1a8-55f2-4ab1-a011-59e38c73b999 req-7def49b1-96ad-43c3-b1da-ef9fe332093e service nova] Lock "f5ad764c-638d-4dac-b032-6680917e46df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:34:29 user nova-compute[74683]: DEBUG nova.compute.manager [req-c40fb1a8-55f2-4ab1-a011-59e38c73b999 req-7def49b1-96ad-43c3-b1da-ef9fe332093e service nova] [instance: f5ad764c-638d-4dac-b032-6680917e46df] No waiting events found dispatching network-vif-unplugged-eb80f49f-da30-478a-900a-5d3da8ec7fa9 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:34:29 user nova-compute[74683]: WARNING nova.compute.manager [req-c40fb1a8-55f2-4ab1-a011-59e38c73b999 req-7def49b1-96ad-43c3-b1da-ef9fe332093e service nova] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Received unexpected event network-vif-unplugged-eb80f49f-da30-478a-900a-5d3da8ec7fa9 for instance with vm_state active and task_state powering-off.
Oct 16 11:34:29 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Instance destroyed successfully.
Oct 16 11:34:29 user nova-compute[74683]: DEBUG nova.compute.manager [None req-d17e0453-f4dc-4276-b0f6-186c43ebeba7 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:34:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-d17e0453-f4dc-4276-b0f6-186c43ebeba7 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "f5ad764c-638d-4dac-b032-6680917e46df" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.876s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:34:30 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:31 user nova-compute[74683]: DEBUG nova.compute.manager [req-1daf772c-e09a-4bcc-81ff-30cdcd50a2d6 req-5cac8d4d-57e4-499f-992a-47d1777652e4 service nova] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Received event network-vif-plugged-eb80f49f-da30-478a-900a-5d3da8ec7fa9 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:34:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-1daf772c-e09a-4bcc-81ff-30cdcd50a2d6 req-5cac8d4d-57e4-499f-992a-47d1777652e4 service nova] Acquiring lock "f5ad764c-638d-4dac-b032-6680917e46df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:34:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-1daf772c-e09a-4bcc-81ff-30cdcd50a2d6 req-5cac8d4d-57e4-499f-992a-47d1777652e4 service nova] Lock "f5ad764c-638d-4dac-b032-6680917e46df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:34:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-1daf772c-e09a-4bcc-81ff-30cdcd50a2d6 req-5cac8d4d-57e4-499f-992a-47d1777652e4 service nova] Lock "f5ad764c-638d-4dac-b032-6680917e46df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:34:31 user nova-compute[74683]: DEBUG nova.compute.manager [req-1daf772c-e09a-4bcc-81ff-30cdcd50a2d6 req-5cac8d4d-57e4-499f-992a-47d1777652e4 service nova] [instance: f5ad764c-638d-4dac-b032-6680917e46df] No waiting events found dispatching network-vif-plugged-eb80f49f-da30-478a-900a-5d3da8ec7fa9 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:34:31 user nova-compute[74683]: WARNING nova.compute.manager [req-1daf772c-e09a-4bcc-81ff-30cdcd50a2d6 req-5cac8d4d-57e4-499f-992a-47d1777652e4 service nova] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Received unexpected event network-vif-plugged-eb80f49f-da30-478a-900a-5d3da8ec7fa9 for instance with vm_state stopped and task_state None.
Oct 16 11:34:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:32 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Acquiring lock "7bf62c7a-fa86-4e13-bc28-13d8cb2918da" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:34:32 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Lock "7bf62c7a-fa86-4e13-bc28-13d8cb2918da" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:34:32 user nova-compute[74683]: DEBUG nova.compute.manager [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] [instance: 7bf62c7a-fa86-4e13-bc28-13d8cb2918da] Starting instance... {{(pid=74683) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 11:34:32 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:34:32 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:34:32 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74683) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 11:34:32 user nova-compute[74683]: INFO nova.compute.claims [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] [instance: 7bf62c7a-fa86-4e13-bc28-13d8cb2918da] Claim successful on node user
Oct 16 11:34:32 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:34:32 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:34:32 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.424s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:34:32 user nova-compute[74683]: DEBUG nova.compute.manager [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] [instance: 7bf62c7a-fa86-4e13-bc28-13d8cb2918da] Start building networks asynchronously for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 11:34:32 user nova-compute[74683]: DEBUG nova.compute.manager [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] [instance: 7bf62c7a-fa86-4e13-bc28-13d8cb2918da] Allocating IP information in the background. {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 11:34:32 user nova-compute[74683]: DEBUG nova.network.neutron [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] [instance: 7bf62c7a-fa86-4e13-bc28-13d8cb2918da] allocate_for_instance() {{(pid=74683) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 11:34:32 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] [instance: 7bf62c7a-fa86-4e13-bc28-13d8cb2918da] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 11:34:32 user nova-compute[74683]: DEBUG nova.compute.manager [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] [instance: 7bf62c7a-fa86-4e13-bc28-13d8cb2918da] Start building block device mappings for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 11:34:32 user nova-compute[74683]: DEBUG nova.policy [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '23509d4ea2334af2ab26c4dcb4baefec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18948f1fc0fc457dac3df9cd93caf2a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74683) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 11:34:32 user nova-compute[74683]: DEBUG nova.compute.manager [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] [instance: 7bf62c7a-fa86-4e13-bc28-13d8cb2918da] Start spawning the instance on the hypervisor. {{(pid=74683) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 11:34:32 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] [instance: 7bf62c7a-fa86-4e13-bc28-13d8cb2918da] Creating instance directory {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 11:34:32 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] [instance: 7bf62c7a-fa86-4e13-bc28-13d8cb2918da] Creating image(s)
Oct 16 11:34:32 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Acquiring lock "/opt/stack/data/nova/instances/7bf62c7a-fa86-4e13-bc28-13d8cb2918da/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:34:32 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Lock "/opt/stack/data/nova/instances/7bf62c7a-fa86-4e13-bc28-13d8cb2918da/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:34:32 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Lock "/opt/stack/data/nova/instances/7bf62c7a-fa86-4e13-bc28-13d8cb2918da/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:34:32 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:34:33 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.189s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:34:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Acquiring lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:34:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:34:33 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:34:33 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.189s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:34:33 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/7bf62c7a-fa86-4e13-bc28-13d8cb2918da/disk 1073741824 {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:34:33 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/7bf62c7a-fa86-4e13-bc28-13d8cb2918da/disk 1073741824" returned: 0 in 0.086s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:34:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:34:33 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:34:33 user nova-compute[74683]: DEBUG nova.network.neutron [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] [instance: 7bf62c7a-fa86-4e13-bc28-13d8cb2918da] Successfully created port: 6153c4bd-b883-4dc2-8bcf-be08fb965888 {{(pid=74683) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 11:34:33 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.187s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:34:33 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7bf62c7a-fa86-4e13-bc28-13d8cb2918da/disk. size=1073741824 {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 11:34:33 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf62c7a-fa86-4e13-bc28-13d8cb2918da/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:34:33 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf62c7a-fa86-4e13-bc28-13d8cb2918da/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:34:33 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Cannot resize image /opt/stack/data/nova/instances/7bf62c7a-fa86-4e13-bc28-13d8cb2918da/disk to a smaller size. {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 11:34:33 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] [instance: 7bf62c7a-fa86-4e13-bc28-13d8cb2918da] Created local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 11:34:33 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] [instance: 7bf62c7a-fa86-4e13-bc28-13d8cb2918da] Ensure instance console log exists: /opt/stack/data/nova/instances/7bf62c7a-fa86-4e13-bc28-13d8cb2918da/console.log {{(pid=74683) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 11:34:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:34:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:34:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:34:34 user nova-compute[74683]: DEBUG nova.network.neutron [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] [instance: 7bf62c7a-fa86-4e13-bc28-13d8cb2918da] Successfully updated port: 6153c4bd-b883-4dc2-8bcf-be08fb965888 {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:34:34 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Acquiring lock "refresh_cache-7bf62c7a-fa86-4e13-bc28-13d8cb2918da" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:34:34 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Acquired lock "refresh_cache-7bf62c7a-fa86-4e13-bc28-13d8cb2918da" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:34:34 user nova-compute[74683]: DEBUG nova.network.neutron [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] [instance: 7bf62c7a-fa86-4e13-bc28-13d8cb2918da] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:34:34 user nova-compute[74683]: DEBUG nova.compute.manager [req-9b4c0a57-61ce-45af-b807-eda17fd0eb38 req-7d1d3034-fee1-4db9-b73b-ddc9d7fc61cf service nova] [instance: 7bf62c7a-fa86-4e13-bc28-13d8cb2918da] Received event network-changed-6153c4bd-b883-4dc2-8bcf-be08fb965888 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:34:34 user nova-compute[74683]: DEBUG nova.compute.manager [req-9b4c0a57-61ce-45af-b807-eda17fd0eb38 req-7d1d3034-fee1-4db9-b73b-ddc9d7fc61cf service nova] [instance: 7bf62c7a-fa86-4e13-bc28-13d8cb2918da] Refreshing instance network info cache due to event network-changed-6153c4bd-b883-4dc2-8bcf-be08fb965888. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:34:34 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-9b4c0a57-61ce-45af-b807-eda17fd0eb38 req-7d1d3034-fee1-4db9-b73b-ddc9d7fc61cf service nova] Acquiring lock "refresh_cache-7bf62c7a-fa86-4e13-bc28-13d8cb2918da" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:34:34 user nova-compute[74683]: DEBUG nova.network.neutron [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] [instance: 7bf62c7a-fa86-4e13-bc28-13d8cb2918da] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:34:34 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:34 user nova-compute[74683]: DEBUG nova.network.neutron [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] [instance: 7bf62c7a-fa86-4e13-bc28-13d8cb2918da] Updating instance_info_cache with network_info: [{"id": "6153c4bd-b883-4dc2-8bcf-be08fb965888", "address": "fa:16:3e:64:83:a1", "network": {"id": "ee1095ab-9f66-4034-9bd2-e93214db8fef", "bridge": "br-int", "label": "tempest-VolumesActionsTest-643747526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18948f1fc0fc457dac3df9cd93caf2a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6153c4bd-b8", "ovs_interfaceid": "6153c4bd-b883-4dc2-8bcf-be08fb965888", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:34:34 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Releasing lock "refresh_cache-7bf62c7a-fa86-4e13-bc28-13d8cb2918da" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:34:34 user nova-compute[74683]: DEBUG nova.compute.manager [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] [instance: 7bf62c7a-fa86-4e13-bc28-13d8cb2918da] Instance network_info: |[{"id": "6153c4bd-b883-4dc2-8bcf-be08fb965888", "address": "fa:16:3e:64:83:a1", "network": {"id": "ee1095ab-9f66-4034-9bd2-e93214db8fef", "bridge": "br-int", "label": "tempest-VolumesActionsTest-643747526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18948f1fc0fc457dac3df9cd93caf2a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6153c4bd-b8", "ovs_interfaceid": "6153c4bd-b883-4dc2-8bcf-be08fb965888", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 11:34:34 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-9b4c0a57-61ce-45af-b807-eda17fd0eb38 req-7d1d3034-fee1-4db9-b73b-ddc9d7fc61cf service nova] Acquired lock "refresh_cache-7bf62c7a-fa86-4e13-bc28-13d8cb2918da" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:34:34 user nova-compute[74683]: DEBUG nova.network.neutron [req-9b4c0a57-61ce-45af-b807-eda17fd0eb38 req-7d1d3034-fee1-4db9-b73b-ddc9d7fc61cf service nova] [instance: 7bf62c7a-fa86-4e13-bc28-13d8cb2918da] Refreshing network info cache for port 6153c4bd-b883-4dc2-8bcf-be08fb965888 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:34:34 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] [instance: 7bf62c7a-fa86-4e13-bc28-13d8cb2918da] Start _get_guest_xml network_info=[{"id": "6153c4bd-b883-4dc2-8bcf-be08fb965888", "address": "fa:16:3e:64:83:a1", "network": {"id": "ee1095ab-9f66-4034-9bd2-e93214db8fef", "bridge": "br-int", "label": "tempest-VolumesActionsTest-643747526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18948f1fc0fc457dac3df9cd93caf2a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6153c4bd-b8", "ovs_interfaceid": "6153c4bd-b883-4dc2-8bcf-be08fb965888", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:34:34 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:34:34 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:34:34 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:34:34 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:34:34 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:34:34 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:34:34 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:34:34 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:34:34 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:34:34 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:34:34 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:34:34 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:34:34 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:34:34 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:34:34 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:34:34 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:34:34 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:34:34 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:34:34 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:34:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1307592261',display_name='tempest-VolumesActionsTest-instance-1307592261',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1307592261',id=40,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18948f1fc0fc457dac3df9cd93caf2a2',ramdisk_id='',reservation_id='r-70hrf83f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-602760708',owner_user_name='tempest-VolumesActionsTest-602760708-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:34:33Z,user_data=None,user_id='23509d4ea2334af2ab26c4dcb4baefec',uuid=7bf62c7a-fa86-4e13-bc28-13d8cb2918da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6153c4bd-b883-4dc2-8bcf-be08fb965888", "address": "fa:16:3e:64:83:a1", "network": {"id": "ee1095ab-9f66-4034-9bd2-e93214db8fef", "bridge": "br-int", "label": "tempest-VolumesActionsTest-643747526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18948f1fc0fc457dac3df9cd93caf2a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6153c4bd-b8", "ovs_interfaceid": "6153c4bd-b883-4dc2-8bcf-be08fb965888", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:34:34 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Converting VIF {"id": "6153c4bd-b883-4dc2-8bcf-be08fb965888", "address": "fa:16:3e:64:83:a1", "network": {"id": "ee1095ab-9f66-4034-9bd2-e93214db8fef", "bridge": "br-int", "label": "tempest-VolumesActionsTest-643747526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18948f1fc0fc457dac3df9cd93caf2a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6153c4bd-b8", "ovs_interfaceid": "6153c4bd-b883-4dc2-8bcf-be08fb965888", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:34:34 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:83:a1,bridge_name='br-int',has_traffic_filtering=True,id=6153c4bd-b883-4dc2-8bcf-be08fb965888,network=Network(ee1095ab-9f66-4034-9bd2-e93214db8fef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6153c4bd-b8') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:34:34 user nova-compute[74683]: DEBUG nova.objects.instance [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Lazy-loading 'pci_devices' on Instance uuid 7bf62c7a-fa86-4e13-bc28-13d8cb2918da {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:34:34 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] [instance: 7bf62c7a-fa86-4e13-bc28-13d8cb2918da] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:34:34 user nova-compute[74683]:   <uuid>7bf62c7a-fa86-4e13-bc28-13d8cb2918da</uuid>
Oct 16 11:34:34 user nova-compute[74683]:   <name>instance-00000028</name>
Oct 16 11:34:34 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:34:34 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:34:34 user nova-compute[74683]:   <metadata>
Oct 16 11:34:34 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:34:34 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:34:34 user nova-compute[74683]:       <nova:name>tempest-VolumesActionsTest-instance-1307592261</nova:name>
Oct 16 11:34:34 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:34:34</nova:creationTime>
Oct 16 11:34:34 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:34:34 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:34:34 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:34:34 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:34:34 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:34:34 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:34:34 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:34:34 user nova-compute[74683]:       <nova:owner>
Oct 16 11:34:34 user nova-compute[74683]:         <nova:user uuid="23509d4ea2334af2ab26c4dcb4baefec">tempest-VolumesActionsTest-602760708-project-member</nova:user>
Oct 16 11:34:34 user nova-compute[74683]:         <nova:project uuid="18948f1fc0fc457dac3df9cd93caf2a2">tempest-VolumesActionsTest-602760708</nova:project>
Oct 16 11:34:34 user nova-compute[74683]:       </nova:owner>
Oct 16 11:34:34 user nova-compute[74683]:       <nova:root type="image" uuid="0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f"/>
Oct 16 11:34:34 user nova-compute[74683]:       <nova:ports>
Oct 16 11:34:34 user nova-compute[74683]:         <nova:port uuid="6153c4bd-b883-4dc2-8bcf-be08fb965888">
Oct 16 11:34:34 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 16 11:34:34 user nova-compute[74683]:         </nova:port>
Oct 16 11:34:34 user nova-compute[74683]:       </nova:ports>
Oct 16 11:34:34 user nova-compute[74683]:     </nova:instance>
Oct 16 11:34:34 user nova-compute[74683]:   </metadata>
Oct 16 11:34:34 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:34:34 user nova-compute[74683]:     <system>
Oct 16 11:34:34 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:34:34 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:34:34 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:34:34 user nova-compute[74683]:       <entry name="serial">7bf62c7a-fa86-4e13-bc28-13d8cb2918da</entry>
Oct 16 11:34:34 user nova-compute[74683]:       <entry name="uuid">7bf62c7a-fa86-4e13-bc28-13d8cb2918da</entry>
Oct 16 11:34:34 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:34:34 user nova-compute[74683]:     </system>
Oct 16 11:34:34 user nova-compute[74683]:   </sysinfo>
Oct 16 11:34:34 user nova-compute[74683]:   <os>
Oct 16 11:34:34 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:34:34 user nova-compute[74683]:     <boot dev="hd"/>
Oct 16 11:34:34 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:34:34 user nova-compute[74683]:   </os>
Oct 16 11:34:34 user nova-compute[74683]:   <features>
Oct 16 11:34:34 user nova-compute[74683]:     <acpi/>
Oct 16 11:34:34 user nova-compute[74683]:     <apic/>
Oct 16 11:34:34 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:34:34 user nova-compute[74683]:   </features>
Oct 16 11:34:34 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:34:34 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:34:34 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:34:34 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:34:34 user nova-compute[74683]:   </clock>
Oct 16 11:34:34 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:34:34 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:34:34 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:34:34 user nova-compute[74683]:   </cpu>
Oct 16 11:34:34 user nova-compute[74683]:   <devices>
Oct 16 11:34:34 user nova-compute[74683]:     <disk type="file" device="disk">
Oct 16 11:34:34 user nova-compute[74683]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 11:34:34 user nova-compute[74683]:       <source file="/opt/stack/data/nova/instances/7bf62c7a-fa86-4e13-bc28-13d8cb2918da/disk"/>
Oct 16 11:34:34 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:34:34 user nova-compute[74683]:     </disk>
Oct 16 11:34:34 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:34:34 user nova-compute[74683]:       <mac address="fa:16:3e:64:83:a1"/>
Oct 16 11:34:34 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:34:34 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:34:34 user nova-compute[74683]:       <target dev="tap6153c4bd-b8"/>
Oct 16 11:34:34 user nova-compute[74683]:     </interface>
Oct 16 11:34:34 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:34:34 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/7bf62c7a-fa86-4e13-bc28-13d8cb2918da/console.log" append="off"/>
Oct 16 11:34:34 user nova-compute[74683]:     </serial>
Oct 16 11:34:34 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:34:34 user nova-compute[74683]:     <video>
Oct 16 11:34:34 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:34:34 user nova-compute[74683]:     </video>
Oct 16 11:34:34 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:34:34 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:34:34 user nova-compute[74683]:     </rng>
Oct 16 11:34:34 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:34:34 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:34:34 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:34:34 user nova-compute[74683]:     </memballoon>
Oct 16 11:34:34 user nova-compute[74683]:   </devices>
Oct 16 11:34:34 user nova-compute[74683]: </domain>
Oct 16 11:34:34 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:34:34 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:34:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1307592261',display_name='tempest-VolumesActionsTest-instance-1307592261',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1307592261',id=40,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18948f1fc0fc457dac3df9cd93caf2a2',ramdisk_id='',reservation_id='r-70hrf83f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-602760708',owner_user_name='tempest-VolumesActionsTest-602760708-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:34:33Z,user_data=None,user_id='23509d4ea2334af2ab26c4dcb4baefec',uuid=7bf62c7a-fa86-4e13-bc28-13d8cb2918da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6153c4bd-b883-4dc2-8bcf-be08fb965888", "address": "fa:16:3e:64:83:a1", "network": {"id": "ee1095ab-9f66-4034-9bd2-e93214db8fef", "bridge": "br-int", "label": "tempest-VolumesActionsTest-643747526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18948f1fc0fc457dac3df9cd93caf2a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6153c4bd-b8", "ovs_interfaceid": "6153c4bd-b883-4dc2-8bcf-be08fb965888", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:34:34 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Converting VIF {"id": "6153c4bd-b883-4dc2-8bcf-be08fb965888", "address": "fa:16:3e:64:83:a1", "network": {"id": "ee1095ab-9f66-4034-9bd2-e93214db8fef", "bridge": "br-int", "label": "tempest-VolumesActionsTest-643747526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18948f1fc0fc457dac3df9cd93caf2a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6153c4bd-b8", "ovs_interfaceid": "6153c4bd-b883-4dc2-8bcf-be08fb965888", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:34:34 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:83:a1,bridge_name='br-int',has_traffic_filtering=True,id=6153c4bd-b883-4dc2-8bcf-be08fb965888,network=Network(ee1095ab-9f66-4034-9bd2-e93214db8fef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6153c4bd-b8') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:34:34 user nova-compute[74683]: DEBUG os_vif [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:83:a1,bridge_name='br-int',has_traffic_filtering=True,id=6153c4bd-b883-4dc2-8bcf-be08fb965888,network=Network(ee1095ab-9f66-4034-9bd2-e93214db8fef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6153c4bd-b8') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:34:34 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:34 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:34:34 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:34:34 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:34 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0c8a35b3-c8ba-57b2-832a-d672b3002eb9', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:34:34 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:34 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:34:34 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:34 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:34 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6153c4bd-b8, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:34:34 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6153c4bd-b8, col_values=(('qos', UUID('067df05c-65fb-4269-a9d7-49d288068b0c')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:34:34 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6153c4bd-b8, col_values=(('external_ids', {'iface-id': '6153c4bd-b883-4dc2-8bcf-be08fb965888', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:83:a1', 'vm-uuid': '7bf62c7a-fa86-4e13-bc28-13d8cb2918da'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:34:34 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:34 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:34:34 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:34 user nova-compute[74683]: INFO os_vif [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:83:a1,bridge_name='br-int',has_traffic_filtering=True,id=6153c4bd-b883-4dc2-8bcf-be08fb965888,network=Network(ee1095ab-9f66-4034-9bd2-e93214db8fef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6153c4bd-b8')
Oct 16 11:34:34 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:34:34 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] No VIF found with MAC fa:16:3e:64:83:a1, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:34:34 user nova-compute[74683]: DEBUG nova.network.neutron [req-9b4c0a57-61ce-45af-b807-eda17fd0eb38 req-7d1d3034-fee1-4db9-b73b-ddc9d7fc61cf service nova] [instance: 7bf62c7a-fa86-4e13-bc28-13d8cb2918da] Updated VIF entry in instance network info cache for port 6153c4bd-b883-4dc2-8bcf-be08fb965888. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:34:34 user nova-compute[74683]: DEBUG nova.network.neutron [req-9b4c0a57-61ce-45af-b807-eda17fd0eb38 req-7d1d3034-fee1-4db9-b73b-ddc9d7fc61cf service nova] [instance: 7bf62c7a-fa86-4e13-bc28-13d8cb2918da] Updating instance_info_cache with network_info: [{"id": "6153c4bd-b883-4dc2-8bcf-be08fb965888", "address": "fa:16:3e:64:83:a1", "network": {"id": "ee1095ab-9f66-4034-9bd2-e93214db8fef", "bridge": "br-int", "label": "tempest-VolumesActionsTest-643747526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18948f1fc0fc457dac3df9cd93caf2a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6153c4bd-b8", "ovs_interfaceid": "6153c4bd-b883-4dc2-8bcf-be08fb965888", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:34:34 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-9b4c0a57-61ce-45af-b807-eda17fd0eb38 req-7d1d3034-fee1-4db9-b73b-ddc9d7fc61cf service nova] Releasing lock "refresh_cache-7bf62c7a-fa86-4e13-bc28-13d8cb2918da" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:34:34 user nova-compute[74683]: INFO nova.compute.manager [None req-8f415d6c-9fbd-4308-98f2-b502382913a0 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Unrescuing
Oct 16 11:34:34 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-8f415d6c-9fbd-4308-98f2-b502382913a0 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Acquiring lock "refresh_cache-9ece51b6-5cb3-4d79-acdb-ea4d895cdce8" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:34:34 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-8f415d6c-9fbd-4308-98f2-b502382913a0 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Acquired lock "refresh_cache-9ece51b6-5cb3-4d79-acdb-ea4d895cdce8" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:34:34 user nova-compute[74683]: DEBUG nova.network.neutron [None req-8f415d6c-9fbd-4308-98f2-b502382913a0 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:34:35 user nova-compute[74683]: DEBUG nova.network.neutron [None req-8f415d6c-9fbd-4308-98f2-b502382913a0 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Updating instance_info_cache with network_info: [{"id": "a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6", "address": "fa:16:3e:cf:8d:8b", "network": {"id": "fa128ba8-cd2f-4621-ac04-ecc21569bb68", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321708612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66a49078f1240bd88207e487dd4951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7bd5f8b-2b", "ovs_interfaceid": "a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:34:35 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-8f415d6c-9fbd-4308-98f2-b502382913a0 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Releasing lock "refresh_cache-9ece51b6-5cb3-4d79-acdb-ea4d895cdce8" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:34:35 user nova-compute[74683]: DEBUG nova.objects.instance [None req-8f415d6c-9fbd-4308-98f2-b502382913a0 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lazy-loading 'flavor' on Instance uuid 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:34:35 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:35 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:35 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:35 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:35 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:35 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:36 user nova-compute[74683]: DEBUG nova.compute.manager [req-64abb60f-7f92-4d24-aebf-ecc0d87fc09a req-d6a9a452-5fdf-4562-8809-39c74144dc64 service nova] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Received event network-vif-unplugged-a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:34:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-64abb60f-7f92-4d24-aebf-ecc0d87fc09a req-d6a9a452-5fdf-4562-8809-39c74144dc64 service nova] Acquiring lock "9ece51b6-5cb3-4d79-acdb-ea4d895cdce8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:34:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-64abb60f-7f92-4d24-aebf-ecc0d87fc09a req-d6a9a452-5fdf-4562-8809-39c74144dc64 service nova] Lock "9ece51b6-5cb3-4d79-acdb-ea4d895cdce8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:34:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-64abb60f-7f92-4d24-aebf-ecc0d87fc09a req-d6a9a452-5fdf-4562-8809-39c74144dc64 service nova] Lock "9ece51b6-5cb3-4d79-acdb-ea4d895cdce8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:34:36 user nova-compute[74683]: DEBUG nova.compute.manager [req-64abb60f-7f92-4d24-aebf-ecc0d87fc09a req-d6a9a452-5fdf-4562-8809-39c74144dc64 service nova] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] No waiting events found dispatching network-vif-unplugged-a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:34:36 user nova-compute[74683]: WARNING nova.compute.manager [req-64abb60f-7f92-4d24-aebf-ecc0d87fc09a req-d6a9a452-5fdf-4562-8809-39c74144dc64 service nova] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Received unexpected event network-vif-unplugged-a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6 for instance with vm_state rescued and task_state unrescuing.
Oct 16 11:34:36 user nova-compute[74683]: DEBUG nova.compute.manager [req-64abb60f-7f92-4d24-aebf-ecc0d87fc09a req-d6a9a452-5fdf-4562-8809-39c74144dc64 service nova] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Received event network-vif-plugged-a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:34:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-64abb60f-7f92-4d24-aebf-ecc0d87fc09a req-d6a9a452-5fdf-4562-8809-39c74144dc64 service nova] Acquiring lock "9ece51b6-5cb3-4d79-acdb-ea4d895cdce8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:34:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-64abb60f-7f92-4d24-aebf-ecc0d87fc09a req-d6a9a452-5fdf-4562-8809-39c74144dc64 service nova] Lock "9ece51b6-5cb3-4d79-acdb-ea4d895cdce8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:34:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-64abb60f-7f92-4d24-aebf-ecc0d87fc09a req-d6a9a452-5fdf-4562-8809-39c74144dc64 service nova] Lock "9ece51b6-5cb3-4d79-acdb-ea4d895cdce8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:34:36 user nova-compute[74683]: DEBUG nova.compute.manager [req-64abb60f-7f92-4d24-aebf-ecc0d87fc09a req-d6a9a452-5fdf-4562-8809-39c74144dc64 service nova] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] No waiting events found dispatching network-vif-plugged-a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:34:36 user nova-compute[74683]: WARNING nova.compute.manager [req-64abb60f-7f92-4d24-aebf-ecc0d87fc09a req-d6a9a452-5fdf-4562-8809-39c74144dc64 service nova] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Received unexpected event network-vif-plugged-a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6 for instance with vm_state rescued and task_state unrescuing.
Oct 16 11:34:36 user nova-compute[74683]: DEBUG nova.compute.manager [req-64abb60f-7f92-4d24-aebf-ecc0d87fc09a req-d6a9a452-5fdf-4562-8809-39c74144dc64 service nova] [instance: 7bf62c7a-fa86-4e13-bc28-13d8cb2918da] Received event network-vif-plugged-6153c4bd-b883-4dc2-8bcf-be08fb965888 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:34:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-64abb60f-7f92-4d24-aebf-ecc0d87fc09a req-d6a9a452-5fdf-4562-8809-39c74144dc64 service nova] Acquiring lock "7bf62c7a-fa86-4e13-bc28-13d8cb2918da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:34:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-64abb60f-7f92-4d24-aebf-ecc0d87fc09a req-d6a9a452-5fdf-4562-8809-39c74144dc64 service nova] Lock "7bf62c7a-fa86-4e13-bc28-13d8cb2918da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:34:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-64abb60f-7f92-4d24-aebf-ecc0d87fc09a req-d6a9a452-5fdf-4562-8809-39c74144dc64 service nova] Lock "7bf62c7a-fa86-4e13-bc28-13d8cb2918da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:34:36 user nova-compute[74683]: DEBUG nova.compute.manager [req-64abb60f-7f92-4d24-aebf-ecc0d87fc09a req-d6a9a452-5fdf-4562-8809-39c74144dc64 service nova] [instance: 7bf62c7a-fa86-4e13-bc28-13d8cb2918da] No waiting events found dispatching network-vif-plugged-6153c4bd-b883-4dc2-8bcf-be08fb965888 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:34:36 user nova-compute[74683]: WARNING nova.compute.manager [req-64abb60f-7f92-4d24-aebf-ecc0d87fc09a req-d6a9a452-5fdf-4562-8809-39c74144dc64 service nova] [instance: 7bf62c7a-fa86-4e13-bc28-13d8cb2918da] Received unexpected event network-vif-plugged-6153c4bd-b883-4dc2-8bcf-be08fb965888 for instance with vm_state building and task_state spawning.
Oct 16 11:34:36 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Instance destroyed successfully.
Oct 16 11:34:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:38 user nova-compute[74683]: DEBUG nova.compute.manager [req-a0c3d733-b438-4ec0-8365-c1dbfd8e8179 req-b91dec66-68ac-4e8d-9769-56bd19246885 service nova] [instance: 7bf62c7a-fa86-4e13-bc28-13d8cb2918da] Received event network-vif-plugged-6153c4bd-b883-4dc2-8bcf-be08fb965888 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:34:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a0c3d733-b438-4ec0-8365-c1dbfd8e8179 req-b91dec66-68ac-4e8d-9769-56bd19246885 service nova] Acquiring lock "7bf62c7a-fa86-4e13-bc28-13d8cb2918da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:34:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a0c3d733-b438-4ec0-8365-c1dbfd8e8179 req-b91dec66-68ac-4e8d-9769-56bd19246885 service nova] Lock "7bf62c7a-fa86-4e13-bc28-13d8cb2918da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:34:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a0c3d733-b438-4ec0-8365-c1dbfd8e8179 req-b91dec66-68ac-4e8d-9769-56bd19246885 service nova] Lock "7bf62c7a-fa86-4e13-bc28-13d8cb2918da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:34:38 user nova-compute[74683]: DEBUG nova.compute.manager [req-a0c3d733-b438-4ec0-8365-c1dbfd8e8179 req-b91dec66-68ac-4e8d-9769-56bd19246885 service nova] [instance: 7bf62c7a-fa86-4e13-bc28-13d8cb2918da] No waiting events found dispatching network-vif-plugged-6153c4bd-b883-4dc2-8bcf-be08fb965888 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:34:38 user nova-compute[74683]: WARNING nova.compute.manager [req-a0c3d733-b438-4ec0-8365-c1dbfd8e8179 req-b91dec66-68ac-4e8d-9769-56bd19246885 service nova] [instance: 7bf62c7a-fa86-4e13-bc28-13d8cb2918da] Received unexpected event network-vif-plugged-6153c4bd-b883-4dc2-8bcf-be08fb965888 for instance with vm_state building and task_state spawning.
Oct 16 11:34:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:39 user nova-compute[74683]: DEBUG nova.compute.manager [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] [instance: 7bf62c7a-fa86-4e13-bc28-13d8cb2918da] Instance event wait completed in 0 seconds for  {{(pid=74683) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 11:34:39 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] [instance: 7bf62c7a-fa86-4e13-bc28-13d8cb2918da] Guest created on hypervisor {{(pid=74683) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 11:34:39 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 7bf62c7a-fa86-4e13-bc28-13d8cb2918da] Instance spawned successfully.
Oct 16 11:34:39 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] [instance: 7bf62c7a-fa86-4e13-bc28-13d8cb2918da] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 11:34:39 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] [instance: 7bf62c7a-fa86-4e13-bc28-13d8cb2918da] Found default for hw_cdrom_bus of ide {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:34:39 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] [instance: 7bf62c7a-fa86-4e13-bc28-13d8cb2918da] Found default for hw_disk_bus of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:34:39 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] [instance: 7bf62c7a-fa86-4e13-bc28-13d8cb2918da] Found default for hw_input_bus of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:34:39 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] [instance: 7bf62c7a-fa86-4e13-bc28-13d8cb2918da] Found default for hw_pointer_model of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:34:39 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] [instance: 7bf62c7a-fa86-4e13-bc28-13d8cb2918da] Found default for hw_video_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:34:39 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] [instance: 7bf62c7a-fa86-4e13-bc28-13d8cb2918da] Found default for hw_vif_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:34:39 user nova-compute[74683]: INFO nova.compute.manager [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] [instance: 7bf62c7a-fa86-4e13-bc28-13d8cb2918da] Took 6.84 seconds to spawn the instance on the hypervisor.
Oct 16 11:34:39 user nova-compute[74683]: DEBUG nova.compute.manager [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] [instance: 7bf62c7a-fa86-4e13-bc28-13d8cb2918da] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:34:39 user nova-compute[74683]: INFO nova.compute.manager [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] [instance: 7bf62c7a-fa86-4e13-bc28-13d8cb2918da] Took 7.60 seconds to build instance.
Oct 16 11:34:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f6f0e772-8e7c-4436-b356-3753fffab68d tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Lock "7bf62c7a-fa86-4e13-bc28-13d8cb2918da" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.699s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:34:40 user nova-compute[74683]: DEBUG nova.compute.manager [req-28acf198-ed29-47de-bc33-46f2cf2e3e7f req-d1659886-2ca4-49aa-9b99-d351323cac97 service nova] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Received event network-vif-plugged-a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:34:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-28acf198-ed29-47de-bc33-46f2cf2e3e7f req-d1659886-2ca4-49aa-9b99-d351323cac97 service nova] Acquiring lock "9ece51b6-5cb3-4d79-acdb-ea4d895cdce8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:34:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-28acf198-ed29-47de-bc33-46f2cf2e3e7f req-d1659886-2ca4-49aa-9b99-d351323cac97 service nova] Lock "9ece51b6-5cb3-4d79-acdb-ea4d895cdce8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:34:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-28acf198-ed29-47de-bc33-46f2cf2e3e7f req-d1659886-2ca4-49aa-9b99-d351323cac97 service nova] Lock "9ece51b6-5cb3-4d79-acdb-ea4d895cdce8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:34:40 user nova-compute[74683]: DEBUG nova.compute.manager [req-28acf198-ed29-47de-bc33-46f2cf2e3e7f req-d1659886-2ca4-49aa-9b99-d351323cac97 service nova] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] No waiting events found dispatching network-vif-plugged-a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:34:40 user nova-compute[74683]: WARNING nova.compute.manager [req-28acf198-ed29-47de-bc33-46f2cf2e3e7f req-d1659886-2ca4-49aa-9b99-d351323cac97 service nova] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Received unexpected event network-vif-plugged-a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6 for instance with vm_state rescued and task_state unrescuing.
Oct 16 11:34:40 user nova-compute[74683]: DEBUG nova.compute.manager [req-28acf198-ed29-47de-bc33-46f2cf2e3e7f req-d1659886-2ca4-49aa-9b99-d351323cac97 service nova] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Received event network-vif-plugged-a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:34:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-28acf198-ed29-47de-bc33-46f2cf2e3e7f req-d1659886-2ca4-49aa-9b99-d351323cac97 service nova] Acquiring lock "9ece51b6-5cb3-4d79-acdb-ea4d895cdce8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:34:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-28acf198-ed29-47de-bc33-46f2cf2e3e7f req-d1659886-2ca4-49aa-9b99-d351323cac97 service nova] Lock "9ece51b6-5cb3-4d79-acdb-ea4d895cdce8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:34:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-28acf198-ed29-47de-bc33-46f2cf2e3e7f req-d1659886-2ca4-49aa-9b99-d351323cac97 service nova] Lock "9ece51b6-5cb3-4d79-acdb-ea4d895cdce8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:34:40 user nova-compute[74683]: DEBUG nova.compute.manager [req-28acf198-ed29-47de-bc33-46f2cf2e3e7f req-d1659886-2ca4-49aa-9b99-d351323cac97 service nova] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] No waiting events found dispatching network-vif-plugged-a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:34:40 user nova-compute[74683]: WARNING nova.compute.manager [req-28acf198-ed29-47de-bc33-46f2cf2e3e7f req-d1659886-2ca4-49aa-9b99-d351323cac97 service nova] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Received unexpected event network-vif-plugged-a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6 for instance with vm_state rescued and task_state unrescuing.
Oct 16 11:34:40 user nova-compute[74683]: DEBUG nova.compute.manager [None req-8f415d6c-9fbd-4308-98f2-b502382913a0 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:34:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:44 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:49 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:54 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:34:59 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:03 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:04 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:08 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:09 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:10 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-80a1eb0f-e443-4e2d-94a4-4a6dd50956c6 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Acquiring lock "43d35d0e-acc5-4076-8641-73b4704f1028" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:35:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-80a1eb0f-e443-4e2d-94a4-4a6dd50956c6 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "43d35d0e-acc5-4076-8641-73b4704f1028" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:35:13 user nova-compute[74683]: DEBUG nova.compute.manager [None req-80a1eb0f-e443-4e2d-94a4-4a6dd50956c6 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Going to confirm migration 2 {{(pid=74683) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4773}}
Oct 16 11:35:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-80a1eb0f-e443-4e2d-94a4-4a6dd50956c6 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Acquiring lock "refresh_cache-43d35d0e-acc5-4076-8641-73b4704f1028" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:35:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-80a1eb0f-e443-4e2d-94a4-4a6dd50956c6 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Acquired lock "refresh_cache-43d35d0e-acc5-4076-8641-73b4704f1028" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:35:13 user nova-compute[74683]: DEBUG nova.network.neutron [None req-80a1eb0f-e443-4e2d-94a4-4a6dd50956c6 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:35:13 user nova-compute[74683]: DEBUG nova.objects.instance [None req-80a1eb0f-e443-4e2d-94a4-4a6dd50956c6 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lazy-loading 'info_cache' on Instance uuid 43d35d0e-acc5-4076-8641-73b4704f1028 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:35:13 user nova-compute[74683]: DEBUG nova.network.neutron [None req-80a1eb0f-e443-4e2d-94a4-4a6dd50956c6 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Updating instance_info_cache with network_info: [{"id": "8bc348fc-b8e3-40da-a8a1-70bd70c3fffe", "address": "fa:16:3e:37:bc:60", "network": {"id": "cd8cf08c-d79c-4d2e-b849-640c440e1498", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1091743670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcb8da41d6584a689e9b50155288aa5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc348fc-b8", "ovs_interfaceid": "8bc348fc-b8e3-40da-a8a1-70bd70c3fffe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:35:14 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-80a1eb0f-e443-4e2d-94a4-4a6dd50956c6 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Releasing lock "refresh_cache-43d35d0e-acc5-4076-8641-73b4704f1028" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:35:14 user nova-compute[74683]: DEBUG nova.objects.instance [None req-80a1eb0f-e443-4e2d-94a4-4a6dd50956c6 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lazy-loading 'migration_context' on Instance uuid 43d35d0e-acc5-4076-8641-73b4704f1028 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:35:14 user nova-compute[74683]: DEBUG nova.objects.base [None req-80a1eb0f-e443-4e2d-94a4-4a6dd50956c6 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Object Instance<43d35d0e-acc5-4076-8641-73b4704f1028> lazy-loaded attributes: info_cache,migration_context {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:35:14 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-80a1eb0f-e443-4e2d-94a4-4a6dd50956c6 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:35:14 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-80a1eb0f-e443-4e2d-94a4-4a6dd50956c6 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:35:14 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-80a1eb0f-e443-4e2d-94a4-4a6dd50956c6 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:35:14 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-80a1eb0f-e443-4e2d-94a4-4a6dd50956c6 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:35:14 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-80a1eb0f-e443-4e2d-94a4-4a6dd50956c6 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.480s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:35:14 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:14 user nova-compute[74683]: INFO nova.scheduler.client.report [None req-80a1eb0f-e443-4e2d-94a4-4a6dd50956c6 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Deleted allocation for migration 32b4eb0a-efa9-489c-ad77-be06c666769f
Oct 16 11:35:14 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-80a1eb0f-e443-4e2d-94a4-4a6dd50956c6 tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "43d35d0e-acc5-4076-8641-73b4704f1028" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.695s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:35:14 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:16 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:19 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:21 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Acquiring lock "8d94b70c-4056-4c58-9df4-73684e0d164f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:35:21 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lock "8d94b70c-4056-4c58-9df4-73684e0d164f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:35:21 user nova-compute[74683]: DEBUG nova.compute.manager [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Starting instance... {{(pid=74683) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 11:35:21 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:35:21 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:35:21 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74683) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 11:35:21 user nova-compute[74683]: INFO nova.compute.claims [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Claim successful on node user
Oct 16 11:35:21 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-96b4c116-f2dc-4fc8-8c3e-29fd0047eca8 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Acquiring lock "6d2a30dc-36e8-4582-a236-821e9f87a687" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:35:21 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-96b4c116-f2dc-4fc8-8c3e-29fd0047eca8 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Lock "6d2a30dc-36e8-4582-a236-821e9f87a687" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:35:21 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-96b4c116-f2dc-4fc8-8c3e-29fd0047eca8 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Acquiring lock "6d2a30dc-36e8-4582-a236-821e9f87a687-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:35:21 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-96b4c116-f2dc-4fc8-8c3e-29fd0047eca8 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Lock "6d2a30dc-36e8-4582-a236-821e9f87a687-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:35:21 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-96b4c116-f2dc-4fc8-8c3e-29fd0047eca8 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Lock "6d2a30dc-36e8-4582-a236-821e9f87a687-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:35:21 user nova-compute[74683]: INFO nova.compute.manager [None req-96b4c116-f2dc-4fc8-8c3e-29fd0047eca8 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 6d2a30dc-36e8-4582-a236-821e9f87a687] Terminating instance
Oct 16 11:35:21 user nova-compute[74683]: DEBUG nova.compute.manager [None req-96b4c116-f2dc-4fc8-8c3e-29fd0047eca8 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 6d2a30dc-36e8-4582-a236-821e9f87a687] Start destroying the instance on the hypervisor. {{(pid=74683) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 11:35:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:21 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:35:21 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:35:21 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Starting heal instance info cache {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 11:35:21 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:35:21 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "refresh_cache-9b8ba94f-43cc-4f06-bcd9-83935ccbe117" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:35:21 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquired lock "refresh_cache-9b8ba94f-43cc-4f06-bcd9-83935ccbe117" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:35:21 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Forcefully refreshing network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 11:35:21 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:35:21 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.527s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:35:21 user nova-compute[74683]: DEBUG nova.compute.manager [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Start building networks asynchronously for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 11:35:21 user nova-compute[74683]: DEBUG nova.compute.manager [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Allocating IP information in the background. {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 11:35:21 user nova-compute[74683]: DEBUG nova.network.neutron [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] allocate_for_instance() {{(pid=74683) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 11:35:21 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 11:35:21 user nova-compute[74683]: DEBUG nova.compute.manager [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Start building block device mappings for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 11:35:21 user nova-compute[74683]: DEBUG nova.policy [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b8afda3d5e1f4c41b991b6e480473ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fd84a1f38a41dc8e4ab6c697028d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74683) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 11:35:22 user nova-compute[74683]: DEBUG nova.compute.manager [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Start spawning the instance on the hypervisor. {{(pid=74683) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 11:35:22 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Creating instance directory {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 11:35:22 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Creating image(s)
Oct 16 11:35:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Acquiring lock "/opt/stack/data/nova/instances/8d94b70c-4056-4c58-9df4-73684e0d164f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:35:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lock "/opt/stack/data/nova/instances/8d94b70c-4056-4c58-9df4-73684e0d164f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:35:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lock "/opt/stack/data/nova/instances/8d94b70c-4056-4c58-9df4-73684e0d164f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:35:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:35:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:22 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 6d2a30dc-36e8-4582-a236-821e9f87a687] Instance destroyed successfully.
Oct 16 11:35:22 user nova-compute[74683]: DEBUG nova.objects.instance [None req-96b4c116-f2dc-4fc8-8c3e-29fd0047eca8 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Lazy-loading 'resources' on Instance uuid 6d2a30dc-36e8-4582-a236-821e9f87a687 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:35:22 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-96b4c116-f2dc-4fc8-8c3e-29fd0047eca8 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:33:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1351527279',display_name='tempest-VolumesActionsTest-instance-1351527279',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1351527279',id=38,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:33:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c02c8882c3f4a2eac7d1f320c06899b',ramdisk_id='',reservation_id='r-ztd5tvv5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1922089110',owner_user_name='tempest-VolumesActionsTest-1922089110-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:33:38Z,user_data=None,user_id='2cb90c639a424b3ba9b7513aa6624334',uuid=6d2a30dc-36e8-4582-a236-821e9f87a687,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c49145a9-b1ae-42b4-8e12-54b00715e0d6", "address": "fa:16:3e:c6:5c:ab", "network": {"id": "d2fbadd4-fd6d-4bbc-96eb-042f4fce1c04", "bridge": "br-int", "label": "tempest-VolumesActionsTest-888145232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c02c8882c3f4a2eac7d1f320c06899b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc49145a9-b1", "ovs_interfaceid": "c49145a9-b1ae-42b4-8e12-54b00715e0d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:35:22 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-96b4c116-f2dc-4fc8-8c3e-29fd0047eca8 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Converting VIF {"id": "c49145a9-b1ae-42b4-8e12-54b00715e0d6", "address": "fa:16:3e:c6:5c:ab", "network": {"id": "d2fbadd4-fd6d-4bbc-96eb-042f4fce1c04", "bridge": "br-int", "label": "tempest-VolumesActionsTest-888145232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c02c8882c3f4a2eac7d1f320c06899b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc49145a9-b1", "ovs_interfaceid": "c49145a9-b1ae-42b4-8e12-54b00715e0d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:35:22 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-96b4c116-f2dc-4fc8-8c3e-29fd0047eca8 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:5c:ab,bridge_name='br-int',has_traffic_filtering=True,id=c49145a9-b1ae-42b4-8e12-54b00715e0d6,network=Network(d2fbadd4-fd6d-4bbc-96eb-042f4fce1c04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc49145a9-b1') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:35:22 user nova-compute[74683]: DEBUG os_vif [None req-96b4c116-f2dc-4fc8-8c3e-29fd0047eca8 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:5c:ab,bridge_name='br-int',has_traffic_filtering=True,id=c49145a9-b1ae-42b4-8e12-54b00715e0d6,network=Network(d2fbadd4-fd6d-4bbc-96eb-042f4fce1c04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc49145a9-b1') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:35:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc49145a9-b1, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:35:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:35:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e98ed737-548f-4697-99bc-70370a9d6647) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:35:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:35:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:22 user nova-compute[74683]: INFO os_vif [None req-96b4c116-f2dc-4fc8-8c3e-29fd0047eca8 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:5c:ab,bridge_name='br-int',has_traffic_filtering=True,id=c49145a9-b1ae-42b4-8e12-54b00715e0d6,network=Network(d2fbadd4-fd6d-4bbc-96eb-042f4fce1c04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc49145a9-b1')
Oct 16 11:35:22 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-96b4c116-f2dc-4fc8-8c3e-29fd0047eca8 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 6d2a30dc-36e8-4582-a236-821e9f87a687] Deleting instance files /opt/stack/data/nova/instances/6d2a30dc-36e8-4582-a236-821e9f87a687_del
Oct 16 11:35:22 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-96b4c116-f2dc-4fc8-8c3e-29fd0047eca8 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 6d2a30dc-36e8-4582-a236-821e9f87a687] Deletion of /opt/stack/data/nova/instances/6d2a30dc-36e8-4582-a236-821e9f87a687_del complete
Oct 16 11:35:22 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Updating instance_info_cache with network_info: [{"id": "ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665", "address": "fa:16:3e:d4:56:40", "network": {"id": "fa128ba8-cd2f-4621-ac04-ecc21569bb68", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321708612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66a49078f1240bd88207e487dd4951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff8b53f2-e6", "ovs_interfaceid": "ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:35:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Releasing lock "refresh_cache-9b8ba94f-43cc-4f06-bcd9-83935ccbe117" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:35:22 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Updated the network info_cache for instance {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 11:35:22 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:35:22 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:35:22 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:35:22 user nova-compute[74683]: INFO nova.compute.manager [None req-96b4c116-f2dc-4fc8-8c3e-29fd0047eca8 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] [instance: 6d2a30dc-36e8-4582-a236-821e9f87a687] Took 0.85 seconds to destroy the instance on the hypervisor.
Oct 16 11:35:22 user nova-compute[74683]: DEBUG oslo.service.loopingcall [None req-96b4c116-f2dc-4fc8-8c3e-29fd0047eca8 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74683) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 11:35:22 user nova-compute[74683]: DEBUG nova.compute.manager [-] [instance: 6d2a30dc-36e8-4582-a236-821e9f87a687] Deallocating network for instance {{(pid=74683) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 11:35:22 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: 6d2a30dc-36e8-4582-a236-821e9f87a687] deallocate_for_instance() {{(pid=74683) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 11:35:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.233s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:35:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Acquiring lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:35:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:35:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:35:22 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:35:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.189s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:35:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/8d94b70c-4056-4c58-9df4-73684e0d164f/disk 1073741824 {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:35:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/8d94b70c-4056-4c58-9df4-73684e0d164f/disk 1073741824" returned: 0 in 0.065s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:35:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:35:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:35:22 user nova-compute[74683]: DEBUG nova.compute.manager [req-47bba83f-d043-4976-84e1-99f58b6d5b18 req-0a22048e-fb4d-42cc-926c-0986c4c277b0 service nova] [instance: 6d2a30dc-36e8-4582-a236-821e9f87a687] Received event network-vif-unplugged-c49145a9-b1ae-42b4-8e12-54b00715e0d6 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:35:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-47bba83f-d043-4976-84e1-99f58b6d5b18 req-0a22048e-fb4d-42cc-926c-0986c4c277b0 service nova] Acquiring lock "6d2a30dc-36e8-4582-a236-821e9f87a687-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:35:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-47bba83f-d043-4976-84e1-99f58b6d5b18 req-0a22048e-fb4d-42cc-926c-0986c4c277b0 service nova] Lock "6d2a30dc-36e8-4582-a236-821e9f87a687-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:35:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-47bba83f-d043-4976-84e1-99f58b6d5b18 req-0a22048e-fb4d-42cc-926c-0986c4c277b0 service nova] Lock "6d2a30dc-36e8-4582-a236-821e9f87a687-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:35:22 user nova-compute[74683]: DEBUG nova.compute.manager [req-47bba83f-d043-4976-84e1-99f58b6d5b18 req-0a22048e-fb4d-42cc-926c-0986c4c277b0 service nova] [instance: 6d2a30dc-36e8-4582-a236-821e9f87a687] No waiting events found dispatching network-vif-unplugged-c49145a9-b1ae-42b4-8e12-54b00715e0d6 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:35:22 user nova-compute[74683]: DEBUG nova.compute.manager [req-47bba83f-d043-4976-84e1-99f58b6d5b18 req-0a22048e-fb4d-42cc-926c-0986c4c277b0 service nova] [instance: 6d2a30dc-36e8-4582-a236-821e9f87a687] Received event network-vif-unplugged-c49145a9-b1ae-42b4-8e12-54b00715e0d6 for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 11:35:22 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:35:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.190s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:35:22 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8d94b70c-4056-4c58-9df4-73684e0d164f/disk. size=1073741824 {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 11:35:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d94b70c-4056-4c58-9df4-73684e0d164f/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:35:22 user nova-compute[74683]: DEBUG nova.network.neutron [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Successfully created port: 80bcc661-5bbf-4b87-87c3-0b4a7e6aa31b {{(pid=74683) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 11:35:22 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: 6d2a30dc-36e8-4582-a236-821e9f87a687] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:35:22 user nova-compute[74683]: DEBUG nova.compute.manager [req-9a565a96-f850-4fee-abd8-351c17625579 req-2a2eedb0-3961-4950-adb4-f7c5de70d7d9 service nova] [instance: 6d2a30dc-36e8-4582-a236-821e9f87a687] Received event network-vif-deleted-c49145a9-b1ae-42b4-8e12-54b00715e0d6 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:35:22 user nova-compute[74683]: INFO nova.compute.manager [req-9a565a96-f850-4fee-abd8-351c17625579 req-2a2eedb0-3961-4950-adb4-f7c5de70d7d9 service nova] [instance: 6d2a30dc-36e8-4582-a236-821e9f87a687] Neutron deleted interface c49145a9-b1ae-42b4-8e12-54b00715e0d6; detaching it from the instance and deleting it from the info cache
Oct 16 11:35:22 user nova-compute[74683]: DEBUG nova.network.neutron [req-9a565a96-f850-4fee-abd8-351c17625579 req-2a2eedb0-3961-4950-adb4-f7c5de70d7d9 service nova] [instance: 6d2a30dc-36e8-4582-a236-821e9f87a687] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:35:22 user nova-compute[74683]: INFO nova.compute.manager [-] [instance: 6d2a30dc-36e8-4582-a236-821e9f87a687] Took 0.62 seconds to deallocate network for instance.
Oct 16 11:35:22 user nova-compute[74683]: DEBUG nova.compute.manager [req-9a565a96-f850-4fee-abd8-351c17625579 req-2a2eedb0-3961-4950-adb4-f7c5de70d7d9 service nova] [instance: 6d2a30dc-36e8-4582-a236-821e9f87a687] Detach interface failed, port_id=c49145a9-b1ae-42b4-8e12-54b00715e0d6, reason: Instance 6d2a30dc-36e8-4582-a236-821e9f87a687 could not be found. {{(pid=74683) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 16 11:35:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d94b70c-4056-4c58-9df4-73684e0d164f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:35:22 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Cannot resize image /opt/stack/data/nova/instances/8d94b70c-4056-4c58-9df4-73684e0d164f/disk to a smaller size. {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 11:35:22 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Created local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 11:35:22 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Ensure instance console log exists: /opt/stack/data/nova/instances/8d94b70c-4056-4c58-9df4-73684e0d164f/console.log {{(pid=74683) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 11:35:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:35:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:35:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:35:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-96b4c116-f2dc-4fc8-8c3e-29fd0047eca8 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:35:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-96b4c116-f2dc-4fc8-8c3e-29fd0047eca8 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:35:23 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-96b4c116-f2dc-4fc8-8c3e-29fd0047eca8 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:35:23 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-96b4c116-f2dc-4fc8-8c3e-29fd0047eca8 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:35:23 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-96b4c116-f2dc-4fc8-8c3e-29fd0047eca8 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.326s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:35:23 user nova-compute[74683]: INFO nova.scheduler.client.report [None req-96b4c116-f2dc-4fc8-8c3e-29fd0047eca8 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Deleted allocations for instance 6d2a30dc-36e8-4582-a236-821e9f87a687
Oct 16 11:35:23 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-96b4c116-f2dc-4fc8-8c3e-29fd0047eca8 tempest-VolumesActionsTest-1922089110 tempest-VolumesActionsTest-1922089110-project-member] Lock "6d2a30dc-36e8-4582-a236-821e9f87a687" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.999s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:35:23 user nova-compute[74683]: DEBUG nova.network.neutron [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Successfully updated port: 80bcc661-5bbf-4b87-87c3-0b4a7e6aa31b {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:35:23 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Acquiring lock "refresh_cache-8d94b70c-4056-4c58-9df4-73684e0d164f" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:35:23 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Acquired lock "refresh_cache-8d94b70c-4056-4c58-9df4-73684e0d164f" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:35:23 user nova-compute[74683]: DEBUG nova.network.neutron [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:35:23 user nova-compute[74683]: DEBUG nova.compute.manager [req-0e95a8d6-f088-4230-9579-d420cc3e9774 req-19ed4a8c-c2ff-4d55-8fea-89e1caaacc08 service nova] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Received event network-changed-80bcc661-5bbf-4b87-87c3-0b4a7e6aa31b {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:35:23 user nova-compute[74683]: DEBUG nova.compute.manager [req-0e95a8d6-f088-4230-9579-d420cc3e9774 req-19ed4a8c-c2ff-4d55-8fea-89e1caaacc08 service nova] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Refreshing instance network info cache due to event network-changed-80bcc661-5bbf-4b87-87c3-0b4a7e6aa31b. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:35:23 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-0e95a8d6-f088-4230-9579-d420cc3e9774 req-19ed4a8c-c2ff-4d55-8fea-89e1caaacc08 service nova] Acquiring lock "refresh_cache-8d94b70c-4056-4c58-9df4-73684e0d164f" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:35:23 user nova-compute[74683]: DEBUG nova.network.neutron [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:35:23 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:35:23 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:35:23 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:35:23 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:35:23 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Auditing locally available compute resources for user (node: user) {{(pid=74683) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 11:35:23 user nova-compute[74683]: DEBUG nova.network.neutron [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Updating instance_info_cache with network_info: [{"id": "80bcc661-5bbf-4b87-87c3-0b4a7e6aa31b", "address": "fa:16:3e:67:41:41", "network": {"id": "f131c862-9d83-4df6-af88-56d3202105fc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-544805614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12fd84a1f38a41dc8e4ab6c697028d9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80bcc661-5b", "ovs_interfaceid": "80bcc661-5bbf-4b87-87c3-0b4a7e6aa31b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:35:23 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Releasing lock "refresh_cache-8d94b70c-4056-4c58-9df4-73684e0d164f" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:35:23 user nova-compute[74683]: DEBUG nova.compute.manager [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Instance network_info: |[{"id": "80bcc661-5bbf-4b87-87c3-0b4a7e6aa31b", "address": "fa:16:3e:67:41:41", "network": {"id": "f131c862-9d83-4df6-af88-56d3202105fc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-544805614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12fd84a1f38a41dc8e4ab6c697028d9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80bcc661-5b", "ovs_interfaceid": "80bcc661-5bbf-4b87-87c3-0b4a7e6aa31b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 11:35:23 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-0e95a8d6-f088-4230-9579-d420cc3e9774 req-19ed4a8c-c2ff-4d55-8fea-89e1caaacc08 service nova] Acquired lock "refresh_cache-8d94b70c-4056-4c58-9df4-73684e0d164f" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:35:23 user nova-compute[74683]: DEBUG nova.network.neutron [req-0e95a8d6-f088-4230-9579-d420cc3e9774 req-19ed4a8c-c2ff-4d55-8fea-89e1caaacc08 service nova] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Refreshing network info cache for port 80bcc661-5bbf-4b87-87c3-0b4a7e6aa31b {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:35:23 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Start _get_guest_xml network_info=[{"id": "80bcc661-5bbf-4b87-87c3-0b4a7e6aa31b", "address": "fa:16:3e:67:41:41", "network": {"id": "f131c862-9d83-4df6-af88-56d3202105fc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-544805614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12fd84a1f38a41dc8e4ab6c697028d9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80bcc661-5b", "ovs_interfaceid": "80bcc661-5bbf-4b87-87c3-0b4a7e6aa31b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:35:23 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:35:23 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:35:23 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:35:23 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:35:23 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:35:23 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:35:23 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:35:23 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:35:23 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:35:23 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:35:23 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:35:23 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:35:23 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:35:23 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:35:23 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:35:23 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:35:23 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:35:23 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:35:23 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:35:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1435511601',display_name='tempest-SnapshotDataIntegrityTests-server-1435511601',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1435511601',id=41,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPMkI4BH6sE1S8VYJ2I7IEYPdT37wnqF1GhjF5l04y1YMKnK4gwdZRO+dHdrt73ZI37SU6vF7WEzYElFf3FhQxDWq0VgXGBcsHUAjCUljKHQLUAWAwH/sDew084SZzG+cg==',key_name='tempest-keypair-1968375565',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12fd84a1f38a41dc8e4ab6c697028d9a',ramdisk_id='',reservation_id='r-5yirzcmp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2137742616',owner_user_name='tempest-SnapshotDataIntegrityTests-2137742616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:35:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8afda3d5e1f4c41b991b6e480473ba7',uuid=8d94b70c-4056-4c58-9df4-73684e0d164f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80bcc661-5bbf-4b87-87c3-0b4a7e6aa31b", "address": "fa:16:3e:67:41:41", "network": {"id": "f131c862-9d83-4df6-af88-56d3202105fc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-544805614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12fd84a1f38a41dc8e4ab6c697028d9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80bcc661-5b", "ovs_interfaceid": "80bcc661-5bbf-4b87-87c3-0b4a7e6aa31b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:35:23 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Converting VIF {"id": "80bcc661-5bbf-4b87-87c3-0b4a7e6aa31b", "address": "fa:16:3e:67:41:41", "network": {"id": "f131c862-9d83-4df6-af88-56d3202105fc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-544805614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12fd84a1f38a41dc8e4ab6c697028d9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80bcc661-5b", "ovs_interfaceid": "80bcc661-5bbf-4b87-87c3-0b4a7e6aa31b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:35:23 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:41:41,bridge_name='br-int',has_traffic_filtering=True,id=80bcc661-5bbf-4b87-87c3-0b4a7e6aa31b,network=Network(f131c862-9d83-4df6-af88-56d3202105fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80bcc661-5b') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:35:23 user nova-compute[74683]: DEBUG nova.objects.instance [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lazy-loading 'pci_devices' on Instance uuid 8d94b70c-4056-4c58-9df4-73684e0d164f {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:35:23 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:35:23 user nova-compute[74683]:   <uuid>8d94b70c-4056-4c58-9df4-73684e0d164f</uuid>
Oct 16 11:35:23 user nova-compute[74683]:   <name>instance-00000029</name>
Oct 16 11:35:23 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:35:23 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:35:23 user nova-compute[74683]:   <metadata>
Oct 16 11:35:23 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:35:23 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:35:23 user nova-compute[74683]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1435511601</nova:name>
Oct 16 11:35:23 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:35:23</nova:creationTime>
Oct 16 11:35:23 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:35:23 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:35:23 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:35:23 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:35:23 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:35:23 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:35:23 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:35:23 user nova-compute[74683]:       <nova:owner>
Oct 16 11:35:23 user nova-compute[74683]:         <nova:user uuid="b8afda3d5e1f4c41b991b6e480473ba7">tempest-SnapshotDataIntegrityTests-2137742616-project-member</nova:user>
Oct 16 11:35:23 user nova-compute[74683]:         <nova:project uuid="12fd84a1f38a41dc8e4ab6c697028d9a">tempest-SnapshotDataIntegrityTests-2137742616</nova:project>
Oct 16 11:35:23 user nova-compute[74683]:       </nova:owner>
Oct 16 11:35:23 user nova-compute[74683]:       <nova:root type="image" uuid="0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f"/>
Oct 16 11:35:23 user nova-compute[74683]:       <nova:ports>
Oct 16 11:35:23 user nova-compute[74683]:         <nova:port uuid="80bcc661-5bbf-4b87-87c3-0b4a7e6aa31b">
Oct 16 11:35:23 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 16 11:35:23 user nova-compute[74683]:         </nova:port>
Oct 16 11:35:23 user nova-compute[74683]:       </nova:ports>
Oct 16 11:35:23 user nova-compute[74683]:     </nova:instance>
Oct 16 11:35:23 user nova-compute[74683]:   </metadata>
Oct 16 11:35:23 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:35:23 user nova-compute[74683]:     <system>
Oct 16 11:35:23 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:35:23 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:35:23 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:35:23 user nova-compute[74683]:       <entry name="serial">8d94b70c-4056-4c58-9df4-73684e0d164f</entry>
Oct 16 11:35:23 user nova-compute[74683]:       <entry name="uuid">8d94b70c-4056-4c58-9df4-73684e0d164f</entry>
Oct 16 11:35:23 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:35:23 user nova-compute[74683]:     </system>
Oct 16 11:35:23 user nova-compute[74683]:   </sysinfo>
Oct 16 11:35:23 user nova-compute[74683]:   <os>
Oct 16 11:35:23 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:35:23 user nova-compute[74683]:     <boot dev="hd"/>
Oct 16 11:35:23 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:35:23 user nova-compute[74683]:   </os>
Oct 16 11:35:23 user nova-compute[74683]:   <features>
Oct 16 11:35:23 user nova-compute[74683]:     <acpi/>
Oct 16 11:35:23 user nova-compute[74683]:     <apic/>
Oct 16 11:35:23 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:35:23 user nova-compute[74683]:   </features>
Oct 16 11:35:23 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:35:23 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:35:23 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:35:23 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:35:23 user nova-compute[74683]:   </clock>
Oct 16 11:35:23 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:35:23 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:35:23 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:35:23 user nova-compute[74683]:   </cpu>
Oct 16 11:35:23 user nova-compute[74683]:   <devices>
Oct 16 11:35:23 user nova-compute[74683]:     <disk type="file" device="disk">
Oct 16 11:35:23 user nova-compute[74683]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 11:35:23 user nova-compute[74683]:       <source file="/opt/stack/data/nova/instances/8d94b70c-4056-4c58-9df4-73684e0d164f/disk"/>
Oct 16 11:35:23 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:35:23 user nova-compute[74683]:     </disk>
Oct 16 11:35:23 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:35:23 user nova-compute[74683]:       <mac address="fa:16:3e:67:41:41"/>
Oct 16 11:35:23 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:35:23 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:35:23 user nova-compute[74683]:       <target dev="tap80bcc661-5b"/>
Oct 16 11:35:23 user nova-compute[74683]:     </interface>
Oct 16 11:35:23 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:35:23 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/8d94b70c-4056-4c58-9df4-73684e0d164f/console.log" append="off"/>
Oct 16 11:35:23 user nova-compute[74683]:     </serial>
Oct 16 11:35:23 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:35:23 user nova-compute[74683]:     <video>
Oct 16 11:35:23 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:35:23 user nova-compute[74683]:     </video>
Oct 16 11:35:23 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:35:23 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:35:23 user nova-compute[74683]:     </rng>
Oct 16 11:35:23 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:35:23 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:35:23 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:35:23 user nova-compute[74683]:     </memballoon>
Oct 16 11:35:23 user nova-compute[74683]:   </devices>
Oct 16 11:35:23 user nova-compute[74683]: </domain>
Oct 16 11:35:23 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:35:23 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:35:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1435511601',display_name='tempest-SnapshotDataIntegrityTests-server-1435511601',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1435511601',id=41,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPMkI4BH6sE1S8VYJ2I7IEYPdT37wnqF1GhjF5l04y1YMKnK4gwdZRO+dHdrt73ZI37SU6vF7WEzYElFf3FhQxDWq0VgXGBcsHUAjCUljKHQLUAWAwH/sDew084SZzG+cg==',key_name='tempest-keypair-1968375565',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12fd84a1f38a41dc8e4ab6c697028d9a',ramdisk_id='',reservation_id='r-5yirzcmp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2137742616',owner_user_name='tempest-SnapshotDataIntegrityTests-2137742616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:35:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8afda3d5e1f4c41b991b6e480473ba7',uuid=8d94b70c-4056-4c58-9df4-73684e0d164f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80bcc661-5bbf-4b87-87c3-0b4a7e6aa31b", "address": "fa:16:3e:67:41:41", "network": {"id": "f131c862-9d83-4df6-af88-56d3202105fc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-544805614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12fd84a1f38a41dc8e4ab6c697028d9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80bcc661-5b", "ovs_interfaceid": "80bcc661-5bbf-4b87-87c3-0b4a7e6aa31b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:35:23 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Converting VIF {"id": "80bcc661-5bbf-4b87-87c3-0b4a7e6aa31b", "address": "fa:16:3e:67:41:41", "network": {"id": "f131c862-9d83-4df6-af88-56d3202105fc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-544805614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12fd84a1f38a41dc8e4ab6c697028d9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80bcc661-5b", "ovs_interfaceid": "80bcc661-5bbf-4b87-87c3-0b4a7e6aa31b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:35:23 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:41:41,bridge_name='br-int',has_traffic_filtering=True,id=80bcc661-5bbf-4b87-87c3-0b4a7e6aa31b,network=Network(f131c862-9d83-4df6-af88-56d3202105fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80bcc661-5b') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:35:23 user nova-compute[74683]: DEBUG os_vif [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:41:41,bridge_name='br-int',has_traffic_filtering=True,id=80bcc661-5bbf-4b87-87c3-0b4a7e6aa31b,network=Network(f131c862-9d83-4df6-af88-56d3202105fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80bcc661-5b') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:35:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:35:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:35:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '22dc7e4a-353d-5eb1-82b4-e2f3b40c7657', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:35:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:35:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:35:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap80bcc661-5b, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:35:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap80bcc661-5b, col_values=(('qos', UUID('e23735f2-5f7e-469a-83a1-8e304b2a2f52')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:35:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap80bcc661-5b, col_values=(('external_ids', {'iface-id': '80bcc661-5bbf-4b87-87c3-0b4a7e6aa31b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:41:41', 'vm-uuid': '8d94b70c-4056-4c58-9df4-73684e0d164f'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:35:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:35:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:23 user nova-compute[74683]: INFO os_vif [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:41:41,bridge_name='br-int',has_traffic_filtering=True,id=80bcc661-5bbf-4b87-87c3-0b4a7e6aa31b,network=Network(f131c862-9d83-4df6-af88-56d3202105fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80bcc661-5b')
Oct 16 11:35:24 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:35:24 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] No VIF found with MAC fa:16:3e:67:41:41, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:35:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:35:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:35:24 user nova-compute[74683]: DEBUG nova.network.neutron [req-0e95a8d6-f088-4230-9579-d420cc3e9774 req-19ed4a8c-c2ff-4d55-8fea-89e1caaacc08 service nova] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Updated VIF entry in instance network info cache for port 80bcc661-5bbf-4b87-87c3-0b4a7e6aa31b. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:35:24 user nova-compute[74683]: DEBUG nova.network.neutron [req-0e95a8d6-f088-4230-9579-d420cc3e9774 req-19ed4a8c-c2ff-4d55-8fea-89e1caaacc08 service nova] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Updating instance_info_cache with network_info: [{"id": "80bcc661-5bbf-4b87-87c3-0b4a7e6aa31b", "address": "fa:16:3e:67:41:41", "network": {"id": "f131c862-9d83-4df6-af88-56d3202105fc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-544805614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12fd84a1f38a41dc8e4ab6c697028d9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80bcc661-5b", "ovs_interfaceid": "80bcc661-5bbf-4b87-87c3-0b4a7e6aa31b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:35:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-0e95a8d6-f088-4230-9579-d420cc3e9774 req-19ed4a8c-c2ff-4d55-8fea-89e1caaacc08 service nova] Releasing lock "refresh_cache-8d94b70c-4056-4c58-9df4-73684e0d164f" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:35:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:35:24 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:35:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:35:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:35:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:35:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:35:24 user nova-compute[74683]: DEBUG nova.compute.manager [req-0b838c08-285f-43df-8ee2-6291d61fcbc0 req-bb1cec31-6f3a-46a1-8e29-bdac1b2e615a service nova] [instance: 6d2a30dc-36e8-4582-a236-821e9f87a687] Received event network-vif-plugged-c49145a9-b1ae-42b4-8e12-54b00715e0d6 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:35:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-0b838c08-285f-43df-8ee2-6291d61fcbc0 req-bb1cec31-6f3a-46a1-8e29-bdac1b2e615a service nova] Acquiring lock "6d2a30dc-36e8-4582-a236-821e9f87a687-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:35:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-0b838c08-285f-43df-8ee2-6291d61fcbc0 req-bb1cec31-6f3a-46a1-8e29-bdac1b2e615a service nova] Lock "6d2a30dc-36e8-4582-a236-821e9f87a687-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:35:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-0b838c08-285f-43df-8ee2-6291d61fcbc0 req-bb1cec31-6f3a-46a1-8e29-bdac1b2e615a service nova] Lock "6d2a30dc-36e8-4582-a236-821e9f87a687-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:35:24 user nova-compute[74683]: DEBUG nova.compute.manager [req-0b838c08-285f-43df-8ee2-6291d61fcbc0 req-bb1cec31-6f3a-46a1-8e29-bdac1b2e615a service nova] [instance: 6d2a30dc-36e8-4582-a236-821e9f87a687] No waiting events found dispatching network-vif-plugged-c49145a9-b1ae-42b4-8e12-54b00715e0d6 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:35:24 user nova-compute[74683]: WARNING nova.compute.manager [req-0b838c08-285f-43df-8ee2-6291d61fcbc0 req-bb1cec31-6f3a-46a1-8e29-bdac1b2e615a service nova] [instance: 6d2a30dc-36e8-4582-a236-821e9f87a687] Received unexpected event network-vif-plugged-c49145a9-b1ae-42b4-8e12-54b00715e0d6 for instance with vm_state deleted and task_state None.
Oct 16 11:35:24 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:35:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf62c7a-fa86-4e13-bc28-13d8cb2918da/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:35:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf62c7a-fa86-4e13-bc28-13d8cb2918da/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:35:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf62c7a-fa86-4e13-bc28-13d8cb2918da/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:35:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf62c7a-fa86-4e13-bc28-13d8cb2918da/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:35:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ece51b6-5cb3-4d79-acdb-ea4d895cdce8/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:35:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ece51b6-5cb3-4d79-acdb-ea4d895cdce8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:35:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ece51b6-5cb3-4d79-acdb-ea4d895cdce8/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:35:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ece51b6-5cb3-4d79-acdb-ea4d895cdce8/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:35:25 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:35:25 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:35:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.rescue --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:35:25 user nova-compute[74683]: DEBUG nova.compute.manager [req-d8c39fff-a6b3-44a9-977a-16042f2dc6d0 req-ee3510d8-0350-4a8e-b117-1e6f14fa1dcf service nova] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Received event network-vif-plugged-80bcc661-5bbf-4b87-87c3-0b4a7e6aa31b {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:35:25 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-d8c39fff-a6b3-44a9-977a-16042f2dc6d0 req-ee3510d8-0350-4a8e-b117-1e6f14fa1dcf service nova] Acquiring lock "8d94b70c-4056-4c58-9df4-73684e0d164f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:35:25 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-d8c39fff-a6b3-44a9-977a-16042f2dc6d0 req-ee3510d8-0350-4a8e-b117-1e6f14fa1dcf service nova] Lock "8d94b70c-4056-4c58-9df4-73684e0d164f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:35:25 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-d8c39fff-a6b3-44a9-977a-16042f2dc6d0 req-ee3510d8-0350-4a8e-b117-1e6f14fa1dcf service nova] Lock "8d94b70c-4056-4c58-9df4-73684e0d164f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:35:25 user nova-compute[74683]: DEBUG nova.compute.manager [req-d8c39fff-a6b3-44a9-977a-16042f2dc6d0 req-ee3510d8-0350-4a8e-b117-1e6f14fa1dcf service nova] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] No waiting events found dispatching network-vif-plugged-80bcc661-5bbf-4b87-87c3-0b4a7e6aa31b {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:35:25 user nova-compute[74683]: WARNING nova.compute.manager [req-d8c39fff-a6b3-44a9-977a-16042f2dc6d0 req-ee3510d8-0350-4a8e-b117-1e6f14fa1dcf service nova] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Received unexpected event network-vif-plugged-80bcc661-5bbf-4b87-87c3-0b4a7e6aa31b for instance with vm_state building and task_state spawning.
Oct 16 11:35:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:35:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.rescue --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:35:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:35:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:35:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:35:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:35:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:35:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:35:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:35:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:35:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:35:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:27 user nova-compute[74683]: DEBUG nova.compute.manager [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Instance event wait completed in 0 seconds for  {{(pid=74683) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 11:35:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Guest created on hypervisor {{(pid=74683) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 11:35:27 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Instance spawned successfully.
Oct 16 11:35:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 11:35:27 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:35:27 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:35:27 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Hypervisor/Node resource view: name=user free_ram=7842MB free_disk=25.185001373291016GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74683) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 11:35:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:35:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:35:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Found default for hw_cdrom_bus of ide {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:35:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Found default for hw_disk_bus of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:35:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Found default for hw_input_bus of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:35:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Found default for hw_pointer_model of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:35:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Found default for hw_video_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:35:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Found default for hw_vif_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:35:27 user nova-compute[74683]: INFO nova.compute.manager [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Took 5.70 seconds to spawn the instance on the hypervisor.
Oct 16 11:35:27 user nova-compute[74683]: DEBUG nova.compute.manager [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:35:27 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance edd01413-1f8a-49e3-aa3c-ecb19c62afae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:35:27 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 9b8ba94f-43cc-4f06-bcd9-83935ccbe117 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:35:27 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance b91af786-36e3-4815-811f-fb3c055e758d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:35:27 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:35:27 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance f5ad764c-638d-4dac-b032-6680917e46df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:35:27 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 43d35d0e-acc5-4076-8641-73b4704f1028 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:35:27 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 6d3528c9-50dd-4f9e-ab92-2f885662bff7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:35:27 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 7bf62c7a-fa86-4e13-bc28-13d8cb2918da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:35:27 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 8d94b70c-4056-4c58-9df4-73684e0d164f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:35:27 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 11:35:27 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 11:35:27 user nova-compute[74683]: INFO nova.compute.manager [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Took 6.60 seconds to build instance.
Oct 16 11:35:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-59453d32-344d-4e97-aa8a-889808332994 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lock "8d94b70c-4056-4c58-9df4-73684e0d164f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.695s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:35:27 user nova-compute[74683]: DEBUG nova.compute.manager [req-7cc35f44-f5e1-449e-b5a9-8d692ae73c92 req-57d17339-0132-4e7a-ab60-8a1c4f25397c service nova] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Received event network-vif-plugged-80bcc661-5bbf-4b87-87c3-0b4a7e6aa31b {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:35:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-7cc35f44-f5e1-449e-b5a9-8d692ae73c92 req-57d17339-0132-4e7a-ab60-8a1c4f25397c service nova] Acquiring lock "8d94b70c-4056-4c58-9df4-73684e0d164f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:35:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-7cc35f44-f5e1-449e-b5a9-8d692ae73c92 req-57d17339-0132-4e7a-ab60-8a1c4f25397c service nova] Lock "8d94b70c-4056-4c58-9df4-73684e0d164f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:35:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-7cc35f44-f5e1-449e-b5a9-8d692ae73c92 req-57d17339-0132-4e7a-ab60-8a1c4f25397c service nova] Lock "8d94b70c-4056-4c58-9df4-73684e0d164f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:35:28 user nova-compute[74683]: DEBUG nova.compute.manager [req-7cc35f44-f5e1-449e-b5a9-8d692ae73c92 req-57d17339-0132-4e7a-ab60-8a1c4f25397c service nova] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] No waiting events found dispatching network-vif-plugged-80bcc661-5bbf-4b87-87c3-0b4a7e6aa31b {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:35:28 user nova-compute[74683]: WARNING nova.compute.manager [req-7cc35f44-f5e1-449e-b5a9-8d692ae73c92 req-57d17339-0132-4e7a-ab60-8a1c4f25397c service nova] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Received unexpected event network-vif-plugged-80bcc661-5bbf-4b87-87c3-0b4a7e6aa31b for instance with vm_state active and task_state None.
Oct 16 11:35:28 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:35:28 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:35:28 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Compute_service record updated for user:user {{(pid=74683) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 11:35:28 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.459s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:35:28 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:28 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:29 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:35:29 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:35:29 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74683) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 11:35:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:33 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:39 user nova-compute[74683]: DEBUG nova.compute.manager [req-f05ac3c5-c410-41b3-bde0-d23a5fdaac1b req-d2c6fde2-c8fc-458d-b09e-7a495893c534 service nova] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Received event network-changed-d29ea840-0505-4827-b11f-2caa7b0f6faa {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:35:39 user nova-compute[74683]: DEBUG nova.compute.manager [req-f05ac3c5-c410-41b3-bde0-d23a5fdaac1b req-d2c6fde2-c8fc-458d-b09e-7a495893c534 service nova] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Refreshing instance network info cache due to event network-changed-d29ea840-0505-4827-b11f-2caa7b0f6faa. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:35:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f05ac3c5-c410-41b3-bde0-d23a5fdaac1b req-d2c6fde2-c8fc-458d-b09e-7a495893c534 service nova] Acquiring lock "refresh_cache-6d3528c9-50dd-4f9e-ab92-2f885662bff7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:35:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f05ac3c5-c410-41b3-bde0-d23a5fdaac1b req-d2c6fde2-c8fc-458d-b09e-7a495893c534 service nova] Acquired lock "refresh_cache-6d3528c9-50dd-4f9e-ab92-2f885662bff7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:35:39 user nova-compute[74683]: DEBUG nova.network.neutron [req-f05ac3c5-c410-41b3-bde0-d23a5fdaac1b req-d2c6fde2-c8fc-458d-b09e-7a495893c534 service nova] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Refreshing network info cache for port d29ea840-0505-4827-b11f-2caa7b0f6faa {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:35:39 user nova-compute[74683]: DEBUG nova.network.neutron [req-f05ac3c5-c410-41b3-bde0-d23a5fdaac1b req-d2c6fde2-c8fc-458d-b09e-7a495893c534 service nova] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Updated VIF entry in instance network info cache for port d29ea840-0505-4827-b11f-2caa7b0f6faa. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:35:39 user nova-compute[74683]: DEBUG nova.network.neutron [req-f05ac3c5-c410-41b3-bde0-d23a5fdaac1b req-d2c6fde2-c8fc-458d-b09e-7a495893c534 service nova] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Updating instance_info_cache with network_info: [{"id": "d29ea840-0505-4827-b11f-2caa7b0f6faa", "address": "fa:16:3e:12:a3:80", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd29ea840-05", "ovs_interfaceid": "d29ea840-0505-4827-b11f-2caa7b0f6faa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:35:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f05ac3c5-c410-41b3-bde0-d23a5fdaac1b req-d2c6fde2-c8fc-458d-b09e-7a495893c534 service nova] Releasing lock "refresh_cache-6d3528c9-50dd-4f9e-ab92-2f885662bff7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:35:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:48 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Acquiring lock "e88445f0-2b1c-4cc1-94ca-33a1e3bec929" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:35:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lock "e88445f0-2b1c-4cc1-94ca-33a1e3bec929" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:35:53 user nova-compute[74683]: DEBUG nova.compute.manager [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Starting instance... {{(pid=74683) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 11:35:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:35:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:35:53 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74683) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 11:35:53 user nova-compute[74683]: INFO nova.compute.claims [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Claim successful on node user
Oct 16 11:35:53 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:35:53 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:35:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.371s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:35:53 user nova-compute[74683]: DEBUG nova.compute.manager [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Start building networks asynchronously for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 11:35:53 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:54 user nova-compute[74683]: DEBUG nova.compute.manager [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Allocating IP information in the background. {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 11:35:54 user nova-compute[74683]: DEBUG nova.network.neutron [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] allocate_for_instance() {{(pid=74683) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 11:35:54 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 11:35:54 user nova-compute[74683]: DEBUG nova.compute.manager [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Start building block device mappings for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 11:35:54 user nova-compute[74683]: DEBUG nova.policy [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '395a6fc9aa93428c95593000c9caeb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d9daeec42a4e73a8ff2c0137f91128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74683) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 11:35:54 user nova-compute[74683]: DEBUG nova.compute.manager [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Start spawning the instance on the hypervisor. {{(pid=74683) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 11:35:54 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Creating instance directory {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 11:35:54 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Creating image(s)
Oct 16 11:35:54 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Acquiring lock "/opt/stack/data/nova/instances/e88445f0-2b1c-4cc1-94ca-33a1e3bec929/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:35:54 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lock "/opt/stack/data/nova/instances/e88445f0-2b1c-4cc1-94ca-33a1e3bec929/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:35:54 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lock "/opt/stack/data/nova/instances/e88445f0-2b1c-4cc1-94ca-33a1e3bec929/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:35:54 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:35:54 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.180s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:35:54 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Acquiring lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:35:54 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:35:54 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:35:54 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.180s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:35:54 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/e88445f0-2b1c-4cc1-94ca-33a1e3bec929/disk 1073741824 {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:35:54 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/e88445f0-2b1c-4cc1-94ca-33a1e3bec929/disk 1073741824" returned: 0 in 0.054s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:35:54 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:35:54 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:35:54 user nova-compute[74683]: DEBUG nova.network.neutron [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Successfully created port: 4ecf301e-0a4b-42f1-8e27-b8f46b00886c {{(pid=74683) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 11:35:54 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.176s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:35:54 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e88445f0-2b1c-4cc1-94ca-33a1e3bec929/disk. size=1073741824 {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 11:35:54 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88445f0-2b1c-4cc1-94ca-33a1e3bec929/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:35:54 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88445f0-2b1c-4cc1-94ca-33a1e3bec929/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:35:54 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Cannot resize image /opt/stack/data/nova/instances/e88445f0-2b1c-4cc1-94ca-33a1e3bec929/disk to a smaller size. {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 11:35:54 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Created local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 11:35:54 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Ensure instance console log exists: /opt/stack/data/nova/instances/e88445f0-2b1c-4cc1-94ca-33a1e3bec929/console.log {{(pid=74683) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 11:35:54 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:35:54 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:35:54 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquiring lock "a6cb0bee-7424-4798-aac2-d5606f124733" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "a6cb0bee-7424-4798-aac2-d5606f124733" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG nova.compute.manager [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Starting instance... {{(pid=74683) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG nova.network.neutron [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Successfully updated port: 4ecf301e-0a4b-42f1-8e27-b8f46b00886c {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Acquiring lock "refresh_cache-e88445f0-2b1c-4cc1-94ca-33a1e3bec929" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Acquired lock "refresh_cache-e88445f0-2b1c-4cc1-94ca-33a1e3bec929" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG nova.network.neutron [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG nova.compute.manager [req-1a0181d0-a708-40b4-8d5d-d52c73094e2e req-2f3e86d0-da42-43c4-9fa9-ff113b703e3d service nova] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Received event network-changed-4ecf301e-0a4b-42f1-8e27-b8f46b00886c {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG nova.compute.manager [req-1a0181d0-a708-40b4-8d5d-d52c73094e2e req-2f3e86d0-da42-43c4-9fa9-ff113b703e3d service nova] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Refreshing instance network info cache due to event network-changed-4ecf301e-0a4b-42f1-8e27-b8f46b00886c. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-1a0181d0-a708-40b4-8d5d-d52c73094e2e req-2f3e86d0-da42-43c4-9fa9-ff113b703e3d service nova] Acquiring lock "refresh_cache-e88445f0-2b1c-4cc1-94ca-33a1e3bec929" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74683) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 11:35:55 user nova-compute[74683]: INFO nova.compute.claims [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Claim successful on node user
Oct 16 11:35:55 user nova-compute[74683]: DEBUG nova.network.neutron [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG nova.network.neutron [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Updating instance_info_cache with network_info: [{"id": "4ecf301e-0a4b-42f1-8e27-b8f46b00886c", "address": "fa:16:3e:6e:28:8e", "network": {"id": "3f02f591-1fa0-477f-8730-b41445fd41b4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1932917211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d9daeec42a4e73a8ff2c0137f91128", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ecf301e-0a", "ovs_interfaceid": "4ecf301e-0a4b-42f1-8e27-b8f46b00886c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Releasing lock "refresh_cache-e88445f0-2b1c-4cc1-94ca-33a1e3bec929" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG nova.compute.manager [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Instance network_info: |[{"id": "4ecf301e-0a4b-42f1-8e27-b8f46b00886c", "address": "fa:16:3e:6e:28:8e", "network": {"id": "3f02f591-1fa0-477f-8730-b41445fd41b4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1932917211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d9daeec42a4e73a8ff2c0137f91128", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ecf301e-0a", "ovs_interfaceid": "4ecf301e-0a4b-42f1-8e27-b8f46b00886c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-1a0181d0-a708-40b4-8d5d-d52c73094e2e req-2f3e86d0-da42-43c4-9fa9-ff113b703e3d service nova] Acquired lock "refresh_cache-e88445f0-2b1c-4cc1-94ca-33a1e3bec929" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG nova.network.neutron [req-1a0181d0-a708-40b4-8d5d-d52c73094e2e req-2f3e86d0-da42-43c4-9fa9-ff113b703e3d service nova] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Refreshing network info cache for port 4ecf301e-0a4b-42f1-8e27-b8f46b00886c {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Start _get_guest_xml network_info=[{"id": "4ecf301e-0a4b-42f1-8e27-b8f46b00886c", "address": "fa:16:3e:6e:28:8e", "network": {"id": "3f02f591-1fa0-477f-8730-b41445fd41b4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1932917211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d9daeec42a4e73a8ff2c0137f91128", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ecf301e-0a", "ovs_interfaceid": "4ecf301e-0a4b-42f1-8e27-b8f46b00886c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:35:55 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:35:55 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:35:55 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:35:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-712792725',display_name='tempest-VolumesSnapshotTestJSON-instance-712792725',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-712792725',id=42,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4rEbCVncqKniWcF5GjLtrbs6WMhnI/1jSt9Ezhy216DBYIjxpBi93FmZS4qsJvdynh7N3UG6gKVur+vqYGfoqu/fGSdlHKMXvlUprn1tokf7pcM2VoeKaYCLDvtA3q0Q==',key_name='tempest-keypair-96601639',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7d9daeec42a4e73a8ff2c0137f91128',ramdisk_id='',reservation_id='r-eharcn00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-919495777',owner_user_name='tempest-VolumesSnapshotTestJSON-919495777-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:35:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='395a6fc9aa93428c95593000c9caeb81',uuid=e88445f0-2b1c-4cc1-94ca-33a1e3bec929,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ecf301e-0a4b-42f1-8e27-b8f46b00886c", "address": "fa:16:3e:6e:28:8e", "network": {"id": "3f02f591-1fa0-477f-8730-b41445fd41b4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1932917211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d9daeec42a4e73a8ff2c0137f91128", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ecf301e-0a", "ovs_interfaceid": "4ecf301e-0a4b-42f1-8e27-b8f46b00886c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Converting VIF {"id": "4ecf301e-0a4b-42f1-8e27-b8f46b00886c", "address": "fa:16:3e:6e:28:8e", "network": {"id": "3f02f591-1fa0-477f-8730-b41445fd41b4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1932917211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d9daeec42a4e73a8ff2c0137f91128", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ecf301e-0a", "ovs_interfaceid": "4ecf301e-0a4b-42f1-8e27-b8f46b00886c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:28:8e,bridge_name='br-int',has_traffic_filtering=True,id=4ecf301e-0a4b-42f1-8e27-b8f46b00886c,network=Network(3f02f591-1fa0-477f-8730-b41445fd41b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ecf301e-0a') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG nova.objects.instance [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lazy-loading 'pci_devices' on Instance uuid e88445f0-2b1c-4cc1-94ca-33a1e3bec929 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:35:55 user nova-compute[74683]:   <uuid>e88445f0-2b1c-4cc1-94ca-33a1e3bec929</uuid>
Oct 16 11:35:55 user nova-compute[74683]:   <name>instance-0000002a</name>
Oct 16 11:35:55 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:35:55 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:35:55 user nova-compute[74683]:   <metadata>
Oct 16 11:35:55 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:35:55 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:35:55 user nova-compute[74683]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-712792725</nova:name>
Oct 16 11:35:55 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:35:55</nova:creationTime>
Oct 16 11:35:55 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:35:55 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:35:55 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:35:55 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:35:55 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:35:55 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:35:55 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:35:55 user nova-compute[74683]:       <nova:owner>
Oct 16 11:35:55 user nova-compute[74683]:         <nova:user uuid="395a6fc9aa93428c95593000c9caeb81">tempest-VolumesSnapshotTestJSON-919495777-project-member</nova:user>
Oct 16 11:35:55 user nova-compute[74683]:         <nova:project uuid="b7d9daeec42a4e73a8ff2c0137f91128">tempest-VolumesSnapshotTestJSON-919495777</nova:project>
Oct 16 11:35:55 user nova-compute[74683]:       </nova:owner>
Oct 16 11:35:55 user nova-compute[74683]:       <nova:root type="image" uuid="0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f"/>
Oct 16 11:35:55 user nova-compute[74683]:       <nova:ports>
Oct 16 11:35:55 user nova-compute[74683]:         <nova:port uuid="4ecf301e-0a4b-42f1-8e27-b8f46b00886c">
Oct 16 11:35:55 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 16 11:35:55 user nova-compute[74683]:         </nova:port>
Oct 16 11:35:55 user nova-compute[74683]:       </nova:ports>
Oct 16 11:35:55 user nova-compute[74683]:     </nova:instance>
Oct 16 11:35:55 user nova-compute[74683]:   </metadata>
Oct 16 11:35:55 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:35:55 user nova-compute[74683]:     <system>
Oct 16 11:35:55 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:35:55 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:35:55 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:35:55 user nova-compute[74683]:       <entry name="serial">e88445f0-2b1c-4cc1-94ca-33a1e3bec929</entry>
Oct 16 11:35:55 user nova-compute[74683]:       <entry name="uuid">e88445f0-2b1c-4cc1-94ca-33a1e3bec929</entry>
Oct 16 11:35:55 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:35:55 user nova-compute[74683]:     </system>
Oct 16 11:35:55 user nova-compute[74683]:   </sysinfo>
Oct 16 11:35:55 user nova-compute[74683]:   <os>
Oct 16 11:35:55 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:35:55 user nova-compute[74683]:     <boot dev="hd"/>
Oct 16 11:35:55 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:35:55 user nova-compute[74683]:   </os>
Oct 16 11:35:55 user nova-compute[74683]:   <features>
Oct 16 11:35:55 user nova-compute[74683]:     <acpi/>
Oct 16 11:35:55 user nova-compute[74683]:     <apic/>
Oct 16 11:35:55 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:35:55 user nova-compute[74683]:   </features>
Oct 16 11:35:55 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:35:55 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:35:55 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:35:55 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:35:55 user nova-compute[74683]:   </clock>
Oct 16 11:35:55 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:35:55 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:35:55 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:35:55 user nova-compute[74683]:   </cpu>
Oct 16 11:35:55 user nova-compute[74683]:   <devices>
Oct 16 11:35:55 user nova-compute[74683]:     <disk type="file" device="disk">
Oct 16 11:35:55 user nova-compute[74683]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 11:35:55 user nova-compute[74683]:       <source file="/opt/stack/data/nova/instances/e88445f0-2b1c-4cc1-94ca-33a1e3bec929/disk"/>
Oct 16 11:35:55 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:35:55 user nova-compute[74683]:     </disk>
Oct 16 11:35:55 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:35:55 user nova-compute[74683]:       <mac address="fa:16:3e:6e:28:8e"/>
Oct 16 11:35:55 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:35:55 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:35:55 user nova-compute[74683]:       <target dev="tap4ecf301e-0a"/>
Oct 16 11:35:55 user nova-compute[74683]:     </interface>
Oct 16 11:35:55 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:35:55 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/e88445f0-2b1c-4cc1-94ca-33a1e3bec929/console.log" append="off"/>
Oct 16 11:35:55 user nova-compute[74683]:     </serial>
Oct 16 11:35:55 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:35:55 user nova-compute[74683]:     <video>
Oct 16 11:35:55 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:35:55 user nova-compute[74683]:     </video>
Oct 16 11:35:55 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:35:55 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:35:55 user nova-compute[74683]:     </rng>
Oct 16 11:35:55 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:35:55 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:35:55 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:35:55 user nova-compute[74683]:     </memballoon>
Oct 16 11:35:55 user nova-compute[74683]:   </devices>
Oct 16 11:35:55 user nova-compute[74683]: </domain>
Oct 16 11:35:55 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:35:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-712792725',display_name='tempest-VolumesSnapshotTestJSON-instance-712792725',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-712792725',id=42,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4rEbCVncqKniWcF5GjLtrbs6WMhnI/1jSt9Ezhy216DBYIjxpBi93FmZS4qsJvdynh7N3UG6gKVur+vqYGfoqu/fGSdlHKMXvlUprn1tokf7pcM2VoeKaYCLDvtA3q0Q==',key_name='tempest-keypair-96601639',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7d9daeec42a4e73a8ff2c0137f91128',ramdisk_id='',reservation_id='r-eharcn00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-919495777',owner_user_name='tempest-VolumesSnapshotTestJSON-919495777-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:35:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='395a6fc9aa93428c95593000c9caeb81',uuid=e88445f0-2b1c-4cc1-94ca-33a1e3bec929,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ecf301e-0a4b-42f1-8e27-b8f46b00886c", "address": "fa:16:3e:6e:28:8e", "network": {"id": "3f02f591-1fa0-477f-8730-b41445fd41b4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1932917211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d9daeec42a4e73a8ff2c0137f91128", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ecf301e-0a", "ovs_interfaceid": "4ecf301e-0a4b-42f1-8e27-b8f46b00886c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Converting VIF {"id": "4ecf301e-0a4b-42f1-8e27-b8f46b00886c", "address": "fa:16:3e:6e:28:8e", "network": {"id": "3f02f591-1fa0-477f-8730-b41445fd41b4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1932917211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d9daeec42a4e73a8ff2c0137f91128", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ecf301e-0a", "ovs_interfaceid": "4ecf301e-0a4b-42f1-8e27-b8f46b00886c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:28:8e,bridge_name='br-int',has_traffic_filtering=True,id=4ecf301e-0a4b-42f1-8e27-b8f46b00886c,network=Network(3f02f591-1fa0-477f-8730-b41445fd41b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ecf301e-0a') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG os_vif [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:28:8e,bridge_name='br-int',has_traffic_filtering=True,id=4ecf301e-0a4b-42f1-8e27-b8f46b00886c,network=Network(3f02f591-1fa0-477f-8730-b41445fd41b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ecf301e-0a') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '62444802-0cf7-503c-a9bf-785dba69d53b', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ecf301e-0a, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4ecf301e-0a, col_values=(('qos', UUID('78edb8c3-b3c1-4f16-879c-b216b69588ad')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4ecf301e-0a, col_values=(('external_ids', {'iface-id': '4ecf301e-0a4b-42f1-8e27-b8f46b00886c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:28:8e', 'vm-uuid': 'e88445f0-2b1c-4cc1-94ca-33a1e3bec929'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:55 user nova-compute[74683]: INFO os_vif [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:28:8e,bridge_name='br-int',has_traffic_filtering=True,id=4ecf301e-0a4b-42f1-8e27-b8f46b00886c,network=Network(3f02f591-1fa0-477f-8730-b41445fd41b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ecf301e-0a')
Oct 16 11:35:55 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.443s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG nova.compute.manager [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Start building networks asynchronously for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] No VIF found with MAC fa:16:3e:6e:28:8e, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG nova.compute.manager [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Allocating IP information in the background. {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 11:35:55 user nova-compute[74683]: DEBUG nova.network.neutron [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] allocate_for_instance() {{(pid=74683) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 11:35:56 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 11:35:56 user nova-compute[74683]: DEBUG nova.policy [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a463a84e332543dfbc03b81518f82be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefabef9e42412f8309f490dcfecc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74683) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 11:35:56 user nova-compute[74683]: DEBUG nova.compute.manager [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Start building block device mappings for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 11:35:56 user nova-compute[74683]: INFO nova.virt.block_device [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Booting with volume f9b67505-0202-45d9-83d4-13042662620d at /dev/vda
Oct 16 11:35:56 user nova-compute[74683]: DEBUG nova.network.neutron [req-1a0181d0-a708-40b4-8d5d-d52c73094e2e req-2f3e86d0-da42-43c4-9fa9-ff113b703e3d service nova] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Updated VIF entry in instance network info cache for port 4ecf301e-0a4b-42f1-8e27-b8f46b00886c. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:35:56 user nova-compute[74683]: DEBUG nova.network.neutron [req-1a0181d0-a708-40b4-8d5d-d52c73094e2e req-2f3e86d0-da42-43c4-9fa9-ff113b703e3d service nova] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Updating instance_info_cache with network_info: [{"id": "4ecf301e-0a4b-42f1-8e27-b8f46b00886c", "address": "fa:16:3e:6e:28:8e", "network": {"id": "3f02f591-1fa0-477f-8730-b41445fd41b4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1932917211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d9daeec42a4e73a8ff2c0137f91128", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ecf301e-0a", "ovs_interfaceid": "4ecf301e-0a4b-42f1-8e27-b8f46b00886c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:35:56 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-1a0181d0-a708-40b4-8d5d-d52c73094e2e req-2f3e86d0-da42-43c4-9fa9-ff113b703e3d service nova] Releasing lock "refresh_cache-e88445f0-2b1c-4cc1-94ca-33a1e3bec929" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:35:56 user nova-compute[74683]: DEBUG os_brick.utils [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:35:56 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:35:56 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:35:56 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[df458126-6903-42db-a562-eb105f083b8c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:70b9d336ab7d\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:35:56 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:35:56 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:35:56 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5bab26-0f94-48cc-9a54-52d3e0566a31]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:35:56 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:35:56 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:35:56 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[434a0f5a-9d8c-4417-be3b-0a7c2c50ad0a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:35:56 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[5432577c-4914-4f5e-82bf-416c13e1d43f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:35:56 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Running cmd (subprocess): nvme version {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:35:56 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] 'nvme version' failed. Not Retrying. {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:35:56 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] nvme not present on system {{(pid=74683) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 11:35:56 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:35:56 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:35:56 user nova-compute[74683]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 11:35:56 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[31530fab-2038-43e6-a3a5-7f89bedbd6ec]: (4, '') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:35:56 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74683) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 11:35:56 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 11:35:56 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] LIGHTOS: no hostnqn found. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 11:35:56 user nova-compute[74683]: DEBUG os_brick.utils [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:70b9d336ab7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:35:56 user nova-compute[74683]: DEBUG nova.virt.block_device [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Updating existing volume attachment record: ddae9be4-c90e-4667-8228-5154f7675721 {{(pid=74683) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 11:35:56 user nova-compute[74683]: DEBUG nova.network.neutron [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Successfully created port: 3a3bfab4-5540-4133-9b06-9fadf024f74c {{(pid=74683) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 11:35:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:57 user nova-compute[74683]: DEBUG nova.network.neutron [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Successfully updated port: 3a3bfab4-5540-4133-9b06-9fadf024f74c {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:35:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquiring lock "refresh_cache-a6cb0bee-7424-4798-aac2-d5606f124733" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:35:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquired lock "refresh_cache-a6cb0bee-7424-4798-aac2-d5606f124733" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:35:57 user nova-compute[74683]: DEBUG nova.network.neutron [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:35:57 user nova-compute[74683]: DEBUG nova.compute.manager [req-f8bb7c1c-1bcb-4ba4-abfb-5554d41e0039 req-0df13ef1-f9b8-46c1-aeea-2b3ea73040a9 service nova] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Received event network-changed-3a3bfab4-5540-4133-9b06-9fadf024f74c {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:35:57 user nova-compute[74683]: DEBUG nova.compute.manager [req-f8bb7c1c-1bcb-4ba4-abfb-5554d41e0039 req-0df13ef1-f9b8-46c1-aeea-2b3ea73040a9 service nova] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Refreshing instance network info cache due to event network-changed-3a3bfab4-5540-4133-9b06-9fadf024f74c. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:35:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f8bb7c1c-1bcb-4ba4-abfb-5554d41e0039 req-0df13ef1-f9b8-46c1-aeea-2b3ea73040a9 service nova] Acquiring lock "refresh_cache-a6cb0bee-7424-4798-aac2-d5606f124733" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:35:57 user nova-compute[74683]: DEBUG nova.network.neutron [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:35:57 user nova-compute[74683]: DEBUG nova.compute.manager [req-c3fbacce-aef7-497f-96b2-9d67cf12dc94 req-b66a9515-2290-46b5-b356-2854e10d9011 service nova] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Received event network-vif-plugged-4ecf301e-0a4b-42f1-8e27-b8f46b00886c {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:35:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c3fbacce-aef7-497f-96b2-9d67cf12dc94 req-b66a9515-2290-46b5-b356-2854e10d9011 service nova] Acquiring lock "e88445f0-2b1c-4cc1-94ca-33a1e3bec929-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:35:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c3fbacce-aef7-497f-96b2-9d67cf12dc94 req-b66a9515-2290-46b5-b356-2854e10d9011 service nova] Lock "e88445f0-2b1c-4cc1-94ca-33a1e3bec929-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:35:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c3fbacce-aef7-497f-96b2-9d67cf12dc94 req-b66a9515-2290-46b5-b356-2854e10d9011 service nova] Lock "e88445f0-2b1c-4cc1-94ca-33a1e3bec929-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:35:57 user nova-compute[74683]: DEBUG nova.compute.manager [req-c3fbacce-aef7-497f-96b2-9d67cf12dc94 req-b66a9515-2290-46b5-b356-2854e10d9011 service nova] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] No waiting events found dispatching network-vif-plugged-4ecf301e-0a4b-42f1-8e27-b8f46b00886c {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:35:57 user nova-compute[74683]: WARNING nova.compute.manager [req-c3fbacce-aef7-497f-96b2-9d67cf12dc94 req-b66a9515-2290-46b5-b356-2854e10d9011 service nova] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Received unexpected event network-vif-plugged-4ecf301e-0a4b-42f1-8e27-b8f46b00886c for instance with vm_state building and task_state spawning.
Oct 16 11:35:57 user nova-compute[74683]: DEBUG nova.network.neutron [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Updating instance_info_cache with network_info: [{"id": "3a3bfab4-5540-4133-9b06-9fadf024f74c", "address": "fa:16:3e:10:7f:06", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a3bfab4-55", "ovs_interfaceid": "3a3bfab4-5540-4133-9b06-9fadf024f74c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:35:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Releasing lock "refresh_cache-a6cb0bee-7424-4798-aac2-d5606f124733" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:35:57 user nova-compute[74683]: DEBUG nova.compute.manager [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Instance network_info: |[{"id": "3a3bfab4-5540-4133-9b06-9fadf024f74c", "address": "fa:16:3e:10:7f:06", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a3bfab4-55", "ovs_interfaceid": "3a3bfab4-5540-4133-9b06-9fadf024f74c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 11:35:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f8bb7c1c-1bcb-4ba4-abfb-5554d41e0039 req-0df13ef1-f9b8-46c1-aeea-2b3ea73040a9 service nova] Acquired lock "refresh_cache-a6cb0bee-7424-4798-aac2-d5606f124733" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:35:57 user nova-compute[74683]: DEBUG nova.network.neutron [req-f8bb7c1c-1bcb-4ba4-abfb-5554d41e0039 req-0df13ef1-f9b8-46c1-aeea-2b3ea73040a9 service nova] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Refreshing network info cache for port 3a3bfab4-5540-4133-9b06-9fadf024f74c {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:35:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:35:58 user nova-compute[74683]: DEBUG nova.network.neutron [req-f8bb7c1c-1bcb-4ba4-abfb-5554d41e0039 req-0df13ef1-f9b8-46c1-aeea-2b3ea73040a9 service nova] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Updated VIF entry in instance network info cache for port 3a3bfab4-5540-4133-9b06-9fadf024f74c. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:35:58 user nova-compute[74683]: DEBUG nova.network.neutron [req-f8bb7c1c-1bcb-4ba4-abfb-5554d41e0039 req-0df13ef1-f9b8-46c1-aeea-2b3ea73040a9 service nova] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Updating instance_info_cache with network_info: [{"id": "3a3bfab4-5540-4133-9b06-9fadf024f74c", "address": "fa:16:3e:10:7f:06", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a3bfab4-55", "ovs_interfaceid": "3a3bfab4-5540-4133-9b06-9fadf024f74c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:35:58 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f8bb7c1c-1bcb-4ba4-abfb-5554d41e0039 req-0df13ef1-f9b8-46c1-aeea-2b3ea73040a9 service nova] Releasing lock "refresh_cache-a6cb0bee-7424-4798-aac2-d5606f124733" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:35:59 user nova-compute[74683]: DEBUG nova.compute.manager [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Instance event wait completed in 0 seconds for  {{(pid=74683) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 11:35:59 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Guest created on hypervisor {{(pid=74683) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 11:35:59 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Instance spawned successfully.
Oct 16 11:35:59 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 11:35:59 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Found default for hw_cdrom_bus of ide {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:35:59 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Found default for hw_disk_bus of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:35:59 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Found default for hw_input_bus of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:35:59 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Found default for hw_pointer_model of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:35:59 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Found default for hw_video_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:35:59 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Found default for hw_vif_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:35:59 user nova-compute[74683]: INFO nova.compute.manager [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Took 5.33 seconds to spawn the instance on the hypervisor.
Oct 16 11:35:59 user nova-compute[74683]: DEBUG nova.compute.manager [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:35:59 user nova-compute[74683]: DEBUG nova.compute.manager [req-8ed3dcbc-30cc-451a-86ff-c4d19286ca8a req-1ec3d473-9d7d-4c2f-9eac-2ca731131136 service nova] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Received event network-vif-plugged-4ecf301e-0a4b-42f1-8e27-b8f46b00886c {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:35:59 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-8ed3dcbc-30cc-451a-86ff-c4d19286ca8a req-1ec3d473-9d7d-4c2f-9eac-2ca731131136 service nova] Acquiring lock "e88445f0-2b1c-4cc1-94ca-33a1e3bec929-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:35:59 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-8ed3dcbc-30cc-451a-86ff-c4d19286ca8a req-1ec3d473-9d7d-4c2f-9eac-2ca731131136 service nova] Lock "e88445f0-2b1c-4cc1-94ca-33a1e3bec929-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:35:59 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-8ed3dcbc-30cc-451a-86ff-c4d19286ca8a req-1ec3d473-9d7d-4c2f-9eac-2ca731131136 service nova] Lock "e88445f0-2b1c-4cc1-94ca-33a1e3bec929-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:35:59 user nova-compute[74683]: DEBUG nova.compute.manager [req-8ed3dcbc-30cc-451a-86ff-c4d19286ca8a req-1ec3d473-9d7d-4c2f-9eac-2ca731131136 service nova] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] No waiting events found dispatching network-vif-plugged-4ecf301e-0a4b-42f1-8e27-b8f46b00886c {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:35:59 user nova-compute[74683]: WARNING nova.compute.manager [req-8ed3dcbc-30cc-451a-86ff-c4d19286ca8a req-1ec3d473-9d7d-4c2f-9eac-2ca731131136 service nova] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Received unexpected event network-vif-plugged-4ecf301e-0a4b-42f1-8e27-b8f46b00886c for instance with vm_state building and task_state spawning.
Oct 16 11:35:59 user nova-compute[74683]: INFO nova.compute.manager [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Took 6.07 seconds to build instance.
Oct 16 11:35:59 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b595df27-d121-4205-8feb-cb1fd1513cf1 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lock "e88445f0-2b1c-4cc1-94ca-33a1e3bec929" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.168s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:36:00 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:36:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:36:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:36:10 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:36:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:36:13 user nova-compute[74683]: DEBUG nova.compute.manager [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Start spawning the instance on the hypervisor. {{(pid=74683) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 11:36:13 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Creating instance directory {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 11:36:13 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Creating image(s)
Oct 16 11:36:13 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Did not create local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 16 11:36:13 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Ensure instance console log exists: /opt/stack/data/nova/instances/a6cb0bee-7424-4798-aac2-d5606f124733/console.log {{(pid=74683) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 11:36:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:36:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:36:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:36:13 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Start _get_guest_xml network_info=[{"id": "3a3bfab4-5540-4133-9b06-9fadf024f74c", "address": "fa:16:3e:10:7f:06", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a3bfab4-55", "ovs_interfaceid": "3a3bfab4-5540-4133-9b06-9fadf024f74c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jIYemgyq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a6cb0bee-7424-4798-aac2-d5606f124733', 'attached_at': '', 'detached_at': '', 'volume_id': 'f9b67505-0202-45d9-83d4-13042662620d', 'serial': 'f9b67505-0202-45d9-83d4-13042662620d'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': 'ddae9be4-c90e-4667-8228-5154f7675721', 'volume_type': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:36:13 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:36:13 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:36:13 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:36:13 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:36:13 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:36:13 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:36:13 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:36:13 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:36:13 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:36:13 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:36:13 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:36:13 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:36:13 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:36:13 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:36:13 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:36:13 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:36:13 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:36:13 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:36:13 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Calling os-brick to attach iSCSI Volume {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 11:36:13 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jIYemgyq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:36:13 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:36:13 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:36:13 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:36:13 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:36:13 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:36:13 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:36:13 user nova-compute[74683]: INFO os_brick.initiator.connectors.iscsi [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 11:36:13 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d -p 172.16.0.220:3260 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:36:13 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:36:13 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15e98f0-7caf-4005-8c9d-08acc3d1dad1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:36:13 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 11:36:13 user nova-compute[74683]:  {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:36:13 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d -p 172.16.0.220:3260 --interface default --op new {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:36:13 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:36:13 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f8b360-19f2-41c4-8d08-81eb98417a25]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d] added\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:36:13 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d] added
Oct 16 11:36:13 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:36:13 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:36:13 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:36:13 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[488102d0-e7f8-46cc-aeb2-c4ff9e3164d8]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:36:13 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:36:13 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:36:13 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:36:13 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79eba34-9d59-40b6-9b66-feca6ec5c75b]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:36:13 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:36:13 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jIYemgyq {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:36:13 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jIYemgyq" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:36:13 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd818f9-f373-45bd-a89d-c5764d231f4f]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:36:13 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jIYemgyq'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:36:13 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:36:13 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:36:13 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae5c1fd-9c5c-4193-b4ad-2677e9acd8f7]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:36:13 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:36:13 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:36:13 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:36:13 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[31590c31-ebdd-46fe-b8f8-2f47d3f1c90a]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:36:13 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b (non-flash)
Oct 16 11:36:13 user nova-compute[74683]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)
Oct 16 11:36:13 user nova-compute[74683]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)
Oct 16 11:36:13 user nova-compute[74683]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e (non-flash)
Oct 16 11:36:13 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:36:13 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b (non-flash)
Oct 16 11:36:13 user nova-compute[74683]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)
Oct 16 11:36:13 user nova-compute[74683]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)
Oct 16 11:36:13 user nova-compute[74683]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e (non-flash)
Oct 16 11:36:13 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:36:13 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d -p 172.16.0.220:3260 --login {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:36:13 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:36:13 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[09636b3e-e4a3-4c67-9bb0-0fd401f98e2b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:36:13 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d, portal: 172.16.0.220,3260]
Oct 16 11:36:13 user nova-compute[74683]: Login to [iface: default, target: iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d, portal: 172.16.0.220,3260] successful.
Oct 16 11:36:13 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:36:13 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:36:13 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:36:13 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa145135-ff8c-4141-822f-db3bcc570693]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:36:13 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:36:13 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:36:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:36:14 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a90da2-866b-4794-8bef-fd7669126868]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:36:14 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b (non-flash)
Oct 16 11:36:14 user nova-compute[74683]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)
Oct 16 11:36:14 user nova-compute[74683]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)
Oct 16 11:36:14 user nova-compute[74683]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e (non-flash)
Oct 16 11:36:14 user nova-compute[74683]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d (non-flash)
Oct 16 11:36:14 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:36:14 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b (non-flash)
Oct 16 11:36:14 user nova-compute[74683]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)
Oct 16 11:36:14 user nova-compute[74683]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)
Oct 16 11:36:14 user nova-compute[74683]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e (non-flash)
Oct 16 11:36:14 user nova-compute[74683]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d (non-flash)
Oct 16 11:36:14 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:36:14 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:36:14 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Connected to 172.16.0.220:3260 {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 11:36:14 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] HCTL ('37', '-', '-', 0) found on session 42 with lun 0 {{(pid=74683) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 11:36:14 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74683) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 11:36:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:36:14 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:36:14 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[8816cc12-bf39-41c1-9b60-c4c65fd16b87]: (4, ('- - 0', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:36:14 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Searching for a device in session 42 and hctl ['37', '*', '*', 0] yield: None {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:36:15 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Searching for a device in session 42 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:36:15 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jIYemgyq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 11:36:15 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:36:15 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '26537313337623037', 'path': '/dev/sdf'} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:36:15 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537313337623037', 'path': '/dev/sdf'} {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 11:36:15 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:35:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1953735950',display_name='tempest-TestVolumeBootPattern-server-1953735950',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1953735950',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJbd1pnA0e+ubtg3c4vxF2Dxe/3H7OECUV6ZZvaa4rKNrKocz4jmO0SXeRO4F7NQHuYFrsF7rAUyRZ4V/U5HkEw1E5UZyfInFppdQCzqY7p8CVOHAXsTsTbK336AbWu7g==',key_name='tempest-TestVolumeBootPattern-1282364245',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2aefabef9e42412f8309f490dcfecc79',ramdisk_id='',reservation_id='r-oeniscjh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-953001121',owner_user_name='tempest-TestVolumeBootPattern-953001121-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:35:56Z,user_data=None,user_id='a463a84e332543dfbc03b81518f82be1',uuid=a6cb0bee-7424-4798-aac2-d5606f124733,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a3bfab4-5540-4133-9b06-9fadf024f74c", "address": "fa:16:3e:10:7f:06", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a3bfab4-55", "ovs_interfaceid": "3a3bfab4-5540-4133-9b06-9fadf024f74c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:36:15 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Converting VIF {"id": "3a3bfab4-5540-4133-9b06-9fadf024f74c", "address": "fa:16:3e:10:7f:06", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a3bfab4-55", "ovs_interfaceid": "3a3bfab4-5540-4133-9b06-9fadf024f74c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:36:15 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:7f:06,bridge_name='br-int',has_traffic_filtering=True,id=3a3bfab4-5540-4133-9b06-9fadf024f74c,network=Network(00883fc4-0b74-4afd-9043-82e2933faab3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a3bfab4-55') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:36:15 user nova-compute[74683]: DEBUG nova.objects.instance [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lazy-loading 'pci_devices' on Instance uuid a6cb0bee-7424-4798-aac2-d5606f124733 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:36:15 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:36:15 user nova-compute[74683]:   <uuid>a6cb0bee-7424-4798-aac2-d5606f124733</uuid>
Oct 16 11:36:15 user nova-compute[74683]:   <name>instance-0000002b</name>
Oct 16 11:36:15 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:36:15 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:36:15 user nova-compute[74683]:   <metadata>
Oct 16 11:36:15 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:36:15 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:36:15 user nova-compute[74683]:       <nova:name>tempest-TestVolumeBootPattern-server-1953735950</nova:name>
Oct 16 11:36:15 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:36:13</nova:creationTime>
Oct 16 11:36:15 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:36:15 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:36:15 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:36:15 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:36:15 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:36:15 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:36:15 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:36:15 user nova-compute[74683]:       <nova:owner>
Oct 16 11:36:15 user nova-compute[74683]:         <nova:user uuid="a463a84e332543dfbc03b81518f82be1">tempest-TestVolumeBootPattern-953001121-project-member</nova:user>
Oct 16 11:36:15 user nova-compute[74683]:         <nova:project uuid="2aefabef9e42412f8309f490dcfecc79">tempest-TestVolumeBootPattern-953001121</nova:project>
Oct 16 11:36:15 user nova-compute[74683]:       </nova:owner>
Oct 16 11:36:15 user nova-compute[74683]:       <nova:ports>
Oct 16 11:36:15 user nova-compute[74683]:         <nova:port uuid="3a3bfab4-5540-4133-9b06-9fadf024f74c">
Oct 16 11:36:15 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 16 11:36:15 user nova-compute[74683]:         </nova:port>
Oct 16 11:36:15 user nova-compute[74683]:       </nova:ports>
Oct 16 11:36:15 user nova-compute[74683]:     </nova:instance>
Oct 16 11:36:15 user nova-compute[74683]:   </metadata>
Oct 16 11:36:15 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:36:15 user nova-compute[74683]:     <system>
Oct 16 11:36:15 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:36:15 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:36:15 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:36:15 user nova-compute[74683]:       <entry name="serial">a6cb0bee-7424-4798-aac2-d5606f124733</entry>
Oct 16 11:36:15 user nova-compute[74683]:       <entry name="uuid">a6cb0bee-7424-4798-aac2-d5606f124733</entry>
Oct 16 11:36:15 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:36:15 user nova-compute[74683]:     </system>
Oct 16 11:36:15 user nova-compute[74683]:   </sysinfo>
Oct 16 11:36:15 user nova-compute[74683]:   <os>
Oct 16 11:36:15 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:36:15 user nova-compute[74683]:     <boot dev="hd"/>
Oct 16 11:36:15 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:36:15 user nova-compute[74683]:   </os>
Oct 16 11:36:15 user nova-compute[74683]:   <features>
Oct 16 11:36:15 user nova-compute[74683]:     <acpi/>
Oct 16 11:36:15 user nova-compute[74683]:     <apic/>
Oct 16 11:36:15 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:36:15 user nova-compute[74683]:   </features>
Oct 16 11:36:15 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:36:15 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:36:15 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:36:15 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:36:15 user nova-compute[74683]:   </clock>
Oct 16 11:36:15 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:36:15 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:36:15 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:36:15 user nova-compute[74683]:   </cpu>
Oct 16 11:36:15 user nova-compute[74683]:   <devices>
Oct 16 11:36:15 user nova-compute[74683]:     <disk type="block" device="disk">
Oct 16 11:36:15 user nova-compute[74683]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:36:15 user nova-compute[74683]:       <source dev="/dev/sdf"/>
Oct 16 11:36:15 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:36:15 user nova-compute[74683]:       <serial>f9b67505-0202-45d9-83d4-13042662620d</serial>
Oct 16 11:36:15 user nova-compute[74683]:     </disk>
Oct 16 11:36:15 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:36:15 user nova-compute[74683]:       <mac address="fa:16:3e:10:7f:06"/>
Oct 16 11:36:15 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:36:15 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:36:15 user nova-compute[74683]:       <target dev="tap3a3bfab4-55"/>
Oct 16 11:36:15 user nova-compute[74683]:     </interface>
Oct 16 11:36:15 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:36:15 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/a6cb0bee-7424-4798-aac2-d5606f124733/console.log" append="off"/>
Oct 16 11:36:15 user nova-compute[74683]:     </serial>
Oct 16 11:36:15 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:36:15 user nova-compute[74683]:     <video>
Oct 16 11:36:15 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:36:15 user nova-compute[74683]:     </video>
Oct 16 11:36:15 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:36:15 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:36:15 user nova-compute[74683]:     </rng>
Oct 16 11:36:15 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:36:15 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:36:15 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:36:15 user nova-compute[74683]:     </memballoon>
Oct 16 11:36:15 user nova-compute[74683]:   </devices>
Oct 16 11:36:15 user nova-compute[74683]: </domain>
Oct 16 11:36:15 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:36:15 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:35:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1953735950',display_name='tempest-TestVolumeBootPattern-server-1953735950',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1953735950',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJbd1pnA0e+ubtg3c4vxF2Dxe/3H7OECUV6ZZvaa4rKNrKocz4jmO0SXeRO4F7NQHuYFrsF7rAUyRZ4V/U5HkEw1E5UZyfInFppdQCzqY7p8CVOHAXsTsTbK336AbWu7g==',key_name='tempest-TestVolumeBootPattern-1282364245',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2aefabef9e42412f8309f490dcfecc79',ramdisk_id='',reservation_id='r-oeniscjh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-953001121',owner_user_name='tempest-TestVolumeBootPattern-953001121-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:35:56Z,user_data=None,user_id='a463a84e332543dfbc03b81518f82be1',uuid=a6cb0bee-7424-4798-aac2-d5606f124733,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a3bfab4-5540-4133-9b06-9fadf024f74c", "address": "fa:16:3e:10:7f:06", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a3bfab4-55", "ovs_interfaceid": "3a3bfab4-5540-4133-9b06-9fadf024f74c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:36:15 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Converting VIF {"id": "3a3bfab4-5540-4133-9b06-9fadf024f74c", "address": "fa:16:3e:10:7f:06", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a3bfab4-55", "ovs_interfaceid": "3a3bfab4-5540-4133-9b06-9fadf024f74c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:36:15 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:7f:06,bridge_name='br-int',has_traffic_filtering=True,id=3a3bfab4-5540-4133-9b06-9fadf024f74c,network=Network(00883fc4-0b74-4afd-9043-82e2933faab3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a3bfab4-55') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:36:15 user nova-compute[74683]: DEBUG os_vif [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:7f:06,bridge_name='br-int',has_traffic_filtering=True,id=3a3bfab4-5540-4133-9b06-9fadf024f74c,network=Network(00883fc4-0b74-4afd-9043-82e2933faab3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a3bfab4-55') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:36:15 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:36:15 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:36:15 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:36:15 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:36:15 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fba92d67-4549-52c1-a483-dc64e5b1f82e', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:36:15 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:36:15 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:36:15 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:36:15 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:36:15 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a3bfab4-55, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:36:15 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3a3bfab4-55, col_values=(('qos', UUID('c7cd11e2-47a6-444c-a465-3d1a9f867271')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:36:15 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3a3bfab4-55, col_values=(('external_ids', {'iface-id': '3a3bfab4-5540-4133-9b06-9fadf024f74c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:7f:06', 'vm-uuid': 'a6cb0bee-7424-4798-aac2-d5606f124733'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:36:15 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:36:15 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:36:15 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:36:15 user nova-compute[74683]: INFO os_vif [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:7f:06,bridge_name='br-int',has_traffic_filtering=True,id=3a3bfab4-5540-4133-9b06-9fadf024f74c,network=Network(00883fc4-0b74-4afd-9043-82e2933faab3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a3bfab4-55')
Oct 16 11:36:15 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:36:15 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] No VIF found with MAC fa:16:3e:10:7f:06, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:36:16 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:36:16 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:36:16 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:36:16 user nova-compute[74683]: DEBUG nova.compute.manager [req-51a9f4d9-a9f8-4feb-9d2d-8cc0748f6524 req-9f5bf087-739f-465c-8de5-88d694407f0e service nova] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Received event network-vif-plugged-3a3bfab4-5540-4133-9b06-9fadf024f74c {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:36:16 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-51a9f4d9-a9f8-4feb-9d2d-8cc0748f6524 req-9f5bf087-739f-465c-8de5-88d694407f0e service nova] Acquiring lock "a6cb0bee-7424-4798-aac2-d5606f124733-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:36:16 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-51a9f4d9-a9f8-4feb-9d2d-8cc0748f6524 req-9f5bf087-739f-465c-8de5-88d694407f0e service nova] Lock "a6cb0bee-7424-4798-aac2-d5606f124733-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:36:16 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-51a9f4d9-a9f8-4feb-9d2d-8cc0748f6524 req-9f5bf087-739f-465c-8de5-88d694407f0e service nova] Lock "a6cb0bee-7424-4798-aac2-d5606f124733-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:36:16 user nova-compute[74683]: DEBUG nova.compute.manager [req-51a9f4d9-a9f8-4feb-9d2d-8cc0748f6524 req-9f5bf087-739f-465c-8de5-88d694407f0e service nova] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] No waiting events found dispatching network-vif-plugged-3a3bfab4-5540-4133-9b06-9fadf024f74c {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:36:16 user nova-compute[74683]: WARNING nova.compute.manager [req-51a9f4d9-a9f8-4feb-9d2d-8cc0748f6524 req-9f5bf087-739f-465c-8de5-88d694407f0e service nova] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Received unexpected event network-vif-plugged-3a3bfab4-5540-4133-9b06-9fadf024f74c for instance with vm_state building and task_state spawning.
Oct 16 11:36:16 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:36:16 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:36:16 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:36:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:36:18 user nova-compute[74683]: DEBUG nova.compute.manager [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Instance event wait completed in 0 seconds for  {{(pid=74683) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 11:36:18 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Guest created on hypervisor {{(pid=74683) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 11:36:18 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Instance spawned successfully.
Oct 16 11:36:18 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 11:36:18 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Found default for hw_cdrom_bus of ide {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:36:18 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Found default for hw_disk_bus of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:36:18 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Found default for hw_input_bus of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:36:18 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Found default for hw_pointer_model of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:36:18 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Found default for hw_video_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:36:18 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Found default for hw_vif_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:36:18 user nova-compute[74683]: INFO nova.compute.manager [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Took 4.93 seconds to spawn the instance on the hypervisor.
Oct 16 11:36:18 user nova-compute[74683]: DEBUG nova.compute.manager [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:36:18 user nova-compute[74683]: INFO nova.compute.manager [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Took 23.29 seconds to build instance.
Oct 16 11:36:18 user nova-compute[74683]: DEBUG nova.compute.manager [req-7b6c2f3f-0516-4db8-a4b2-20ba86768ac2 req-a0c8f334-feef-44f1-b473-cfb9925e7afb service nova] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Received event network-vif-plugged-3a3bfab4-5540-4133-9b06-9fadf024f74c {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:36:18 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-7b6c2f3f-0516-4db8-a4b2-20ba86768ac2 req-a0c8f334-feef-44f1-b473-cfb9925e7afb service nova] Acquiring lock "a6cb0bee-7424-4798-aac2-d5606f124733-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:36:18 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-7b6c2f3f-0516-4db8-a4b2-20ba86768ac2 req-a0c8f334-feef-44f1-b473-cfb9925e7afb service nova] Lock "a6cb0bee-7424-4798-aac2-d5606f124733-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:36:18 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-7b6c2f3f-0516-4db8-a4b2-20ba86768ac2 req-a0c8f334-feef-44f1-b473-cfb9925e7afb service nova] Lock "a6cb0bee-7424-4798-aac2-d5606f124733-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:36:18 user nova-compute[74683]: DEBUG nova.compute.manager [req-7b6c2f3f-0516-4db8-a4b2-20ba86768ac2 req-a0c8f334-feef-44f1-b473-cfb9925e7afb service nova] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] No waiting events found dispatching network-vif-plugged-3a3bfab4-5540-4133-9b06-9fadf024f74c {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:36:18 user nova-compute[74683]: WARNING nova.compute.manager [req-7b6c2f3f-0516-4db8-a4b2-20ba86768ac2 req-a0c8f334-feef-44f1-b473-cfb9925e7afb service nova] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Received unexpected event network-vif-plugged-3a3bfab4-5540-4133-9b06-9fadf024f74c for instance with vm_state active and task_state None.
Oct 16 11:36:18 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:36:18 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Starting heal instance info cache {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 11:36:18 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2979b2bb-614b-406e-80d9-9038c9437e2e tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "a6cb0bee-7424-4798-aac2-d5606f124733" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.418s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:36:18 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "refresh_cache-b91af786-36e3-4815-811f-fb3c055e758d" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:36:18 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquired lock "refresh_cache-b91af786-36e3-4815-811f-fb3c055e758d" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:36:18 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Forcefully refreshing network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 11:36:19 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Updating instance_info_cache with network_info: [{"id": "abc9cf45-e4f5-4a33-9ffc-dab110e73398", "address": "fa:16:3e:03:03:02", "network": {"id": "fa128ba8-cd2f-4621-ac04-ecc21569bb68", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321708612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66a49078f1240bd88207e487dd4951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc9cf45-e4", "ovs_interfaceid": "abc9cf45-e4f5-4a33-9ffc-dab110e73398", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:36:19 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Releasing lock "refresh_cache-b91af786-36e3-4815-811f-fb3c055e758d" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:36:19 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Updated the network info_cache for instance {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 11:36:19 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:36:19 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:36:20 user nova-compute[74683]: DEBUG nova.objects.instance [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lazy-loading 'flavor' on Instance uuid f5ad764c-638d-4dac-b032-6680917e46df {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:36:20 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Acquiring lock "refresh_cache-f5ad764c-638d-4dac-b032-6680917e46df" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:36:20 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Acquired lock "refresh_cache-f5ad764c-638d-4dac-b032-6680917e46df" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:36:20 user nova-compute[74683]: DEBUG nova.network.neutron [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:36:20 user nova-compute[74683]: DEBUG nova.objects.instance [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lazy-loading 'info_cache' on Instance uuid f5ad764c-638d-4dac-b032-6680917e46df {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:36:20 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:36:20 user nova-compute[74683]: DEBUG nova.objects.base [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Object Instance<f5ad764c-638d-4dac-b032-6680917e46df> lazy-loaded attributes: flavor,info_cache {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:36:20 user nova-compute[74683]: DEBUG nova.network.neutron [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Updating instance_info_cache with network_info: [{"id": "eb80f49f-da30-478a-900a-5d3da8ec7fa9", "address": "fa:16:3e:c8:02:4d", "network": {"id": "badd2db9-6c0f-40cc-afe9-a199e040399a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1368098259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "889cb980200446c0933fe965738a62df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb80f49f-da", "ovs_interfaceid": "eb80f49f-da30-478a-900a-5d3da8ec7fa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:36:20 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Releasing lock "refresh_cache-f5ad764c-638d-4dac-b032-6680917e46df" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:36:20 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:36:20 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Instance destroyed successfully.
Oct 16 11:36:20 user nova-compute[74683]: DEBUG nova.objects.instance [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lazy-loading 'resources' on Instance uuid f5ad764c-638d-4dac-b032-6680917e46df {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:36:20 user nova-compute[74683]: DEBUG nova.objects.base [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Object Instance<f5ad764c-638d-4dac-b032-6680917e46df> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:36:20 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:32:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1312798176',display_name='tempest-AttachVolumeTestJSON-server-1312798176',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1312798176',id=37,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK71ozq2/KpO5RlTCFqfn2Y2zadWP27MahKIqPNvvjn6AoGcB4vtAlejjcQWpo0ZyUGWpGjLegzCVDVvdR5EwjFBNV5GDYZr2laQXH53s66DwTCeGEg2DbbqZiQTOGLfAw==',key_name='tempest-keypair-1447279783',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:32:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='889cb980200446c0933fe965738a62df',ramdisk_id='',reservation_id='r-acd30a2f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-263939305',owner_user_name='tempest-AttachVolumeTestJSON-263939305-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:34:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c38fd3bc86ba4b7a95e06b926d22e60f',uuid=f5ad764c-638d-4dac-b032-6680917e46df,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "eb80f49f-da30-478a-900a-5d3da8ec7fa9", "address": "fa:16:3e:c8:02:4d", "network": {"id": "badd2db9-6c0f-40cc-afe9-a199e040399a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1368098259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "889cb980200446c0933fe965738a62df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb80f49f-da", "ovs_interfaceid": "eb80f49f-da30-478a-900a-5d3da8ec7fa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:36:20 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Converting VIF {"id": "eb80f49f-da30-478a-900a-5d3da8ec7fa9", "address": "fa:16:3e:c8:02:4d", "network": {"id": "badd2db9-6c0f-40cc-afe9-a199e040399a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1368098259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "889cb980200446c0933fe965738a62df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb80f49f-da", "ovs_interfaceid": "eb80f49f-da30-478a-900a-5d3da8ec7fa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:36:20 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:02:4d,bridge_name='br-int',has_traffic_filtering=True,id=eb80f49f-da30-478a-900a-5d3da8ec7fa9,network=Network(badd2db9-6c0f-40cc-afe9-a199e040399a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb80f49f-da') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:36:20 user nova-compute[74683]: DEBUG os_vif [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:02:4d,bridge_name='br-int',has_traffic_filtering=True,id=eb80f49f-da30-478a-900a-5d3da8ec7fa9,network=Network(badd2db9-6c0f-40cc-afe9-a199e040399a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb80f49f-da') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:36:20 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:36:20 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeb80f49f-da, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:36:20 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:36:20 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:36:20 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:36:20 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7e530e55-9597-4dd5-b3ab-26570d287753) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:36:20 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:36:20 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:36:20 user nova-compute[74683]: INFO os_vif [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:02:4d,bridge_name='br-int',has_traffic_filtering=True,id=eb80f49f-da30-478a-900a-5d3da8ec7fa9,network=Network(badd2db9-6c0f-40cc-afe9-a199e040399a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb80f49f-da')
Oct 16 11:36:20 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] calling os-brick to detach iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 11:36:20 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, {'target_iqn': 'iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JjfbFZCq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:36:20 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:36:20 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:36:20 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:36:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:36:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:36:20 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[de914b95-b211-4827-9976-efff9b95e728]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:36:20 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 11:36:20 user nova-compute[74683]: No targets found.
Oct 16 11:36:20 user nova-compute[74683]: iSNS:
Oct 16 11:36:20 user nova-compute[74683]: No targets found.
Oct 16 11:36:20 user nova-compute[74683]: STATIC:
Oct 16 11:36:20 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e
Oct 16 11:36:20 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:36:20 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:36:20 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f
Oct 16 11:36:20 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:36:20 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:36:20 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b
Oct 16 11:36:20 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:36:20 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:36:20 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44
Oct 16 11:36:20 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:36:20 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:36:20 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d
Oct 16 11:36:20 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:36:20 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:36:20 user nova-compute[74683]: FIRMWARE:
Oct 16 11:36:20 user nova-compute[74683]: No targets found.
Oct 16 11:36:20 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:36:20 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 11:36:20 user nova-compute[74683]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 11:36:20 user nova-compute[74683]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74683) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 11:36:20 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e', 0)] {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 11:36:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:36:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:36:20 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b2c904-1933-412f-b71c-bbae5d8d569d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:36:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:36:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:36:20 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[da033b47-e217-44fb-93f9-51e37057e6d7]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:36:20 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b (non-flash)
Oct 16 11:36:20 user nova-compute[74683]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)
Oct 16 11:36:20 user nova-compute[74683]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)
Oct 16 11:36:20 user nova-compute[74683]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e (non-flash)
Oct 16 11:36:20 user nova-compute[74683]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d (non-flash)
Oct 16 11:36:20 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:36:20 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b (non-flash)
Oct 16 11:36:20 user nova-compute[74683]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)
Oct 16 11:36:20 user nova-compute[74683]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)
Oct 16 11:36:20 user nova-compute[74683]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e (non-flash)
Oct 16 11:36:20 user nova-compute[74683]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d (non-flash)
Oct 16 11:36:20 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:36:20 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda4c794dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e'): ({'sde'}, set())}) {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 11:36:20 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Removing single pathed devices sde {{(pid=74683) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 11:36:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:36:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:36:20 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[49bbcfae-22e3-4869-ae39-4a1b86cc4aa9]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:36:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:36:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:36:20 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[664d1583-9f96-4bce-b1de-5d2239c0959e]: (4, ('ok\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:36:20 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Flushing IO for device /dev/sde {{(pid=74683) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 11:36:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:36:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:36:20 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5144291-695a-48ab-a8d7-b951374c138e]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:36:20 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74683) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 11:36:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:36:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:36:20 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[257f8fed-02eb-4dd7-80e1-6aac579e59a0]: (4, ('1', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:36:20 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 11:36:20 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] SCSI volumes sde have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 11:36:20 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e')] {{(pid=74683) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 11:36:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:36:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:36:20 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8021da8-89dd-4ec4-ba77-41d0d9cd67b7]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:36:20 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:36:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e -p 172.16.0.220:3260 --logout {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e -p 172.16.0.220:3260 --logout" returned: 0 in 0.091s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc6f081-c4d1-4f4c-8d1b-d27f1266d2fe]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e, portal: 172.16.0.220,3260]
Oct 16 11:36:21 user nova-compute[74683]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e, portal: 172.16.0.220,3260] successful.
Oct 16 11:36:21 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e -p 172.16.0.220:3260 --op delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[78468ad5-4ba9-4bc4-8198-6f9768f46556]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] <== disconnect_volume: return (365ms) None {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Disconnected iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Start _get_guest_xml network_info=[{"id": "eb80f49f-da30-478a-900a-5d3da8ec7fa9", "address": "fa:16:3e:c8:02:4d", "network": {"id": "badd2db9-6c0f-40cc-afe9-a199e040399a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1368098259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "889cb980200446c0933fe965738a62df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb80f49f-da", "ovs_interfaceid": "eb80f49f-da30-478a-900a-5d3da8ec7fa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JjfbFZCq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'f5ad764c-638d-4dac-b032-6680917e46df', 'attached_at': '', 'detached_at': '', 'volume_id': '22c582f7-e7ab-4c14-a3e5-2d52b953051e', 'serial': '22c582f7-e7ab-4c14-a3e5-2d52b953051e'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': None, 'delete_on_termination': False, 'attachment_id': '4dcc279c-936d-4432-a0de-4efb1a3d6aba', 'volume_type': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG nova.objects.instance [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lazy-loading 'numa_topology' on Instance uuid f5ad764c-638d-4dac-b032-6680917e46df {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG nova.objects.base [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Object Instance<f5ad764c-638d-4dac-b032-6680917e46df> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:36:21 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:36:21 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:36:21 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG nova.objects.instance [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lazy-loading 'vcpu_model' on Instance uuid f5ad764c-638d-4dac-b032-6680917e46df {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG nova.objects.base [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Object Instance<f5ad764c-638d-4dac-b032-6680917e46df> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Calling os-brick to attach iSCSI Volume {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JjfbFZCq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:36:21 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:36:21 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:36:21 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:36:21 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:36:21 user nova-compute[74683]: INFO os_brick.initiator.connectors.iscsi [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 11:36:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e -p 172.16.0.220:3260 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e3d186-1d5f-4b5c-9bbc-616f7df7df9d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 11:36:21 user nova-compute[74683]:  {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e -p 172.16.0.220:3260 --interface default --op new {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[743f3255-6e11-4c3d-93c8-949af867a10f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e] added\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e] added
Oct 16 11:36:21 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c659e8a-47be-4bd3-a20d-0d95a4287a10]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ac1654-df6c-4ea4-a7a5-26b42e55755d]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JjfbFZCq {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JjfbFZCq" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca787129-0901-4e4b-b4bd-321ad661aec4]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JjfbFZCq'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a24fe3-5082-4688-9293-2108badcf75a]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d200c04d-50a0-41ce-8da0-47efaa8233fd]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b (non-flash)
Oct 16 11:36:21 user nova-compute[74683]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)
Oct 16 11:36:21 user nova-compute[74683]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)
Oct 16 11:36:21 user nova-compute[74683]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d (non-flash)
Oct 16 11:36:21 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b (non-flash)
Oct 16 11:36:21 user nova-compute[74683]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)
Oct 16 11:36:21 user nova-compute[74683]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)
Oct 16 11:36:21 user nova-compute[74683]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d (non-flash)
Oct 16 11:36:21 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e -p 172.16.0.220:3260 --login {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8f53d1-fb5a-4f83-9ea6-f09fd24015c1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e, portal: 172.16.0.220,3260]
Oct 16 11:36:21 user nova-compute[74683]: Login to [iface: default, target: iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e, portal: 172.16.0.220,3260] successful.
Oct 16 11:36:21 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9af28e-295b-4971-9410-8f503256d6a0]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac27bd8-d1a2-4a84-883b-6b9bd357b058]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b (non-flash)
Oct 16 11:36:21 user nova-compute[74683]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)
Oct 16 11:36:21 user nova-compute[74683]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)
Oct 16 11:36:21 user nova-compute[74683]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d (non-flash)
Oct 16 11:36:21 user nova-compute[74683]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e (non-flash)
Oct 16 11:36:21 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b (non-flash)
Oct 16 11:36:21 user nova-compute[74683]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)
Oct 16 11:36:21 user nova-compute[74683]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)
Oct 16 11:36:21 user nova-compute[74683]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d (non-flash)
Oct 16 11:36:21 user nova-compute[74683]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e (non-flash)
Oct 16 11:36:21 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Connected to 172.16.0.220:3260 {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] HCTL ('36', '-', '-', 0) found on session 43 with lun 0 {{(pid=74683) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74683) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90b56aa-d783-415b-9b46-3f2892b52d6b]: (4, ('- - 0', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Searching for a device in session 43 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JjfbFZCq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 11:36:21 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:36:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:36:22 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.376s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:36:22 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] <== connect_volume: return (1377ms) {'type': 'block', 'scsi_wwn': '26630613737363966', 'path': '/dev/sde'} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:36:22 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630613737363966', 'path': '/dev/sde'} {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 11:36:22 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:32:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1312798176',display_name='tempest-AttachVolumeTestJSON-server-1312798176',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1312798176',id=37,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK71ozq2/KpO5RlTCFqfn2Y2zadWP27MahKIqPNvvjn6AoGcB4vtAlejjcQWpo0ZyUGWpGjLegzCVDVvdR5EwjFBNV5GDYZr2laQXH53s66DwTCeGEg2DbbqZiQTOGLfAw==',key_name='tempest-keypair-1447279783',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:32:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='889cb980200446c0933fe965738a62df',ramdisk_id='',reservation_id='r-acd30a2f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-263939305',owner_user_name='tempest-AttachVolumeTestJSON-263939305-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:34:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c38fd3bc86ba4b7a95e06b926d22e60f',uuid=f5ad764c-638d-4dac-b032-6680917e46df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "eb80f49f-da30-478a-900a-5d3da8ec7fa9", "address": "fa:16:3e:c8:02:4d", "network": {"id": "badd2db9-6c0f-40cc-afe9-a199e040399a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1368098259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "889cb980200446c0933fe965738a62df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb80f49f-da", "ovs_interfaceid": "eb80f49f-da30-478a-900a-5d3da8ec7fa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:36:22 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Converting VIF {"id": "eb80f49f-da30-478a-900a-5d3da8ec7fa9", "address": "fa:16:3e:c8:02:4d", "network": {"id": "badd2db9-6c0f-40cc-afe9-a199e040399a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1368098259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "889cb980200446c0933fe965738a62df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb80f49f-da", "ovs_interfaceid": "eb80f49f-da30-478a-900a-5d3da8ec7fa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:36:22 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:02:4d,bridge_name='br-int',has_traffic_filtering=True,id=eb80f49f-da30-478a-900a-5d3da8ec7fa9,network=Network(badd2db9-6c0f-40cc-afe9-a199e040399a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb80f49f-da') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:36:22 user nova-compute[74683]: DEBUG nova.objects.instance [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lazy-loading 'pci_devices' on Instance uuid f5ad764c-638d-4dac-b032-6680917e46df {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:36:22 user nova-compute[74683]: DEBUG nova.objects.base [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Object Instance<f5ad764c-638d-4dac-b032-6680917e46df> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:36:22 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:36:22 user nova-compute[74683]:   <uuid>f5ad764c-638d-4dac-b032-6680917e46df</uuid>
Oct 16 11:36:22 user nova-compute[74683]:   <name>instance-00000025</name>
Oct 16 11:36:22 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:36:22 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:36:22 user nova-compute[74683]:   <metadata>
Oct 16 11:36:22 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:36:22 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:36:22 user nova-compute[74683]:       <nova:name>tempest-AttachVolumeTestJSON-server-1312798176</nova:name>
Oct 16 11:36:22 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:36:21</nova:creationTime>
Oct 16 11:36:22 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:36:22 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:36:22 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:36:22 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:36:22 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:36:22 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:36:22 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:36:22 user nova-compute[74683]:       <nova:owner>
Oct 16 11:36:22 user nova-compute[74683]:         <nova:user uuid="c38fd3bc86ba4b7a95e06b926d22e60f">tempest-AttachVolumeTestJSON-263939305-project-member</nova:user>
Oct 16 11:36:22 user nova-compute[74683]:         <nova:project uuid="889cb980200446c0933fe965738a62df">tempest-AttachVolumeTestJSON-263939305</nova:project>
Oct 16 11:36:22 user nova-compute[74683]:       </nova:owner>
Oct 16 11:36:22 user nova-compute[74683]:       <nova:root type="image" uuid="0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f"/>
Oct 16 11:36:22 user nova-compute[74683]:       <nova:ports>
Oct 16 11:36:22 user nova-compute[74683]:         <nova:port uuid="eb80f49f-da30-478a-900a-5d3da8ec7fa9">
Oct 16 11:36:22 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 16 11:36:22 user nova-compute[74683]:         </nova:port>
Oct 16 11:36:22 user nova-compute[74683]:       </nova:ports>
Oct 16 11:36:22 user nova-compute[74683]:     </nova:instance>
Oct 16 11:36:22 user nova-compute[74683]:   </metadata>
Oct 16 11:36:22 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:36:22 user nova-compute[74683]:     <system>
Oct 16 11:36:22 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:36:22 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:36:22 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:36:22 user nova-compute[74683]:       <entry name="serial">f5ad764c-638d-4dac-b032-6680917e46df</entry>
Oct 16 11:36:22 user nova-compute[74683]:       <entry name="uuid">f5ad764c-638d-4dac-b032-6680917e46df</entry>
Oct 16 11:36:22 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:36:22 user nova-compute[74683]:     </system>
Oct 16 11:36:22 user nova-compute[74683]:   </sysinfo>
Oct 16 11:36:22 user nova-compute[74683]:   <os>
Oct 16 11:36:22 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:36:22 user nova-compute[74683]:     <boot dev="hd"/>
Oct 16 11:36:22 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:36:22 user nova-compute[74683]:   </os>
Oct 16 11:36:22 user nova-compute[74683]:   <features>
Oct 16 11:36:22 user nova-compute[74683]:     <acpi/>
Oct 16 11:36:22 user nova-compute[74683]:     <apic/>
Oct 16 11:36:22 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:36:22 user nova-compute[74683]:   </features>
Oct 16 11:36:22 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:36:22 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:36:22 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:36:22 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:36:22 user nova-compute[74683]:   </clock>
Oct 16 11:36:22 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:36:22 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:36:22 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:36:22 user nova-compute[74683]:   </cpu>
Oct 16 11:36:22 user nova-compute[74683]:   <devices>
Oct 16 11:36:22 user nova-compute[74683]:     <disk type="file" device="disk">
Oct 16 11:36:22 user nova-compute[74683]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 11:36:22 user nova-compute[74683]:       <source file="/opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk"/>
Oct 16 11:36:22 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:36:22 user nova-compute[74683]:     </disk>
Oct 16 11:36:22 user nova-compute[74683]:     <disk type="block" device="disk">
Oct 16 11:36:22 user nova-compute[74683]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:36:22 user nova-compute[74683]:       <source dev="/dev/sde"/>
Oct 16 11:36:22 user nova-compute[74683]:       <target dev="vdb" bus="virtio"/>
Oct 16 11:36:22 user nova-compute[74683]:       <serial>22c582f7-e7ab-4c14-a3e5-2d52b953051e</serial>
Oct 16 11:36:22 user nova-compute[74683]:     </disk>
Oct 16 11:36:22 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:36:22 user nova-compute[74683]:       <mac address="fa:16:3e:c8:02:4d"/>
Oct 16 11:36:22 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:36:22 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:36:22 user nova-compute[74683]:       <target dev="tapeb80f49f-da"/>
Oct 16 11:36:22 user nova-compute[74683]:     </interface>
Oct 16 11:36:22 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:36:22 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/console.log" append="off"/>
Oct 16 11:36:22 user nova-compute[74683]:     </serial>
Oct 16 11:36:22 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:36:22 user nova-compute[74683]:     <video>
Oct 16 11:36:22 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:36:22 user nova-compute[74683]:     </video>
Oct 16 11:36:22 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:36:22 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:36:22 user nova-compute[74683]:     </rng>
Oct 16 11:36:22 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:36:22 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:36:22 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:36:22 user nova-compute[74683]:     </memballoon>
Oct 16 11:36:22 user nova-compute[74683]:   </devices>
Oct 16 11:36:22 user nova-compute[74683]: </domain>
Oct 16 11:36:22 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:36:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:36:22 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:36:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:36:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:36:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:36:23 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:36:23 user nova-compute[74683]: DEBUG nova.objects.instance [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lazy-loading 'trusted_certs' on Instance uuid f5ad764c-638d-4dac-b032-6680917e46df {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:36:23 user nova-compute[74683]: DEBUG nova.objects.base [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Object Instance<f5ad764c-638d-4dac-b032-6680917e46df> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:36:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:36:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.262s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:36:23 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk. size=1073741824 {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 11:36:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:36:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:36:23 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Cannot resize image /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk to a smaller size. {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 11:36:23 user nova-compute[74683]: DEBUG nova.objects.instance [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lazy-loading 'migration_context' on Instance uuid f5ad764c-638d-4dac-b032-6680917e46df {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:36:23 user nova-compute[74683]: DEBUG nova.objects.base [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Object Instance<f5ad764c-638d-4dac-b032-6680917e46df> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:36:23 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:32:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1312798176',display_name='tempest-AttachVolumeTestJSON-server-1312798176',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1312798176',id=37,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK71ozq2/KpO5RlTCFqfn2Y2zadWP27MahKIqPNvvjn6AoGcB4vtAlejjcQWpo0ZyUGWpGjLegzCVDVvdR5EwjFBNV5GDYZr2laQXH53s66DwTCeGEg2DbbqZiQTOGLfAw==',key_name='tempest-keypair-1447279783',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:32:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='889cb980200446c0933fe965738a62df',ramdisk_id='',reservation_id='r-acd30a2f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-263939305',owner_user_name='tempest-AttachVolumeTestJSON-263939305-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:34:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c38fd3bc86ba4b7a95e06b926d22e60f',uuid=f5ad764c-638d-4dac-b032-6680917e46df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "eb80f49f-da30-478a-900a-5d3da8ec7fa9", "address": "fa:16:3e:c8:02:4d", "network": {"id": "badd2db9-6c0f-40cc-afe9-a199e040399a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1368098259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "889cb980200446c0933fe965738a62df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb80f49f-da", "ovs_interfaceid": "eb80f49f-da30-478a-900a-5d3da8ec7fa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:36:23 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Converting VIF {"id": "eb80f49f-da30-478a-900a-5d3da8ec7fa9", "address": "fa:16:3e:c8:02:4d", "network": {"id": "badd2db9-6c0f-40cc-afe9-a199e040399a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1368098259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "889cb980200446c0933fe965738a62df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb80f49f-da", "ovs_interfaceid": "eb80f49f-da30-478a-900a-5d3da8ec7fa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:36:23 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:02:4d,bridge_name='br-int',has_traffic_filtering=True,id=eb80f49f-da30-478a-900a-5d3da8ec7fa9,network=Network(badd2db9-6c0f-40cc-afe9-a199e040399a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb80f49f-da') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:36:23 user nova-compute[74683]: DEBUG os_vif [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:02:4d,bridge_name='br-int',has_traffic_filtering=True,id=eb80f49f-da30-478a-900a-5d3da8ec7fa9,network=Network(badd2db9-6c0f-40cc-afe9-a199e040399a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb80f49f-da') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:36:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:36:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:36:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:36:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:36:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '62e33a0e-1db6-509e-9031-ed30d2e60514', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:36:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:36:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:36:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeb80f49f-da, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:36:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeb80f49f-da, col_values=(('qos', UUID('a24882a7-6fb1-415e-8b66-25678fd75589')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:36:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeb80f49f-da, col_values=(('external_ids', {'iface-id': 'eb80f49f-da30-478a-900a-5d3da8ec7fa9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:02:4d', 'vm-uuid': 'f5ad764c-638d-4dac-b032-6680917e46df'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:36:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:36:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:36:23 user nova-compute[74683]: INFO os_vif [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:02:4d,bridge_name='br-int',has_traffic_filtering=True,id=eb80f49f-da30-478a-900a-5d3da8ec7fa9,network=Network(badd2db9-6c0f-40cc-afe9-a199e040399a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb80f49f-da')
Oct 16 11:36:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:36:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:36:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:36:25 user nova-compute[74683]: DEBUG nova.compute.manager [req-3d094619-d9d8-4c49-a613-d608ba6ccf4e req-ae090cf6-eb71-4dbb-92dd-d0aeb7e7e2e3 service nova] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Received event network-vif-plugged-eb80f49f-da30-478a-900a-5d3da8ec7fa9 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:36:25 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-3d094619-d9d8-4c49-a613-d608ba6ccf4e req-ae090cf6-eb71-4dbb-92dd-d0aeb7e7e2e3 service nova] Acquiring lock "f5ad764c-638d-4dac-b032-6680917e46df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:36:25 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-3d094619-d9d8-4c49-a613-d608ba6ccf4e req-ae090cf6-eb71-4dbb-92dd-d0aeb7e7e2e3 service nova] Lock "f5ad764c-638d-4dac-b032-6680917e46df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:36:25 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-3d094619-d9d8-4c49-a613-d608ba6ccf4e req-ae090cf6-eb71-4dbb-92dd-d0aeb7e7e2e3 service nova] Lock "f5ad764c-638d-4dac-b032-6680917e46df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:36:25 user nova-compute[74683]: DEBUG nova.compute.manager [req-3d094619-d9d8-4c49-a613-d608ba6ccf4e req-ae090cf6-eb71-4dbb-92dd-d0aeb7e7e2e3 service nova] [instance: f5ad764c-638d-4dac-b032-6680917e46df] No waiting events found dispatching network-vif-plugged-eb80f49f-da30-478a-900a-5d3da8ec7fa9 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:36:25 user nova-compute[74683]: WARNING nova.compute.manager [req-3d094619-d9d8-4c49-a613-d608ba6ccf4e req-ae090cf6-eb71-4dbb-92dd-d0aeb7e7e2e3 service nova] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Received unexpected event network-vif-plugged-eb80f49f-da30-478a-900a-5d3da8ec7fa9 for instance with vm_state stopped and task_state powering-on.
Oct 16 11:36:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:36:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:36:25 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:36:25 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:36:25 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74683) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 11:36:25 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:36:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:36:25 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:36:25 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:36:25 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:36:25 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Auditing locally available compute resources for user (node: user) {{(pid=74683) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 11:36:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:36:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:36:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:36:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:36:26 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:36:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:36:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:36:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:36:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:36:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d94b70c-4056-4c58-9df4-73684e0d164f/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:36:26 user nova-compute[74683]: DEBUG nova.compute.manager [req-15405fc2-4dd1-4f3e-a3ea-d1b0b153b4cc req-a02d0491-4c72-4640-bf9a-95b73756aede service nova] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Received event network-changed-a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:36:26 user nova-compute[74683]: DEBUG nova.compute.manager [req-15405fc2-4dd1-4f3e-a3ea-d1b0b153b4cc req-a02d0491-4c72-4640-bf9a-95b73756aede service nova] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Refreshing instance network info cache due to event network-changed-a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:36:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-15405fc2-4dd1-4f3e-a3ea-d1b0b153b4cc req-a02d0491-4c72-4640-bf9a-95b73756aede service nova] Acquiring lock "refresh_cache-9ece51b6-5cb3-4d79-acdb-ea4d895cdce8" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:36:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-15405fc2-4dd1-4f3e-a3ea-d1b0b153b4cc req-a02d0491-4c72-4640-bf9a-95b73756aede service nova] Acquired lock "refresh_cache-9ece51b6-5cb3-4d79-acdb-ea4d895cdce8" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:36:26 user nova-compute[74683]: DEBUG nova.network.neutron [req-15405fc2-4dd1-4f3e-a3ea-d1b0b153b4cc req-a02d0491-4c72-4640-bf9a-95b73756aede service nova] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Refreshing network info cache for port a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:36:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d94b70c-4056-4c58-9df4-73684e0d164f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:36:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d94b70c-4056-4c58-9df4-73684e0d164f/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:36:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:36:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d94b70c-4056-4c58-9df4-73684e0d164f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:36:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:36:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf62c7a-fa86-4e13-bc28-13d8cb2918da/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:36:27 user nova-compute[74683]: DEBUG nova.compute.manager [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Instance event wait completed in 0 seconds for  {{(pid=74683) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 11:36:27 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Instance rebooted successfully.
Oct 16 11:36:27 user nova-compute[74683]: DEBUG nova.compute.manager [None req-a1f04f42-79a6-49e1-8df4-61d52991febe tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:36:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf62c7a-fa86-4e13-bc28-13d8cb2918da/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:36:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf62c7a-fa86-4e13-bc28-13d8cb2918da/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:36:27 user nova-compute[74683]: DEBUG nova.compute.manager [req-3bcff714-e09c-4570-a5a2-e5c952db1a39 req-17559702-b2c0-4f12-a112-3c8cfabffa8a service nova] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Received event network-vif-plugged-eb80f49f-da30-478a-900a-5d3da8ec7fa9 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:36:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-3bcff714-e09c-4570-a5a2-e5c952db1a39 req-17559702-b2c0-4f12-a112-3c8cfabffa8a service nova] Acquiring lock "f5ad764c-638d-4dac-b032-6680917e46df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:36:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-3bcff714-e09c-4570-a5a2-e5c952db1a39 req-17559702-b2c0-4f12-a112-3c8cfabffa8a service nova] Lock "f5ad764c-638d-4dac-b032-6680917e46df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:36:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-3bcff714-e09c-4570-a5a2-e5c952db1a39 req-17559702-b2c0-4f12-a112-3c8cfabffa8a service nova] Lock "f5ad764c-638d-4dac-b032-6680917e46df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:36:27 user nova-compute[74683]: DEBUG nova.compute.manager [req-3bcff714-e09c-4570-a5a2-e5c952db1a39 req-17559702-b2c0-4f12-a112-3c8cfabffa8a service nova] [instance: f5ad764c-638d-4dac-b032-6680917e46df] No waiting events found dispatching network-vif-plugged-eb80f49f-da30-478a-900a-5d3da8ec7fa9 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:36:27 user nova-compute[74683]: WARNING nova.compute.manager [req-3bcff714-e09c-4570-a5a2-e5c952db1a39 req-17559702-b2c0-4f12-a112-3c8cfabffa8a service nova] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Received unexpected event network-vif-plugged-eb80f49f-da30-478a-900a-5d3da8ec7fa9 for instance with vm_state active and task_state None.
Oct 16 11:36:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-87905182-e4b0-4f83-9731-de050d9e2d92 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Acquiring lock "9ece51b6-5cb3-4d79-acdb-ea4d895cdce8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:36:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-87905182-e4b0-4f83-9731-de050d9e2d92 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "9ece51b6-5cb3-4d79-acdb-ea4d895cdce8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:36:27 user nova-compute[74683]: INFO nova.compute.manager [None req-87905182-e4b0-4f83-9731-de050d9e2d92 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Detaching volume 6d40c601-cae7-44b2-b5a1-10ddadfb2b2b
Oct 16 11:36:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf62c7a-fa86-4e13-bc28-13d8cb2918da/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:36:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ece51b6-5cb3-4d79-acdb-ea4d895cdce8/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:36:27 user nova-compute[74683]: INFO nova.virt.block_device [None req-87905182-e4b0-4f83-9731-de050d9e2d92 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Attempting to driver detach volume 6d40c601-cae7-44b2-b5a1-10ddadfb2b2b from mountpoint /dev/vdb
Oct 16 11:36:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-87905182-e4b0-4f83-9731-de050d9e2d92 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Attempting to detach device vdb from instance 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8 from the persistent domain config. {{(pid=74683) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 11:36:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-87905182-e4b0-4f83-9731-de050d9e2d92 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 11:36:27 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:36:27 user nova-compute[74683]:   <source dev="/dev/sdd"/>
Oct 16 11:36:27 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:36:27 user nova-compute[74683]:   <serial>6d40c601-cae7-44b2-b5a1-10ddadfb2b2b</serial>
Oct 16 11:36:27 user nova-compute[74683]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 11:36:27 user nova-compute[74683]: </disk>
Oct 16 11:36:27 user nova-compute[74683]:  {{(pid=74683) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 11:36:27 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-87905182-e4b0-4f83-9731-de050d9e2d92 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Successfully detached device vdb from instance 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8 from the persistent domain config.
Oct 16 11:36:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-87905182-e4b0-4f83-9731-de050d9e2d92 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8 from the live domain config. {{(pid=74683) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 11:36:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-87905182-e4b0-4f83-9731-de050d9e2d92 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 11:36:27 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:36:27 user nova-compute[74683]:   <source dev="/dev/sdd"/>
Oct 16 11:36:27 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:36:27 user nova-compute[74683]:   <serial>6d40c601-cae7-44b2-b5a1-10ddadfb2b2b</serial>
Oct 16 11:36:27 user nova-compute[74683]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 11:36:27 user nova-compute[74683]: </disk>
Oct 16 11:36:27 user nova-compute[74683]:  {{(pid=74683) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 11:36:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ece51b6-5cb3-4d79-acdb-ea4d895cdce8/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:36:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ece51b6-5cb3-4d79-acdb-ea4d895cdce8/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:36:27 user nova-compute[74683]: DEBUG nova.network.neutron [req-15405fc2-4dd1-4f3e-a3ea-d1b0b153b4cc req-a02d0491-4c72-4640-bf9a-95b73756aede service nova] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Updated VIF entry in instance network info cache for port a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:36:27 user nova-compute[74683]: DEBUG nova.network.neutron [req-15405fc2-4dd1-4f3e-a3ea-d1b0b153b4cc req-a02d0491-4c72-4640-bf9a-95b73756aede service nova] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Updating instance_info_cache with network_info: [{"id": "a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6", "address": "fa:16:3e:cf:8d:8b", "network": {"id": "fa128ba8-cd2f-4621-ac04-ecc21569bb68", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321708612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66a49078f1240bd88207e487dd4951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7bd5f8b-2b", "ovs_interfaceid": "a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:36:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-15405fc2-4dd1-4f3e-a3ea-d1b0b153b4cc req-a02d0491-4c72-4640-bf9a-95b73756aede service nova] Releasing lock "refresh_cache-9ece51b6-5cb3-4d79-acdb-ea4d895cdce8" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:36:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ece51b6-5cb3-4d79-acdb-ea4d895cdce8/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:36:28 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:36:28 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:36:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88445f0-2b1c-4cc1-94ca-33a1e3bec929/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:36:28 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-87905182-e4b0-4f83-9731-de050d9e2d92 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8 {{(pid=74683) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 11:36:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88445f0-2b1c-4cc1-94ca-33a1e3bec929/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:36:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88445f0-2b1c-4cc1-94ca-33a1e3bec929/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:36:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88445f0-2b1c-4cc1-94ca-33a1e3bec929/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:36:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.rescue --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:36:28 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:36:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:36:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.rescue --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:36:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:36:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:36:29 user nova-compute[74683]: DEBUG nova.compute.manager [req-669729e3-6085-4f90-bce0-27e10dff72db req-46accbd8-2f52-41df-90c2-118dec7f82b9 service nova] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Received event network-changed-a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:36:29 user nova-compute[74683]: DEBUG nova.compute.manager [req-669729e3-6085-4f90-bce0-27e10dff72db req-46accbd8-2f52-41df-90c2-118dec7f82b9 service nova] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Refreshing instance network info cache due to event network-changed-a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:36:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-669729e3-6085-4f90-bce0-27e10dff72db req-46accbd8-2f52-41df-90c2-118dec7f82b9 service nova] Acquiring lock "refresh_cache-9ece51b6-5cb3-4d79-acdb-ea4d895cdce8" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:36:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-669729e3-6085-4f90-bce0-27e10dff72db req-46accbd8-2f52-41df-90c2-118dec7f82b9 service nova] Acquired lock "refresh_cache-9ece51b6-5cb3-4d79-acdb-ea4d895cdce8" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:36:29 user nova-compute[74683]: DEBUG nova.network.neutron [req-669729e3-6085-4f90-bce0-27e10dff72db req-46accbd8-2f52-41df-90c2-118dec7f82b9 service nova] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Refreshing network info cache for port a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:36:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:36:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:36:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:36:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:36:29 user nova-compute[74683]: DEBUG nova.network.neutron [req-669729e3-6085-4f90-bce0-27e10dff72db req-46accbd8-2f52-41df-90c2-118dec7f82b9 service nova] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Updated VIF entry in instance network info cache for port a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:36:29 user nova-compute[74683]: DEBUG nova.network.neutron [req-669729e3-6085-4f90-bce0-27e10dff72db req-46accbd8-2f52-41df-90c2-118dec7f82b9 service nova] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Updating instance_info_cache with network_info: [{"id": "a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6", "address": "fa:16:3e:cf:8d:8b", "network": {"id": "fa128ba8-cd2f-4621-ac04-ecc21569bb68", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321708612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66a49078f1240bd88207e487dd4951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7bd5f8b-2b", "ovs_interfaceid": "a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:36:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-669729e3-6085-4f90-bce0-27e10dff72db req-46accbd8-2f52-41df-90c2-118dec7f82b9 service nova] Releasing lock "refresh_cache-9ece51b6-5cb3-4d79-acdb-ea4d895cdce8" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:36:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:36:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:36:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:36:29 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:36:30 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:36:30 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:36:30 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Hypervisor/Node resource view: name=user free_ram=7429MB free_disk=25.12429428100586GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74683) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 11:36:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:36:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:36:30 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance edd01413-1f8a-49e3-aa3c-ecb19c62afae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:36:30 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 9b8ba94f-43cc-4f06-bcd9-83935ccbe117 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:36:30 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance b91af786-36e3-4815-811f-fb3c055e758d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:36:30 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:36:30 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance f5ad764c-638d-4dac-b032-6680917e46df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:36:30 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 43d35d0e-acc5-4076-8641-73b4704f1028 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:36:30 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 6d3528c9-50dd-4f9e-ab92-2f885662bff7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:36:30 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 7bf62c7a-fa86-4e13-bc28-13d8cb2918da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:36:30 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 8d94b70c-4056-4c58-9df4-73684e0d164f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:36:30 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance e88445f0-2b1c-4cc1-94ca-33a1e3bec929 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:36:30 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance a6cb0bee-7424-4798-aac2-d5606f124733 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:36:30 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 11:36:30 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 11:36:31 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:36:31 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:36:31 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Compute_service record updated for user:user {{(pid=74683) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 11:36:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.668s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:36:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:36:33 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:36:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:36:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-46ecd775-f28f-48d5-9632-8ab928fd90b3 tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Acquiring lock "7bf62c7a-fa86-4e13-bc28-13d8cb2918da" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:36:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-46ecd775-f28f-48d5-9632-8ab928fd90b3 tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Lock "7bf62c7a-fa86-4e13-bc28-13d8cb2918da" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:36:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-46ecd775-f28f-48d5-9632-8ab928fd90b3 tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Acquiring lock "7bf62c7a-fa86-4e13-bc28-13d8cb2918da-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:36:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-46ecd775-f28f-48d5-9632-8ab928fd90b3 tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Lock "7bf62c7a-fa86-4e13-bc28-13d8cb2918da-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:36:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-46ecd775-f28f-48d5-9632-8ab928fd90b3 tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Lock "7bf62c7a-fa86-4e13-bc28-13d8cb2918da-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:36:38 user nova-compute[74683]: INFO nova.compute.manager [None req-46ecd775-f28f-48d5-9632-8ab928fd90b3 tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] [instance: 7bf62c7a-fa86-4e13-bc28-13d8cb2918da] Terminating instance
Oct 16 11:36:38 user nova-compute[74683]: DEBUG nova.compute.manager [None req-46ecd775-f28f-48d5-9632-8ab928fd90b3 tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] [instance: 7bf62c7a-fa86-4e13-bc28-13d8cb2918da] Start destroying the instance on the hypervisor. {{(pid=74683) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 11:36:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:36:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:36:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:36:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:36:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:36:38 user nova-compute[74683]: DEBUG nova.compute.manager [req-0bf07508-db9d-4698-9163-139d4cd33d58 req-4dfd48b1-018e-425b-b34f-427bdf1c119b service nova] [instance: 7bf62c7a-fa86-4e13-bc28-13d8cb2918da] Received event network-vif-unplugged-6153c4bd-b883-4dc2-8bcf-be08fb965888 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:36:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-0bf07508-db9d-4698-9163-139d4cd33d58 req-4dfd48b1-018e-425b-b34f-427bdf1c119b service nova] Acquiring lock "7bf62c7a-fa86-4e13-bc28-13d8cb2918da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:36:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-0bf07508-db9d-4698-9163-139d4cd33d58 req-4dfd48b1-018e-425b-b34f-427bdf1c119b service nova] Lock "7bf62c7a-fa86-4e13-bc28-13d8cb2918da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:36:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-0bf07508-db9d-4698-9163-139d4cd33d58 req-4dfd48b1-018e-425b-b34f-427bdf1c119b service nova] Lock "7bf62c7a-fa86-4e13-bc28-13d8cb2918da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:36:38 user nova-compute[74683]: DEBUG nova.compute.manager [req-0bf07508-db9d-4698-9163-139d4cd33d58 req-4dfd48b1-018e-425b-b34f-427bdf1c119b service nova] [instance: 7bf62c7a-fa86-4e13-bc28-13d8cb2918da] No waiting events found dispatching network-vif-unplugged-6153c4bd-b883-4dc2-8bcf-be08fb965888 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:36:38 user nova-compute[74683]: DEBUG nova.compute.manager [req-0bf07508-db9d-4698-9163-139d4cd33d58 req-4dfd48b1-018e-425b-b34f-427bdf1c119b service nova] [instance: 7bf62c7a-fa86-4e13-bc28-13d8cb2918da] Received event network-vif-unplugged-6153c4bd-b883-4dc2-8bcf-be08fb965888 for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 11:36:39 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 7bf62c7a-fa86-4e13-bc28-13d8cb2918da] Instance destroyed successfully.
Oct 16 11:36:39 user nova-compute[74683]: DEBUG nova.objects.instance [None req-46ecd775-f28f-48d5-9632-8ab928fd90b3 tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Lazy-loading 'resources' on Instance uuid 7bf62c7a-fa86-4e13-bc28-13d8cb2918da {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:36:39 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-46ecd775-f28f-48d5-9632-8ab928fd90b3 tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:34:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1307592261',display_name='tempest-VolumesActionsTest-instance-1307592261',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1307592261',id=40,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:34:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='18948f1fc0fc457dac3df9cd93caf2a2',ramdisk_id='',reservation_id='r-70hrf83f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-602760708',owner_user_name='tempest-VolumesActionsTest-602760708-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:34:40Z,user_data=None,user_id='23509d4ea2334af2ab26c4dcb4baefec',uuid=7bf62c7a-fa86-4e13-bc28-13d8cb2918da,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6153c4bd-b883-4dc2-8bcf-be08fb965888", "address": "fa:16:3e:64:83:a1", "network": {"id": "ee1095ab-9f66-4034-9bd2-e93214db8fef", "bridge": "br-int", "label": "tempest-VolumesActionsTest-643747526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18948f1fc0fc457dac3df9cd93caf2a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6153c4bd-b8", "ovs_interfaceid": "6153c4bd-b883-4dc2-8bcf-be08fb965888", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:36:39 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-46ecd775-f28f-48d5-9632-8ab928fd90b3 tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Converting VIF {"id": "6153c4bd-b883-4dc2-8bcf-be08fb965888", "address": "fa:16:3e:64:83:a1", "network": {"id": "ee1095ab-9f66-4034-9bd2-e93214db8fef", "bridge": "br-int", "label": "tempest-VolumesActionsTest-643747526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18948f1fc0fc457dac3df9cd93caf2a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6153c4bd-b8", "ovs_interfaceid": "6153c4bd-b883-4dc2-8bcf-be08fb965888", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:36:39 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-46ecd775-f28f-48d5-9632-8ab928fd90b3 tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:83:a1,bridge_name='br-int',has_traffic_filtering=True,id=6153c4bd-b883-4dc2-8bcf-be08fb965888,network=Network(ee1095ab-9f66-4034-9bd2-e93214db8fef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6153c4bd-b8') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:36:39 user nova-compute[74683]: DEBUG os_vif [None req-46ecd775-f28f-48d5-9632-8ab928fd90b3 tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:83:a1,bridge_name='br-int',has_traffic_filtering=True,id=6153c4bd-b883-4dc2-8bcf-be08fb965888,network=Network(ee1095ab-9f66-4034-9bd2-e93214db8fef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6153c4bd-b8') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:36:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:36:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6153c4bd-b8, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:36:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:36:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:36:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:36:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=067df05c-65fb-4269-a9d7-49d288068b0c) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:36:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:36:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:36:39 user nova-compute[74683]: INFO os_vif [None req-46ecd775-f28f-48d5-9632-8ab928fd90b3 tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:83:a1,bridge_name='br-int',has_traffic_filtering=True,id=6153c4bd-b883-4dc2-8bcf-be08fb965888,network=Network(ee1095ab-9f66-4034-9bd2-e93214db8fef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6153c4bd-b8')
Oct 16 11:36:39 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-46ecd775-f28f-48d5-9632-8ab928fd90b3 tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] [instance: 7bf62c7a-fa86-4e13-bc28-13d8cb2918da] Deleting instance files /opt/stack/data/nova/instances/7bf62c7a-fa86-4e13-bc28-13d8cb2918da_del
Oct 16 11:36:39 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-46ecd775-f28f-48d5-9632-8ab928fd90b3 tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] [instance: 7bf62c7a-fa86-4e13-bc28-13d8cb2918da] Deletion of /opt/stack/data/nova/instances/7bf62c7a-fa86-4e13-bc28-13d8cb2918da_del complete
Oct 16 11:36:39 user nova-compute[74683]: INFO nova.compute.manager [None req-46ecd775-f28f-48d5-9632-8ab928fd90b3 tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] [instance: 7bf62c7a-fa86-4e13-bc28-13d8cb2918da] Took 0.89 seconds to destroy the instance on the hypervisor.
Oct 16 11:36:39 user nova-compute[74683]: DEBUG oslo.service.loopingcall [None req-46ecd775-f28f-48d5-9632-8ab928fd90b3 tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74683) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 11:36:39 user nova-compute[74683]: DEBUG nova.compute.manager [-] [instance: 7bf62c7a-fa86-4e13-bc28-13d8cb2918da] Deallocating network for instance {{(pid=74683) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 11:36:39 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: 7bf62c7a-fa86-4e13-bc28-13d8cb2918da] deallocate_for_instance() {{(pid=74683) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 11:36:40 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: 7bf62c7a-fa86-4e13-bc28-13d8cb2918da] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:36:40 user nova-compute[74683]: INFO nova.compute.manager [-] [instance: 7bf62c7a-fa86-4e13-bc28-13d8cb2918da] Took 1.41 seconds to deallocate network for instance.
Oct 16 11:36:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-46ecd775-f28f-48d5-9632-8ab928fd90b3 tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:36:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-46ecd775-f28f-48d5-9632-8ab928fd90b3 tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:36:41 user nova-compute[74683]: DEBUG nova.compute.manager [req-9fcb57d4-f54a-424d-aa69-9be15fb1bfbe req-9489def9-d163-4751-afb8-63032b8eec18 service nova] [instance: 7bf62c7a-fa86-4e13-bc28-13d8cb2918da] Received event network-vif-plugged-6153c4bd-b883-4dc2-8bcf-be08fb965888 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:36:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-9fcb57d4-f54a-424d-aa69-9be15fb1bfbe req-9489def9-d163-4751-afb8-63032b8eec18 service nova] Acquiring lock "7bf62c7a-fa86-4e13-bc28-13d8cb2918da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:36:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-9fcb57d4-f54a-424d-aa69-9be15fb1bfbe req-9489def9-d163-4751-afb8-63032b8eec18 service nova] Lock "7bf62c7a-fa86-4e13-bc28-13d8cb2918da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:36:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-9fcb57d4-f54a-424d-aa69-9be15fb1bfbe req-9489def9-d163-4751-afb8-63032b8eec18 service nova] Lock "7bf62c7a-fa86-4e13-bc28-13d8cb2918da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:36:41 user nova-compute[74683]: DEBUG nova.compute.manager [req-9fcb57d4-f54a-424d-aa69-9be15fb1bfbe req-9489def9-d163-4751-afb8-63032b8eec18 service nova] [instance: 7bf62c7a-fa86-4e13-bc28-13d8cb2918da] No waiting events found dispatching network-vif-plugged-6153c4bd-b883-4dc2-8bcf-be08fb965888 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:36:41 user nova-compute[74683]: WARNING nova.compute.manager [req-9fcb57d4-f54a-424d-aa69-9be15fb1bfbe req-9489def9-d163-4751-afb8-63032b8eec18 service nova] [instance: 7bf62c7a-fa86-4e13-bc28-13d8cb2918da] Received unexpected event network-vif-plugged-6153c4bd-b883-4dc2-8bcf-be08fb965888 for instance with vm_state deleted and task_state None.
Oct 16 11:36:41 user nova-compute[74683]: DEBUG nova.compute.manager [req-9fcb57d4-f54a-424d-aa69-9be15fb1bfbe req-9489def9-d163-4751-afb8-63032b8eec18 service nova] [instance: 7bf62c7a-fa86-4e13-bc28-13d8cb2918da] Received event network-vif-deleted-6153c4bd-b883-4dc2-8bcf-be08fb965888 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:36:41 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-46ecd775-f28f-48d5-9632-8ab928fd90b3 tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:36:41 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-46ecd775-f28f-48d5-9632-8ab928fd90b3 tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:36:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-46ecd775-f28f-48d5-9632-8ab928fd90b3 tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.777s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:36:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:36:42 user nova-compute[74683]: INFO nova.scheduler.client.report [None req-46ecd775-f28f-48d5-9632-8ab928fd90b3 tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Deleted allocations for instance 7bf62c7a-fa86-4e13-bc28-13d8cb2918da
Oct 16 11:36:42 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-46ecd775-f28f-48d5-9632-8ab928fd90b3 tempest-VolumesActionsTest-602760708 tempest-VolumesActionsTest-602760708-project-member] Lock "7bf62c7a-fa86-4e13-bc28-13d8cb2918da" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.941s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:36:44 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:36:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:36:48 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-87905182-e4b0-4f83-9731-de050d9e2d92 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8 is timed out.
Oct 16 11:36:48 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-87905182-e4b0-4f83-9731-de050d9e2d92 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Successfully detached device vdb from instance 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8 from the live domain config.
Oct 16 11:36:48 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87905182-e4b0-4f83-9731-de050d9e2d92 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] calling os-brick to detach iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 11:36:48 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-87905182-e4b0-4f83-9731-de050d9e2d92 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, {'target_iqn': 'iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sABuomcZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:36:48 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-87905182-e4b0-4f83-9731-de050d9e2d92 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:36:48 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-87905182-e4b0-4f83-9731-de050d9e2d92 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:36:48 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-87905182-e4b0-4f83-9731-de050d9e2d92 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:36:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:36:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.099s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:36:48 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[4178f2f6-ef51-41ac-a95e-585db046d0ea]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6295e19b-ac2a-46be-a7b3-364759c00e5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:36:48 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-87905182-e4b0-4f83-9731-de050d9e2d92 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 11:36:48 user nova-compute[74683]: No targets found.
Oct 16 11:36:48 user nova-compute[74683]: iSNS:
Oct 16 11:36:48 user nova-compute[74683]: No targets found.
Oct 16 11:36:48 user nova-compute[74683]: STATIC:
Oct 16 11:36:48 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:6295e19b-ac2a-46be-a7b3-364759c00e5a
Oct 16 11:36:48 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:36:48 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:36:48 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e
Oct 16 11:36:48 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:36:48 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:36:48 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f
Oct 16 11:36:48 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:36:48 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:36:48 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b
Oct 16 11:36:48 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:36:48 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:36:48 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44
Oct 16 11:36:48 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:36:48 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:36:48 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d
Oct 16 11:36:48 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:36:48 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:36:48 user nova-compute[74683]: FIRMWARE:
Oct 16 11:36:48 user nova-compute[74683]: No targets found.
Oct 16 11:36:48 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:36:48 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-87905182-e4b0-4f83-9731-de050d9e2d92 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 11:36:48 user nova-compute[74683]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 11:36:48 user nova-compute[74683]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74683) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 11:36:48 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-87905182-e4b0-4f83-9731-de050d9e2d92 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b', 0)] {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 11:36:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:36:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:36:48 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[4570fced-dba3-4b6a-88c9-a0b94e7a8b90]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6295e19b-ac2a-46be-a7b3-364759c00e5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:36:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:36:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:36:48 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0b0620-2495-4bdd-a41f-c23f1804e58d]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6295e19b-ac2a-46be-a7b3-364759c00e5a (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:36:48 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-87905182-e4b0-4f83-9731-de050d9e2d92 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b (non-flash)
Oct 16 11:36:48 user nova-compute[74683]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)
Oct 16 11:36:48 user nova-compute[74683]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)
Oct 16 11:36:48 user nova-compute[74683]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d (non-flash)
Oct 16 11:36:48 user nova-compute[74683]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e (non-flash)
Oct 16 11:36:48 user nova-compute[74683]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6295e19b-ac2a-46be-a7b3-364759c00e5a (non-flash)
Oct 16 11:36:48 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:36:48 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-87905182-e4b0-4f83-9731-de050d9e2d92 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b (non-flash)
Oct 16 11:36:48 user nova-compute[74683]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)
Oct 16 11:36:48 user nova-compute[74683]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)
Oct 16 11:36:48 user nova-compute[74683]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d (non-flash)
Oct 16 11:36:48 user nova-compute[74683]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e (non-flash)
Oct 16 11:36:48 user nova-compute[74683]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6295e19b-ac2a-46be-a7b3-364759c00e5a (non-flash)
Oct 16 11:36:48 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:36:48 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-87905182-e4b0-4f83-9731-de050d9e2d92 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda6c39ca60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b'): ({'sdd'}, set())}) {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 11:36:48 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-87905182-e4b0-4f83-9731-de050d9e2d92 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Removing single pathed devices sdd {{(pid=74683) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 11:36:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:36:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:36:48 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ee4bf3-029a-4a60-8680-2a2e343f85be]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:36:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:36:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:36:48 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f219d71f-7981-4ce0-a8c7-5b60e0461a54]: (4, ('ok\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:36:48 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-87905182-e4b0-4f83-9731-de050d9e2d92 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Flushing IO for device /dev/sdd {{(pid=74683) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 11:36:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:36:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.026s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:36:48 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27c4c7d-fde0-47b8-a0c5-df90625d1c29]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:36:48 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-87905182-e4b0-4f83-9731-de050d9e2d92 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74683) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 11:36:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:36:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.097s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:36:48 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0ffac7-b7f2-4e1d-a190-f966cacd862b]: (4, ('1', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:36:48 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-87905182-e4b0-4f83-9731-de050d9e2d92 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 11:36:48 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-87905182-e4b0-4f83-9731-de050d9e2d92 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] SCSI volumes sdd have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 11:36:48 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-87905182-e4b0-4f83-9731-de050d9e2d92 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b')] {{(pid=74683) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 11:36:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:36:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:36:48 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef43d30-f30e-46ed-96e3-6acd3995a71a]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:36:48 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-87905182-e4b0-4f83-9731-de050d9e2d92 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:36:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b -p 172.16.0.220:3260 --logout {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:36:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b -p 172.16.0.220:3260 --logout" returned: 0 in 0.113s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:36:48 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[07751b4e-cdef-44d4-9163-70b9dce78ebc]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:36:48 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-87905182-e4b0-4f83-9731-de050d9e2d92 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b, portal: 172.16.0.220,3260]
Oct 16 11:36:48 user nova-compute[74683]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b, portal: 172.16.0.220,3260] successful.
Oct 16 11:36:48 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:36:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b -p 172.16.0.220:3260 --op delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:36:48 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d40c601-cae7-44b2-b5a1-10ddadfb2b2b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:36:48 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d404c3d6-bfca-42ca-8781-ba85d217b8dc]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:36:48 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-87905182-e4b0-4f83-9731-de050d9e2d92 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:36:48 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-87905182-e4b0-4f83-9731-de050d9e2d92 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.594s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:36:48 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-87905182-e4b0-4f83-9731-de050d9e2d92 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] <== disconnect_volume: return (595ms) None {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:36:48 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87905182-e4b0-4f83-9731-de050d9e2d92 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Disconnected iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 11:36:49 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:36:50 user nova-compute[74683]: DEBUG nova.objects.instance [None req-87905182-e4b0-4f83-9731-de050d9e2d92 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lazy-loading 'flavor' on Instance uuid 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:36:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-87905182-e4b0-4f83-9731-de050d9e2d92 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "9ece51b6-5cb3-4d79-acdb-ea4d895cdce8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.857s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:36:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:36:54 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:36:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:36:59 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:37:04 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:37:04 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:37:04 user nova-compute[74683]: INFO nova.compute.manager [None req-08834566-dd74-4723-8e4c-9846eb831e4e tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Get console output
Oct 16 11:37:04 user nova-compute[74683]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Oct 16 11:37:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:37:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:37:09 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:37:12 user nova-compute[74683]: DEBUG nova.compute.manager [req-686bdac0-fb51-4ca0-bba3-20f89983585f req-d1eee898-e1b8-492a-8012-7d80ed437e2b service nova] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Received event network-changed-80bcc661-5bbf-4b87-87c3-0b4a7e6aa31b {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:37:12 user nova-compute[74683]: DEBUG nova.compute.manager [req-686bdac0-fb51-4ca0-bba3-20f89983585f req-d1eee898-e1b8-492a-8012-7d80ed437e2b service nova] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Refreshing instance network info cache due to event network-changed-80bcc661-5bbf-4b87-87c3-0b4a7e6aa31b. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:37:12 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-686bdac0-fb51-4ca0-bba3-20f89983585f req-d1eee898-e1b8-492a-8012-7d80ed437e2b service nova] Acquiring lock "refresh_cache-8d94b70c-4056-4c58-9df4-73684e0d164f" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:37:12 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-686bdac0-fb51-4ca0-bba3-20f89983585f req-d1eee898-e1b8-492a-8012-7d80ed437e2b service nova] Acquired lock "refresh_cache-8d94b70c-4056-4c58-9df4-73684e0d164f" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:37:12 user nova-compute[74683]: DEBUG nova.network.neutron [req-686bdac0-fb51-4ca0-bba3-20f89983585f req-d1eee898-e1b8-492a-8012-7d80ed437e2b service nova] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Refreshing network info cache for port 80bcc661-5bbf-4b87-87c3-0b4a7e6aa31b {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:37:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:37:12 user nova-compute[74683]: DEBUG nova.network.neutron [req-686bdac0-fb51-4ca0-bba3-20f89983585f req-d1eee898-e1b8-492a-8012-7d80ed437e2b service nova] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Updated VIF entry in instance network info cache for port 80bcc661-5bbf-4b87-87c3-0b4a7e6aa31b. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:37:12 user nova-compute[74683]: DEBUG nova.network.neutron [req-686bdac0-fb51-4ca0-bba3-20f89983585f req-d1eee898-e1b8-492a-8012-7d80ed437e2b service nova] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Updating instance_info_cache with network_info: [{"id": "80bcc661-5bbf-4b87-87c3-0b4a7e6aa31b", "address": "fa:16:3e:67:41:41", "network": {"id": "f131c862-9d83-4df6-af88-56d3202105fc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-544805614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12fd84a1f38a41dc8e4ab6c697028d9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80bcc661-5b", "ovs_interfaceid": "80bcc661-5bbf-4b87-87c3-0b4a7e6aa31b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:37:12 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-686bdac0-fb51-4ca0-bba3-20f89983585f req-d1eee898-e1b8-492a-8012-7d80ed437e2b service nova] Releasing lock "refresh_cache-8d94b70c-4056-4c58-9df4-73684e0d164f" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:37:14 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:37:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:37:17 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-4a333bcb-4d44-4fd4-b9c5-eadecdf7487e tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Acquiring lock "8d94b70c-4056-4c58-9df4-73684e0d164f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:37:17 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-4a333bcb-4d44-4fd4-b9c5-eadecdf7487e tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lock "8d94b70c-4056-4c58-9df4-73684e0d164f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:37:17 user nova-compute[74683]: DEBUG nova.objects.instance [None req-4a333bcb-4d44-4fd4-b9c5-eadecdf7487e tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lazy-loading 'flavor' on Instance uuid 8d94b70c-4056-4c58-9df4-73684e0d164f {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:37:17 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-4a333bcb-4d44-4fd4-b9c5-eadecdf7487e tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lock "8d94b70c-4056-4c58-9df4-73684e0d164f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:37:18 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-572d512b-e641-4a11-9804-5269da77366c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Acquiring lock "9ece51b6-5cb3-4d79-acdb-ea4d895cdce8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:37:18 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-572d512b-e641-4a11-9804-5269da77366c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "9ece51b6-5cb3-4d79-acdb-ea4d895cdce8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:37:18 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-572d512b-e641-4a11-9804-5269da77366c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Acquiring lock "9ece51b6-5cb3-4d79-acdb-ea4d895cdce8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:37:18 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-572d512b-e641-4a11-9804-5269da77366c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "9ece51b6-5cb3-4d79-acdb-ea4d895cdce8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:37:18 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-572d512b-e641-4a11-9804-5269da77366c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "9ece51b6-5cb3-4d79-acdb-ea4d895cdce8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:37:18 user nova-compute[74683]: INFO nova.compute.manager [None req-572d512b-e641-4a11-9804-5269da77366c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Terminating instance
Oct 16 11:37:18 user nova-compute[74683]: DEBUG nova.compute.manager [None req-572d512b-e641-4a11-9804-5269da77366c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Start destroying the instance on the hypervisor. {{(pid=74683) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 11:37:18 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-4a333bcb-4d44-4fd4-b9c5-eadecdf7487e tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Acquiring lock "8d94b70c-4056-4c58-9df4-73684e0d164f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:37:18 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-4a333bcb-4d44-4fd4-b9c5-eadecdf7487e tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lock "8d94b70c-4056-4c58-9df4-73684e0d164f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:37:18 user nova-compute[74683]: INFO nova.compute.manager [None req-4a333bcb-4d44-4fd4-b9c5-eadecdf7487e tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Attaching volume 99659c6e-9089-4eab-bfa8-25b1700bfc87 to /dev/vdb
Oct 16 11:37:18 user nova-compute[74683]: DEBUG os_brick.utils [None req-4a333bcb-4d44-4fd4-b9c5-eadecdf7487e tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:37:18 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:37:18 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:37:18 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3cf7583-b75f-4d6e-bcd8-cfc1f8f2548a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:70b9d336ab7d\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:37:18 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:37:18 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:37:18 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc83d0c-5769-4028-a82f-4e91f4e02315]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:37:18 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:37:18 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:37:18 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ebfb9e-6a0a-43ca-8fda-f329212145c0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:37:18 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f750dea9-13b5-4be1-9132-886e93913fc1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:37:18 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-4a333bcb-4d44-4fd4-b9c5-eadecdf7487e tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Running cmd (subprocess): nvme version {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:37:18 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-4a333bcb-4d44-4fd4-b9c5-eadecdf7487e tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] 'nvme version' failed. Not Retrying. {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:37:18 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4a333bcb-4d44-4fd4-b9c5-eadecdf7487e tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] nvme not present on system {{(pid=74683) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 11:37:18 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:37:18 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:37:18 user nova-compute[74683]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 11:37:18 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[5350a74d-945e-4d87-a5cc-0bf091450b56]: (4, '') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:37:18 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-4a333bcb-4d44-4fd4-b9c5-eadecdf7487e tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74683) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 11:37:18 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-4a333bcb-4d44-4fd4-b9c5-eadecdf7487e tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 11:37:18 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-4a333bcb-4d44-4fd4-b9c5-eadecdf7487e tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] LIGHTOS: no hostnqn found. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 11:37:18 user nova-compute[74683]: DEBUG os_brick.utils [None req-4a333bcb-4d44-4fd4-b9c5-eadecdf7487e tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:70b9d336ab7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:37:18 user nova-compute[74683]: DEBUG nova.virt.block_device [None req-4a333bcb-4d44-4fd4-b9c5-eadecdf7487e tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Updating existing volume attachment record: 6fe471e0-4d8f-4e24-9c31-7f9b5c4d8fff {{(pid=74683) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 11:37:18 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:37:18 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:37:18 user nova-compute[74683]: DEBUG nova.compute.manager [req-cdbf8b4a-3538-4f9f-9102-2991d0a1612f req-ae7e14e7-2102-460c-a181-d7a6e9299e9e service nova] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Received event network-vif-unplugged-a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:37:18 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-cdbf8b4a-3538-4f9f-9102-2991d0a1612f req-ae7e14e7-2102-460c-a181-d7a6e9299e9e service nova] Acquiring lock "9ece51b6-5cb3-4d79-acdb-ea4d895cdce8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:37:18 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-cdbf8b4a-3538-4f9f-9102-2991d0a1612f req-ae7e14e7-2102-460c-a181-d7a6e9299e9e service nova] Lock "9ece51b6-5cb3-4d79-acdb-ea4d895cdce8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:37:18 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-cdbf8b4a-3538-4f9f-9102-2991d0a1612f req-ae7e14e7-2102-460c-a181-d7a6e9299e9e service nova] Lock "9ece51b6-5cb3-4d79-acdb-ea4d895cdce8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:37:18 user nova-compute[74683]: DEBUG nova.compute.manager [req-cdbf8b4a-3538-4f9f-9102-2991d0a1612f req-ae7e14e7-2102-460c-a181-d7a6e9299e9e service nova] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] No waiting events found dispatching network-vif-unplugged-a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:37:18 user nova-compute[74683]: DEBUG nova.compute.manager [req-cdbf8b4a-3538-4f9f-9102-2991d0a1612f req-ae7e14e7-2102-460c-a181-d7a6e9299e9e service nova] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Received event network-vif-unplugged-a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6 for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 11:37:18 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:37:18 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:37:19 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Instance destroyed successfully.
Oct 16 11:37:19 user nova-compute[74683]: DEBUG nova.objects.instance [None req-572d512b-e641-4a11-9804-5269da77366c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lazy-loading 'resources' on Instance uuid 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:37:19 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-572d512b-e641-4a11-9804-5269da77366c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:30:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-526350141',display_name='tempest-ServerRescueNegativeTestJSON-server-526350141',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-526350141',id=33,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNz1V1kjn+NusY2zgo3ikJiEK0+g7zHYU6qx9jtiB8KZYL8r9TMeQpPPNhfnwBaZYH54zgAqVMOORXAZv/pdJIJRHHUu3H3sIO4N1YDwfFsndK20Q/vGu2bvzF+wspuY3Q==',key_name='tempest-keypair-1176984004',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:32:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e66a49078f1240bd88207e487dd4951e',ramdisk_id='',reservation_id='r-8k60d1p0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1690011355',owner_user_name='tempest-ServerRescueNegativeTestJSON-1690011355-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:34:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3436197c787446d4a03fb7697d7999a1',uuid=9ece51b6-5cb3-4d79-acdb-ea4d895cdce8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6", "address": "fa:16:3e:cf:8d:8b", "network": {"id": "fa128ba8-cd2f-4621-ac04-ecc21569bb68", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321708612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66a49078f1240bd88207e487dd4951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7bd5f8b-2b", "ovs_interfaceid": "a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:37:19 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-572d512b-e641-4a11-9804-5269da77366c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Converting VIF {"id": "a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6", "address": "fa:16:3e:cf:8d:8b", "network": {"id": "fa128ba8-cd2f-4621-ac04-ecc21569bb68", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321708612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66a49078f1240bd88207e487dd4951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7bd5f8b-2b", "ovs_interfaceid": "a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:37:19 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-572d512b-e641-4a11-9804-5269da77366c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cf:8d:8b,bridge_name='br-int',has_traffic_filtering=True,id=a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6,network=Network(fa128ba8-cd2f-4621-ac04-ecc21569bb68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7bd5f8b-2b') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:37:19 user nova-compute[74683]: DEBUG os_vif [None req-572d512b-e641-4a11-9804-5269da77366c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cf:8d:8b,bridge_name='br-int',has_traffic_filtering=True,id=a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6,network=Network(fa128ba8-cd2f-4621-ac04-ecc21569bb68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7bd5f8b-2b') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:37:19 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:37:19 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa7bd5f8b-2b, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:37:19 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:37:19 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:37:19 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:37:19 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=733a2aee-4a92-4fdc-af43-588af0b9e770) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:37:19 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:37:19 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:37:19 user nova-compute[74683]: INFO os_vif [None req-572d512b-e641-4a11-9804-5269da77366c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cf:8d:8b,bridge_name='br-int',has_traffic_filtering=True,id=a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6,network=Network(fa128ba8-cd2f-4621-ac04-ecc21569bb68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7bd5f8b-2b')
Oct 16 11:37:19 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-572d512b-e641-4a11-9804-5269da77366c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Deleting instance files /opt/stack/data/nova/instances/9ece51b6-5cb3-4d79-acdb-ea4d895cdce8_del
Oct 16 11:37:19 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-572d512b-e641-4a11-9804-5269da77366c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Deletion of /opt/stack/data/nova/instances/9ece51b6-5cb3-4d79-acdb-ea4d895cdce8_del complete
Oct 16 11:37:19 user nova-compute[74683]: INFO nova.compute.manager [None req-572d512b-e641-4a11-9804-5269da77366c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Took 0.96 seconds to destroy the instance on the hypervisor.
Oct 16 11:37:19 user nova-compute[74683]: DEBUG oslo.service.loopingcall [None req-572d512b-e641-4a11-9804-5269da77366c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74683) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 11:37:19 user nova-compute[74683]: DEBUG nova.compute.manager [-] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Deallocating network for instance {{(pid=74683) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 11:37:19 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] deallocate_for_instance() {{(pid=74683) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 11:37:19 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:37:19 user nova-compute[74683]: INFO nova.compute.manager [-] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Took 0.64 seconds to deallocate network for instance.
Oct 16 11:37:19 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-572d512b-e641-4a11-9804-5269da77366c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:37:19 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-572d512b-e641-4a11-9804-5269da77366c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:37:20 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-572d512b-e641-4a11-9804-5269da77366c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:37:20 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-572d512b-e641-4a11-9804-5269da77366c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:37:20 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-572d512b-e641-4a11-9804-5269da77366c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.344s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:37:20 user nova-compute[74683]: INFO nova.scheduler.client.report [None req-572d512b-e641-4a11-9804-5269da77366c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Deleted allocations for instance 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8
Oct 16 11:37:20 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-572d512b-e641-4a11-9804-5269da77366c tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "9ece51b6-5cb3-4d79-acdb-ea4d895cdce8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.125s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:37:20 user nova-compute[74683]: DEBUG nova.compute.manager [req-418049c8-7d71-495c-957f-2652926ba96b req-c4ad1405-e62e-4336-9de5-1cfb37ade536 service nova] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Received event network-vif-plugged-a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:37:20 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-418049c8-7d71-495c-957f-2652926ba96b req-c4ad1405-e62e-4336-9de5-1cfb37ade536 service nova] Acquiring lock "9ece51b6-5cb3-4d79-acdb-ea4d895cdce8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:37:20 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-418049c8-7d71-495c-957f-2652926ba96b req-c4ad1405-e62e-4336-9de5-1cfb37ade536 service nova] Lock "9ece51b6-5cb3-4d79-acdb-ea4d895cdce8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:37:20 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-418049c8-7d71-495c-957f-2652926ba96b req-c4ad1405-e62e-4336-9de5-1cfb37ade536 service nova] Lock "9ece51b6-5cb3-4d79-acdb-ea4d895cdce8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:37:20 user nova-compute[74683]: DEBUG nova.compute.manager [req-418049c8-7d71-495c-957f-2652926ba96b req-c4ad1405-e62e-4336-9de5-1cfb37ade536 service nova] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] No waiting events found dispatching network-vif-plugged-a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:37:20 user nova-compute[74683]: WARNING nova.compute.manager [req-418049c8-7d71-495c-957f-2652926ba96b req-c4ad1405-e62e-4336-9de5-1cfb37ade536 service nova] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Received unexpected event network-vif-plugged-a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6 for instance with vm_state deleted and task_state None.
Oct 16 11:37:20 user nova-compute[74683]: DEBUG nova.compute.manager [req-418049c8-7d71-495c-957f-2652926ba96b req-c4ad1405-e62e-4336-9de5-1cfb37ade536 service nova] [instance: 9ece51b6-5cb3-4d79-acdb-ea4d895cdce8] Received event network-vif-deleted-a7bd5f8b-2b98-40aa-b312-5d98a3b87ba6 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:37:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:37:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:37:26 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:37:26 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:37:26 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:37:26 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Starting heal instance info cache {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 11:37:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "refresh_cache-43d35d0e-acc5-4076-8641-73b4704f1028" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:37:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquired lock "refresh_cache-43d35d0e-acc5-4076-8641-73b4704f1028" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:37:26 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Forcefully refreshing network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 11:37:26 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Updating instance_info_cache with network_info: [{"id": "8bc348fc-b8e3-40da-a8a1-70bd70c3fffe", "address": "fa:16:3e:37:bc:60", "network": {"id": "cd8cf08c-d79c-4d2e-b849-640c440e1498", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1091743670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcb8da41d6584a689e9b50155288aa5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc348fc-b8", "ovs_interfaceid": "8bc348fc-b8e3-40da-a8a1-70bd70c3fffe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:37:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Releasing lock "refresh_cache-43d35d0e-acc5-4076-8641-73b4704f1028" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:37:26 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Updated the network info_cache for instance {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 11:37:26 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:37:26 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:37:26 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:37:26 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:37:26 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:37:26 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:37:26 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74683) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 11:37:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:37:27 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:37:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:37:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:37:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:37:27 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Auditing locally available compute resources for user (node: user) {{(pid=74683) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 11:37:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:37:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:37:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:37:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:37:28 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:37:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:37:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:37:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:37:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:37:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d94b70c-4056-4c58-9df4-73684e0d164f/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:37:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d94b70c-4056-4c58-9df4-73684e0d164f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:37:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d94b70c-4056-4c58-9df4-73684e0d164f/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:37:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d94b70c-4056-4c58-9df4-73684e0d164f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:37:28 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:37:28 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:37:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88445f0-2b1c-4cc1-94ca-33a1e3bec929/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:37:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:37:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88445f0-2b1c-4cc1-94ca-33a1e3bec929/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:37:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88445f0-2b1c-4cc1-94ca-33a1e3bec929/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:37:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88445f0-2b1c-4cc1-94ca-33a1e3bec929/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:37:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.rescue --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:37:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:37:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.rescue --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:37:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:37:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:37:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:37:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:37:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:37:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:37:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:37:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:37:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:37:30 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:37:30 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:37:30 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:37:30 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Hypervisor/Node resource view: name=user free_ram=7673MB free_disk=25.169139862060547GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74683) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 11:37:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:37:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:37:30 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance edd01413-1f8a-49e3-aa3c-ecb19c62afae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:37:30 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 9b8ba94f-43cc-4f06-bcd9-83935ccbe117 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:37:30 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance b91af786-36e3-4815-811f-fb3c055e758d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:37:30 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance f5ad764c-638d-4dac-b032-6680917e46df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:37:31 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 43d35d0e-acc5-4076-8641-73b4704f1028 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:37:31 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 6d3528c9-50dd-4f9e-ab92-2f885662bff7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:37:31 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 8d94b70c-4056-4c58-9df4-73684e0d164f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:37:31 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance e88445f0-2b1c-4cc1-94ca-33a1e3bec929 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:37:31 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance a6cb0bee-7424-4798-aac2-d5606f124733 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:37:31 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 11:37:31 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 11:37:31 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:37:31 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:37:31 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Compute_service record updated for user:user {{(pid=74683) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 11:37:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.563s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:37:34 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:37:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:37:44 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:37:44 user nova-compute[74683]: DEBUG nova.compute.manager [req-e3586cdd-f8ad-4f89-b687-a40c09995527 req-82a074dd-941a-4323-8c68-f92bd0508ae9 service nova] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Received event network-changed-4ecf301e-0a4b-42f1-8e27-b8f46b00886c {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:37:44 user nova-compute[74683]: DEBUG nova.compute.manager [req-e3586cdd-f8ad-4f89-b687-a40c09995527 req-82a074dd-941a-4323-8c68-f92bd0508ae9 service nova] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Refreshing instance network info cache due to event network-changed-4ecf301e-0a4b-42f1-8e27-b8f46b00886c. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:37:44 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e3586cdd-f8ad-4f89-b687-a40c09995527 req-82a074dd-941a-4323-8c68-f92bd0508ae9 service nova] Acquiring lock "refresh_cache-e88445f0-2b1c-4cc1-94ca-33a1e3bec929" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:37:44 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e3586cdd-f8ad-4f89-b687-a40c09995527 req-82a074dd-941a-4323-8c68-f92bd0508ae9 service nova] Acquired lock "refresh_cache-e88445f0-2b1c-4cc1-94ca-33a1e3bec929" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:37:44 user nova-compute[74683]: DEBUG nova.network.neutron [req-e3586cdd-f8ad-4f89-b687-a40c09995527 req-82a074dd-941a-4323-8c68-f92bd0508ae9 service nova] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Refreshing network info cache for port 4ecf301e-0a4b-42f1-8e27-b8f46b00886c {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:37:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1280c3a3-12f1-4633-91f3-73a9cdeab4fa tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Acquiring lock "e88445f0-2b1c-4cc1-94ca-33a1e3bec929" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:37:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1280c3a3-12f1-4633-91f3-73a9cdeab4fa tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lock "e88445f0-2b1c-4cc1-94ca-33a1e3bec929" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:37:45 user nova-compute[74683]: DEBUG nova.objects.instance [None req-1280c3a3-12f1-4633-91f3-73a9cdeab4fa tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lazy-loading 'flavor' on Instance uuid e88445f0-2b1c-4cc1-94ca-33a1e3bec929 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:37:45 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-1280c3a3-12f1-4633-91f3-73a9cdeab4fa tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Ignoring supplied device name: /dev/vdb
Oct 16 11:37:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1280c3a3-12f1-4633-91f3-73a9cdeab4fa tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lock "e88445f0-2b1c-4cc1-94ca-33a1e3bec929" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:37:45 user nova-compute[74683]: DEBUG nova.network.neutron [req-e3586cdd-f8ad-4f89-b687-a40c09995527 req-82a074dd-941a-4323-8c68-f92bd0508ae9 service nova] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Updated VIF entry in instance network info cache for port 4ecf301e-0a4b-42f1-8e27-b8f46b00886c. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:37:45 user nova-compute[74683]: DEBUG nova.network.neutron [req-e3586cdd-f8ad-4f89-b687-a40c09995527 req-82a074dd-941a-4323-8c68-f92bd0508ae9 service nova] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Updating instance_info_cache with network_info: [{"id": "4ecf301e-0a4b-42f1-8e27-b8f46b00886c", "address": "fa:16:3e:6e:28:8e", "network": {"id": "3f02f591-1fa0-477f-8730-b41445fd41b4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1932917211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d9daeec42a4e73a8ff2c0137f91128", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ecf301e-0a", "ovs_interfaceid": "4ecf301e-0a4b-42f1-8e27-b8f46b00886c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:37:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e3586cdd-f8ad-4f89-b687-a40c09995527 req-82a074dd-941a-4323-8c68-f92bd0508ae9 service nova] Releasing lock "refresh_cache-e88445f0-2b1c-4cc1-94ca-33a1e3bec929" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:37:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1280c3a3-12f1-4633-91f3-73a9cdeab4fa tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Acquiring lock "e88445f0-2b1c-4cc1-94ca-33a1e3bec929" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:37:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1280c3a3-12f1-4633-91f3-73a9cdeab4fa tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lock "e88445f0-2b1c-4cc1-94ca-33a1e3bec929" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:37:45 user nova-compute[74683]: INFO nova.compute.manager [None req-1280c3a3-12f1-4633-91f3-73a9cdeab4fa tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Attaching volume 3400449b-1160-4ffe-9ea2-9fdfb4995ea5 to /dev/vdb
Oct 16 11:37:45 user nova-compute[74683]: DEBUG os_brick.utils [None req-1280c3a3-12f1-4633-91f3-73a9cdeab4fa tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:37:45 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:37:45 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:37:45 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[89030b08-fed9-42c8-8f54-4182e1643c4a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:70b9d336ab7d\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:37:45 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:37:45 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:37:45 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e8f415-fee5-4682-bc6c-8472b9012525]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:37:45 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:37:45 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:37:45 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[947ac4a3-a4d8-4dc3-92e0-c08416c966a7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:37:45 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb12c91-a5fd-40fb-8001-c609470e48f3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:37:45 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-1280c3a3-12f1-4633-91f3-73a9cdeab4fa tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Running cmd (subprocess): nvme version {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:37:45 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-1280c3a3-12f1-4633-91f3-73a9cdeab4fa tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] 'nvme version' failed. Not Retrying. {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:37:45 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1280c3a3-12f1-4633-91f3-73a9cdeab4fa tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] nvme not present on system {{(pid=74683) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 11:37:45 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:37:45 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:37:45 user nova-compute[74683]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 11:37:45 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8cf4dc5-c255-4411-8715-34621a870e69]: (4, '') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:37:45 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-1280c3a3-12f1-4633-91f3-73a9cdeab4fa tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74683) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 11:37:45 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-1280c3a3-12f1-4633-91f3-73a9cdeab4fa tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 11:37:45 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-1280c3a3-12f1-4633-91f3-73a9cdeab4fa tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] LIGHTOS: no hostnqn found. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 11:37:45 user nova-compute[74683]: DEBUG os_brick.utils [None req-1280c3a3-12f1-4633-91f3-73a9cdeab4fa tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:70b9d336ab7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:37:45 user nova-compute[74683]: DEBUG nova.virt.block_device [None req-1280c3a3-12f1-4633-91f3-73a9cdeab4fa tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Updating existing volume attachment record: 74bfcefe-5b94-42e1-b80e-6397a6163810 {{(pid=74683) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 11:37:46 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:37:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:37:47 user nova-compute[74683]: DEBUG nova.compute.manager [req-8f05b97f-b78b-42c1-9f77-f5a0edb0318b req-edabb603-389e-4aec-9d60-2e720efe3e12 service nova] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Received event network-changed-3a3bfab4-5540-4133-9b06-9fadf024f74c {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:37:47 user nova-compute[74683]: DEBUG nova.compute.manager [req-8f05b97f-b78b-42c1-9f77-f5a0edb0318b req-edabb603-389e-4aec-9d60-2e720efe3e12 service nova] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Refreshing instance network info cache due to event network-changed-3a3bfab4-5540-4133-9b06-9fadf024f74c. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:37:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-8f05b97f-b78b-42c1-9f77-f5a0edb0318b req-edabb603-389e-4aec-9d60-2e720efe3e12 service nova] Acquiring lock "refresh_cache-a6cb0bee-7424-4798-aac2-d5606f124733" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:37:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-8f05b97f-b78b-42c1-9f77-f5a0edb0318b req-edabb603-389e-4aec-9d60-2e720efe3e12 service nova] Acquired lock "refresh_cache-a6cb0bee-7424-4798-aac2-d5606f124733" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:37:47 user nova-compute[74683]: DEBUG nova.network.neutron [req-8f05b97f-b78b-42c1-9f77-f5a0edb0318b req-edabb603-389e-4aec-9d60-2e720efe3e12 service nova] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Refreshing network info cache for port 3a3bfab4-5540-4133-9b06-9fadf024f74c {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:37:48 user nova-compute[74683]: DEBUG nova.network.neutron [req-8f05b97f-b78b-42c1-9f77-f5a0edb0318b req-edabb603-389e-4aec-9d60-2e720efe3e12 service nova] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Updated VIF entry in instance network info cache for port 3a3bfab4-5540-4133-9b06-9fadf024f74c. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:37:48 user nova-compute[74683]: DEBUG nova.network.neutron [req-8f05b97f-b78b-42c1-9f77-f5a0edb0318b req-edabb603-389e-4aec-9d60-2e720efe3e12 service nova] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Updating instance_info_cache with network_info: [{"id": "3a3bfab4-5540-4133-9b06-9fadf024f74c", "address": "fa:16:3e:10:7f:06", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a3bfab4-55", "ovs_interfaceid": "3a3bfab4-5540-4133-9b06-9fadf024f74c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:37:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-8f05b97f-b78b-42c1-9f77-f5a0edb0318b req-edabb603-389e-4aec-9d60-2e720efe3e12 service nova] Releasing lock "refresh_cache-a6cb0bee-7424-4798-aac2-d5606f124733" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:37:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-638d0187-2a68-4689-b96c-a17639990158 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquiring lock "a6cb0bee-7424-4798-aac2-d5606f124733" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:37:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-638d0187-2a68-4689-b96c-a17639990158 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "a6cb0bee-7424-4798-aac2-d5606f124733" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:37:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-638d0187-2a68-4689-b96c-a17639990158 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquiring lock "a6cb0bee-7424-4798-aac2-d5606f124733-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:37:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-638d0187-2a68-4689-b96c-a17639990158 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "a6cb0bee-7424-4798-aac2-d5606f124733-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:37:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-638d0187-2a68-4689-b96c-a17639990158 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "a6cb0bee-7424-4798-aac2-d5606f124733-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:37:48 user nova-compute[74683]: INFO nova.compute.manager [None req-638d0187-2a68-4689-b96c-a17639990158 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Terminating instance
Oct 16 11:37:48 user nova-compute[74683]: DEBUG nova.compute.manager [None req-638d0187-2a68-4689-b96c-a17639990158 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Start destroying the instance on the hypervisor. {{(pid=74683) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 11:37:48 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:37:48 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:37:48 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:37:48 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:37:49 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Instance destroyed successfully.
Oct 16 11:37:49 user nova-compute[74683]: DEBUG nova.objects.instance [None req-638d0187-2a68-4689-b96c-a17639990158 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lazy-loading 'resources' on Instance uuid a6cb0bee-7424-4798-aac2-d5606f124733 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-638d0187-2a68-4689-b96c-a17639990158 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:35:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1953735950',display_name='tempest-TestVolumeBootPattern-server-1953735950',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1953735950',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJbd1pnA0e+ubtg3c4vxF2Dxe/3H7OECUV6ZZvaa4rKNrKocz4jmO0SXeRO4F7NQHuYFrsF7rAUyRZ4V/U5HkEw1E5UZyfInFppdQCzqY7p8CVOHAXsTsTbK336AbWu7g==',key_name='tempest-TestVolumeBootPattern-1282364245',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:36:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2aefabef9e42412f8309f490dcfecc79',ramdisk_id='',reservation_id='r-oeniscjh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-953001121',owner_user_name='tempest-TestVolumeBootPattern-953001121-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:36:19Z,user_data=None,user_id='a463a84e332543dfbc03b81518f82be1',uuid=a6cb0bee-7424-4798-aac2-d5606f124733,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a3bfab4-5540-4133-9b06-9fadf024f74c", "address": "fa:16:3e:10:7f:06", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a3bfab4-55", "ovs_interfaceid": "3a3bfab4-5540-4133-9b06-9fadf024f74c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-638d0187-2a68-4689-b96c-a17639990158 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Converting VIF {"id": "3a3bfab4-5540-4133-9b06-9fadf024f74c", "address": "fa:16:3e:10:7f:06", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a3bfab4-55", "ovs_interfaceid": "3a3bfab4-5540-4133-9b06-9fadf024f74c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-638d0187-2a68-4689-b96c-a17639990158 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:7f:06,bridge_name='br-int',has_traffic_filtering=True,id=3a3bfab4-5540-4133-9b06-9fadf024f74c,network=Network(00883fc4-0b74-4afd-9043-82e2933faab3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a3bfab4-55') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG os_vif [None req-638d0187-2a68-4689-b96c-a17639990158 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:7f:06,bridge_name='br-int',has_traffic_filtering=True,id=3a3bfab4-5540-4133-9b06-9fadf024f74c,network=Network(00883fc4-0b74-4afd-9043-82e2933faab3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a3bfab4-55') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a3bfab4-55, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c7cd11e2-47a6-444c-a465-3d1a9f867271) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:37:49 user nova-compute[74683]: INFO os_vif [None req-638d0187-2a68-4689-b96c-a17639990158 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:7f:06,bridge_name='br-int',has_traffic_filtering=True,id=3a3bfab4-5540-4133-9b06-9fadf024f74c,network=Network(00883fc4-0b74-4afd-9043-82e2933faab3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a3bfab4-55')
Oct 16 11:37:49 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-638d0187-2a68-4689-b96c-a17639990158 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] calling os-brick to detach iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-638d0187-2a68-4689-b96c-a17639990158 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, {'target_iqn': 'iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jIYemgyq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:37:49 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-638d0187-2a68-4689-b96c-a17639990158 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:37:49 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-638d0187-2a68-4689-b96c-a17639990158 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-638d0187-2a68-4689-b96c-a17639990158 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e0b7f7-9cd9-40e7-bb4a-5c82b85e4cd4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-638d0187-2a68-4689-b96c-a17639990158 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 11:37:49 user nova-compute[74683]: No targets found.
Oct 16 11:37:49 user nova-compute[74683]: iSNS:
Oct 16 11:37:49 user nova-compute[74683]: No targets found.
Oct 16 11:37:49 user nova-compute[74683]: STATIC:
Oct 16 11:37:49 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e
Oct 16 11:37:49 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:37:49 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:37:49 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f
Oct 16 11:37:49 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:37:49 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:37:49 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44
Oct 16 11:37:49 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:37:49 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:37:49 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d
Oct 16 11:37:49 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:37:49 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:37:49 user nova-compute[74683]: FIRMWARE:
Oct 16 11:37:49 user nova-compute[74683]: No targets found.
Oct 16 11:37:49 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-638d0187-2a68-4689-b96c-a17639990158 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 11:37:49 user nova-compute[74683]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 11:37:49 user nova-compute[74683]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74683) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-638d0187-2a68-4689-b96c-a17639990158 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d', 0)] {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[801bd154-b465-45e3-b875-452df87e9ef5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4bfb671-429e-45bf-985c-4f39dc8d0a50]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-638d0187-2a68-4689-b96c-a17639990158 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)
Oct 16 11:37:49 user nova-compute[74683]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)
Oct 16 11:37:49 user nova-compute[74683]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d (non-flash)
Oct 16 11:37:49 user nova-compute[74683]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e (non-flash)
Oct 16 11:37:49 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-638d0187-2a68-4689-b96c-a17639990158 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)
Oct 16 11:37:49 user nova-compute[74683]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)
Oct 16 11:37:49 user nova-compute[74683]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d (non-flash)
Oct 16 11:37:49 user nova-compute[74683]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e (non-flash)
Oct 16 11:37:49 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-638d0187-2a68-4689-b96c-a17639990158 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda4c5d6cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d'): ({'sdf'}, set())}) {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-638d0187-2a68-4689-b96c-a17639990158 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Removing single pathed devices sdf {{(pid=74683) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e7bca9-1e43-4a5a-8a3d-ab37ad06c1ee]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG nova.compute.manager [req-9ec6ab34-8a1d-41d9-97c3-edc234aa4512 req-e7ecda54-f6dd-4f36-a777-3a3b09c35a41 service nova] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Received event network-changed-3a3bfab4-5540-4133-9b06-9fadf024f74c {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG nova.compute.manager [req-9ec6ab34-8a1d-41d9-97c3-edc234aa4512 req-e7ecda54-f6dd-4f36-a777-3a3b09c35a41 service nova] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Refreshing instance network info cache due to event network-changed-3a3bfab4-5540-4133-9b06-9fadf024f74c. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-9ec6ab34-8a1d-41d9-97c3-edc234aa4512 req-e7ecda54-f6dd-4f36-a777-3a3b09c35a41 service nova] Acquiring lock "refresh_cache-a6cb0bee-7424-4798-aac2-d5606f124733" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-9ec6ab34-8a1d-41d9-97c3-edc234aa4512 req-e7ecda54-f6dd-4f36-a777-3a3b09c35a41 service nova] Acquired lock "refresh_cache-a6cb0bee-7424-4798-aac2-d5606f124733" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG nova.network.neutron [req-9ec6ab34-8a1d-41d9-97c3-edc234aa4512 req-e7ecda54-f6dd-4f36-a777-3a3b09c35a41 service nova] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Refreshing network info cache for port 3a3bfab4-5540-4133-9b06-9fadf024f74c {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.029s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b83de7d-9fb2-42a6-af4a-29b7fd90d426]: (4, ('ok\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-638d0187-2a68-4689-b96c-a17639990158 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Flushing IO for device /dev/sdf {{(pid=74683) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a75d30-e6ae-4ae1-bbd1-b4f4833041ca]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-638d0187-2a68-4689-b96c-a17639990158 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74683) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.044s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a39baa-c274-4ef3-b4ef-7ef4f7a41ed4]: (4, ('1', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-638d0187-2a68-4689-b96c-a17639990158 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-638d0187-2a68-4689-b96c-a17639990158 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] SCSI volumes sdf have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-638d0187-2a68-4689-b96c-a17639990158 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d')] {{(pid=74683) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f271367-0b66-4f6b-a5b7-3b89495a55e1]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-638d0187-2a68-4689-b96c-a17639990158 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d -p 172.16.0.220:3260 --logout {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da1c672-b14b-4d0e-9a86-5578c0c649f9]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-638d0187-2a68-4689-b96c-a17639990158 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d, portal: 172.16.0.220,3260]
Oct 16 11:37:49 user nova-compute[74683]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d, portal: 172.16.0.220,3260] successful.
Oct 16 11:37:49 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d -p 172.16.0.220:3260 --op delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9b67505-0202-45d9-83d4-13042662620d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a16365-30df-4641-a1cd-af58554a83c0]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-638d0187-2a68-4689-b96c-a17639990158 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-638d0187-2a68-4689-b96c-a17639990158 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-638d0187-2a68-4689-b96c-a17639990158 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] <== disconnect_volume: return (356ms) None {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-638d0187-2a68-4689-b96c-a17639990158 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Disconnected iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 11:37:49 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-638d0187-2a68-4689-b96c-a17639990158 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Deleting instance files /opt/stack/data/nova/instances/a6cb0bee-7424-4798-aac2-d5606f124733_del
Oct 16 11:37:49 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-638d0187-2a68-4689-b96c-a17639990158 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Deletion of /opt/stack/data/nova/instances/a6cb0bee-7424-4798-aac2-d5606f124733_del complete
Oct 16 11:37:49 user nova-compute[74683]: INFO nova.compute.manager [None req-638d0187-2a68-4689-b96c-a17639990158 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Took 1.27 seconds to destroy the instance on the hypervisor.
Oct 16 11:37:49 user nova-compute[74683]: DEBUG oslo.service.loopingcall [None req-638d0187-2a68-4689-b96c-a17639990158 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74683) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG nova.compute.manager [-] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Deallocating network for instance {{(pid=74683) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 11:37:49 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] deallocate_for_instance() {{(pid=74683) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 11:37:50 user nova-compute[74683]: DEBUG nova.network.neutron [req-9ec6ab34-8a1d-41d9-97c3-edc234aa4512 req-e7ecda54-f6dd-4f36-a777-3a3b09c35a41 service nova] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Updated VIF entry in instance network info cache for port 3a3bfab4-5540-4133-9b06-9fadf024f74c. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:37:50 user nova-compute[74683]: DEBUG nova.network.neutron [req-9ec6ab34-8a1d-41d9-97c3-edc234aa4512 req-e7ecda54-f6dd-4f36-a777-3a3b09c35a41 service nova] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Updating instance_info_cache with network_info: [{"id": "3a3bfab4-5540-4133-9b06-9fadf024f74c", "address": "fa:16:3e:10:7f:06", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a3bfab4-55", "ovs_interfaceid": "3a3bfab4-5540-4133-9b06-9fadf024f74c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:37:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-9ec6ab34-8a1d-41d9-97c3-edc234aa4512 req-e7ecda54-f6dd-4f36-a777-3a3b09c35a41 service nova] Releasing lock "refresh_cache-a6cb0bee-7424-4798-aac2-d5606f124733" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:37:50 user nova-compute[74683]: DEBUG nova.compute.manager [req-9ec6ab34-8a1d-41d9-97c3-edc234aa4512 req-e7ecda54-f6dd-4f36-a777-3a3b09c35a41 service nova] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Received event network-vif-unplugged-3a3bfab4-5540-4133-9b06-9fadf024f74c {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:37:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-9ec6ab34-8a1d-41d9-97c3-edc234aa4512 req-e7ecda54-f6dd-4f36-a777-3a3b09c35a41 service nova] Acquiring lock "a6cb0bee-7424-4798-aac2-d5606f124733-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:37:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-9ec6ab34-8a1d-41d9-97c3-edc234aa4512 req-e7ecda54-f6dd-4f36-a777-3a3b09c35a41 service nova] Lock "a6cb0bee-7424-4798-aac2-d5606f124733-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:37:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-9ec6ab34-8a1d-41d9-97c3-edc234aa4512 req-e7ecda54-f6dd-4f36-a777-3a3b09c35a41 service nova] Lock "a6cb0bee-7424-4798-aac2-d5606f124733-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:37:50 user nova-compute[74683]: DEBUG nova.compute.manager [req-9ec6ab34-8a1d-41d9-97c3-edc234aa4512 req-e7ecda54-f6dd-4f36-a777-3a3b09c35a41 service nova] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] No waiting events found dispatching network-vif-unplugged-3a3bfab4-5540-4133-9b06-9fadf024f74c {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:37:50 user nova-compute[74683]: DEBUG nova.compute.manager [req-9ec6ab34-8a1d-41d9-97c3-edc234aa4512 req-e7ecda54-f6dd-4f36-a777-3a3b09c35a41 service nova] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Received event network-vif-unplugged-3a3bfab4-5540-4133-9b06-9fadf024f74c for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 11:37:50 user nova-compute[74683]: DEBUG nova.compute.manager [req-9ec6ab34-8a1d-41d9-97c3-edc234aa4512 req-e7ecda54-f6dd-4f36-a777-3a3b09c35a41 service nova] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Received event network-vif-plugged-3a3bfab4-5540-4133-9b06-9fadf024f74c {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:37:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-9ec6ab34-8a1d-41d9-97c3-edc234aa4512 req-e7ecda54-f6dd-4f36-a777-3a3b09c35a41 service nova] Acquiring lock "a6cb0bee-7424-4798-aac2-d5606f124733-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:37:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-9ec6ab34-8a1d-41d9-97c3-edc234aa4512 req-e7ecda54-f6dd-4f36-a777-3a3b09c35a41 service nova] Lock "a6cb0bee-7424-4798-aac2-d5606f124733-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:37:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-9ec6ab34-8a1d-41d9-97c3-edc234aa4512 req-e7ecda54-f6dd-4f36-a777-3a3b09c35a41 service nova] Lock "a6cb0bee-7424-4798-aac2-d5606f124733-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:37:50 user nova-compute[74683]: DEBUG nova.compute.manager [req-9ec6ab34-8a1d-41d9-97c3-edc234aa4512 req-e7ecda54-f6dd-4f36-a777-3a3b09c35a41 service nova] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] No waiting events found dispatching network-vif-plugged-3a3bfab4-5540-4133-9b06-9fadf024f74c {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:37:50 user nova-compute[74683]: WARNING nova.compute.manager [req-9ec6ab34-8a1d-41d9-97c3-edc234aa4512 req-e7ecda54-f6dd-4f36-a777-3a3b09c35a41 service nova] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Received unexpected event network-vif-plugged-3a3bfab4-5540-4133-9b06-9fadf024f74c for instance with vm_state active and task_state deleting.
Oct 16 11:37:50 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:37:50 user nova-compute[74683]: INFO nova.compute.manager [-] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Took 1.00 seconds to deallocate network for instance.
Oct 16 11:37:51 user nova-compute[74683]: DEBUG nova.compute.manager [req-20bb827d-9f5a-455a-a176-cb6bbb2235e1 req-d1369df2-3119-426c-b639-030276fa068a service nova] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Received event network-vif-deleted-3a3bfab4-5540-4133-9b06-9fadf024f74c {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:37:51 user nova-compute[74683]: INFO nova.compute.manager [None req-638d0187-2a68-4689-b96c-a17639990158 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: a6cb0bee-7424-4798-aac2-d5606f124733] Took 0.87 seconds to detach 1 volumes for instance.
Oct 16 11:37:51 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-638d0187-2a68-4689-b96c-a17639990158 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:37:51 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-638d0187-2a68-4689-b96c-a17639990158 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:37:52 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-638d0187-2a68-4689-b96c-a17639990158 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:37:52 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-638d0187-2a68-4689-b96c-a17639990158 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:37:52 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-638d0187-2a68-4689-b96c-a17639990158 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.355s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:37:52 user nova-compute[74683]: INFO nova.scheduler.client.report [None req-638d0187-2a68-4689-b96c-a17639990158 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Deleted allocations for instance a6cb0bee-7424-4798-aac2-d5606f124733
Oct 16 11:37:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:37:52 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-638d0187-2a68-4689-b96c-a17639990158 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "a6cb0bee-7424-4798-aac2-d5606f124733" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.700s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:37:54 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:37:59 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a333bcb-4d44-4fd4-b9c5-eadecdf7487e tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Calling os-brick to attach iSCSI Volume {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 11:37:59 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a333bcb-4d44-4fd4-b9c5-eadecdf7487e tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gasOQIiU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:37:59 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-4a333bcb-4d44-4fd4-b9c5-eadecdf7487e tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:37:59 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-4a333bcb-4d44-4fd4-b9c5-eadecdf7487e tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:37:59 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-4a333bcb-4d44-4fd4-b9c5-eadecdf7487e tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:37:59 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-4a333bcb-4d44-4fd4-b9c5-eadecdf7487e tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:37:59 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-4a333bcb-4d44-4fd4-b9c5-eadecdf7487e tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:37:59 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-4a333bcb-4d44-4fd4-b9c5-eadecdf7487e tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:37:59 user nova-compute[74683]: INFO os_brick.initiator.connectors.iscsi [None req-4a333bcb-4d44-4fd4-b9c5-eadecdf7487e tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 11:37:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87 -p 172.16.0.220:3260 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:37:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:37:59 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4ac4cb-e1d1-435f-9fb0-f908d86b2e77]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:37:59 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a333bcb-4d44-4fd4-b9c5-eadecdf7487e tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 11:37:59 user nova-compute[74683]:  {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:37:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87 -p 172.16.0.220:3260 --interface default --op new {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:37:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:37:59 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9900726-3ac3-471a-90d8-1a9a58a830ec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87] added\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:37:59 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a333bcb-4d44-4fd4-b9c5-eadecdf7487e tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87] added
Oct 16 11:37:59 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:37:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:37:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:37:59 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[664eed12-8f05-452e-b024-99d333aa4105]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:37:59 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a333bcb-4d44-4fd4-b9c5-eadecdf7487e tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:37:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:37:59 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:37:59 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:37:59 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74683) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 11:37:59 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:37:59 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:37:59 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:37:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:37:59 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dee3126-1c6e-42e5-a0ec-ef27f7ac4c5f]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:37:59 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a333bcb-4d44-4fd4-b9c5-eadecdf7487e tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:37:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gasOQIiU {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:37:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gasOQIiU" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:37:59 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f1604f-a782-4d5e-bf61-902ae9786c01]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:37:59 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a333bcb-4d44-4fd4-b9c5-eadecdf7487e tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gasOQIiU'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:37:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:37:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:37:59 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d80bb6-6587-43ec-b87c-7daeaf2f3ccc]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:37:59 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a333bcb-4d44-4fd4-b9c5-eadecdf7487e tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:37:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:37:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:37:59 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f218ee-8aa0-4a49-9852-13d3ecfb48e9]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:37:59 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a333bcb-4d44-4fd4-b9c5-eadecdf7487e tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)
Oct 16 11:37:59 user nova-compute[74683]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)
Oct 16 11:37:59 user nova-compute[74683]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e (non-flash)
Oct 16 11:37:59 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:37:59 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a333bcb-4d44-4fd4-b9c5-eadecdf7487e tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)
Oct 16 11:37:59 user nova-compute[74683]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)
Oct 16 11:37:59 user nova-compute[74683]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e (non-flash)
Oct 16 11:37:59 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:37:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87 -p 172.16.0.220:3260 --login {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87 -p 172.16.0.220:3260 --login" returned: 0 in 1.065s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:00 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[71933a3b-2691-4abd-8ac2-4a790f0e8901]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:38:00 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a333bcb-4d44-4fd4-b9c5-eadecdf7487e tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87, portal: 172.16.0.220,3260]
Oct 16 11:38:00 user nova-compute[74683]: Login to [iface: default, target: iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87, portal: 172.16.0.220,3260] successful.
Oct 16 11:38:00 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:38:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:00 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[507c894a-cf7d-4cba-b34c-d7eff21a2c19]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:38:00 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a333bcb-4d44-4fd4-b9c5-eadecdf7487e tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:38:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:00 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ad87fb-7604-41fb-a3d9-39e5ba3ccd2b]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:38:00 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a333bcb-4d44-4fd4-b9c5-eadecdf7487e tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)
Oct 16 11:38:00 user nova-compute[74683]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)
Oct 16 11:38:00 user nova-compute[74683]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e (non-flash)
Oct 16 11:38:00 user nova-compute[74683]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87 (non-flash)
Oct 16 11:38:00 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:38:00 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a333bcb-4d44-4fd4-b9c5-eadecdf7487e tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)
Oct 16 11:38:00 user nova-compute[74683]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)
Oct 16 11:38:00 user nova-compute[74683]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e (non-flash)
Oct 16 11:38:00 user nova-compute[74683]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87 (non-flash)
Oct 16 11:38:00 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:38:00 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-4a333bcb-4d44-4fd4-b9c5-eadecdf7487e tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.298s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:38:00 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a333bcb-4d44-4fd4-b9c5-eadecdf7487e tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Connected to 172.16.0.220:3260 {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 11:38:00 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-4a333bcb-4d44-4fd4-b9c5-eadecdf7487e tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] HCTL ('35', '-', '-', 0) found on session 45 with lun 0 {{(pid=74683) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 11:38:00 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-4a333bcb-4d44-4fd4-b9c5-eadecdf7487e tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74683) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 11:38:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:00 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2bbce18-a8d0-41ea-80e2-0f031db90771]: (4, ('- - 0', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:38:00 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-4a333bcb-4d44-4fd4-b9c5-eadecdf7487e tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:38:00 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a333bcb-4d44-4fd4-b9c5-eadecdf7487e tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gasOQIiU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 11:38:01 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-4a333bcb-4d44-4fd4-b9c5-eadecdf7487e tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.332s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:38:01 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a333bcb-4d44-4fd4-b9c5-eadecdf7487e tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] <== connect_volume: return (2335ms) {'type': 'block', 'scsi_wwn': '26431663930333066', 'path': '/dev/sdd'} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:38:01 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a333bcb-4d44-4fd4-b9c5-eadecdf7487e tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431663930333066', 'path': '/dev/sdd'} {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 11:38:01 user nova-compute[74683]: DEBUG nova.objects.instance [None req-4a333bcb-4d44-4fd4-b9c5-eadecdf7487e tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lazy-loading 'flavor' on Instance uuid 8d94b70c-4056-4c58-9df4-73684e0d164f {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:38:01 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-4a333bcb-4d44-4fd4-b9c5-eadecdf7487e tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 11:38:01 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:38:01 user nova-compute[74683]:   <source dev="/dev/sdd"/>
Oct 16 11:38:01 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:38:01 user nova-compute[74683]:   <serial>99659c6e-9089-4eab-bfa8-25b1700bfc87</serial>
Oct 16 11:38:01 user nova-compute[74683]: </disk>
Oct 16 11:38:01 user nova-compute[74683]:  {{(pid=74683) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 11:38:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:38:02 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-4a333bcb-4d44-4fd4-b9c5-eadecdf7487e tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:38:02 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-4a333bcb-4d44-4fd4-b9c5-eadecdf7487e tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:38:02 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-4a333bcb-4d44-4fd4-b9c5-eadecdf7487e tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] No VIF found with MAC fa:16:3e:67:41:41, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:38:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-4a333bcb-4d44-4fd4-b9c5-eadecdf7487e tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lock "8d94b70c-4056-4c58-9df4-73684e0d164f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 44.197s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:38:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1280c3a3-12f1-4633-91f3-73a9cdeab4fa tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Calling os-brick to attach iSCSI Volume {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 11:38:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1280c3a3-12f1-4633-91f3-73a9cdeab4fa tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xunQNFqz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:38:04 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-1280c3a3-12f1-4633-91f3-73a9cdeab4fa tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:38:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-1280c3a3-12f1-4633-91f3-73a9cdeab4fa tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:38:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-1280c3a3-12f1-4633-91f3-73a9cdeab4fa tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:38:04 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-1280c3a3-12f1-4633-91f3-73a9cdeab4fa tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:38:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-1280c3a3-12f1-4633-91f3-73a9cdeab4fa tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:38:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-1280c3a3-12f1-4633-91f3-73a9cdeab4fa tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:38:04 user nova-compute[74683]: INFO os_brick.initiator.connectors.iscsi [None req-1280c3a3-12f1-4633-91f3-73a9cdeab4fa tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 11:38:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5 -p 172.16.0.220:3260 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3d8cfb-eabb-4828-b861-9405af542a2c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:38:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1280c3a3-12f1-4633-91f3-73a9cdeab4fa tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 11:38:04 user nova-compute[74683]:  {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:38:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[039d18f9-ef23-40c0-b331-938d36015ab5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5] added\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:38:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1280c3a3-12f1-4633-91f3-73a9cdeab4fa tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5] added
Oct 16 11:38:04 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:38:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56a6c54-a220-4ada-8f95-7a2294793cde]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:38:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1280c3a3-12f1-4633-91f3-73a9cdeab4fa tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:38:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[abedf9a6-1b71-4fc9-80fb-a81c9d3b1f8e]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:38:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1280c3a3-12f1-4633-91f3-73a9cdeab4fa tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:38:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xunQNFqz {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:04 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:38:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xunQNFqz" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[247eae2d-b404-4324-a151-8ec49c8a334e]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:38:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1280c3a3-12f1-4633-91f3-73a9cdeab4fa tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xunQNFqz'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:38:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[403446d3-04d1-4c5a-ad2b-4dd58e893d83]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:38:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1280c3a3-12f1-4633-91f3-73a9cdeab4fa tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:38:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cad8be9-ff42-4788-a934-58d0428475f4]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:38:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1280c3a3-12f1-4633-91f3-73a9cdeab4fa tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)
Oct 16 11:38:04 user nova-compute[74683]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)
Oct 16 11:38:04 user nova-compute[74683]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e (non-flash)
Oct 16 11:38:04 user nova-compute[74683]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87 (non-flash)
Oct 16 11:38:04 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:38:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1280c3a3-12f1-4633-91f3-73a9cdeab4fa tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)
Oct 16 11:38:04 user nova-compute[74683]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)
Oct 16 11:38:04 user nova-compute[74683]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e (non-flash)
Oct 16 11:38:04 user nova-compute[74683]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87 (non-flash)
Oct 16 11:38:04 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:38:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5 -p 172.16.0.220:3260 --login {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[35534ffb-cfe8-4d13-a0dc-b9b826ed48a9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:38:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1280c3a3-12f1-4633-91f3-73a9cdeab4fa tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5, portal: 172.16.0.220,3260]
Oct 16 11:38:04 user nova-compute[74683]: Login to [iface: default, target: iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5, portal: 172.16.0.220,3260] successful.
Oct 16 11:38:04 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:38:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b65e1d-2847-4275-b636-b8c48bbd9157]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:38:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1280c3a3-12f1-4633-91f3-73a9cdeab4fa tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:38:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1472b9-382b-4cf0-9579-3ecbbec1e704]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:38:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1280c3a3-12f1-4633-91f3-73a9cdeab4fa tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)
Oct 16 11:38:04 user nova-compute[74683]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)
Oct 16 11:38:04 user nova-compute[74683]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e (non-flash)
Oct 16 11:38:04 user nova-compute[74683]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87 (non-flash)
Oct 16 11:38:04 user nova-compute[74683]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5 (non-flash)
Oct 16 11:38:04 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:38:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1280c3a3-12f1-4633-91f3-73a9cdeab4fa tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)
Oct 16 11:38:04 user nova-compute[74683]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)
Oct 16 11:38:04 user nova-compute[74683]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e (non-flash)
Oct 16 11:38:04 user nova-compute[74683]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87 (non-flash)
Oct 16 11:38:04 user nova-compute[74683]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5 (non-flash)
Oct 16 11:38:04 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:38:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-1280c3a3-12f1-4633-91f3-73a9cdeab4fa tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:38:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1280c3a3-12f1-4633-91f3-73a9cdeab4fa tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Connected to 172.16.0.220:3260 {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 11:38:04 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-1280c3a3-12f1-4633-91f3-73a9cdeab4fa tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] HCTL ('37', '-', '-', 0) found on session 46 with lun 0 {{(pid=74683) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 11:38:04 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-1280c3a3-12f1-4633-91f3-73a9cdeab4fa tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74683) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 11:38:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f92e931-572b-4c9b-9981-98d2f32c3d70]: (4, ('- - 0', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:38:04 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-1280c3a3-12f1-4633-91f3-73a9cdeab4fa tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Searching for a device in session 46 and hctl ['37', '*', '*', 0] yield: None {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:38:05 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-66ce115d-8048-40ac-9af1-6646c00e4c0e tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Acquiring lock "43d35d0e-acc5-4076-8641-73b4704f1028" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:38:05 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-66ce115d-8048-40ac-9af1-6646c00e4c0e tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "43d35d0e-acc5-4076-8641-73b4704f1028" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:38:05 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-66ce115d-8048-40ac-9af1-6646c00e4c0e tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Acquiring lock "43d35d0e-acc5-4076-8641-73b4704f1028-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:38:05 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-66ce115d-8048-40ac-9af1-6646c00e4c0e tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "43d35d0e-acc5-4076-8641-73b4704f1028-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:38:05 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-66ce115d-8048-40ac-9af1-6646c00e4c0e tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "43d35d0e-acc5-4076-8641-73b4704f1028-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:38:05 user nova-compute[74683]: INFO nova.compute.manager [None req-66ce115d-8048-40ac-9af1-6646c00e4c0e tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Terminating instance
Oct 16 11:38:05 user nova-compute[74683]: DEBUG nova.compute.manager [None req-66ce115d-8048-40ac-9af1-6646c00e4c0e tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Start destroying the instance on the hypervisor. {{(pid=74683) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 11:38:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:38:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:38:05 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-1280c3a3-12f1-4633-91f3-73a9cdeab4fa tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Searching for a device in session 46 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:38:05 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1280c3a3-12f1-4633-91f3-73a9cdeab4fa tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xunQNFqz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 11:38:05 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-1280c3a3-12f1-4633-91f3-73a9cdeab4fa tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:38:05 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1280c3a3-12f1-4633-91f3-73a9cdeab4fa tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '26431366336376666', 'path': '/dev/sdf'} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:38:05 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1280c3a3-12f1-4633-91f3-73a9cdeab4fa tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431366336376666', 'path': '/dev/sdf'} {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 11:38:05 user nova-compute[74683]: DEBUG nova.objects.instance [None req-1280c3a3-12f1-4633-91f3-73a9cdeab4fa tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lazy-loading 'flavor' on Instance uuid e88445f0-2b1c-4cc1-94ca-33a1e3bec929 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:38:05 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-1280c3a3-12f1-4633-91f3-73a9cdeab4fa tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 11:38:05 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:38:05 user nova-compute[74683]:   <source dev="/dev/sdf"/>
Oct 16 11:38:05 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:38:05 user nova-compute[74683]:   <serial>3400449b-1160-4ffe-9ea2-9fdfb4995ea5</serial>
Oct 16 11:38:05 user nova-compute[74683]: </disk>
Oct 16 11:38:05 user nova-compute[74683]:  {{(pid=74683) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 11:38:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:38:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:38:05 user nova-compute[74683]: DEBUG nova.compute.manager [req-c2894beb-7ee9-461e-8315-5c19406920f3 req-f520e2fc-4245-4897-b964-b295e9344659 service nova] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Received event network-vif-unplugged-8bc348fc-b8e3-40da-a8a1-70bd70c3fffe {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:38:05 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c2894beb-7ee9-461e-8315-5c19406920f3 req-f520e2fc-4245-4897-b964-b295e9344659 service nova] Acquiring lock "43d35d0e-acc5-4076-8641-73b4704f1028-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:38:05 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c2894beb-7ee9-461e-8315-5c19406920f3 req-f520e2fc-4245-4897-b964-b295e9344659 service nova] Lock "43d35d0e-acc5-4076-8641-73b4704f1028-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:38:05 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c2894beb-7ee9-461e-8315-5c19406920f3 req-f520e2fc-4245-4897-b964-b295e9344659 service nova] Lock "43d35d0e-acc5-4076-8641-73b4704f1028-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:38:05 user nova-compute[74683]: DEBUG nova.compute.manager [req-c2894beb-7ee9-461e-8315-5c19406920f3 req-f520e2fc-4245-4897-b964-b295e9344659 service nova] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] No waiting events found dispatching network-vif-unplugged-8bc348fc-b8e3-40da-a8a1-70bd70c3fffe {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:38:05 user nova-compute[74683]: DEBUG nova.compute.manager [req-c2894beb-7ee9-461e-8315-5c19406920f3 req-f520e2fc-4245-4897-b964-b295e9344659 service nova] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Received event network-vif-unplugged-8bc348fc-b8e3-40da-a8a1-70bd70c3fffe for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 11:38:06 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Instance destroyed successfully.
Oct 16 11:38:06 user nova-compute[74683]: DEBUG nova.objects.instance [None req-66ce115d-8048-40ac-9af1-6646c00e4c0e tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lazy-loading 'resources' on Instance uuid 43d35d0e-acc5-4076-8641-73b4704f1028 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-66ce115d-8048-40ac-9af1-6646c00e4c0e tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:31:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1789370996',display_name='tempest-ServerActionsTestOtherA-server-1789370996',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1789370996',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBEVF+XohWeGna7xpASkIb8CQzH1AhAApSWM489KR3Xw5eNUrWHdrfnFEDLkNX5O9VFz9JiKaf+QhMQdRVklpUzwWiktfTm3fcbGcjt8FS9CdAQjTtJZQ2xWrypXQEhUiQ==',key_name='tempest-keypair-1801585168',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:33:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fcb8da41d6584a689e9b50155288aa5e',ramdisk_id='',reservation_id='r-ydo0ajxm',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-327072564',owner_user_name='tempest-ServerActionsTestOtherA-327072564-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:35:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a55641a42b142ea9fb6c6c1fdb9963e',uuid=43d35d0e-acc5-4076-8641-73b4704f1028,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8bc348fc-b8e3-40da-a8a1-70bd70c3fffe", "address": "fa:16:3e:37:bc:60", "network": {"id": "cd8cf08c-d79c-4d2e-b849-640c440e1498", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1091743670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcb8da41d6584a689e9b50155288aa5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc348fc-b8", "ovs_interfaceid": "8bc348fc-b8e3-40da-a8a1-70bd70c3fffe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-66ce115d-8048-40ac-9af1-6646c00e4c0e tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Converting VIF {"id": "8bc348fc-b8e3-40da-a8a1-70bd70c3fffe", "address": "fa:16:3e:37:bc:60", "network": {"id": "cd8cf08c-d79c-4d2e-b849-640c440e1498", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1091743670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcb8da41d6584a689e9b50155288aa5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc348fc-b8", "ovs_interfaceid": "8bc348fc-b8e3-40da-a8a1-70bd70c3fffe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-66ce115d-8048-40ac-9af1-6646c00e4c0e tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:37:bc:60,bridge_name='br-int',has_traffic_filtering=True,id=8bc348fc-b8e3-40da-a8a1-70bd70c3fffe,network=Network(cd8cf08c-d79c-4d2e-b849-640c440e1498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bc348fc-b8') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG os_vif [None req-66ce115d-8048-40ac-9af1-6646c00e4c0e tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:bc:60,bridge_name='br-int',has_traffic_filtering=True,id=8bc348fc-b8e3-40da-a8a1-70bd70c3fffe,network=Network(cd8cf08c-d79c-4d2e-b849-640c440e1498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bc348fc-b8') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8bc348fc-b8, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=17d69c37-86da-4534-995e-1d7ec2ee4b67) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-1280c3a3-12f1-4633-91f3-73a9cdeab4fa tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-1280c3a3-12f1-4633-91f3-73a9cdeab4fa tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-1280c3a3-12f1-4633-91f3-73a9cdeab4fa tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] No VIF found with MAC fa:16:3e:6e:28:8e, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:38:06 user nova-compute[74683]: INFO os_vif [None req-66ce115d-8048-40ac-9af1-6646c00e4c0e tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:bc:60,bridge_name='br-int',has_traffic_filtering=True,id=8bc348fc-b8e3-40da-a8a1-70bd70c3fffe,network=Network(cd8cf08c-d79c-4d2e-b849-640c440e1498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bc348fc-b8')
Oct 16 11:38:06 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66ce115d-8048-40ac-9af1-6646c00e4c0e tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] calling os-brick to detach iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ce115d-8048-40ac-9af1-6646c00e4c0e tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, {'target_iqn': 'iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qDUviZHh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:38:06 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-66ce115d-8048-40ac-9af1-6646c00e4c0e tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:38:06 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-66ce115d-8048-40ac-9af1-6646c00e4c0e tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-66ce115d-8048-40ac-9af1-6646c00e4c0e tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[b865818e-f9da-4c2d-9400-fda432380355]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ce115d-8048-40ac-9af1-6646c00e4c0e tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 11:38:06 user nova-compute[74683]: No targets found.
Oct 16 11:38:06 user nova-compute[74683]: iSNS:
Oct 16 11:38:06 user nova-compute[74683]: No targets found.
Oct 16 11:38:06 user nova-compute[74683]: STATIC:
Oct 16 11:38:06 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5
Oct 16 11:38:06 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:38:06 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:38:06 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87
Oct 16 11:38:06 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:38:06 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:38:06 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e
Oct 16 11:38:06 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:38:06 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:38:06 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f
Oct 16 11:38:06 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:38:06 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:38:06 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44
Oct 16 11:38:06 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:38:06 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:38:06 user nova-compute[74683]: FIRMWARE:
Oct 16 11:38:06 user nova-compute[74683]: No targets found.
Oct 16 11:38:06 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ce115d-8048-40ac-9af1-6646c00e4c0e tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 11:38:06 user nova-compute[74683]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 11:38:06 user nova-compute[74683]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74683) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ce115d-8048-40ac-9af1-6646c00e4c0e tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44', 0)] {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd06f40-52f1-4d43-bd1e-e49dc90e9be7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe1d670-84ad-423b-b87a-5cf3b7eb9b33]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ce115d-8048-40ac-9af1-6646c00e4c0e tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)
Oct 16 11:38:06 user nova-compute[74683]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)
Oct 16 11:38:06 user nova-compute[74683]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e (non-flash)
Oct 16 11:38:06 user nova-compute[74683]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87 (non-flash)
Oct 16 11:38:06 user nova-compute[74683]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5 (non-flash)
Oct 16 11:38:06 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ce115d-8048-40ac-9af1-6646c00e4c0e tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 (non-flash)
Oct 16 11:38:06 user nova-compute[74683]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)
Oct 16 11:38:06 user nova-compute[74683]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e (non-flash)
Oct 16 11:38:06 user nova-compute[74683]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87 (non-flash)
Oct 16 11:38:06 user nova-compute[74683]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5 (non-flash)
Oct 16 11:38:06 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ce115d-8048-40ac-9af1-6646c00e4c0e tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda6c427eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44'): ({'sdb'}, set())}) {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-66ce115d-8048-40ac-9af1-6646c00e4c0e tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Removing single pathed devices sdb {{(pid=74683) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb97aa7e-5697-41c2-bcfc-13b295cdf5d8]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aab2e74-f26b-4884-8e31-4d057a7d7647]: (4, ('ok\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-66ce115d-8048-40ac-9af1-6646c00e4c0e tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Flushing IO for device /dev/sdb {{(pid=74683) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d5e4ac-ea4f-4c7f-b821-855fa9cfabdb]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-66ce115d-8048-40ac-9af1-6646c00e4c0e tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74683) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1280c3a3-12f1-4633-91f3-73a9cdeab4fa tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lock "e88445f0-2b1c-4cc1-94ca-33a1e3bec929" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.219s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a6a453-2500-483c-824f-51ea829bc663]: (4, ('1', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-66ce115d-8048-40ac-9af1-6646c00e4c0e tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-66ce115d-8048-40ac-9af1-6646c00e4c0e tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] SCSI volumes sdb have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_f41bd9d7', '/dev/disk/by-id/scsi-23763333465303433', '/dev/disk/by-id/scsi-1SCST_BIOf41bd9d7-7c34e04347a6ce9c') {{(pid=85666) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19191f3-5df6-4196-9ce4-d14ce27c4d96]: (4, None) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ce115d-8048-40ac-9af1-6646c00e4c0e tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44')] {{(pid=74683) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16aeb49-eb5c-4154-a478-600c7e7d89d2]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ce115d-8048-40ac-9af1-6646c00e4c0e tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 -p 172.16.0.220:3260 --logout {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e334c4ff-2c72-4121-8885-03e701b8ff49]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ce115d-8048-40ac-9af1-6646c00e4c0e tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44, portal: 172.16.0.220,3260]
Oct 16 11:38:06 user nova-compute[74683]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44, portal: 172.16.0.220,3260] successful.
Oct 16 11:38:06 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 -p 172.16.0.220:3260 --op delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64115bde-e392-4631-bc47-a4b9b829eb44 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8c365c-34ca-447f-ae32-4c4d68b7c10d]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ce115d-8048-40ac-9af1-6646c00e4c0e tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-66ce115d-8048-40ac-9af1-6646c00e4c0e tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ce115d-8048-40ac-9af1-6646c00e4c0e tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] <== disconnect_volume: return (368ms) None {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66ce115d-8048-40ac-9af1-6646c00e4c0e tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Disconnected iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 11:38:06 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-66ce115d-8048-40ac-9af1-6646c00e4c0e tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Deleting instance files /opt/stack/data/nova/instances/43d35d0e-acc5-4076-8641-73b4704f1028_del
Oct 16 11:38:06 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-66ce115d-8048-40ac-9af1-6646c00e4c0e tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Deletion of /opt/stack/data/nova/instances/43d35d0e-acc5-4076-8641-73b4704f1028_del complete
Oct 16 11:38:06 user nova-compute[74683]: INFO nova.compute.manager [None req-66ce115d-8048-40ac-9af1-6646c00e4c0e tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Took 1.45 seconds to destroy the instance on the hypervisor.
Oct 16 11:38:06 user nova-compute[74683]: DEBUG oslo.service.loopingcall [None req-66ce115d-8048-40ac-9af1-6646c00e4c0e tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74683) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG nova.compute.manager [-] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Deallocating network for instance {{(pid=74683) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 11:38:06 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] deallocate_for_instance() {{(pid=74683) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 11:38:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:38:07 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:38:07 user nova-compute[74683]: INFO nova.compute.manager [-] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Took 0.86 seconds to deallocate network for instance.
Oct 16 11:38:07 user nova-compute[74683]: DEBUG nova.compute.manager [req-e1150d6b-82e9-42e2-b197-f2fa90c22c14 req-ce7c9e48-9ff2-45e6-9142-2140261f6031 service nova] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Received event network-vif-deleted-8bc348fc-b8e3-40da-a8a1-70bd70c3fffe {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:38:07 user nova-compute[74683]: INFO nova.compute.manager [req-e1150d6b-82e9-42e2-b197-f2fa90c22c14 req-ce7c9e48-9ff2-45e6-9142-2140261f6031 service nova] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Neutron deleted interface 8bc348fc-b8e3-40da-a8a1-70bd70c3fffe; detaching it from the instance and deleting it from the info cache
Oct 16 11:38:07 user nova-compute[74683]: DEBUG nova.network.neutron [req-e1150d6b-82e9-42e2-b197-f2fa90c22c14 req-ce7c9e48-9ff2-45e6-9142-2140261f6031 service nova] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:38:07 user nova-compute[74683]: DEBUG nova.compute.manager [req-e1150d6b-82e9-42e2-b197-f2fa90c22c14 req-ce7c9e48-9ff2-45e6-9142-2140261f6031 service nova] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Detach interface failed, port_id=8bc348fc-b8e3-40da-a8a1-70bd70c3fffe, reason: Instance 43d35d0e-acc5-4076-8641-73b4704f1028 could not be found. {{(pid=74683) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 16 11:38:07 user nova-compute[74683]: DEBUG nova.compute.manager [req-15f2224e-1118-45b5-acad-c902460777ba req-5fa41d75-637b-479a-8d21-3b94d9d352fa service nova] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Received event network-vif-plugged-8bc348fc-b8e3-40da-a8a1-70bd70c3fffe {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:38:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-15f2224e-1118-45b5-acad-c902460777ba req-5fa41d75-637b-479a-8d21-3b94d9d352fa service nova] Acquiring lock "43d35d0e-acc5-4076-8641-73b4704f1028-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:38:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-15f2224e-1118-45b5-acad-c902460777ba req-5fa41d75-637b-479a-8d21-3b94d9d352fa service nova] Lock "43d35d0e-acc5-4076-8641-73b4704f1028-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:38:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-15f2224e-1118-45b5-acad-c902460777ba req-5fa41d75-637b-479a-8d21-3b94d9d352fa service nova] Lock "43d35d0e-acc5-4076-8641-73b4704f1028-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:38:07 user nova-compute[74683]: DEBUG nova.compute.manager [req-15f2224e-1118-45b5-acad-c902460777ba req-5fa41d75-637b-479a-8d21-3b94d9d352fa service nova] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] No waiting events found dispatching network-vif-plugged-8bc348fc-b8e3-40da-a8a1-70bd70c3fffe {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:38:07 user nova-compute[74683]: WARNING nova.compute.manager [req-15f2224e-1118-45b5-acad-c902460777ba req-5fa41d75-637b-479a-8d21-3b94d9d352fa service nova] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Received unexpected event network-vif-plugged-8bc348fc-b8e3-40da-a8a1-70bd70c3fffe for instance with vm_state active and task_state deleting.
Oct 16 11:38:08 user nova-compute[74683]: INFO nova.compute.manager [None req-66ce115d-8048-40ac-9af1-6646c00e4c0e tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Took 0.88 seconds to detach 1 volumes for instance.
Oct 16 11:38:08 user nova-compute[74683]: DEBUG nova.compute.manager [None req-66ce115d-8048-40ac-9af1-6646c00e4c0e tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: 43d35d0e-acc5-4076-8641-73b4704f1028] Deleting volume: 64115bde-e392-4631-bc47-a4b9b829eb44 {{(pid=74683) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 16 11:38:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-66ce115d-8048-40ac-9af1-6646c00e4c0e tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:38:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-66ce115d-8048-40ac-9af1-6646c00e4c0e tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:38:09 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-66ce115d-8048-40ac-9af1-6646c00e4c0e tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:38:09 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-66ce115d-8048-40ac-9af1-6646c00e4c0e tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:38:09 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-66ce115d-8048-40ac-9af1-6646c00e4c0e tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.321s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:38:09 user nova-compute[74683]: INFO nova.scheduler.client.report [None req-66ce115d-8048-40ac-9af1-6646c00e4c0e tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Deleted allocations for instance 43d35d0e-acc5-4076-8641-73b4704f1028
Oct 16 11:38:09 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-66ce115d-8048-40ac-9af1-6646c00e4c0e tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "43d35d0e-acc5-4076-8641-73b4704f1028" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.860s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:38:11 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:38:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9c2c1eed-cb9e-41cf-a14b-336c7fa8c3e9 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Acquiring lock "f5ad764c-638d-4dac-b032-6680917e46df" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:38:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9c2c1eed-cb9e-41cf-a14b-336c7fa8c3e9 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "f5ad764c-638d-4dac-b032-6680917e46df" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:38:11 user nova-compute[74683]: INFO nova.compute.manager [None req-9c2c1eed-cb9e-41cf-a14b-336c7fa8c3e9 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Detaching volume 22c582f7-e7ab-4c14-a3e5-2d52b953051e
Oct 16 11:38:11 user nova-compute[74683]: INFO nova.virt.block_device [None req-9c2c1eed-cb9e-41cf-a14b-336c7fa8c3e9 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Attempting to driver detach volume 22c582f7-e7ab-4c14-a3e5-2d52b953051e from mountpoint /dev/vdb
Oct 16 11:38:11 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9c2c1eed-cb9e-41cf-a14b-336c7fa8c3e9 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Attempting to detach device vdb from instance f5ad764c-638d-4dac-b032-6680917e46df from the persistent domain config. {{(pid=74683) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 11:38:11 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-9c2c1eed-cb9e-41cf-a14b-336c7fa8c3e9 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 11:38:11 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:38:11 user nova-compute[74683]:   <source dev="/dev/sde"/>
Oct 16 11:38:11 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:38:11 user nova-compute[74683]:   <serial>22c582f7-e7ab-4c14-a3e5-2d52b953051e</serial>
Oct 16 11:38:11 user nova-compute[74683]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 16 11:38:11 user nova-compute[74683]: </disk>
Oct 16 11:38:11 user nova-compute[74683]:  {{(pid=74683) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 11:38:11 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-9c2c1eed-cb9e-41cf-a14b-336c7fa8c3e9 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Successfully detached device vdb from instance f5ad764c-638d-4dac-b032-6680917e46df from the persistent domain config.
Oct 16 11:38:11 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9c2c1eed-cb9e-41cf-a14b-336c7fa8c3e9 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f5ad764c-638d-4dac-b032-6680917e46df from the live domain config. {{(pid=74683) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 11:38:11 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-9c2c1eed-cb9e-41cf-a14b-336c7fa8c3e9 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 11:38:11 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:38:11 user nova-compute[74683]:   <source dev="/dev/sde"/>
Oct 16 11:38:11 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:38:11 user nova-compute[74683]:   <serial>22c582f7-e7ab-4c14-a3e5-2d52b953051e</serial>
Oct 16 11:38:11 user nova-compute[74683]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 16 11:38:11 user nova-compute[74683]: </disk>
Oct 16 11:38:11 user nova-compute[74683]:  {{(pid=74683) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 11:38:12 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9c2c1eed-cb9e-41cf-a14b-336c7fa8c3e9 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f5ad764c-638d-4dac-b032-6680917e46df {{(pid=74683) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 11:38:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:38:16 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:38:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:38:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:38:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:38:26 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:38:26 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:38:26 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Starting heal instance info cache {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 11:38:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "refresh_cache-f5ad764c-638d-4dac-b032-6680917e46df" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:38:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquired lock "refresh_cache-f5ad764c-638d-4dac-b032-6680917e46df" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:38:26 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Forcefully refreshing network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 11:38:27 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Updating instance_info_cache with network_info: [{"id": "eb80f49f-da30-478a-900a-5d3da8ec7fa9", "address": "fa:16:3e:c8:02:4d", "network": {"id": "badd2db9-6c0f-40cc-afe9-a199e040399a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1368098259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "889cb980200446c0933fe965738a62df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb80f49f-da", "ovs_interfaceid": "eb80f49f-da30-478a-900a-5d3da8ec7fa9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:38:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Releasing lock "refresh_cache-f5ad764c-638d-4dac-b032-6680917e46df" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:38:27 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Updated the network info_cache for instance {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 11:38:27 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:38:27 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:38:27 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:38:27 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:38:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:38:27 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:38:27 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:38:27 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74683) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 11:38:27 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:38:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:38:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:38:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:38:27 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Auditing locally available compute resources for user (node: user) {{(pid=74683) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 11:38:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d94b70c-4056-4c58-9df4-73684e0d164f/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d94b70c-4056-4c58-9df4-73684e0d164f/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d94b70c-4056-4c58-9df4-73684e0d164f/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d94b70c-4056-4c58-9df4-73684e0d164f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:29 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:38:29 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:38:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88445f0-2b1c-4cc1-94ca-33a1e3bec929/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88445f0-2b1c-4cc1-94ca-33a1e3bec929/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88445f0-2b1c-4cc1-94ca-33a1e3bec929/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88445f0-2b1c-4cc1-94ca-33a1e3bec929/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:29 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:38:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.rescue --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.rescue --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:31 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:38:31 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:38:31 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Hypervisor/Node resource view: name=user free_ram=8041MB free_disk=25.16489028930664GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74683) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 11:38:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:38:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:38:31 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance edd01413-1f8a-49e3-aa3c-ecb19c62afae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:38:31 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 9b8ba94f-43cc-4f06-bcd9-83935ccbe117 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:38:31 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance b91af786-36e3-4815-811f-fb3c055e758d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:38:31 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance f5ad764c-638d-4dac-b032-6680917e46df actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:38:31 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 6d3528c9-50dd-4f9e-ab92-2f885662bff7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:38:31 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 8d94b70c-4056-4c58-9df4-73684e0d164f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:38:31 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance e88445f0-2b1c-4cc1-94ca-33a1e3bec929 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:38:31 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 11:38:31 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 11:38:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:38:31 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:38:31 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:38:31 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Compute_service record updated for user:user {{(pid=74683) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 11:38:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.378s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:38:32 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9c2c1eed-cb9e-41cf-a14b-336c7fa8c3e9 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f5ad764c-638d-4dac-b032-6680917e46df is timed out.
Oct 16 11:38:32 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-9c2c1eed-cb9e-41cf-a14b-336c7fa8c3e9 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Successfully detached device vdb from instance f5ad764c-638d-4dac-b032-6680917e46df from the live domain config.
Oct 16 11:38:32 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c2c1eed-cb9e-41cf-a14b-336c7fa8c3e9 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] calling os-brick to detach iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 11:38:32 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c2c1eed-cb9e-41cf-a14b-336c7fa8c3e9 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, {'target_iqn': 'iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JjfbFZCq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:38:32 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-9c2c1eed-cb9e-41cf-a14b-336c7fa8c3e9 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:38:32 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-9c2c1eed-cb9e-41cf-a14b-336c7fa8c3e9 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:38:32 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-9c2c1eed-cb9e-41cf-a14b-336c7fa8c3e9 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:38:32 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:32 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:32 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[227b4468-df77-40e9-8e94-078e516c3083]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:38:32 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c2c1eed-cb9e-41cf-a14b-336c7fa8c3e9 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 11:38:32 user nova-compute[74683]: No targets found.
Oct 16 11:38:32 user nova-compute[74683]: iSNS:
Oct 16 11:38:32 user nova-compute[74683]: No targets found.
Oct 16 11:38:32 user nova-compute[74683]: STATIC:
Oct 16 11:38:32 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5
Oct 16 11:38:32 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:38:32 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:38:32 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87
Oct 16 11:38:32 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:38:32 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:38:32 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e
Oct 16 11:38:32 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:38:32 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:38:32 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f
Oct 16 11:38:32 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:38:32 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:38:32 user nova-compute[74683]: FIRMWARE:
Oct 16 11:38:32 user nova-compute[74683]: No targets found.
Oct 16 11:38:32 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:38:32 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c2c1eed-cb9e-41cf-a14b-336c7fa8c3e9 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 11:38:32 user nova-compute[74683]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 11:38:32 user nova-compute[74683]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74683) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 11:38:32 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c2c1eed-cb9e-41cf-a14b-336c7fa8c3e9 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e', 0)] {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 11:38:32 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:32 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:32 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3196f53-87f5-40f7-af90-b01baf63e597]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:38:32 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:32 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:32 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bada9a5-ddda-4695-9cc5-831a0bc869f7]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:38:32 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c2c1eed-cb9e-41cf-a14b-336c7fa8c3e9 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)
Oct 16 11:38:32 user nova-compute[74683]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e (non-flash)
Oct 16 11:38:32 user nova-compute[74683]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87 (non-flash)
Oct 16 11:38:32 user nova-compute[74683]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5 (non-flash)
Oct 16 11:38:32 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:38:32 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c2c1eed-cb9e-41cf-a14b-336c7fa8c3e9 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)
Oct 16 11:38:32 user nova-compute[74683]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e (non-flash)
Oct 16 11:38:32 user nova-compute[74683]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87 (non-flash)
Oct 16 11:38:32 user nova-compute[74683]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5 (non-flash)
Oct 16 11:38:32 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:38:32 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c2c1eed-cb9e-41cf-a14b-336c7fa8c3e9 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda4c7dfe20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e'): ({'sde'}, set())}) {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 11:38:32 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-9c2c1eed-cb9e-41cf-a14b-336c7fa8c3e9 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Removing single pathed devices sde {{(pid=74683) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 11:38:32 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:32 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:32 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5f581b-a537-4ce8-b7ac-8c19e6704bf8]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:38:32 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:32 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:32 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b258e5-6c64-4b4b-a0f4-e530dd76461a]: (4, ('ok\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:38:32 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-9c2c1eed-cb9e-41cf-a14b-336c7fa8c3e9 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Flushing IO for device /dev/sde {{(pid=74683) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 11:38:32 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:32 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:32 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a601fe0c-3f4e-4799-a80e-4da5fa9cd4ac]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:38:32 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-9c2c1eed-cb9e-41cf-a14b-336c7fa8c3e9 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74683) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 11:38:32 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:32 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:32 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0482e7-ea3e-402f-85fb-73af140c6aa4]: (4, ('1', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:38:32 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-9c2c1eed-cb9e-41cf-a14b-336c7fa8c3e9 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 11:38:32 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-9c2c1eed-cb9e-41cf-a14b-336c7fa8c3e9 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] SCSI volumes sde have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 11:38:32 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c2c1eed-cb9e-41cf-a14b-336c7fa8c3e9 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e')] {{(pid=74683) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 11:38:32 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:32 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:32 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[50312518-ac14-4658-a34a-2ea441e29837]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:38:32 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c2c1eed-cb9e-41cf-a14b-336c7fa8c3e9 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:38:32 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e -p 172.16.0.220:3260 --logout {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:32 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:32 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[84fefa47-a15a-4d77-ad5b-29850e9b0714]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:38:32 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c2c1eed-cb9e-41cf-a14b-336c7fa8c3e9 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e, portal: 172.16.0.220,3260]
Oct 16 11:38:32 user nova-compute[74683]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e, portal: 172.16.0.220,3260] successful.
Oct 16 11:38:32 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:38:32 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e -p 172.16.0.220:3260 --op delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:32 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22c582f7-e7ab-4c14-a3e5-2d52b953051e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:32 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87b7928-72d1-4011-a740-31fed0b6a3f1]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:38:32 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c2c1eed-cb9e-41cf-a14b-336c7fa8c3e9 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:38:32 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-9c2c1eed-cb9e-41cf-a14b-336c7fa8c3e9 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:38:32 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c2c1eed-cb9e-41cf-a14b-336c7fa8c3e9 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] <== disconnect_volume: return (307ms) None {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:38:32 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c2c1eed-cb9e-41cf-a14b-336c7fa8c3e9 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Disconnected iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 11:38:33 user nova-compute[74683]: DEBUG nova.objects.instance [None req-9c2c1eed-cb9e-41cf-a14b-336c7fa8c3e9 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lazy-loading 'flavor' on Instance uuid f5ad764c-638d-4dac-b032-6680917e46df {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:38:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9c2c1eed-cb9e-41cf-a14b-336c7fa8c3e9 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "f5ad764c-638d-4dac-b032-6680917e46df" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.840s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:38:34 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-84b27a32-0b67-4a86-9697-9187632e4fe3 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Acquiring lock "f5ad764c-638d-4dac-b032-6680917e46df" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:38:34 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-84b27a32-0b67-4a86-9697-9187632e4fe3 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "f5ad764c-638d-4dac-b032-6680917e46df" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:38:34 user nova-compute[74683]: DEBUG nova.compute.manager [None req-84b27a32-0b67-4a86-9697-9187632e4fe3 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:38:34 user nova-compute[74683]: DEBUG nova.compute.manager [None req-84b27a32-0b67-4a86-9697-9187632e4fe3 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74683) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Oct 16 11:38:34 user nova-compute[74683]: DEBUG nova.objects.instance [None req-84b27a32-0b67-4a86-9697-9187632e4fe3 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lazy-loading 'flavor' on Instance uuid f5ad764c-638d-4dac-b032-6680917e46df {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:38:34 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:38:34 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:38:34 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:38:34 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:38:34 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:38:34 user nova-compute[74683]: DEBUG nova.compute.manager [req-ad8ea790-e1eb-4bc2-8c86-73e644e3c84c req-6643132c-3cde-4501-84b5-08f2a8b68a70 service nova] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Received event network-vif-unplugged-eb80f49f-da30-478a-900a-5d3da8ec7fa9 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:38:34 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-ad8ea790-e1eb-4bc2-8c86-73e644e3c84c req-6643132c-3cde-4501-84b5-08f2a8b68a70 service nova] Acquiring lock "f5ad764c-638d-4dac-b032-6680917e46df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:38:34 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-ad8ea790-e1eb-4bc2-8c86-73e644e3c84c req-6643132c-3cde-4501-84b5-08f2a8b68a70 service nova] Lock "f5ad764c-638d-4dac-b032-6680917e46df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:38:34 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-ad8ea790-e1eb-4bc2-8c86-73e644e3c84c req-6643132c-3cde-4501-84b5-08f2a8b68a70 service nova] Lock "f5ad764c-638d-4dac-b032-6680917e46df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:38:34 user nova-compute[74683]: DEBUG nova.compute.manager [req-ad8ea790-e1eb-4bc2-8c86-73e644e3c84c req-6643132c-3cde-4501-84b5-08f2a8b68a70 service nova] [instance: f5ad764c-638d-4dac-b032-6680917e46df] No waiting events found dispatching network-vif-unplugged-eb80f49f-da30-478a-900a-5d3da8ec7fa9 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:38:34 user nova-compute[74683]: WARNING nova.compute.manager [req-ad8ea790-e1eb-4bc2-8c86-73e644e3c84c req-6643132c-3cde-4501-84b5-08f2a8b68a70 service nova] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Received unexpected event network-vif-unplugged-eb80f49f-da30-478a-900a-5d3da8ec7fa9 for instance with vm_state active and task_state powering-off.
Oct 16 11:38:34 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-4f1e5aae-8f08-4e94-8476-e552ddda6d6b tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Acquiring lock "8d94b70c-4056-4c58-9df4-73684e0d164f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:38:34 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-4f1e5aae-8f08-4e94-8476-e552ddda6d6b tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lock "8d94b70c-4056-4c58-9df4-73684e0d164f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:38:34 user nova-compute[74683]: INFO nova.compute.manager [None req-4f1e5aae-8f08-4e94-8476-e552ddda6d6b tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Detaching volume 99659c6e-9089-4eab-bfa8-25b1700bfc87
Oct 16 11:38:34 user nova-compute[74683]: INFO nova.virt.block_device [None req-4f1e5aae-8f08-4e94-8476-e552ddda6d6b tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Attempting to driver detach volume 99659c6e-9089-4eab-bfa8-25b1700bfc87 from mountpoint /dev/vdb
Oct 16 11:38:34 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-4f1e5aae-8f08-4e94-8476-e552ddda6d6b tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Attempting to detach device vdb from instance 8d94b70c-4056-4c58-9df4-73684e0d164f from the persistent domain config. {{(pid=74683) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 11:38:34 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-4f1e5aae-8f08-4e94-8476-e552ddda6d6b tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 11:38:34 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:38:34 user nova-compute[74683]:   <source dev="/dev/sdd"/>
Oct 16 11:38:34 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:38:34 user nova-compute[74683]:   <serial>99659c6e-9089-4eab-bfa8-25b1700bfc87</serial>
Oct 16 11:38:34 user nova-compute[74683]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 11:38:34 user nova-compute[74683]: </disk>
Oct 16 11:38:34 user nova-compute[74683]:  {{(pid=74683) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 11:38:34 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-4f1e5aae-8f08-4e94-8476-e552ddda6d6b tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Successfully detached device vdb from instance 8d94b70c-4056-4c58-9df4-73684e0d164f from the persistent domain config.
Oct 16 11:38:34 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-4f1e5aae-8f08-4e94-8476-e552ddda6d6b tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8d94b70c-4056-4c58-9df4-73684e0d164f from the live domain config. {{(pid=74683) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 11:38:34 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-4f1e5aae-8f08-4e94-8476-e552ddda6d6b tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 11:38:34 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:38:34 user nova-compute[74683]:   <source dev="/dev/sdd"/>
Oct 16 11:38:34 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:38:34 user nova-compute[74683]:   <serial>99659c6e-9089-4eab-bfa8-25b1700bfc87</serial>
Oct 16 11:38:34 user nova-compute[74683]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 11:38:34 user nova-compute[74683]: </disk>
Oct 16 11:38:34 user nova-compute[74683]:  {{(pid=74683) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 11:38:35 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Instance destroyed successfully.
Oct 16 11:38:35 user nova-compute[74683]: DEBUG nova.compute.manager [None req-84b27a32-0b67-4a86-9697-9187632e4fe3 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:38:35 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-84b27a32-0b67-4a86-9697-9187632e4fe3 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "f5ad764c-638d-4dac-b032-6680917e46df" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.935s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:38:35 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-4f1e5aae-8f08-4e94-8476-e552ddda6d6b tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8d94b70c-4056-4c58-9df4-73684e0d164f {{(pid=74683) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 11:38:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:38:36 user nova-compute[74683]: DEBUG nova.compute.manager [req-948ed740-2daf-4e0c-8123-70ab5f32859f req-445ce16e-a140-472e-b4ca-3cf3a192543b service nova] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Received event network-vif-plugged-eb80f49f-da30-478a-900a-5d3da8ec7fa9 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:38:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-948ed740-2daf-4e0c-8123-70ab5f32859f req-445ce16e-a140-472e-b4ca-3cf3a192543b service nova] Acquiring lock "f5ad764c-638d-4dac-b032-6680917e46df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:38:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-948ed740-2daf-4e0c-8123-70ab5f32859f req-445ce16e-a140-472e-b4ca-3cf3a192543b service nova] Lock "f5ad764c-638d-4dac-b032-6680917e46df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:38:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-948ed740-2daf-4e0c-8123-70ab5f32859f req-445ce16e-a140-472e-b4ca-3cf3a192543b service nova] Lock "f5ad764c-638d-4dac-b032-6680917e46df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:38:36 user nova-compute[74683]: DEBUG nova.compute.manager [req-948ed740-2daf-4e0c-8123-70ab5f32859f req-445ce16e-a140-472e-b4ca-3cf3a192543b service nova] [instance: f5ad764c-638d-4dac-b032-6680917e46df] No waiting events found dispatching network-vif-plugged-eb80f49f-da30-478a-900a-5d3da8ec7fa9 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:38:36 user nova-compute[74683]: WARNING nova.compute.manager [req-948ed740-2daf-4e0c-8123-70ab5f32859f req-445ce16e-a140-472e-b4ca-3cf3a192543b service nova] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Received unexpected event network-vif-plugged-eb80f49f-da30-478a-900a-5d3da8ec7fa9 for instance with vm_state stopped and task_state None.
Oct 16 11:38:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:38:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:38:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:38:44 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-cb2be261-c7c7-476e-8e29-f08e46ab50d8 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Acquiring lock "b91af786-36e3-4815-811f-fb3c055e758d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:38:44 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-cb2be261-c7c7-476e-8e29-f08e46ab50d8 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "b91af786-36e3-4815-811f-fb3c055e758d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:38:44 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-cb2be261-c7c7-476e-8e29-f08e46ab50d8 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Acquiring lock "b91af786-36e3-4815-811f-fb3c055e758d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:38:44 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-cb2be261-c7c7-476e-8e29-f08e46ab50d8 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "b91af786-36e3-4815-811f-fb3c055e758d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:38:44 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-cb2be261-c7c7-476e-8e29-f08e46ab50d8 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "b91af786-36e3-4815-811f-fb3c055e758d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:38:44 user nova-compute[74683]: INFO nova.compute.manager [None req-cb2be261-c7c7-476e-8e29-f08e46ab50d8 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Terminating instance
Oct 16 11:38:44 user nova-compute[74683]: DEBUG nova.compute.manager [None req-cb2be261-c7c7-476e-8e29-f08e46ab50d8 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Start destroying the instance on the hypervisor. {{(pid=74683) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 11:38:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:38:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:38:45 user nova-compute[74683]: DEBUG nova.compute.manager [req-fdb312f5-deb0-438c-8e74-7dd9b4b95e75 req-a955a181-cbbe-40ba-b238-14d0e846104f service nova] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Received event network-vif-unplugged-abc9cf45-e4f5-4a33-9ffc-dab110e73398 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:38:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-fdb312f5-deb0-438c-8e74-7dd9b4b95e75 req-a955a181-cbbe-40ba-b238-14d0e846104f service nova] Acquiring lock "b91af786-36e3-4815-811f-fb3c055e758d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:38:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-fdb312f5-deb0-438c-8e74-7dd9b4b95e75 req-a955a181-cbbe-40ba-b238-14d0e846104f service nova] Lock "b91af786-36e3-4815-811f-fb3c055e758d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:38:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-fdb312f5-deb0-438c-8e74-7dd9b4b95e75 req-a955a181-cbbe-40ba-b238-14d0e846104f service nova] Lock "b91af786-36e3-4815-811f-fb3c055e758d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:38:45 user nova-compute[74683]: DEBUG nova.compute.manager [req-fdb312f5-deb0-438c-8e74-7dd9b4b95e75 req-a955a181-cbbe-40ba-b238-14d0e846104f service nova] [instance: b91af786-36e3-4815-811f-fb3c055e758d] No waiting events found dispatching network-vif-unplugged-abc9cf45-e4f5-4a33-9ffc-dab110e73398 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:38:45 user nova-compute[74683]: DEBUG nova.compute.manager [req-fdb312f5-deb0-438c-8e74-7dd9b4b95e75 req-a955a181-cbbe-40ba-b238-14d0e846104f service nova] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Received event network-vif-unplugged-abc9cf45-e4f5-4a33-9ffc-dab110e73398 for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 11:38:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:38:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:38:45 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Instance destroyed successfully.
Oct 16 11:38:45 user nova-compute[74683]: DEBUG nova.objects.instance [None req-cb2be261-c7c7-476e-8e29-f08e46ab50d8 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lazy-loading 'resources' on Instance uuid b91af786-36e3-4815-811f-fb3c055e758d {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:38:45 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-cb2be261-c7c7-476e-8e29-f08e46ab50d8 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:21:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-311629692',display_name='tempest-ServerRescueNegativeTestJSON-server-311629692',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-311629692',id=24,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:23:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e66a49078f1240bd88207e487dd4951e',ramdisk_id='',reservation_id='r-d5sue84g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1690011355',owner_user_name='tempest-ServerRescueNegativeTestJSON-1690011355-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:23:50Z,user_data=None,user_id='3436197c787446d4a03fb7697d7999a1',uuid=b91af786-36e3-4815-811f-fb3c055e758d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "abc9cf45-e4f5-4a33-9ffc-dab110e73398", "address": "fa:16:3e:03:03:02", "network": {"id": "fa128ba8-cd2f-4621-ac04-ecc21569bb68", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321708612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66a49078f1240bd88207e487dd4951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc9cf45-e4", "ovs_interfaceid": "abc9cf45-e4f5-4a33-9ffc-dab110e73398", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:38:45 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-cb2be261-c7c7-476e-8e29-f08e46ab50d8 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Converting VIF {"id": "abc9cf45-e4f5-4a33-9ffc-dab110e73398", "address": "fa:16:3e:03:03:02", "network": {"id": "fa128ba8-cd2f-4621-ac04-ecc21569bb68", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321708612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66a49078f1240bd88207e487dd4951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc9cf45-e4", "ovs_interfaceid": "abc9cf45-e4f5-4a33-9ffc-dab110e73398", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:38:45 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-cb2be261-c7c7-476e-8e29-f08e46ab50d8 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:03:02,bridge_name='br-int',has_traffic_filtering=True,id=abc9cf45-e4f5-4a33-9ffc-dab110e73398,network=Network(fa128ba8-cd2f-4621-ac04-ecc21569bb68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabc9cf45-e4') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:38:45 user nova-compute[74683]: DEBUG os_vif [None req-cb2be261-c7c7-476e-8e29-f08e46ab50d8 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:03:02,bridge_name='br-int',has_traffic_filtering=True,id=abc9cf45-e4f5-4a33-9ffc-dab110e73398,network=Network(fa128ba8-cd2f-4621-ac04-ecc21569bb68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabc9cf45-e4') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:38:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:38:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapabc9cf45-e4, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:38:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:38:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:38:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:38:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:38:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=78e142f0-131f-495d-a779-728e94305086) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:38:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:38:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:38:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:38:45 user nova-compute[74683]: INFO os_vif [None req-cb2be261-c7c7-476e-8e29-f08e46ab50d8 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:03:02,bridge_name='br-int',has_traffic_filtering=True,id=abc9cf45-e4f5-4a33-9ffc-dab110e73398,network=Network(fa128ba8-cd2f-4621-ac04-ecc21569bb68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabc9cf45-e4')
Oct 16 11:38:45 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-cb2be261-c7c7-476e-8e29-f08e46ab50d8 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Deleting instance files /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d_del
Oct 16 11:38:45 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-cb2be261-c7c7-476e-8e29-f08e46ab50d8 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Deletion of /opt/stack/data/nova/instances/b91af786-36e3-4815-811f-fb3c055e758d_del complete
Oct 16 11:38:45 user nova-compute[74683]: INFO nova.compute.manager [None req-cb2be261-c7c7-476e-8e29-f08e46ab50d8 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Took 0.80 seconds to destroy the instance on the hypervisor.
Oct 16 11:38:45 user nova-compute[74683]: DEBUG oslo.service.loopingcall [None req-cb2be261-c7c7-476e-8e29-f08e46ab50d8 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74683) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 11:38:45 user nova-compute[74683]: DEBUG nova.compute.manager [-] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Deallocating network for instance {{(pid=74683) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 11:38:45 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: b91af786-36e3-4815-811f-fb3c055e758d] deallocate_for_instance() {{(pid=74683) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 11:38:46 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:38:46 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:38:46 user nova-compute[74683]: INFO nova.compute.manager [-] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Took 0.78 seconds to deallocate network for instance.
Oct 16 11:38:46 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-cb2be261-c7c7-476e-8e29-f08e46ab50d8 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:38:46 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-cb2be261-c7c7-476e-8e29-f08e46ab50d8 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:38:46 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-cb2be261-c7c7-476e-8e29-f08e46ab50d8 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:38:46 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-cb2be261-c7c7-476e-8e29-f08e46ab50d8 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:38:46 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-cb2be261-c7c7-476e-8e29-f08e46ab50d8 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.290s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:38:46 user nova-compute[74683]: INFO nova.scheduler.client.report [None req-cb2be261-c7c7-476e-8e29-f08e46ab50d8 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Deleted allocations for instance b91af786-36e3-4815-811f-fb3c055e758d
Oct 16 11:38:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-cb2be261-c7c7-476e-8e29-f08e46ab50d8 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "b91af786-36e3-4815-811f-fb3c055e758d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.109s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:38:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:38:47 user nova-compute[74683]: DEBUG nova.compute.manager [req-bfeb636c-5c86-4c61-91a1-d13e7b0f9c8b req-7376b22a-b9d9-46c4-b49b-bddc2794e69e service nova] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Received event network-vif-plugged-abc9cf45-e4f5-4a33-9ffc-dab110e73398 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:38:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-bfeb636c-5c86-4c61-91a1-d13e7b0f9c8b req-7376b22a-b9d9-46c4-b49b-bddc2794e69e service nova] Acquiring lock "b91af786-36e3-4815-811f-fb3c055e758d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:38:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-bfeb636c-5c86-4c61-91a1-d13e7b0f9c8b req-7376b22a-b9d9-46c4-b49b-bddc2794e69e service nova] Lock "b91af786-36e3-4815-811f-fb3c055e758d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:38:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-bfeb636c-5c86-4c61-91a1-d13e7b0f9c8b req-7376b22a-b9d9-46c4-b49b-bddc2794e69e service nova] Lock "b91af786-36e3-4815-811f-fb3c055e758d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:38:47 user nova-compute[74683]: DEBUG nova.compute.manager [req-bfeb636c-5c86-4c61-91a1-d13e7b0f9c8b req-7376b22a-b9d9-46c4-b49b-bddc2794e69e service nova] [instance: b91af786-36e3-4815-811f-fb3c055e758d] No waiting events found dispatching network-vif-plugged-abc9cf45-e4f5-4a33-9ffc-dab110e73398 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:38:47 user nova-compute[74683]: WARNING nova.compute.manager [req-bfeb636c-5c86-4c61-91a1-d13e7b0f9c8b req-7376b22a-b9d9-46c4-b49b-bddc2794e69e service nova] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Received unexpected event network-vif-plugged-abc9cf45-e4f5-4a33-9ffc-dab110e73398 for instance with vm_state deleted and task_state None.
Oct 16 11:38:47 user nova-compute[74683]: DEBUG nova.compute.manager [req-bfeb636c-5c86-4c61-91a1-d13e7b0f9c8b req-7376b22a-b9d9-46c4-b49b-bddc2794e69e service nova] [instance: b91af786-36e3-4815-811f-fb3c055e758d] Received event network-vif-deleted-abc9cf45-e4f5-4a33-9ffc-dab110e73398 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:38:50 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:38:50 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:38:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:38:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:38:54 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:38:55 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-4f1e5aae-8f08-4e94-8476-e552ddda6d6b tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8d94b70c-4056-4c58-9df4-73684e0d164f is timed out.
Oct 16 11:38:55 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-4f1e5aae-8f08-4e94-8476-e552ddda6d6b tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Successfully detached device vdb from instance 8d94b70c-4056-4c58-9df4-73684e0d164f from the live domain config.
Oct 16 11:38:55 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f1e5aae-8f08-4e94-8476-e552ddda6d6b tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] calling os-brick to detach iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 11:38:55 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f1e5aae-8f08-4e94-8476-e552ddda6d6b tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, {'target_iqn': 'iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gasOQIiU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:38:55 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-4f1e5aae-8f08-4e94-8476-e552ddda6d6b tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:38:55 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-4f1e5aae-8f08-4e94-8476-e552ddda6d6b tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:38:55 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-4f1e5aae-8f08-4e94-8476-e552ddda6d6b tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:38:55 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:55 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:55 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[726c5fe6-93aa-4b8a-8327-8a9056a64685]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:38:55 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f1e5aae-8f08-4e94-8476-e552ddda6d6b tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 11:38:55 user nova-compute[74683]: No targets found.
Oct 16 11:38:55 user nova-compute[74683]: iSNS:
Oct 16 11:38:55 user nova-compute[74683]: No targets found.
Oct 16 11:38:55 user nova-compute[74683]: STATIC:
Oct 16 11:38:55 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5
Oct 16 11:38:55 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:38:55 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:38:55 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87
Oct 16 11:38:55 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:38:55 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:38:55 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f
Oct 16 11:38:55 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:38:55 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:38:55 user nova-compute[74683]: FIRMWARE:
Oct 16 11:38:55 user nova-compute[74683]: No targets found.
Oct 16 11:38:55 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:38:55 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f1e5aae-8f08-4e94-8476-e552ddda6d6b tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 11:38:55 user nova-compute[74683]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 11:38:55 user nova-compute[74683]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74683) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 11:38:55 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f1e5aae-8f08-4e94-8476-e552ddda6d6b tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87', 0)] {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 11:38:55 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:55 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:55 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e83bc712-db02-4b7c-aa25-f39cfd0be062]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:38:55 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:55 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:55 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[015baec1-5c0e-48bf-8f80-d921981d90d6]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:38:55 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f1e5aae-8f08-4e94-8476-e552ddda6d6b tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)
Oct 16 11:38:55 user nova-compute[74683]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87 (non-flash)
Oct 16 11:38:55 user nova-compute[74683]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5 (non-flash)
Oct 16 11:38:55 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:38:55 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f1e5aae-8f08-4e94-8476-e552ddda6d6b tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)
Oct 16 11:38:55 user nova-compute[74683]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87 (non-flash)
Oct 16 11:38:55 user nova-compute[74683]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5 (non-flash)
Oct 16 11:38:55 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:38:55 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f1e5aae-8f08-4e94-8476-e552ddda6d6b tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda6c297d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87'): ({'sdd'}, set())}) {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 11:38:55 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-4f1e5aae-8f08-4e94-8476-e552ddda6d6b tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Removing single pathed devices sdd {{(pid=74683) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 11:38:55 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:55 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:55 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[054f8045-769e-45b5-b639-3cd10ccdbc2b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:38:55 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:55 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:55 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[dddd41b0-2bbb-4b41-86b6-a01a15c71b79]: (4, ('ok\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:38:55 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-4f1e5aae-8f08-4e94-8476-e552ddda6d6b tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Flushing IO for device /dev/sdd {{(pid=74683) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 11:38:55 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:55 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:55 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f6e44d-f319-4c92-a161-6d4843294c49]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:38:55 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-4f1e5aae-8f08-4e94-8476-e552ddda6d6b tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74683) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 11:38:55 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:55 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:38:55 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:55 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad52339b-b22d-4477-a6de-6cf3e8973599]: (4, ('1', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:38:55 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-4f1e5aae-8f08-4e94-8476-e552ddda6d6b tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 11:38:55 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-4f1e5aae-8f08-4e94-8476-e552ddda6d6b tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] SCSI volumes sdd have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 11:38:55 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f1e5aae-8f08-4e94-8476-e552ddda6d6b tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87')] {{(pid=74683) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 11:38:55 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:55 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:55 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bcc9351-bf11-47bf-b5ec-1b4ec3e4918b]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:38:55 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f1e5aae-8f08-4e94-8476-e552ddda6d6b tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:38:55 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87 -p 172.16.0.220:3260 --logout {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:55 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:55 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ed62fa-baf7-4750-a152-78734bea8082]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:38:55 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f1e5aae-8f08-4e94-8476-e552ddda6d6b tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87, portal: 172.16.0.220,3260]
Oct 16 11:38:55 user nova-compute[74683]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87, portal: 172.16.0.220,3260] successful.
Oct 16 11:38:55 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:38:55 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87 -p 172.16.0.220:3260 --op delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:55 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99659c6e-9089-4eab-bfa8-25b1700bfc87 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:55 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ffc2be-5641-4fad-878c-e8d8e7a228af]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:38:55 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f1e5aae-8f08-4e94-8476-e552ddda6d6b tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:38:55 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-4f1e5aae-8f08-4e94-8476-e552ddda6d6b tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:38:55 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f1e5aae-8f08-4e94-8476-e552ddda6d6b tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] <== disconnect_volume: return (305ms) None {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:38:55 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f1e5aae-8f08-4e94-8476-e552ddda6d6b tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Disconnected iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 11:38:56 user nova-compute[74683]: DEBUG nova.objects.instance [None req-4f1e5aae-8f08-4e94-8476-e552ddda6d6b tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lazy-loading 'flavor' on Instance uuid 8d94b70c-4056-4c58-9df4-73684e0d164f {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:38:56 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-4f1e5aae-8f08-4e94-8476-e552ddda6d6b tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lock "8d94b70c-4056-4c58-9df4-73684e0d164f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.959s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:38:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Acquiring lock "1986f9b5-30fb-4290-802d-ee699a19b608" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:38:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "1986f9b5-30fb-4290-802d-ee699a19b608" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:38:57 user nova-compute[74683]: DEBUG nova.compute.manager [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Starting instance... {{(pid=74683) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 11:38:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:38:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:38:57 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74683) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 11:38:57 user nova-compute[74683]: INFO nova.compute.claims [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Claim successful on node user
Oct 16 11:38:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:38:57 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:38:57 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:38:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.429s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:38:57 user nova-compute[74683]: DEBUG nova.compute.manager [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Start building networks asynchronously for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 11:38:57 user nova-compute[74683]: DEBUG nova.compute.manager [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Allocating IP information in the background. {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 11:38:57 user nova-compute[74683]: DEBUG nova.network.neutron [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] allocate_for_instance() {{(pid=74683) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 11:38:57 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 11:38:57 user nova-compute[74683]: DEBUG nova.compute.manager [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Start building block device mappings for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 11:38:57 user nova-compute[74683]: DEBUG nova.policy [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7bd40e88d3914927a7804e3b4fb26549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1ce607a3614fc493d33e6ba8ca5807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74683) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 11:38:57 user nova-compute[74683]: DEBUG nova.compute.manager [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Start spawning the instance on the hypervisor. {{(pid=74683) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 11:38:57 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Creating instance directory {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 11:38:57 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Creating image(s)
Oct 16 11:38:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Acquiring lock "/opt/stack/data/nova/instances/1986f9b5-30fb-4290-802d-ee699a19b608/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:38:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "/opt/stack/data/nova/instances/1986f9b5-30fb-4290-802d-ee699a19b608/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:38:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "/opt/stack/data/nova/instances/1986f9b5-30fb-4290-802d-ee699a19b608/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:38:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Acquiring lock "599effbe8b015f8f32845bbe528a552caba4a42c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:38:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "599effbe8b015f8f32845bbe528a552caba4a42c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:38:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:38:58 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/599effbe8b015f8f32845bbe528a552caba4a42c.part --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:58 user nova-compute[74683]: DEBUG nova.network.neutron [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Successfully created port: f6b38471-41ce-443b-8562-bee2b4f64d31 {{(pid=74683) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 11:38:58 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/599effbe8b015f8f32845bbe528a552caba4a42c.part --force-share --output=json" returned: 0 in 0.173s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:58 user nova-compute[74683]: DEBUG nova.virt.images [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] 3655c371-474c-4f9f-ba8b-0d7456865849 was qcow2, converting to raw {{(pid=74683) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 16 11:38:58 user nova-compute[74683]: DEBUG nova.privsep.utils [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74683) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 11:38:58 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/599effbe8b015f8f32845bbe528a552caba4a42c.part /opt/stack/data/nova/instances/_base/599effbe8b015f8f32845bbe528a552caba4a42c.converted {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:58 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/599effbe8b015f8f32845bbe528a552caba4a42c.part /opt/stack/data/nova/instances/_base/599effbe8b015f8f32845bbe528a552caba4a42c.converted" returned: 0 in 0.293s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:58 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/599effbe8b015f8f32845bbe528a552caba4a42c.converted --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/599effbe8b015f8f32845bbe528a552caba4a42c.converted --force-share --output=json" returned: 0 in 0.182s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:59 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "599effbe8b015f8f32845bbe528a552caba4a42c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.195s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:38:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/599effbe8b015f8f32845bbe528a552caba4a42c --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:59 user nova-compute[74683]: DEBUG nova.network.neutron [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Successfully updated port: f6b38471-41ce-443b-8562-bee2b4f64d31 {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:38:59 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Acquiring lock "refresh_cache-1986f9b5-30fb-4290-802d-ee699a19b608" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:38:59 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Acquired lock "refresh_cache-1986f9b5-30fb-4290-802d-ee699a19b608" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:38:59 user nova-compute[74683]: DEBUG nova.network.neutron [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:38:59 user nova-compute[74683]: DEBUG nova.compute.manager [req-588f4772-0210-49a5-8bca-bd109df5a632 req-1e482e10-a2db-4bda-830b-09d281d1b2ac service nova] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Received event network-changed-f6b38471-41ce-443b-8562-bee2b4f64d31 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:38:59 user nova-compute[74683]: DEBUG nova.compute.manager [req-588f4772-0210-49a5-8bca-bd109df5a632 req-1e482e10-a2db-4bda-830b-09d281d1b2ac service nova] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Refreshing instance network info cache due to event network-changed-f6b38471-41ce-443b-8562-bee2b4f64d31. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:38:59 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-588f4772-0210-49a5-8bca-bd109df5a632 req-1e482e10-a2db-4bda-830b-09d281d1b2ac service nova] Acquiring lock "refresh_cache-1986f9b5-30fb-4290-802d-ee699a19b608" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:38:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/599effbe8b015f8f32845bbe528a552caba4a42c --force-share --output=json" returned: 0 in 0.201s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:59 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Acquiring lock "599effbe8b015f8f32845bbe528a552caba4a42c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:38:59 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "599effbe8b015f8f32845bbe528a552caba4a42c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:38:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/599effbe8b015f8f32845bbe528a552caba4a42c --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:59 user nova-compute[74683]: DEBUG nova.network.neutron [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:38:59 user nova-compute[74683]: DEBUG nova.compute.manager [req-62237d77-8db8-4536-9b49-1db03ba93149 req-47b71e88-a283-44d2-8c9d-e904abf8b6a5 service nova] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Received event network-changed-d29ea840-0505-4827-b11f-2caa7b0f6faa {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:38:59 user nova-compute[74683]: DEBUG nova.compute.manager [req-62237d77-8db8-4536-9b49-1db03ba93149 req-47b71e88-a283-44d2-8c9d-e904abf8b6a5 service nova] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Refreshing instance network info cache due to event network-changed-d29ea840-0505-4827-b11f-2caa7b0f6faa. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:38:59 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-62237d77-8db8-4536-9b49-1db03ba93149 req-47b71e88-a283-44d2-8c9d-e904abf8b6a5 service nova] Acquiring lock "refresh_cache-6d3528c9-50dd-4f9e-ab92-2f885662bff7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:38:59 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-62237d77-8db8-4536-9b49-1db03ba93149 req-47b71e88-a283-44d2-8c9d-e904abf8b6a5 service nova] Acquired lock "refresh_cache-6d3528c9-50dd-4f9e-ab92-2f885662bff7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:38:59 user nova-compute[74683]: DEBUG nova.network.neutron [req-62237d77-8db8-4536-9b49-1db03ba93149 req-47b71e88-a283-44d2-8c9d-e904abf8b6a5 service nova] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Refreshing network info cache for port d29ea840-0505-4827-b11f-2caa7b0f6faa {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:38:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/599effbe8b015f8f32845bbe528a552caba4a42c --force-share --output=json" returned: 0 in 0.215s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/599effbe8b015f8f32845bbe528a552caba4a42c,backing_fmt=raw /opt/stack/data/nova/instances/1986f9b5-30fb-4290-802d-ee699a19b608/disk 1073741824 {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/599effbe8b015f8f32845bbe528a552caba4a42c,backing_fmt=raw /opt/stack/data/nova/instances/1986f9b5-30fb-4290-802d-ee699a19b608/disk 1073741824" returned: 0 in 0.088s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:59 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "599effbe8b015f8f32845bbe528a552caba4a42c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.309s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:38:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/599effbe8b015f8f32845bbe528a552caba4a42c --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:59 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-fada2b1f-bbfc-4809-a507-ad06df918016 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquiring lock "6d3528c9-50dd-4f9e-ab92-2f885662bff7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:38:59 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-fada2b1f-bbfc-4809-a507-ad06df918016 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "6d3528c9-50dd-4f9e-ab92-2f885662bff7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.004s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:38:59 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-fada2b1f-bbfc-4809-a507-ad06df918016 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquiring lock "6d3528c9-50dd-4f9e-ab92-2f885662bff7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:38:59 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-fada2b1f-bbfc-4809-a507-ad06df918016 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "6d3528c9-50dd-4f9e-ab92-2f885662bff7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:38:59 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-fada2b1f-bbfc-4809-a507-ad06df918016 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "6d3528c9-50dd-4f9e-ab92-2f885662bff7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:38:59 user nova-compute[74683]: INFO nova.compute.manager [None req-fada2b1f-bbfc-4809-a507-ad06df918016 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Terminating instance
Oct 16 11:38:59 user nova-compute[74683]: DEBUG nova.compute.manager [None req-fada2b1f-bbfc-4809-a507-ad06df918016 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Start destroying the instance on the hypervisor. {{(pid=74683) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 11:38:59 user nova-compute[74683]: DEBUG nova.network.neutron [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Updating instance_info_cache with network_info: [{"id": "f6b38471-41ce-443b-8562-bee2b4f64d31", "address": "fa:16:3e:c9:39:63", "network": {"id": "1fa0852d-814a-45ef-80fa-171693e4d02a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-184537544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ce607a3614fc493d33e6ba8ca5807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6b38471-41", "ovs_interfaceid": "f6b38471-41ce-443b-8562-bee2b4f64d31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:38:59 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Releasing lock "refresh_cache-1986f9b5-30fb-4290-802d-ee699a19b608" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:38:59 user nova-compute[74683]: DEBUG nova.compute.manager [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Instance network_info: |[{"id": "f6b38471-41ce-443b-8562-bee2b4f64d31", "address": "fa:16:3e:c9:39:63", "network": {"id": "1fa0852d-814a-45ef-80fa-171693e4d02a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-184537544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ce607a3614fc493d33e6ba8ca5807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6b38471-41", "ovs_interfaceid": "f6b38471-41ce-443b-8562-bee2b4f64d31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 11:38:59 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-588f4772-0210-49a5-8bca-bd109df5a632 req-1e482e10-a2db-4bda-830b-09d281d1b2ac service nova] Acquired lock "refresh_cache-1986f9b5-30fb-4290-802d-ee699a19b608" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:38:59 user nova-compute[74683]: DEBUG nova.network.neutron [req-588f4772-0210-49a5-8bca-bd109df5a632 req-1e482e10-a2db-4bda-830b-09d281d1b2ac service nova] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Refreshing network info cache for port f6b38471-41ce-443b-8562-bee2b4f64d31 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:38:59 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:38:59 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:38:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/599effbe8b015f8f32845bbe528a552caba4a42c --force-share --output=json" returned: 0 in 0.233s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:38:59 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1986f9b5-30fb-4290-802d-ee699a19b608/disk. size=1073741824 {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 11:38:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1986f9b5-30fb-4290-802d-ee699a19b608/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:38:59 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1986f9b5-30fb-4290-802d-ee699a19b608/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Cannot resize image /opt/stack/data/nova/instances/1986f9b5-30fb-4290-802d-ee699a19b608/disk to a smaller size. {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Created local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Ensure instance console log exists: /opt/stack/data/nova/instances/1986f9b5-30fb-4290-802d-ee699a19b608/console.log {{(pid=74683) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Start _get_guest_xml network_info=[{"id": "f6b38471-41ce-443b-8562-bee2b4f64d31", "address": "fa:16:3e:c9:39:63", "network": {"id": "1fa0852d-814a-45ef-80fa-171693e4d02a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-184537544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ce607a3614fc493d33e6ba8ca5807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6b38471-41", "ovs_interfaceid": "f6b38471-41ce-443b-8562-bee2b4f64d31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:38:54Z,direct_url=<?>,disk_format='qcow2',id=3655c371-474c-4f9f-ba8b-0d7456865849,min_disk=0,min_ram=0,name='tempest-scenario-img--1644110122',owner='5f1ce607a3614fc493d33e6ba8ca5807',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:38:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '3655c371-474c-4f9f-ba8b-0d7456865849'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:39:00 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:39:00 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:39:00 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:38:54Z,direct_url=<?>,disk_format='qcow2',id=3655c371-474c-4f9f-ba8b-0d7456865849,min_disk=0,min_ram=0,name='tempest-scenario-img--1644110122',owner='5f1ce607a3614fc493d33e6ba8ca5807',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:38:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:38:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1431918915',display_name='tempest-TestMinimumBasicScenario-server-1431918915',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1431918915',id=44,image_ref='3655c371-474c-4f9f-ba8b-0d7456865849',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCI5nTHN+Qfkky+jJW3BD5AjS3zBFf7VOxBEwGAWRlhhO37Od80oayCaWewTkSYmErNkZl6VLo4/JM0tQtAYq4JzjY6pa6GzBXSeQpF5WvAUIkacc81Db7rcQJLH79d+dg==',key_name='tempest-TestMinimumBasicScenario-1795285557',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f1ce607a3614fc493d33e6ba8ca5807',ramdisk_id='',reservation_id='r-04floz6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3655c371-474c-4f9f-ba8b-0d7456865849',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-470564601',owner_user_name='tempest-TestMinimumBasicScenario-470564601-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:38:58Z,user_data=None,user_id='7bd40e88d3914927a7804e3b4fb26549',uuid=1986f9b5-30fb-4290-802d-ee699a19b608,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f6b38471-41ce-443b-8562-bee2b4f64d31", "address": "fa:16:3e:c9:39:63", "network": {"id": "1fa0852d-814a-45ef-80fa-171693e4d02a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-184537544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ce607a3614fc493d33e6ba8ca5807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6b38471-41", "ovs_interfaceid": "f6b38471-41ce-443b-8562-bee2b4f64d31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Converting VIF {"id": "f6b38471-41ce-443b-8562-bee2b4f64d31", "address": "fa:16:3e:c9:39:63", "network": {"id": "1fa0852d-814a-45ef-80fa-171693e4d02a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-184537544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ce607a3614fc493d33e6ba8ca5807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6b38471-41", "ovs_interfaceid": "f6b38471-41ce-443b-8562-bee2b4f64d31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:39:63,bridge_name='br-int',has_traffic_filtering=True,id=f6b38471-41ce-443b-8562-bee2b4f64d31,network=Network(1fa0852d-814a-45ef-80fa-171693e4d02a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6b38471-41') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG nova.objects.instance [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lazy-loading 'pci_devices' on Instance uuid 1986f9b5-30fb-4290-802d-ee699a19b608 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:39:00 user nova-compute[74683]:   <uuid>1986f9b5-30fb-4290-802d-ee699a19b608</uuid>
Oct 16 11:39:00 user nova-compute[74683]:   <name>instance-0000002c</name>
Oct 16 11:39:00 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:39:00 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:39:00 user nova-compute[74683]:   <metadata>
Oct 16 11:39:00 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:39:00 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:39:00 user nova-compute[74683]:       <nova:name>tempest-TestMinimumBasicScenario-server-1431918915</nova:name>
Oct 16 11:39:00 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:39:00</nova:creationTime>
Oct 16 11:39:00 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:39:00 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:39:00 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:39:00 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:39:00 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:39:00 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:39:00 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:39:00 user nova-compute[74683]:       <nova:owner>
Oct 16 11:39:00 user nova-compute[74683]:         <nova:user uuid="7bd40e88d3914927a7804e3b4fb26549">tempest-TestMinimumBasicScenario-470564601-project-member</nova:user>
Oct 16 11:39:00 user nova-compute[74683]:         <nova:project uuid="5f1ce607a3614fc493d33e6ba8ca5807">tempest-TestMinimumBasicScenario-470564601</nova:project>
Oct 16 11:39:00 user nova-compute[74683]:       </nova:owner>
Oct 16 11:39:00 user nova-compute[74683]:       <nova:root type="image" uuid="3655c371-474c-4f9f-ba8b-0d7456865849"/>
Oct 16 11:39:00 user nova-compute[74683]:       <nova:ports>
Oct 16 11:39:00 user nova-compute[74683]:         <nova:port uuid="f6b38471-41ce-443b-8562-bee2b4f64d31">
Oct 16 11:39:00 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 16 11:39:00 user nova-compute[74683]:         </nova:port>
Oct 16 11:39:00 user nova-compute[74683]:       </nova:ports>
Oct 16 11:39:00 user nova-compute[74683]:     </nova:instance>
Oct 16 11:39:00 user nova-compute[74683]:   </metadata>
Oct 16 11:39:00 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:39:00 user nova-compute[74683]:     <system>
Oct 16 11:39:00 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:39:00 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:39:00 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:39:00 user nova-compute[74683]:       <entry name="serial">1986f9b5-30fb-4290-802d-ee699a19b608</entry>
Oct 16 11:39:00 user nova-compute[74683]:       <entry name="uuid">1986f9b5-30fb-4290-802d-ee699a19b608</entry>
Oct 16 11:39:00 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:39:00 user nova-compute[74683]:     </system>
Oct 16 11:39:00 user nova-compute[74683]:   </sysinfo>
Oct 16 11:39:00 user nova-compute[74683]:   <os>
Oct 16 11:39:00 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:39:00 user nova-compute[74683]:     <boot dev="hd"/>
Oct 16 11:39:00 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:39:00 user nova-compute[74683]:   </os>
Oct 16 11:39:00 user nova-compute[74683]:   <features>
Oct 16 11:39:00 user nova-compute[74683]:     <acpi/>
Oct 16 11:39:00 user nova-compute[74683]:     <apic/>
Oct 16 11:39:00 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:39:00 user nova-compute[74683]:   </features>
Oct 16 11:39:00 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:39:00 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:39:00 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:39:00 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:39:00 user nova-compute[74683]:   </clock>
Oct 16 11:39:00 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:39:00 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:39:00 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:39:00 user nova-compute[74683]:   </cpu>
Oct 16 11:39:00 user nova-compute[74683]:   <devices>
Oct 16 11:39:00 user nova-compute[74683]:     <disk type="file" device="disk">
Oct 16 11:39:00 user nova-compute[74683]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 11:39:00 user nova-compute[74683]:       <source file="/opt/stack/data/nova/instances/1986f9b5-30fb-4290-802d-ee699a19b608/disk"/>
Oct 16 11:39:00 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:39:00 user nova-compute[74683]:     </disk>
Oct 16 11:39:00 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:39:00 user nova-compute[74683]:       <mac address="fa:16:3e:c9:39:63"/>
Oct 16 11:39:00 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:39:00 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:39:00 user nova-compute[74683]:       <target dev="tapf6b38471-41"/>
Oct 16 11:39:00 user nova-compute[74683]:     </interface>
Oct 16 11:39:00 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:39:00 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/1986f9b5-30fb-4290-802d-ee699a19b608/console.log" append="off"/>
Oct 16 11:39:00 user nova-compute[74683]:     </serial>
Oct 16 11:39:00 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:39:00 user nova-compute[74683]:     <video>
Oct 16 11:39:00 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:39:00 user nova-compute[74683]:     </video>
Oct 16 11:39:00 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:39:00 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:39:00 user nova-compute[74683]:     </rng>
Oct 16 11:39:00 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:39:00 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:39:00 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:39:00 user nova-compute[74683]:     </memballoon>
Oct 16 11:39:00 user nova-compute[74683]:   </devices>
Oct 16 11:39:00 user nova-compute[74683]: </domain>
Oct 16 11:39:00 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:38:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1431918915',display_name='tempest-TestMinimumBasicScenario-server-1431918915',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1431918915',id=44,image_ref='3655c371-474c-4f9f-ba8b-0d7456865849',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCI5nTHN+Qfkky+jJW3BD5AjS3zBFf7VOxBEwGAWRlhhO37Od80oayCaWewTkSYmErNkZl6VLo4/JM0tQtAYq4JzjY6pa6GzBXSeQpF5WvAUIkacc81Db7rcQJLH79d+dg==',key_name='tempest-TestMinimumBasicScenario-1795285557',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f1ce607a3614fc493d33e6ba8ca5807',ramdisk_id='',reservation_id='r-04floz6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3655c371-474c-4f9f-ba8b-0d7456865849',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-470564601',owner_user_name='tempest-TestMinimumBasicScenario-470564601-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:38:58Z,user_data=None,user_id='7bd40e88d3914927a7804e3b4fb26549',uuid=1986f9b5-30fb-4290-802d-ee699a19b608,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f6b38471-41ce-443b-8562-bee2b4f64d31", "address": "fa:16:3e:c9:39:63", "network": {"id": "1fa0852d-814a-45ef-80fa-171693e4d02a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-184537544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ce607a3614fc493d33e6ba8ca5807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6b38471-41", "ovs_interfaceid": "f6b38471-41ce-443b-8562-bee2b4f64d31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Converting VIF {"id": "f6b38471-41ce-443b-8562-bee2b4f64d31", "address": "fa:16:3e:c9:39:63", "network": {"id": "1fa0852d-814a-45ef-80fa-171693e4d02a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-184537544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ce607a3614fc493d33e6ba8ca5807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6b38471-41", "ovs_interfaceid": "f6b38471-41ce-443b-8562-bee2b4f64d31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:39:63,bridge_name='br-int',has_traffic_filtering=True,id=f6b38471-41ce-443b-8562-bee2b4f64d31,network=Network(1fa0852d-814a-45ef-80fa-171693e4d02a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6b38471-41') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG os_vif [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:39:63,bridge_name='br-int',has_traffic_filtering=True,id=f6b38471-41ce-443b-8562-bee2b4f64d31,network=Network(1fa0852d-814a-45ef-80fa-171693e4d02a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6b38471-41') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8602ef39-64d2-5851-9343-fe46ee1beaf0', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG nova.compute.manager [req-bfc21278-6d45-47e7-a1cf-924ba0085e8b req-7bb97ef5-842b-4c99-890f-70671ca58205 service nova] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Received event network-vif-unplugged-d29ea840-0505-4827-b11f-2caa7b0f6faa {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-bfc21278-6d45-47e7-a1cf-924ba0085e8b req-7bb97ef5-842b-4c99-890f-70671ca58205 service nova] Acquiring lock "6d3528c9-50dd-4f9e-ab92-2f885662bff7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-bfc21278-6d45-47e7-a1cf-924ba0085e8b req-7bb97ef5-842b-4c99-890f-70671ca58205 service nova] Lock "6d3528c9-50dd-4f9e-ab92-2f885662bff7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-bfc21278-6d45-47e7-a1cf-924ba0085e8b req-7bb97ef5-842b-4c99-890f-70671ca58205 service nova] Lock "6d3528c9-50dd-4f9e-ab92-2f885662bff7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG nova.compute.manager [req-bfc21278-6d45-47e7-a1cf-924ba0085e8b req-7bb97ef5-842b-4c99-890f-70671ca58205 service nova] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] No waiting events found dispatching network-vif-unplugged-d29ea840-0505-4827-b11f-2caa7b0f6faa {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG nova.compute.manager [req-bfc21278-6d45-47e7-a1cf-924ba0085e8b req-7bb97ef5-842b-4c99-890f-70671ca58205 service nova] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Received event network-vif-unplugged-d29ea840-0505-4827-b11f-2caa7b0f6faa for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf6b38471-41, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf6b38471-41, col_values=(('qos', UUID('4f8a9e61-a7fb-4ebe-8ff1-d19526261cdd')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf6b38471-41, col_values=(('external_ids', {'iface-id': 'f6b38471-41ce-443b-8562-bee2b4f64d31', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:39:63', 'vm-uuid': '1986f9b5-30fb-4290-802d-ee699a19b608'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG nova.network.neutron [req-588f4772-0210-49a5-8bca-bd109df5a632 req-1e482e10-a2db-4bda-830b-09d281d1b2ac service nova] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Updated VIF entry in instance network info cache for port f6b38471-41ce-443b-8562-bee2b4f64d31. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG nova.network.neutron [req-588f4772-0210-49a5-8bca-bd109df5a632 req-1e482e10-a2db-4bda-830b-09d281d1b2ac service nova] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Updating instance_info_cache with network_info: [{"id": "f6b38471-41ce-443b-8562-bee2b4f64d31", "address": "fa:16:3e:c9:39:63", "network": {"id": "1fa0852d-814a-45ef-80fa-171693e4d02a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-184537544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ce607a3614fc493d33e6ba8ca5807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6b38471-41", "ovs_interfaceid": "f6b38471-41ce-443b-8562-bee2b4f64d31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:00 user nova-compute[74683]: INFO os_vif [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:39:63,bridge_name='br-int',has_traffic_filtering=True,id=f6b38471-41ce-443b-8562-bee2b4f64d31,network=Network(1fa0852d-814a-45ef-80fa-171693e4d02a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6b38471-41')
Oct 16 11:39:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-588f4772-0210-49a5-8bca-bd109df5a632 req-1e482e10-a2db-4bda-830b-09d281d1b2ac service nova] Releasing lock "refresh_cache-1986f9b5-30fb-4290-802d-ee699a19b608" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] No VIF found with MAC fa:16:3e:c9:39:63, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG nova.network.neutron [req-62237d77-8db8-4536-9b49-1db03ba93149 req-47b71e88-a283-44d2-8c9d-e904abf8b6a5 service nova] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Updated VIF entry in instance network info cache for port d29ea840-0505-4827-b11f-2caa7b0f6faa. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG nova.network.neutron [req-62237d77-8db8-4536-9b49-1db03ba93149 req-47b71e88-a283-44d2-8c9d-e904abf8b6a5 service nova] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Updating instance_info_cache with network_info: [{"id": "d29ea840-0505-4827-b11f-2caa7b0f6faa", "address": "fa:16:3e:12:a3:80", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd29ea840-05", "ovs_interfaceid": "d29ea840-0505-4827-b11f-2caa7b0f6faa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-62237d77-8db8-4536-9b49-1db03ba93149 req-47b71e88-a283-44d2-8c9d-e904abf8b6a5 service nova] Releasing lock "refresh_cache-6d3528c9-50dd-4f9e-ab92-2f885662bff7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:39:00 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Instance destroyed successfully.
Oct 16 11:39:00 user nova-compute[74683]: DEBUG nova.objects.instance [None req-fada2b1f-bbfc-4809-a507-ad06df918016 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lazy-loading 'resources' on Instance uuid 6d3528c9-50dd-4f9e-ab92-2f885662bff7 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-fada2b1f-bbfc-4809-a507-ad06df918016 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:33:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-835993735',display_name='tempest-TestVolumeBootPattern-server-835993735',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-835993735',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJbd1pnA0e+ubtg3c4vxF2Dxe/3H7OECUV6ZZvaa4rKNrKocz4jmO0SXeRO4F7NQHuYFrsF7rAUyRZ4V/U5HkEw1E5UZyfInFppdQCzqY7p8CVOHAXsTsTbK336AbWu7g==',key_name='tempest-TestVolumeBootPattern-1282364245',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:34:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2aefabef9e42412f8309f490dcfecc79',ramdisk_id='',reservation_id='r-3jw043ei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-953001121',owner_user_name='tempest-TestVolumeBootPattern-953001121-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:34:13Z,user_data=None,user_id='a463a84e332543dfbc03b81518f82be1',uuid=6d3528c9-50dd-4f9e-ab92-2f885662bff7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d29ea840-0505-4827-b11f-2caa7b0f6faa", "address": "fa:16:3e:12:a3:80", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd29ea840-05", "ovs_interfaceid": "d29ea840-0505-4827-b11f-2caa7b0f6faa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-fada2b1f-bbfc-4809-a507-ad06df918016 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Converting VIF {"id": "d29ea840-0505-4827-b11f-2caa7b0f6faa", "address": "fa:16:3e:12:a3:80", "network": {"id": "00883fc4-0b74-4afd-9043-82e2933faab3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1874622350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aefabef9e42412f8309f490dcfecc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd29ea840-05", "ovs_interfaceid": "d29ea840-0505-4827-b11f-2caa7b0f6faa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-fada2b1f-bbfc-4809-a507-ad06df918016 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:a3:80,bridge_name='br-int',has_traffic_filtering=True,id=d29ea840-0505-4827-b11f-2caa7b0f6faa,network=Network(00883fc4-0b74-4afd-9043-82e2933faab3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd29ea840-05') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG os_vif [None req-fada2b1f-bbfc-4809-a507-ad06df918016 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:a3:80,bridge_name='br-int',has_traffic_filtering=True,id=d29ea840-0505-4827-b11f-2caa7b0f6faa,network=Network(00883fc4-0b74-4afd-9043-82e2933faab3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd29ea840-05') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd29ea840-05, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:00 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:39:01 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:01 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:01 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7ea19daf-770d-4a06-979d-4f3086bd1702) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:39:01 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:01 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:39:01 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:01 user nova-compute[74683]: INFO os_vif [None req-fada2b1f-bbfc-4809-a507-ad06df918016 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:a3:80,bridge_name='br-int',has_traffic_filtering=True,id=d29ea840-0505-4827-b11f-2caa7b0f6faa,network=Network(00883fc4-0b74-4afd-9043-82e2933faab3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd29ea840-05')
Oct 16 11:39:01 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fada2b1f-bbfc-4809-a507-ad06df918016 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] calling os-brick to detach iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 11:39:01 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-fada2b1f-bbfc-4809-a507-ad06df918016 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, {'target_iqn': 'iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YRKjTnxa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:39:01 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-fada2b1f-bbfc-4809-a507-ad06df918016 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:39:01 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-fada2b1f-bbfc-4809-a507-ad06df918016 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:39:01 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-fada2b1f-bbfc-4809-a507-ad06df918016 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:39:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:39:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:39:01 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a565e36a-13b6-4600-82a3-87f792e4642a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:39:01 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-fada2b1f-bbfc-4809-a507-ad06df918016 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 11:39:01 user nova-compute[74683]: No targets found.
Oct 16 11:39:01 user nova-compute[74683]: iSNS:
Oct 16 11:39:01 user nova-compute[74683]: No targets found.
Oct 16 11:39:01 user nova-compute[74683]: STATIC:
Oct 16 11:39:01 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5
Oct 16 11:39:01 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:39:01 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:39:01 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f
Oct 16 11:39:01 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:39:01 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:39:01 user nova-compute[74683]: FIRMWARE:
Oct 16 11:39:01 user nova-compute[74683]: No targets found.
Oct 16 11:39:01 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:39:01 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-fada2b1f-bbfc-4809-a507-ad06df918016 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 11:39:01 user nova-compute[74683]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 11:39:01 user nova-compute[74683]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74683) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 11:39:01 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-fada2b1f-bbfc-4809-a507-ad06df918016 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f', 0)] {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 11:39:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:39:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:39:01 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[3223fe6b-4b6d-4ee2-8412-e4b9b53f5684]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:39:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:39:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:39:01 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7768a2d-578d-4570-80bc-7eebcb1ff5c2]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:39:01 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-fada2b1f-bbfc-4809-a507-ad06df918016 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)
Oct 16 11:39:01 user nova-compute[74683]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5 (non-flash)
Oct 16 11:39:01 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:39:01 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-fada2b1f-bbfc-4809-a507-ad06df918016 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f (non-flash)
Oct 16 11:39:01 user nova-compute[74683]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5 (non-flash)
Oct 16 11:39:01 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:39:01 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-fada2b1f-bbfc-4809-a507-ad06df918016 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda4c6149d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f'): ({'sdc'}, set())}) {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 11:39:01 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-fada2b1f-bbfc-4809-a507-ad06df918016 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Removing single pathed devices sdc {{(pid=74683) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 11:39:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:39:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:39:01 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e015b872-6341-43aa-a857-43ecebff7aa5]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:39:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:39:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:39:01 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[b119e152-d62f-4af7-892b-4fb36594fd7e]: (4, ('ok\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:39:01 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-fada2b1f-bbfc-4809-a507-ad06df918016 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Flushing IO for device /dev/sdc {{(pid=74683) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 11:39:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:39:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:39:01 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[585c6987-53de-4006-80ac-6604928fd169]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:39:01 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-fada2b1f-bbfc-4809-a507-ad06df918016 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74683) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 11:39:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:39:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:39:01 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb2285e-f674-4514-8276-dec0364ed217]: (4, ('1', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:39:01 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-fada2b1f-bbfc-4809-a507-ad06df918016 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 11:39:01 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-fada2b1f-bbfc-4809-a507-ad06df918016 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] SCSI volumes sdc have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 11:39:01 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-fada2b1f-bbfc-4809-a507-ad06df918016 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f')] {{(pid=74683) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 11:39:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:39:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:39:01 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0b09e9-74f2-424f-8d3d-f19708760d10]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:39:01 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-fada2b1f-bbfc-4809-a507-ad06df918016 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:39:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f -p 172.16.0.220:3260 --logout {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:39:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:39:01 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[0609758a-c763-4327-a02c-098e8b1745d3]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:39:01 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-fada2b1f-bbfc-4809-a507-ad06df918016 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f, portal: 172.16.0.220,3260]
Oct 16 11:39:01 user nova-compute[74683]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f, portal: 172.16.0.220,3260] successful.
Oct 16 11:39:01 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:39:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f -p 172.16.0.220:3260 --op delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:39:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6f05240-96d4-498f-9c29-f5888f6ed27f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:39:01 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4cb4fe8-5713-4f7f-a6ee-7977fcb42446]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:39:01 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-fada2b1f-bbfc-4809-a507-ad06df918016 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:39:01 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-fada2b1f-bbfc-4809-a507-ad06df918016 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:39:01 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-fada2b1f-bbfc-4809-a507-ad06df918016 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] <== disconnect_volume: return (321ms) None {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:39:01 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fada2b1f-bbfc-4809-a507-ad06df918016 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Disconnected iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 11:39:01 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-fada2b1f-bbfc-4809-a507-ad06df918016 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Deleting instance files /opt/stack/data/nova/instances/6d3528c9-50dd-4f9e-ab92-2f885662bff7_del
Oct 16 11:39:01 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-fada2b1f-bbfc-4809-a507-ad06df918016 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Deletion of /opt/stack/data/nova/instances/6d3528c9-50dd-4f9e-ab92-2f885662bff7_del complete
Oct 16 11:39:01 user nova-compute[74683]: INFO nova.compute.manager [None req-fada2b1f-bbfc-4809-a507-ad06df918016 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Took 1.78 seconds to destroy the instance on the hypervisor.
Oct 16 11:39:01 user nova-compute[74683]: DEBUG oslo.service.loopingcall [None req-fada2b1f-bbfc-4809-a507-ad06df918016 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74683) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 11:39:01 user nova-compute[74683]: DEBUG nova.compute.manager [-] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Deallocating network for instance {{(pid=74683) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 11:39:01 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] deallocate_for_instance() {{(pid=74683) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 11:39:01 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:01 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:39:01 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:01 user nova-compute[74683]: INFO nova.compute.manager [-] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Took 0.51 seconds to deallocate network for instance.
Oct 16 11:39:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:02 user nova-compute[74683]: DEBUG nova.compute.manager [req-2974077c-4c2e-4a87-8a81-c792c7e8feb5 req-c1008a37-e74a-4152-a98a-5b6495528dd2 service nova] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Received event network-vif-deleted-d29ea840-0505-4827-b11f-2caa7b0f6faa {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:39:02 user nova-compute[74683]: INFO nova.compute.manager [req-2974077c-4c2e-4a87-8a81-c792c7e8feb5 req-c1008a37-e74a-4152-a98a-5b6495528dd2 service nova] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Neutron deleted interface d29ea840-0505-4827-b11f-2caa7b0f6faa; detaching it from the instance and deleting it from the info cache
Oct 16 11:39:02 user nova-compute[74683]: DEBUG nova.network.neutron [req-2974077c-4c2e-4a87-8a81-c792c7e8feb5 req-c1008a37-e74a-4152-a98a-5b6495528dd2 service nova] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:39:02 user nova-compute[74683]: DEBUG nova.compute.manager [req-2974077c-4c2e-4a87-8a81-c792c7e8feb5 req-c1008a37-e74a-4152-a98a-5b6495528dd2 service nova] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Detach interface failed, port_id=d29ea840-0505-4827-b11f-2caa7b0f6faa, reason: Instance 6d3528c9-50dd-4f9e-ab92-2f885662bff7 could not be found. {{(pid=74683) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 16 11:39:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:02 user nova-compute[74683]: DEBUG nova.compute.manager [req-e8077241-0738-4f68-88ef-9f82a124748f req-aa41c64a-4ba7-4f5f-9e3c-a0f4bcd273a7 service nova] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Received event network-vif-plugged-d29ea840-0505-4827-b11f-2caa7b0f6faa {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:39:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e8077241-0738-4f68-88ef-9f82a124748f req-aa41c64a-4ba7-4f5f-9e3c-a0f4bcd273a7 service nova] Acquiring lock "6d3528c9-50dd-4f9e-ab92-2f885662bff7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:39:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e8077241-0738-4f68-88ef-9f82a124748f req-aa41c64a-4ba7-4f5f-9e3c-a0f4bcd273a7 service nova] Lock "6d3528c9-50dd-4f9e-ab92-2f885662bff7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:39:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e8077241-0738-4f68-88ef-9f82a124748f req-aa41c64a-4ba7-4f5f-9e3c-a0f4bcd273a7 service nova] Lock "6d3528c9-50dd-4f9e-ab92-2f885662bff7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:39:02 user nova-compute[74683]: DEBUG nova.compute.manager [req-e8077241-0738-4f68-88ef-9f82a124748f req-aa41c64a-4ba7-4f5f-9e3c-a0f4bcd273a7 service nova] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] No waiting events found dispatching network-vif-plugged-d29ea840-0505-4827-b11f-2caa7b0f6faa {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:39:02 user nova-compute[74683]: WARNING nova.compute.manager [req-e8077241-0738-4f68-88ef-9f82a124748f req-aa41c64a-4ba7-4f5f-9e3c-a0f4bcd273a7 service nova] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Received unexpected event network-vif-plugged-d29ea840-0505-4827-b11f-2caa7b0f6faa for instance with vm_state active and task_state deleting.
Oct 16 11:39:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:03 user nova-compute[74683]: INFO nova.compute.manager [None req-fada2b1f-bbfc-4809-a507-ad06df918016 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] [instance: 6d3528c9-50dd-4f9e-ab92-2f885662bff7] Took 1.17 seconds to detach 1 volumes for instance.
Oct 16 11:39:03 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-fada2b1f-bbfc-4809-a507-ad06df918016 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:39:03 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-fada2b1f-bbfc-4809-a507-ad06df918016 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:39:03 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-fada2b1f-bbfc-4809-a507-ad06df918016 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:39:03 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-fada2b1f-bbfc-4809-a507-ad06df918016 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:39:03 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-fada2b1f-bbfc-4809-a507-ad06df918016 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.395s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:39:03 user nova-compute[74683]: INFO nova.scheduler.client.report [None req-fada2b1f-bbfc-4809-a507-ad06df918016 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Deleted allocations for instance 6d3528c9-50dd-4f9e-ab92-2f885662bff7
Oct 16 11:39:03 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-fada2b1f-bbfc-4809-a507-ad06df918016 tempest-TestVolumeBootPattern-953001121 tempest-TestVolumeBootPattern-953001121-project-member] Lock "6d3528c9-50dd-4f9e-ab92-2f885662bff7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.148s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:39:04 user nova-compute[74683]: DEBUG nova.compute.manager [req-7489d640-c0a6-4c2f-a9ab-af809310c62d req-112e3631-2205-4c29-b3dd-d7c81828e732 service nova] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Received event network-vif-plugged-f6b38471-41ce-443b-8562-bee2b4f64d31 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:39:04 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-7489d640-c0a6-4c2f-a9ab-af809310c62d req-112e3631-2205-4c29-b3dd-d7c81828e732 service nova] Acquiring lock "1986f9b5-30fb-4290-802d-ee699a19b608-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:39:04 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-7489d640-c0a6-4c2f-a9ab-af809310c62d req-112e3631-2205-4c29-b3dd-d7c81828e732 service nova] Lock "1986f9b5-30fb-4290-802d-ee699a19b608-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:39:04 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-7489d640-c0a6-4c2f-a9ab-af809310c62d req-112e3631-2205-4c29-b3dd-d7c81828e732 service nova] Lock "1986f9b5-30fb-4290-802d-ee699a19b608-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:39:04 user nova-compute[74683]: DEBUG nova.compute.manager [req-7489d640-c0a6-4c2f-a9ab-af809310c62d req-112e3631-2205-4c29-b3dd-d7c81828e732 service nova] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] No waiting events found dispatching network-vif-plugged-f6b38471-41ce-443b-8562-bee2b4f64d31 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:39:04 user nova-compute[74683]: WARNING nova.compute.manager [req-7489d640-c0a6-4c2f-a9ab-af809310c62d req-112e3631-2205-4c29-b3dd-d7c81828e732 service nova] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Received unexpected event network-vif-plugged-f6b38471-41ce-443b-8562-bee2b4f64d31 for instance with vm_state building and task_state spawning.
Oct 16 11:39:04 user nova-compute[74683]: DEBUG nova.compute.manager [req-7489d640-c0a6-4c2f-a9ab-af809310c62d req-112e3631-2205-4c29-b3dd-d7c81828e732 service nova] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Received event network-vif-plugged-f6b38471-41ce-443b-8562-bee2b4f64d31 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:39:04 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-7489d640-c0a6-4c2f-a9ab-af809310c62d req-112e3631-2205-4c29-b3dd-d7c81828e732 service nova] Acquiring lock "1986f9b5-30fb-4290-802d-ee699a19b608-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:39:04 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-7489d640-c0a6-4c2f-a9ab-af809310c62d req-112e3631-2205-4c29-b3dd-d7c81828e732 service nova] Lock "1986f9b5-30fb-4290-802d-ee699a19b608-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:39:04 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-7489d640-c0a6-4c2f-a9ab-af809310c62d req-112e3631-2205-4c29-b3dd-d7c81828e732 service nova] Lock "1986f9b5-30fb-4290-802d-ee699a19b608-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:39:04 user nova-compute[74683]: DEBUG nova.compute.manager [req-7489d640-c0a6-4c2f-a9ab-af809310c62d req-112e3631-2205-4c29-b3dd-d7c81828e732 service nova] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] No waiting events found dispatching network-vif-plugged-f6b38471-41ce-443b-8562-bee2b4f64d31 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:39:04 user nova-compute[74683]: WARNING nova.compute.manager [req-7489d640-c0a6-4c2f-a9ab-af809310c62d req-112e3631-2205-4c29-b3dd-d7c81828e732 service nova] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Received unexpected event network-vif-plugged-f6b38471-41ce-443b-8562-bee2b4f64d31 for instance with vm_state building and task_state spawning.
Oct 16 11:39:04 user nova-compute[74683]: DEBUG nova.compute.manager [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Instance event wait completed in 0 seconds for  {{(pid=74683) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 11:39:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Guest created on hypervisor {{(pid=74683) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 11:39:04 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Instance spawned successfully.
Oct 16 11:39:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 11:39:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Found default for hw_cdrom_bus of ide {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:39:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Found default for hw_disk_bus of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:39:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Found default for hw_input_bus of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:39:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Found default for hw_pointer_model of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:39:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Found default for hw_video_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:39:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Found default for hw_vif_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:39:04 user nova-compute[74683]: INFO nova.compute.manager [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Took 6.94 seconds to spawn the instance on the hypervisor.
Oct 16 11:39:04 user nova-compute[74683]: DEBUG nova.compute.manager [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:39:04 user nova-compute[74683]: INFO nova.compute.manager [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Took 7.77 seconds to build instance.
Oct 16 11:39:04 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-6edf07aa-6459-4ad9-b02f-cbda922e72ba tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "1986f9b5-30fb-4290-802d-ee699a19b608" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.866s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:39:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-478ae192-96c0-4d03-92c5-8a754e0e2cbe tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Acquiring lock "edd01413-1f8a-49e3-aa3c-ecb19c62afae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:39:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-478ae192-96c0-4d03-92c5-8a754e0e2cbe tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "edd01413-1f8a-49e3-aa3c-ecb19c62afae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:39:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-478ae192-96c0-4d03-92c5-8a754e0e2cbe tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Acquiring lock "edd01413-1f8a-49e3-aa3c-ecb19c62afae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:39:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-478ae192-96c0-4d03-92c5-8a754e0e2cbe tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "edd01413-1f8a-49e3-aa3c-ecb19c62afae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:39:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-478ae192-96c0-4d03-92c5-8a754e0e2cbe tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "edd01413-1f8a-49e3-aa3c-ecb19c62afae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:39:06 user nova-compute[74683]: INFO nova.compute.manager [None req-478ae192-96c0-4d03-92c5-8a754e0e2cbe tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Terminating instance
Oct 16 11:39:06 user nova-compute[74683]: DEBUG nova.compute.manager [None req-478ae192-96c0-4d03-92c5-8a754e0e2cbe tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Start destroying the instance on the hypervisor. {{(pid=74683) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 11:39:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:06 user nova-compute[74683]: DEBUG nova.compute.manager [req-ad6af9df-8be4-4283-b78b-cd46852909a2 req-5c9ab9e2-9dd4-49f2-a996-faab8a367694 service nova] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Received event network-vif-unplugged-7ba36bb4-91c7-42ee-b592-6653e63a1d50 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:39:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-ad6af9df-8be4-4283-b78b-cd46852909a2 req-5c9ab9e2-9dd4-49f2-a996-faab8a367694 service nova] Acquiring lock "edd01413-1f8a-49e3-aa3c-ecb19c62afae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:39:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-ad6af9df-8be4-4283-b78b-cd46852909a2 req-5c9ab9e2-9dd4-49f2-a996-faab8a367694 service nova] Lock "edd01413-1f8a-49e3-aa3c-ecb19c62afae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:39:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-ad6af9df-8be4-4283-b78b-cd46852909a2 req-5c9ab9e2-9dd4-49f2-a996-faab8a367694 service nova] Lock "edd01413-1f8a-49e3-aa3c-ecb19c62afae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:39:06 user nova-compute[74683]: DEBUG nova.compute.manager [req-ad6af9df-8be4-4283-b78b-cd46852909a2 req-5c9ab9e2-9dd4-49f2-a996-faab8a367694 service nova] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] No waiting events found dispatching network-vif-unplugged-7ba36bb4-91c7-42ee-b592-6653e63a1d50 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:39:06 user nova-compute[74683]: DEBUG nova.compute.manager [req-ad6af9df-8be4-4283-b78b-cd46852909a2 req-5c9ab9e2-9dd4-49f2-a996-faab8a367694 service nova] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Received event network-vif-unplugged-7ba36bb4-91c7-42ee-b592-6653e63a1d50 for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 11:39:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:06 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Instance destroyed successfully.
Oct 16 11:39:06 user nova-compute[74683]: DEBUG nova.objects.instance [None req-478ae192-96c0-4d03-92c5-8a754e0e2cbe tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lazy-loading 'resources' on Instance uuid edd01413-1f8a-49e3-aa3c-ecb19c62afae {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:39:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:06 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-478ae192-96c0-4d03-92c5-8a754e0e2cbe tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:19:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-540936552',display_name='tempest-ServerActionsTestOtherA-server-540936552',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-540936552',id=18,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBEVF+XohWeGna7xpASkIb8CQzH1AhAApSWM489KR3Xw5eNUrWHdrfnFEDLkNX5O9VFz9JiKaf+QhMQdRVklpUzwWiktfTm3fcbGcjt8FS9CdAQjTtJZQ2xWrypXQEhUiQ==',key_name='tempest-keypair-1801585168',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:19:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fcb8da41d6584a689e9b50155288aa5e',ramdisk_id='',reservation_id='r-48u77990',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-327072564',owner_user_name='tempest-ServerActionsTestOtherA-327072564-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:19:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a55641a42b142ea9fb6c6c1fdb9963e',uuid=edd01413-1f8a-49e3-aa3c-ecb19c62afae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ba36bb4-91c7-42ee-b592-6653e63a1d50", "address": "fa:16:3e:b4:d6:37", "network": {"id": "cd8cf08c-d79c-4d2e-b849-640c440e1498", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1091743670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcb8da41d6584a689e9b50155288aa5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba36bb4-91", "ovs_interfaceid": "7ba36bb4-91c7-42ee-b592-6653e63a1d50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:39:06 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-478ae192-96c0-4d03-92c5-8a754e0e2cbe tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Converting VIF {"id": "7ba36bb4-91c7-42ee-b592-6653e63a1d50", "address": "fa:16:3e:b4:d6:37", "network": {"id": "cd8cf08c-d79c-4d2e-b849-640c440e1498", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1091743670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcb8da41d6584a689e9b50155288aa5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba36bb4-91", "ovs_interfaceid": "7ba36bb4-91c7-42ee-b592-6653e63a1d50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:39:06 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-478ae192-96c0-4d03-92c5-8a754e0e2cbe tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:d6:37,bridge_name='br-int',has_traffic_filtering=True,id=7ba36bb4-91c7-42ee-b592-6653e63a1d50,network=Network(cd8cf08c-d79c-4d2e-b849-640c440e1498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ba36bb4-91') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:39:06 user nova-compute[74683]: DEBUG os_vif [None req-478ae192-96c0-4d03-92c5-8a754e0e2cbe tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:d6:37,bridge_name='br-int',has_traffic_filtering=True,id=7ba36bb4-91c7-42ee-b592-6653e63a1d50,network=Network(cd8cf08c-d79c-4d2e-b849-640c440e1498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ba36bb4-91') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:39:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7ba36bb4-91, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:39:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:39:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3f9c9b11-7411-4be1-88b2-7717b83f0508) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:39:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:39:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:06 user nova-compute[74683]: INFO os_vif [None req-478ae192-96c0-4d03-92c5-8a754e0e2cbe tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:d6:37,bridge_name='br-int',has_traffic_filtering=True,id=7ba36bb4-91c7-42ee-b592-6653e63a1d50,network=Network(cd8cf08c-d79c-4d2e-b849-640c440e1498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ba36bb4-91')
Oct 16 11:39:06 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-478ae192-96c0-4d03-92c5-8a754e0e2cbe tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Deleting instance files /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae_del
Oct 16 11:39:06 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-478ae192-96c0-4d03-92c5-8a754e0e2cbe tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Deletion of /opt/stack/data/nova/instances/edd01413-1f8a-49e3-aa3c-ecb19c62afae_del complete
Oct 16 11:39:07 user nova-compute[74683]: INFO nova.compute.manager [None req-478ae192-96c0-4d03-92c5-8a754e0e2cbe tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Took 0.81 seconds to destroy the instance on the hypervisor.
Oct 16 11:39:07 user nova-compute[74683]: DEBUG oslo.service.loopingcall [None req-478ae192-96c0-4d03-92c5-8a754e0e2cbe tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74683) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 11:39:07 user nova-compute[74683]: DEBUG nova.compute.manager [-] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Deallocating network for instance {{(pid=74683) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 11:39:07 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] deallocate_for_instance() {{(pid=74683) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 11:39:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:07 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:39:07 user nova-compute[74683]: INFO nova.compute.manager [-] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Took 0.89 seconds to deallocate network for instance.
Oct 16 11:39:07 user nova-compute[74683]: DEBUG nova.compute.manager [req-c85461f3-894e-4a9b-9c4f-f991751a7008 req-e0fcdc26-c606-48c5-8dd2-be6839ad8a38 service nova] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Received event network-vif-deleted-7ba36bb4-91c7-42ee-b592-6653e63a1d50 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:39:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-478ae192-96c0-4d03-92c5-8a754e0e2cbe tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:39:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-478ae192-96c0-4d03-92c5-8a754e0e2cbe tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:39:08 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-478ae192-96c0-4d03-92c5-8a754e0e2cbe tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:39:08 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-478ae192-96c0-4d03-92c5-8a754e0e2cbe tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:39:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-478ae192-96c0-4d03-92c5-8a754e0e2cbe tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.295s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:39:08 user nova-compute[74683]: INFO nova.scheduler.client.report [None req-478ae192-96c0-4d03-92c5-8a754e0e2cbe tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Deleted allocations for instance edd01413-1f8a-49e3-aa3c-ecb19c62afae
Oct 16 11:39:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-478ae192-96c0-4d03-92c5-8a754e0e2cbe tempest-ServerActionsTestOtherA-327072564 tempest-ServerActionsTestOtherA-327072564-project-member] Lock "edd01413-1f8a-49e3-aa3c-ecb19c62afae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.288s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:39:08 user nova-compute[74683]: DEBUG nova.compute.manager [req-a2ee0b1c-2541-4f8f-9d1b-c30e3fabcf36 req-0567e040-f32d-481b-bcc5-84445a402d0b service nova] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Received event network-vif-plugged-7ba36bb4-91c7-42ee-b592-6653e63a1d50 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:39:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a2ee0b1c-2541-4f8f-9d1b-c30e3fabcf36 req-0567e040-f32d-481b-bcc5-84445a402d0b service nova] Acquiring lock "edd01413-1f8a-49e3-aa3c-ecb19c62afae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:39:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a2ee0b1c-2541-4f8f-9d1b-c30e3fabcf36 req-0567e040-f32d-481b-bcc5-84445a402d0b service nova] Lock "edd01413-1f8a-49e3-aa3c-ecb19c62afae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:39:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a2ee0b1c-2541-4f8f-9d1b-c30e3fabcf36 req-0567e040-f32d-481b-bcc5-84445a402d0b service nova] Lock "edd01413-1f8a-49e3-aa3c-ecb19c62afae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:39:08 user nova-compute[74683]: DEBUG nova.compute.manager [req-a2ee0b1c-2541-4f8f-9d1b-c30e3fabcf36 req-0567e040-f32d-481b-bcc5-84445a402d0b service nova] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] No waiting events found dispatching network-vif-plugged-7ba36bb4-91c7-42ee-b592-6653e63a1d50 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:39:08 user nova-compute[74683]: WARNING nova.compute.manager [req-a2ee0b1c-2541-4f8f-9d1b-c30e3fabcf36 req-0567e040-f32d-481b-bcc5-84445a402d0b service nova] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Received unexpected event network-vif-plugged-7ba36bb4-91c7-42ee-b592-6653e63a1d50 for instance with vm_state deleted and task_state None.
Oct 16 11:39:08 user nova-compute[74683]: DEBUG nova.compute.manager [req-a2ee0b1c-2541-4f8f-9d1b-c30e3fabcf36 req-0567e040-f32d-481b-bcc5-84445a402d0b service nova] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Received event network-vif-plugged-7ba36bb4-91c7-42ee-b592-6653e63a1d50 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:39:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a2ee0b1c-2541-4f8f-9d1b-c30e3fabcf36 req-0567e040-f32d-481b-bcc5-84445a402d0b service nova] Acquiring lock "edd01413-1f8a-49e3-aa3c-ecb19c62afae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:39:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a2ee0b1c-2541-4f8f-9d1b-c30e3fabcf36 req-0567e040-f32d-481b-bcc5-84445a402d0b service nova] Lock "edd01413-1f8a-49e3-aa3c-ecb19c62afae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:39:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a2ee0b1c-2541-4f8f-9d1b-c30e3fabcf36 req-0567e040-f32d-481b-bcc5-84445a402d0b service nova] Lock "edd01413-1f8a-49e3-aa3c-ecb19c62afae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:39:08 user nova-compute[74683]: DEBUG nova.compute.manager [req-a2ee0b1c-2541-4f8f-9d1b-c30e3fabcf36 req-0567e040-f32d-481b-bcc5-84445a402d0b service nova] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] No waiting events found dispatching network-vif-plugged-7ba36bb4-91c7-42ee-b592-6653e63a1d50 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:39:08 user nova-compute[74683]: WARNING nova.compute.manager [req-a2ee0b1c-2541-4f8f-9d1b-c30e3fabcf36 req-0567e040-f32d-481b-bcc5-84445a402d0b service nova] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Received unexpected event network-vif-plugged-7ba36bb4-91c7-42ee-b592-6653e63a1d50 for instance with vm_state deleted and task_state None.
Oct 16 11:39:08 user nova-compute[74683]: DEBUG nova.compute.manager [req-a2ee0b1c-2541-4f8f-9d1b-c30e3fabcf36 req-0567e040-f32d-481b-bcc5-84445a402d0b service nova] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Received event network-vif-plugged-7ba36bb4-91c7-42ee-b592-6653e63a1d50 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:39:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a2ee0b1c-2541-4f8f-9d1b-c30e3fabcf36 req-0567e040-f32d-481b-bcc5-84445a402d0b service nova] Acquiring lock "edd01413-1f8a-49e3-aa3c-ecb19c62afae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:39:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a2ee0b1c-2541-4f8f-9d1b-c30e3fabcf36 req-0567e040-f32d-481b-bcc5-84445a402d0b service nova] Lock "edd01413-1f8a-49e3-aa3c-ecb19c62afae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:39:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a2ee0b1c-2541-4f8f-9d1b-c30e3fabcf36 req-0567e040-f32d-481b-bcc5-84445a402d0b service nova] Lock "edd01413-1f8a-49e3-aa3c-ecb19c62afae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:39:08 user nova-compute[74683]: DEBUG nova.compute.manager [req-a2ee0b1c-2541-4f8f-9d1b-c30e3fabcf36 req-0567e040-f32d-481b-bcc5-84445a402d0b service nova] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] No waiting events found dispatching network-vif-plugged-7ba36bb4-91c7-42ee-b592-6653e63a1d50 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:39:08 user nova-compute[74683]: WARNING nova.compute.manager [req-a2ee0b1c-2541-4f8f-9d1b-c30e3fabcf36 req-0567e040-f32d-481b-bcc5-84445a402d0b service nova] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Received unexpected event network-vif-plugged-7ba36bb4-91c7-42ee-b592-6653e63a1d50 for instance with vm_state deleted and task_state None.
Oct 16 11:39:08 user nova-compute[74683]: DEBUG nova.compute.manager [req-a2ee0b1c-2541-4f8f-9d1b-c30e3fabcf36 req-0567e040-f32d-481b-bcc5-84445a402d0b service nova] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Received event network-vif-unplugged-7ba36bb4-91c7-42ee-b592-6653e63a1d50 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:39:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a2ee0b1c-2541-4f8f-9d1b-c30e3fabcf36 req-0567e040-f32d-481b-bcc5-84445a402d0b service nova] Acquiring lock "edd01413-1f8a-49e3-aa3c-ecb19c62afae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:39:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a2ee0b1c-2541-4f8f-9d1b-c30e3fabcf36 req-0567e040-f32d-481b-bcc5-84445a402d0b service nova] Lock "edd01413-1f8a-49e3-aa3c-ecb19c62afae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:39:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a2ee0b1c-2541-4f8f-9d1b-c30e3fabcf36 req-0567e040-f32d-481b-bcc5-84445a402d0b service nova] Lock "edd01413-1f8a-49e3-aa3c-ecb19c62afae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:39:08 user nova-compute[74683]: DEBUG nova.compute.manager [req-a2ee0b1c-2541-4f8f-9d1b-c30e3fabcf36 req-0567e040-f32d-481b-bcc5-84445a402d0b service nova] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] No waiting events found dispatching network-vif-unplugged-7ba36bb4-91c7-42ee-b592-6653e63a1d50 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:39:08 user nova-compute[74683]: WARNING nova.compute.manager [req-a2ee0b1c-2541-4f8f-9d1b-c30e3fabcf36 req-0567e040-f32d-481b-bcc5-84445a402d0b service nova] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Received unexpected event network-vif-unplugged-7ba36bb4-91c7-42ee-b592-6653e63a1d50 for instance with vm_state deleted and task_state None.
Oct 16 11:39:08 user nova-compute[74683]: DEBUG nova.compute.manager [req-a2ee0b1c-2541-4f8f-9d1b-c30e3fabcf36 req-0567e040-f32d-481b-bcc5-84445a402d0b service nova] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Received event network-vif-plugged-7ba36bb4-91c7-42ee-b592-6653e63a1d50 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:39:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a2ee0b1c-2541-4f8f-9d1b-c30e3fabcf36 req-0567e040-f32d-481b-bcc5-84445a402d0b service nova] Acquiring lock "edd01413-1f8a-49e3-aa3c-ecb19c62afae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:39:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a2ee0b1c-2541-4f8f-9d1b-c30e3fabcf36 req-0567e040-f32d-481b-bcc5-84445a402d0b service nova] Lock "edd01413-1f8a-49e3-aa3c-ecb19c62afae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:39:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a2ee0b1c-2541-4f8f-9d1b-c30e3fabcf36 req-0567e040-f32d-481b-bcc5-84445a402d0b service nova] Lock "edd01413-1f8a-49e3-aa3c-ecb19c62afae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:39:08 user nova-compute[74683]: DEBUG nova.compute.manager [req-a2ee0b1c-2541-4f8f-9d1b-c30e3fabcf36 req-0567e040-f32d-481b-bcc5-84445a402d0b service nova] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] No waiting events found dispatching network-vif-plugged-7ba36bb4-91c7-42ee-b592-6653e63a1d50 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:39:08 user nova-compute[74683]: WARNING nova.compute.manager [req-a2ee0b1c-2541-4f8f-9d1b-c30e3fabcf36 req-0567e040-f32d-481b-bcc5-84445a402d0b service nova] [instance: edd01413-1f8a-49e3-aa3c-ecb19c62afae] Received unexpected event network-vif-plugged-7ba36bb4-91c7-42ee-b592-6653e63a1d50 for instance with vm_state deleted and task_state None.
Oct 16 11:39:11 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:14 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-4c004ea9-e179-44ce-bfe6-e979571e2a37 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Acquiring lock "e88445f0-2b1c-4cc1-94ca-33a1e3bec929" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:39:14 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-4c004ea9-e179-44ce-bfe6-e979571e2a37 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lock "e88445f0-2b1c-4cc1-94ca-33a1e3bec929" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:39:14 user nova-compute[74683]: INFO nova.compute.manager [None req-4c004ea9-e179-44ce-bfe6-e979571e2a37 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Detaching volume 3400449b-1160-4ffe-9ea2-9fdfb4995ea5
Oct 16 11:39:14 user nova-compute[74683]: INFO nova.virt.block_device [None req-4c004ea9-e179-44ce-bfe6-e979571e2a37 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Attempting to driver detach volume 3400449b-1160-4ffe-9ea2-9fdfb4995ea5 from mountpoint /dev/vdb
Oct 16 11:39:14 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-4c004ea9-e179-44ce-bfe6-e979571e2a37 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Attempting to detach device vdb from instance e88445f0-2b1c-4cc1-94ca-33a1e3bec929 from the persistent domain config. {{(pid=74683) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 11:39:14 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-4c004ea9-e179-44ce-bfe6-e979571e2a37 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 11:39:14 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:39:14 user nova-compute[74683]:   <source dev="/dev/sdf"/>
Oct 16 11:39:14 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:39:14 user nova-compute[74683]:   <serial>3400449b-1160-4ffe-9ea2-9fdfb4995ea5</serial>
Oct 16 11:39:14 user nova-compute[74683]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 11:39:14 user nova-compute[74683]: </disk>
Oct 16 11:39:14 user nova-compute[74683]:  {{(pid=74683) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 11:39:14 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-4c004ea9-e179-44ce-bfe6-e979571e2a37 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Successfully detached device vdb from instance e88445f0-2b1c-4cc1-94ca-33a1e3bec929 from the persistent domain config.
Oct 16 11:39:14 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-4c004ea9-e179-44ce-bfe6-e979571e2a37 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e88445f0-2b1c-4cc1-94ca-33a1e3bec929 from the live domain config. {{(pid=74683) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 11:39:14 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-4c004ea9-e179-44ce-bfe6-e979571e2a37 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 11:39:14 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:39:14 user nova-compute[74683]:   <source dev="/dev/sdf"/>
Oct 16 11:39:14 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:39:14 user nova-compute[74683]:   <serial>3400449b-1160-4ffe-9ea2-9fdfb4995ea5</serial>
Oct 16 11:39:14 user nova-compute[74683]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 11:39:14 user nova-compute[74683]: </disk>
Oct 16 11:39:14 user nova-compute[74683]:  {{(pid=74683) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 11:39:14 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-7117f7cd-2020-4626-9313-2ef8ee4a6cb9 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Acquiring lock "e88445f0-2b1c-4cc1-94ca-33a1e3bec929" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:39:14 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-4c004ea9-e179-44ce-bfe6-e979571e2a37 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e88445f0-2b1c-4cc1-94ca-33a1e3bec929 {{(pid=74683) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 11:39:15 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:39:15 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Cleaning up deleted instances with incomplete migration  {{(pid=74683) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 16 11:39:16 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:39:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:22 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:39:22 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:39:23 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:39:23 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Starting heal instance info cache {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 11:39:23 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Didn't find any instances for network info cache update. {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 16 11:39:23 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:39:24 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:39:24 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:39:25 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:39:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:27 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:39:27 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74683) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 11:39:28 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:39:28 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:39:28 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:39:28 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:39:28 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Auditing locally available compute resources for user (node: user) {{(pid=74683) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 11:39:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:39:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:39:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:39:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:39:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:39:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:39:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:39:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:39:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d94b70c-4056-4c58-9df4-73684e0d164f/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:39:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d94b70c-4056-4c58-9df4-73684e0d164f/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:39:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d94b70c-4056-4c58-9df4-73684e0d164f/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:39:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ec63ea4a-1874-4e61-aa73-d22320f9f980 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Acquiring lock "8d94b70c-4056-4c58-9df4-73684e0d164f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:39:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ec63ea4a-1874-4e61-aa73-d22320f9f980 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lock "8d94b70c-4056-4c58-9df4-73684e0d164f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:39:29 user nova-compute[74683]: DEBUG nova.objects.instance [None req-ec63ea4a-1874-4e61-aa73-d22320f9f980 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lazy-loading 'flavor' on Instance uuid 8d94b70c-4056-4c58-9df4-73684e0d164f {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:39:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ec63ea4a-1874-4e61-aa73-d22320f9f980 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lock "8d94b70c-4056-4c58-9df4-73684e0d164f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:39:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d94b70c-4056-4c58-9df4-73684e0d164f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:39:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1986f9b5-30fb-4290-802d-ee699a19b608/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:39:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ec63ea4a-1874-4e61-aa73-d22320f9f980 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Acquiring lock "8d94b70c-4056-4c58-9df4-73684e0d164f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:39:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ec63ea4a-1874-4e61-aa73-d22320f9f980 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lock "8d94b70c-4056-4c58-9df4-73684e0d164f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:39:30 user nova-compute[74683]: INFO nova.compute.manager [None req-ec63ea4a-1874-4e61-aa73-d22320f9f980 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Attaching volume bc0034fd-87f8-471e-bb72-83a4bce0c1a9 to /dev/vdb
Oct 16 11:39:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1986f9b5-30fb-4290-802d-ee699a19b608/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:39:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1986f9b5-30fb-4290-802d-ee699a19b608/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:39:30 user nova-compute[74683]: DEBUG os_brick.utils [None req-ec63ea4a-1874-4e61-aa73-d22320f9f980 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:39:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:39:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:39:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[974dd094-fa4d-49fd-9861-2d5e1d0e409e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:70b9d336ab7d\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:39:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:39:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:39:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[94614407-012a-4f64-b890-5283b9267872]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:39:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:39:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:39:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dde4729-fc49-4886-84e8-bc32145db9ba]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:39:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2fc53f-b8b7-4c54-9057-c042009dfd32]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:39:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-ec63ea4a-1874-4e61-aa73-d22320f9f980 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Running cmd (subprocess): nvme version {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:39:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-ec63ea4a-1874-4e61-aa73-d22320f9f980 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] 'nvme version' failed. Not Retrying. {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:39:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ec63ea4a-1874-4e61-aa73-d22320f9f980 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] nvme not present on system {{(pid=74683) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 11:39:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:39:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:39:30 user nova-compute[74683]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 11:39:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[950de5b8-fbb8-4404-858c-24681bc45863]: (4, '') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:39:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-ec63ea4a-1874-4e61-aa73-d22320f9f980 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74683) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 11:39:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-ec63ea4a-1874-4e61-aa73-d22320f9f980 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 11:39:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-ec63ea4a-1874-4e61-aa73-d22320f9f980 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] LIGHTOS: no hostnqn found. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 11:39:30 user nova-compute[74683]: DEBUG os_brick.utils [None req-ec63ea4a-1874-4e61-aa73-d22320f9f980 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:70b9d336ab7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:39:30 user nova-compute[74683]: DEBUG nova.virt.block_device [None req-ec63ea4a-1874-4e61-aa73-d22320f9f980 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Updating existing volume attachment record: d02019a1-a010-414c-b4c2-bac2909f73ed {{(pid=74683) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 11:39:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1986f9b5-30fb-4290-802d-ee699a19b608/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:39:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88445f0-2b1c-4cc1-94ca-33a1e3bec929/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:39:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88445f0-2b1c-4cc1-94ca-33a1e3bec929/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:39:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88445f0-2b1c-4cc1-94ca-33a1e3bec929/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:39:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88445f0-2b1c-4cc1-94ca-33a1e3bec929/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:39:31 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:39:31 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:39:31 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Hypervisor/Node resource view: name=user free_ram=8281MB free_disk=25.10457992553711GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74683) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 11:39:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:39:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:39:31 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 9b8ba94f-43cc-4f06-bcd9-83935ccbe117 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:39:31 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance f5ad764c-638d-4dac-b032-6680917e46df actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:39:31 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 8d94b70c-4056-4c58-9df4-73684e0d164f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:39:31 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance e88445f0-2b1c-4cc1-94ca-33a1e3bec929 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:39:31 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 1986f9b5-30fb-4290-802d-ee699a19b608 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:39:31 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 11:39:31 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 11:39:31 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Refreshing inventories for resource provider 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 16 11:39:31 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Updating ProviderTree inventory for provider 7142d606-df50-4cbe-b5ed-1802caa31862 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 16 11:39:31 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Updating inventory in ProviderTree for provider 7142d606-df50-4cbe-b5ed-1802caa31862 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 16 11:39:31 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Refreshing aggregate associations for resource provider 7142d606-df50-4cbe-b5ed-1802caa31862, aggregates: None {{(pid=74683) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 16 11:39:31 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Refreshing trait associations for resource provider 7142d606-df50-4cbe-b5ed-1802caa31862, traits: COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VMVGA {{(pid=74683) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 16 11:39:31 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:39:31 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:39:31 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Compute_service record updated for user:user {{(pid=74683) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 11:39:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.601s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:39:31 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:39:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:32 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:39:33 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:39:33 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Cleaning up deleted instances {{(pid=74683) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 16 11:39:33 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] There are 0 instances to clean {{(pid=74683) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 16 11:39:34 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-4c004ea9-e179-44ce-bfe6-e979571e2a37 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e88445f0-2b1c-4cc1-94ca-33a1e3bec929 is timed out.
Oct 16 11:39:34 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-4c004ea9-e179-44ce-bfe6-e979571e2a37 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Successfully detached device vdb from instance e88445f0-2b1c-4cc1-94ca-33a1e3bec929 from the live domain config.
Oct 16 11:39:34 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c004ea9-e179-44ce-bfe6-e979571e2a37 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] calling os-brick to detach iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 11:39:34 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c004ea9-e179-44ce-bfe6-e979571e2a37 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, {'target_iqn': 'iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xunQNFqz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:39:34 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-4c004ea9-e179-44ce-bfe6-e979571e2a37 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:39:34 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-4c004ea9-e179-44ce-bfe6-e979571e2a37 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:39:34 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-4c004ea9-e179-44ce-bfe6-e979571e2a37 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:39:34 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:39:34 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:39:34 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[062d8732-d1a1-4751-890f-d938316668c8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:39:34 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c004ea9-e179-44ce-bfe6-e979571e2a37 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 11:39:34 user nova-compute[74683]: No targets found.
Oct 16 11:39:34 user nova-compute[74683]: iSNS:
Oct 16 11:39:34 user nova-compute[74683]: No targets found.
Oct 16 11:39:34 user nova-compute[74683]: STATIC:
Oct 16 11:39:34 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5
Oct 16 11:39:34 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:39:34 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:39:34 user nova-compute[74683]: FIRMWARE:
Oct 16 11:39:34 user nova-compute[74683]: No targets found.
Oct 16 11:39:34 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:39:34 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c004ea9-e179-44ce-bfe6-e979571e2a37 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 11:39:34 user nova-compute[74683]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 11:39:34 user nova-compute[74683]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74683) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 11:39:34 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c004ea9-e179-44ce-bfe6-e979571e2a37 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5', 0)] {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 11:39:34 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:39:34 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:39:34 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[613b94fd-069d-45d4-bd26-0bcb8e31ce09]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:39:34 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:39:34 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:39:34 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[07dba35a-d089-4be3-8c90-180ea99db4ae]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:39:34 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c004ea9-e179-44ce-bfe6-e979571e2a37 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5 (non-flash)
Oct 16 11:39:34 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:39:34 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c004ea9-e179-44ce-bfe6-e979571e2a37 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5 (non-flash)
Oct 16 11:39:34 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:39:34 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c004ea9-e179-44ce-bfe6-e979571e2a37 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda6c4dcca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5'): ({'sdf'}, set())}) {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 11:39:34 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-4c004ea9-e179-44ce-bfe6-e979571e2a37 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Removing single pathed devices sdf {{(pid=74683) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 11:39:34 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:39:34 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:39:34 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80c3dd6-be4c-4baa-a859-87a2b6bdffe5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:39:34 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:39:34 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:39:34 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b1c82c-79ac-4543-9a9c-58595e17e03d]: (4, ('ok\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:39:34 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-4c004ea9-e179-44ce-bfe6-e979571e2a37 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Flushing IO for device /dev/sdf {{(pid=74683) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 11:39:34 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:39:34 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:39:34 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6921ba-7906-42c2-916e-e6de7fa1286a]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:39:34 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-4c004ea9-e179-44ce-bfe6-e979571e2a37 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74683) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 11:39:34 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:39:34 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.045s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:39:34 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[821f847b-a0d5-480c-9f01-2a7a7e570ac7]: (4, ('1', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:39:34 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-4c004ea9-e179-44ce-bfe6-e979571e2a37 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 11:39:34 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-4c004ea9-e179-44ce-bfe6-e979571e2a37 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] SCSI volumes sdf have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 11:39:34 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c004ea9-e179-44ce-bfe6-e979571e2a37 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5')] {{(pid=74683) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 11:39:34 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:39:34 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:39:34 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ae14c4-a4e7-429b-9c2d-b459219c888c]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:39:34 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c004ea9-e179-44ce-bfe6-e979571e2a37 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:39:34 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5 -p 172.16.0.220:3260 --logout {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:39:34 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:39:34 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[2834720d-649f-4933-9520-aade77bcf512]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:39:34 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c004ea9-e179-44ce-bfe6-e979571e2a37 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5, portal: 172.16.0.220,3260]
Oct 16 11:39:34 user nova-compute[74683]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5, portal: 172.16.0.220,3260] successful.
Oct 16 11:39:34 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:39:34 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5 -p 172.16.0.220:3260 --op delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:39:34 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:39:34 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa31e540-06e5-4c8c-81d5-832a743eb457]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:39:34 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c004ea9-e179-44ce-bfe6-e979571e2a37 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:39:34 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-4c004ea9-e179-44ce-bfe6-e979571e2a37 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:39:34 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c004ea9-e179-44ce-bfe6-e979571e2a37 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] <== disconnect_volume: return (288ms) None {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:39:34 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c004ea9-e179-44ce-bfe6-e979571e2a37 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Disconnected iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 11:39:35 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2b141bb9-9e22-4956-9dbb-36b87f5b03a8 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Acquiring lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:39:35 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2b141bb9-9e22-4956-9dbb-36b87f5b03a8 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:39:35 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2b141bb9-9e22-4956-9dbb-36b87f5b03a8 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Acquiring lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:39:35 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2b141bb9-9e22-4956-9dbb-36b87f5b03a8 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:39:35 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2b141bb9-9e22-4956-9dbb-36b87f5b03a8 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:39:35 user nova-compute[74683]: DEBUG nova.objects.instance [None req-4c004ea9-e179-44ce-bfe6-e979571e2a37 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lazy-loading 'flavor' on Instance uuid e88445f0-2b1c-4cc1-94ca-33a1e3bec929 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:39:35 user nova-compute[74683]: INFO nova.compute.manager [None req-2b141bb9-9e22-4956-9dbb-36b87f5b03a8 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Terminating instance
Oct 16 11:39:35 user nova-compute[74683]: DEBUG nova.compute.manager [None req-2b141bb9-9e22-4956-9dbb-36b87f5b03a8 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Start destroying the instance on the hypervisor. {{(pid=74683) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 11:39:35 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-4c004ea9-e179-44ce-bfe6-e979571e2a37 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lock "e88445f0-2b1c-4cc1-94ca-33a1e3bec929" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.780s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:39:35 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-7117f7cd-2020-4626-9313-2ef8ee4a6cb9 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lock "e88445f0-2b1c-4cc1-94ca-33a1e3bec929" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.624s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:39:35 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-7117f7cd-2020-4626-9313-2ef8ee4a6cb9 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Acquiring lock "e88445f0-2b1c-4cc1-94ca-33a1e3bec929-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:39:35 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-7117f7cd-2020-4626-9313-2ef8ee4a6cb9 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lock "e88445f0-2b1c-4cc1-94ca-33a1e3bec929-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:39:35 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-7117f7cd-2020-4626-9313-2ef8ee4a6cb9 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lock "e88445f0-2b1c-4cc1-94ca-33a1e3bec929-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:39:35 user nova-compute[74683]: INFO nova.compute.manager [None req-7117f7cd-2020-4626-9313-2ef8ee4a6cb9 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Terminating instance
Oct 16 11:39:35 user nova-compute[74683]: DEBUG nova.compute.manager [None req-7117f7cd-2020-4626-9313-2ef8ee4a6cb9 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Start destroying the instance on the hypervisor. {{(pid=74683) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 11:39:35 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:36 user nova-compute[74683]: DEBUG nova.compute.manager [req-c61bd91e-1692-4ee9-abd3-8f77e10e867e req-feadcfd6-5c53-4b2e-9d90-10baf724a894 service nova] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Received event network-vif-unplugged-4ecf301e-0a4b-42f1-8e27-b8f46b00886c {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:39:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c61bd91e-1692-4ee9-abd3-8f77e10e867e req-feadcfd6-5c53-4b2e-9d90-10baf724a894 service nova] Acquiring lock "e88445f0-2b1c-4cc1-94ca-33a1e3bec929-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:39:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c61bd91e-1692-4ee9-abd3-8f77e10e867e req-feadcfd6-5c53-4b2e-9d90-10baf724a894 service nova] Lock "e88445f0-2b1c-4cc1-94ca-33a1e3bec929-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:39:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c61bd91e-1692-4ee9-abd3-8f77e10e867e req-feadcfd6-5c53-4b2e-9d90-10baf724a894 service nova] Lock "e88445f0-2b1c-4cc1-94ca-33a1e3bec929-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:39:36 user nova-compute[74683]: DEBUG nova.compute.manager [req-c61bd91e-1692-4ee9-abd3-8f77e10e867e req-feadcfd6-5c53-4b2e-9d90-10baf724a894 service nova] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] No waiting events found dispatching network-vif-unplugged-4ecf301e-0a4b-42f1-8e27-b8f46b00886c {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:39:36 user nova-compute[74683]: DEBUG nova.compute.manager [req-c61bd91e-1692-4ee9-abd3-8f77e10e867e req-feadcfd6-5c53-4b2e-9d90-10baf724a894 service nova] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Received event network-vif-unplugged-4ecf301e-0a4b-42f1-8e27-b8f46b00886c for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 11:39:36 user nova-compute[74683]: DEBUG nova.compute.manager [req-64ef21e1-d9ca-44d5-86a6-9c01c7a4cb82 req-ffd3f9d5-c6bd-4236-a3a0-2a59c2887e7f service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Received event network-vif-unplugged-ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:39:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-64ef21e1-d9ca-44d5-86a6-9c01c7a4cb82 req-ffd3f9d5-c6bd-4236-a3a0-2a59c2887e7f service nova] Acquiring lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:39:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-64ef21e1-d9ca-44d5-86a6-9c01c7a4cb82 req-ffd3f9d5-c6bd-4236-a3a0-2a59c2887e7f service nova] Lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:39:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-64ef21e1-d9ca-44d5-86a6-9c01c7a4cb82 req-ffd3f9d5-c6bd-4236-a3a0-2a59c2887e7f service nova] Lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:39:36 user nova-compute[74683]: DEBUG nova.compute.manager [req-64ef21e1-d9ca-44d5-86a6-9c01c7a4cb82 req-ffd3f9d5-c6bd-4236-a3a0-2a59c2887e7f service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] No waiting events found dispatching network-vif-unplugged-ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:39:36 user nova-compute[74683]: DEBUG nova.compute.manager [req-64ef21e1-d9ca-44d5-86a6-9c01c7a4cb82 req-ffd3f9d5-c6bd-4236-a3a0-2a59c2887e7f service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Received event network-vif-unplugged-ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 11:39:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:36 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Instance destroyed successfully.
Oct 16 11:39:36 user nova-compute[74683]: DEBUG nova.objects.instance [None req-2b141bb9-9e22-4956-9dbb-36b87f5b03a8 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lazy-loading 'resources' on Instance uuid 9b8ba94f-43cc-4f06-bcd9-83935ccbe117 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:39:36 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-2b141bb9-9e22-4956-9dbb-36b87f5b03a8 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:21:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-75769581',display_name='tempest-ServerRescueNegativeTestJSON-server-75769581',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-75769581',id=23,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:26:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e66a49078f1240bd88207e487dd4951e',ramdisk_id='',reservation_id='r-eju2vrqd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1690011355',owner_user_name='tempest-ServerRescueNegativeTestJSON-1690011355-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:28:37Z,user_data=None,user_id='3436197c787446d4a03fb7697d7999a1',uuid=9b8ba94f-43cc-4f06-bcd9-83935ccbe117,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665", "address": "fa:16:3e:d4:56:40", "network": {"id": "fa128ba8-cd2f-4621-ac04-ecc21569bb68", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321708612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66a49078f1240bd88207e487dd4951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff8b53f2-e6", "ovs_interfaceid": "ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:39:36 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-2b141bb9-9e22-4956-9dbb-36b87f5b03a8 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Converting VIF {"id": "ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665", "address": "fa:16:3e:d4:56:40", "network": {"id": "fa128ba8-cd2f-4621-ac04-ecc21569bb68", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321708612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66a49078f1240bd88207e487dd4951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff8b53f2-e6", "ovs_interfaceid": "ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:39:36 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-2b141bb9-9e22-4956-9dbb-36b87f5b03a8 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d4:56:40,bridge_name='br-int',has_traffic_filtering=True,id=ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665,network=Network(fa128ba8-cd2f-4621-ac04-ecc21569bb68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff8b53f2-e6') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:39:36 user nova-compute[74683]: DEBUG os_vif [None req-2b141bb9-9e22-4956-9dbb-36b87f5b03a8 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:56:40,bridge_name='br-int',has_traffic_filtering=True,id=ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665,network=Network(fa128ba8-cd2f-4621-ac04-ecc21569bb68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff8b53f2-e6') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:39:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff8b53f2-e6, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:39:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:39:36 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Instance destroyed successfully.
Oct 16 11:39:36 user nova-compute[74683]: DEBUG nova.objects.instance [None req-7117f7cd-2020-4626-9313-2ef8ee4a6cb9 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lazy-loading 'resources' on Instance uuid e88445f0-2b1c-4cc1-94ca-33a1e3bec929 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:39:36 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-7117f7cd-2020-4626-9313-2ef8ee4a6cb9 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:35:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-712792725',display_name='tempest-VolumesSnapshotTestJSON-instance-712792725',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-712792725',id=42,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4rEbCVncqKniWcF5GjLtrbs6WMhnI/1jSt9Ezhy216DBYIjxpBi93FmZS4qsJvdynh7N3UG6gKVur+vqYGfoqu/fGSdlHKMXvlUprn1tokf7pcM2VoeKaYCLDvtA3q0Q==',key_name='tempest-keypair-96601639',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:35:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b7d9daeec42a4e73a8ff2c0137f91128',ramdisk_id='',reservation_id='r-eharcn00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-919495777',owner_user_name='tempest-VolumesSnapshotTestJSON-919495777-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:36:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='395a6fc9aa93428c95593000c9caeb81',uuid=e88445f0-2b1c-4cc1-94ca-33a1e3bec929,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ecf301e-0a4b-42f1-8e27-b8f46b00886c", "address": "fa:16:3e:6e:28:8e", "network": {"id": "3f02f591-1fa0-477f-8730-b41445fd41b4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1932917211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d9daeec42a4e73a8ff2c0137f91128", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ecf301e-0a", "ovs_interfaceid": "4ecf301e-0a4b-42f1-8e27-b8f46b00886c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:39:36 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-7117f7cd-2020-4626-9313-2ef8ee4a6cb9 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Converting VIF {"id": "4ecf301e-0a4b-42f1-8e27-b8f46b00886c", "address": "fa:16:3e:6e:28:8e", "network": {"id": "3f02f591-1fa0-477f-8730-b41445fd41b4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1932917211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d9daeec42a4e73a8ff2c0137f91128", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ecf301e-0a", "ovs_interfaceid": "4ecf301e-0a4b-42f1-8e27-b8f46b00886c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:39:36 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-7117f7cd-2020-4626-9313-2ef8ee4a6cb9 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:28:8e,bridge_name='br-int',has_traffic_filtering=True,id=4ecf301e-0a4b-42f1-8e27-b8f46b00886c,network=Network(3f02f591-1fa0-477f-8730-b41445fd41b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ecf301e-0a') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:39:36 user nova-compute[74683]: DEBUG os_vif [None req-7117f7cd-2020-4626-9313-2ef8ee4a6cb9 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:28:8e,bridge_name='br-int',has_traffic_filtering=True,id=4ecf301e-0a4b-42f1-8e27-b8f46b00886c,network=Network(3f02f591-1fa0-477f-8730-b41445fd41b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ecf301e-0a') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:39:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ecf301e-0a, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:39:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:39:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0cf0b200-7a48-4762-8325-cae88d5adf2d) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:39:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:39:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=78edb8c3-b3c1-4f16-879c-b216b69588ad) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:39:36 user nova-compute[74683]: INFO os_vif [None req-2b141bb9-9e22-4956-9dbb-36b87f5b03a8 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:56:40,bridge_name='br-int',has_traffic_filtering=True,id=ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665,network=Network(fa128ba8-cd2f-4621-ac04-ecc21569bb68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff8b53f2-e6')
Oct 16 11:39:36 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-2b141bb9-9e22-4956-9dbb-36b87f5b03a8 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Deleting instance files /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117_del
Oct 16 11:39:37 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-2b141bb9-9e22-4956-9dbb-36b87f5b03a8 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Deletion of /opt/stack/data/nova/instances/9b8ba94f-43cc-4f06-bcd9-83935ccbe117_del complete
Oct 16 11:39:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:39:37 user nova-compute[74683]: INFO os_vif [None req-7117f7cd-2020-4626-9313-2ef8ee4a6cb9 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:28:8e,bridge_name='br-int',has_traffic_filtering=True,id=4ecf301e-0a4b-42f1-8e27-b8f46b00886c,network=Network(3f02f591-1fa0-477f-8730-b41445fd41b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ecf301e-0a')
Oct 16 11:39:37 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7117f7cd-2020-4626-9313-2ef8ee4a6cb9 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] calling os-brick to detach iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 11:39:37 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-7117f7cd-2020-4626-9313-2ef8ee4a6cb9 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, {'target_iqn': 'iqn.2010-10.org.openstack:3400449b-1160-4ffe-9ea2-9fdfb4995ea5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xunQNFqz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:39:37 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-7117f7cd-2020-4626-9313-2ef8ee4a6cb9 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:39:37 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-7117f7cd-2020-4626-9313-2ef8ee4a6cb9 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:39:37 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-7117f7cd-2020-4626-9313-2ef8ee4a6cb9 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:39:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:39:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:39:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:39:37 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[d567115b-1693-478b-bf64-53c21397f65d]: Unexpected error while running command.
Oct 16 11:39:37 user nova-compute[74683]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 16 11:39:37 user nova-compute[74683]: Exit code: 21
Oct 16 11:39:37 user nova-compute[74683]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 16 11:39:37 user nova-compute[74683]: Stderr: '' {{(pid=85666) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Oct 16 11:39:37 user nova-compute[74683]: Traceback (most recent call last):
Oct 16 11:39:37 user nova-compute[74683]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Oct 16 11:39:37 user nova-compute[74683]:     ret = func(*f_args, **f_kwargs)
Oct 16 11:39:37 user nova-compute[74683]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Oct 16 11:39:37 user nova-compute[74683]:     return func(*args, **kwargs)
Oct 16 11:39:37 user nova-compute[74683]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Oct 16 11:39:37 user nova-compute[74683]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Oct 16 11:39:37 user nova-compute[74683]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Oct 16 11:39:37 user nova-compute[74683]:     return putils.execute(on_execute=on_execute,
Oct 16 11:39:37 user nova-compute[74683]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Oct 16 11:39:37 user nova-compute[74683]:     raise ProcessExecutionError(exit_code=_returncode,
Oct 16 11:39:37 user nova-compute[74683]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 16 11:39:37 user nova-compute[74683]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 16 11:39:37 user nova-compute[74683]: Exit code: 21
Oct 16 11:39:37 user nova-compute[74683]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 16 11:39:37 user nova-compute[74683]: Stderr: ''
Oct 16 11:39:37 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d567115b-1693-478b-bf64-53c21397f65d]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:39:37 user nova-compute[74683]: ERROR os_brick.initiator.connectors.iscsi [None req-7117f7cd-2020-4626-9313-2ef8ee4a6cb9 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 16 11:39:37 user nova-compute[74683]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 16 11:39:37 user nova-compute[74683]: Exit code: 21
Oct 16 11:39:37 user nova-compute[74683]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 16 11:39:37 user nova-compute[74683]: Stderr: ''
Oct 16 11:39:37 user nova-compute[74683]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Oct 16 11:39:37 user nova-compute[74683]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Oct 16 11:39:37 user nova-compute[74683]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Oct 16 11:39:37 user nova-compute[74683]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Oct 16 11:39:37 user nova-compute[74683]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Oct 16 11:39:37 user nova-compute[74683]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Oct 16 11:39:37 user nova-compute[74683]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Oct 16 11:39:37 user nova-compute[74683]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Oct 16 11:39:37 user nova-compute[74683]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Oct 16 11:39:37 user nova-compute[74683]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Oct 16 11:39:37 user nova-compute[74683]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Oct 16 11:39:37 user nova-compute[74683]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Oct 16 11:39:37 user nova-compute[74683]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Oct 16 11:39:37 user nova-compute[74683]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Oct 16 11:39:37 user nova-compute[74683]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Oct 16 11:39:37 user nova-compute[74683]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 16 11:39:37 user nova-compute[74683]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Oct 16 11:39:37 user nova-compute[74683]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Oct 16 11:39:37 user nova-compute[74683]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 16 11:39:37 user nova-compute[74683]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Oct 16 11:39:37 user nova-compute[74683]: ERROR os_brick.initiator.connectors.iscsi 
Oct 16 11:39:37 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-7117f7cd-2020-4626-9313-2ef8ee4a6cb9 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=74683) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Oct 16 11:39:37 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-7117f7cd-2020-4626-9313-2ef8ee4a6cb9 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.034s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:39:37 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-7117f7cd-2020-4626-9313-2ef8ee4a6cb9 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] <== disconnect_volume: return (35ms) None {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:39:37 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7117f7cd-2020-4626-9313-2ef8ee4a6cb9 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Disconnected iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 11:39:37 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-7117f7cd-2020-4626-9313-2ef8ee4a6cb9 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Deleting instance files /opt/stack/data/nova/instances/e88445f0-2b1c-4cc1-94ca-33a1e3bec929_del
Oct 16 11:39:37 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-7117f7cd-2020-4626-9313-2ef8ee4a6cb9 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Deletion of /opt/stack/data/nova/instances/e88445f0-2b1c-4cc1-94ca-33a1e3bec929_del complete
Oct 16 11:39:37 user nova-compute[74683]: INFO nova.compute.manager [None req-2b141bb9-9e22-4956-9dbb-36b87f5b03a8 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Took 1.34 seconds to destroy the instance on the hypervisor.
Oct 16 11:39:37 user nova-compute[74683]: DEBUG oslo.service.loopingcall [None req-2b141bb9-9e22-4956-9dbb-36b87f5b03a8 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74683) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 11:39:37 user nova-compute[74683]: DEBUG nova.compute.manager [-] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Deallocating network for instance {{(pid=74683) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 11:39:37 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] deallocate_for_instance() {{(pid=74683) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 11:39:37 user nova-compute[74683]: INFO nova.compute.manager [None req-7117f7cd-2020-4626-9313-2ef8ee4a6cb9 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Took 1.30 seconds to destroy the instance on the hypervisor.
Oct 16 11:39:37 user nova-compute[74683]: DEBUG oslo.service.loopingcall [None req-7117f7cd-2020-4626-9313-2ef8ee4a6cb9 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74683) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 11:39:37 user nova-compute[74683]: DEBUG nova.compute.manager [-] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Deallocating network for instance {{(pid=74683) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 11:39:37 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] deallocate_for_instance() {{(pid=74683) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 11:39:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:37 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:39:37 user nova-compute[74683]: INFO nova.compute.manager [-] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Took 0.55 seconds to deallocate network for instance.
Oct 16 11:39:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2b141bb9-9e22-4956-9dbb-36b87f5b03a8 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:39:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2b141bb9-9e22-4956-9dbb-36b87f5b03a8 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:39:37 user nova-compute[74683]: DEBUG nova.compute.manager [req-abccfc24-1a71-4b3e-9cb4-db7ef8ab38cc req-475cf0d1-f538-4ec1-9bda-22ebb4bbff54 service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Received event network-vif-deleted-ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:39:37 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-2b141bb9-9e22-4956-9dbb-36b87f5b03a8 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:39:37 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-2b141bb9-9e22-4956-9dbb-36b87f5b03a8 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:39:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2b141bb9-9e22-4956-9dbb-36b87f5b03a8 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.243s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:39:37 user nova-compute[74683]: INFO nova.scheduler.client.report [None req-2b141bb9-9e22-4956-9dbb-36b87f5b03a8 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Deleted allocations for instance 9b8ba94f-43cc-4f06-bcd9-83935ccbe117
Oct 16 11:39:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2b141bb9-9e22-4956-9dbb-36b87f5b03a8 tempest-ServerRescueNegativeTestJSON-1690011355 tempest-ServerRescueNegativeTestJSON-1690011355-project-member] Lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.336s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:39:38 user nova-compute[74683]: DEBUG nova.compute.manager [req-e1075669-599d-43e2-8ce0-26fb9524796d req-b148deb5-c6b7-4107-9d53-dc68db83eafe service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Received event network-vif-plugged-ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:39:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e1075669-599d-43e2-8ce0-26fb9524796d req-b148deb5-c6b7-4107-9d53-dc68db83eafe service nova] Acquiring lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:39:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e1075669-599d-43e2-8ce0-26fb9524796d req-b148deb5-c6b7-4107-9d53-dc68db83eafe service nova] Lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:39:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e1075669-599d-43e2-8ce0-26fb9524796d req-b148deb5-c6b7-4107-9d53-dc68db83eafe service nova] Lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:39:38 user nova-compute[74683]: DEBUG nova.compute.manager [req-e1075669-599d-43e2-8ce0-26fb9524796d req-b148deb5-c6b7-4107-9d53-dc68db83eafe service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] No waiting events found dispatching network-vif-plugged-ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:39:38 user nova-compute[74683]: WARNING nova.compute.manager [req-e1075669-599d-43e2-8ce0-26fb9524796d req-b148deb5-c6b7-4107-9d53-dc68db83eafe service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Received unexpected event network-vif-plugged-ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 for instance with vm_state deleted and task_state None.
Oct 16 11:39:38 user nova-compute[74683]: DEBUG nova.compute.manager [req-e1075669-599d-43e2-8ce0-26fb9524796d req-b148deb5-c6b7-4107-9d53-dc68db83eafe service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Received event network-vif-plugged-ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:39:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e1075669-599d-43e2-8ce0-26fb9524796d req-b148deb5-c6b7-4107-9d53-dc68db83eafe service nova] Acquiring lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:39:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e1075669-599d-43e2-8ce0-26fb9524796d req-b148deb5-c6b7-4107-9d53-dc68db83eafe service nova] Lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:39:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e1075669-599d-43e2-8ce0-26fb9524796d req-b148deb5-c6b7-4107-9d53-dc68db83eafe service nova] Lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:39:38 user nova-compute[74683]: DEBUG nova.compute.manager [req-e1075669-599d-43e2-8ce0-26fb9524796d req-b148deb5-c6b7-4107-9d53-dc68db83eafe service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] No waiting events found dispatching network-vif-plugged-ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:39:38 user nova-compute[74683]: WARNING nova.compute.manager [req-e1075669-599d-43e2-8ce0-26fb9524796d req-b148deb5-c6b7-4107-9d53-dc68db83eafe service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Received unexpected event network-vif-plugged-ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 for instance with vm_state deleted and task_state None.
Oct 16 11:39:38 user nova-compute[74683]: DEBUG nova.compute.manager [req-e1075669-599d-43e2-8ce0-26fb9524796d req-b148deb5-c6b7-4107-9d53-dc68db83eafe service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Received event network-vif-plugged-ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:39:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e1075669-599d-43e2-8ce0-26fb9524796d req-b148deb5-c6b7-4107-9d53-dc68db83eafe service nova] Acquiring lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:39:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e1075669-599d-43e2-8ce0-26fb9524796d req-b148deb5-c6b7-4107-9d53-dc68db83eafe service nova] Lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:39:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e1075669-599d-43e2-8ce0-26fb9524796d req-b148deb5-c6b7-4107-9d53-dc68db83eafe service nova] Lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:39:38 user nova-compute[74683]: DEBUG nova.compute.manager [req-e1075669-599d-43e2-8ce0-26fb9524796d req-b148deb5-c6b7-4107-9d53-dc68db83eafe service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] No waiting events found dispatching network-vif-plugged-ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:39:38 user nova-compute[74683]: WARNING nova.compute.manager [req-e1075669-599d-43e2-8ce0-26fb9524796d req-b148deb5-c6b7-4107-9d53-dc68db83eafe service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Received unexpected event network-vif-plugged-ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 for instance with vm_state deleted and task_state None.
Oct 16 11:39:38 user nova-compute[74683]: DEBUG nova.compute.manager [req-e1075669-599d-43e2-8ce0-26fb9524796d req-b148deb5-c6b7-4107-9d53-dc68db83eafe service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Received event network-vif-unplugged-ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:39:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e1075669-599d-43e2-8ce0-26fb9524796d req-b148deb5-c6b7-4107-9d53-dc68db83eafe service nova] Acquiring lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:39:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e1075669-599d-43e2-8ce0-26fb9524796d req-b148deb5-c6b7-4107-9d53-dc68db83eafe service nova] Lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:39:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e1075669-599d-43e2-8ce0-26fb9524796d req-b148deb5-c6b7-4107-9d53-dc68db83eafe service nova] Lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:39:38 user nova-compute[74683]: DEBUG nova.compute.manager [req-e1075669-599d-43e2-8ce0-26fb9524796d req-b148deb5-c6b7-4107-9d53-dc68db83eafe service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] No waiting events found dispatching network-vif-unplugged-ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:39:38 user nova-compute[74683]: WARNING nova.compute.manager [req-e1075669-599d-43e2-8ce0-26fb9524796d req-b148deb5-c6b7-4107-9d53-dc68db83eafe service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Received unexpected event network-vif-unplugged-ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 for instance with vm_state deleted and task_state None.
Oct 16 11:39:38 user nova-compute[74683]: DEBUG nova.compute.manager [req-e1075669-599d-43e2-8ce0-26fb9524796d req-b148deb5-c6b7-4107-9d53-dc68db83eafe service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Received event network-vif-plugged-ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:39:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e1075669-599d-43e2-8ce0-26fb9524796d req-b148deb5-c6b7-4107-9d53-dc68db83eafe service nova] Acquiring lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:39:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e1075669-599d-43e2-8ce0-26fb9524796d req-b148deb5-c6b7-4107-9d53-dc68db83eafe service nova] Lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:39:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e1075669-599d-43e2-8ce0-26fb9524796d req-b148deb5-c6b7-4107-9d53-dc68db83eafe service nova] Lock "9b8ba94f-43cc-4f06-bcd9-83935ccbe117-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:39:38 user nova-compute[74683]: DEBUG nova.compute.manager [req-e1075669-599d-43e2-8ce0-26fb9524796d req-b148deb5-c6b7-4107-9d53-dc68db83eafe service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] No waiting events found dispatching network-vif-plugged-ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:39:38 user nova-compute[74683]: WARNING nova.compute.manager [req-e1075669-599d-43e2-8ce0-26fb9524796d req-b148deb5-c6b7-4107-9d53-dc68db83eafe service nova] [instance: 9b8ba94f-43cc-4f06-bcd9-83935ccbe117] Received unexpected event network-vif-plugged-ff8b53f2-e6b2-421d-ab1a-ea52ba7c6665 for instance with vm_state deleted and task_state None.
Oct 16 11:39:38 user nova-compute[74683]: DEBUG nova.compute.manager [req-11f59d01-97ef-4f9a-9e9c-a36358c5778e req-01ade1c3-b98e-4946-b998-8cc43f4fb47f service nova] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Received event network-vif-plugged-4ecf301e-0a4b-42f1-8e27-b8f46b00886c {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:39:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-11f59d01-97ef-4f9a-9e9c-a36358c5778e req-01ade1c3-b98e-4946-b998-8cc43f4fb47f service nova] Acquiring lock "e88445f0-2b1c-4cc1-94ca-33a1e3bec929-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:39:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-11f59d01-97ef-4f9a-9e9c-a36358c5778e req-01ade1c3-b98e-4946-b998-8cc43f4fb47f service nova] Lock "e88445f0-2b1c-4cc1-94ca-33a1e3bec929-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:39:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-11f59d01-97ef-4f9a-9e9c-a36358c5778e req-01ade1c3-b98e-4946-b998-8cc43f4fb47f service nova] Lock "e88445f0-2b1c-4cc1-94ca-33a1e3bec929-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:39:38 user nova-compute[74683]: DEBUG nova.compute.manager [req-11f59d01-97ef-4f9a-9e9c-a36358c5778e req-01ade1c3-b98e-4946-b998-8cc43f4fb47f service nova] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] No waiting events found dispatching network-vif-plugged-4ecf301e-0a4b-42f1-8e27-b8f46b00886c {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:39:38 user nova-compute[74683]: WARNING nova.compute.manager [req-11f59d01-97ef-4f9a-9e9c-a36358c5778e req-01ade1c3-b98e-4946-b998-8cc43f4fb47f service nova] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Received unexpected event network-vif-plugged-4ecf301e-0a4b-42f1-8e27-b8f46b00886c for instance with vm_state active and task_state deleting.
Oct 16 11:39:38 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:39:38 user nova-compute[74683]: INFO nova.compute.manager [-] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Took 1.50 seconds to deallocate network for instance.
Oct 16 11:39:38 user nova-compute[74683]: WARNING nova.volume.cinder [None req-7117f7cd-2020-4626-9313-2ef8ee4a6cb9 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Attachment 74bfcefe-5b94-42e1-b80e-6397a6163810 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 74bfcefe-5b94-42e1-b80e-6397a6163810. (HTTP 404) (Request-ID: req-52ecea06-2b74-4f1c-bf69-9f5c13fc2393)
Oct 16 11:39:38 user nova-compute[74683]: INFO nova.compute.manager [None req-7117f7cd-2020-4626-9313-2ef8ee4a6cb9 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Took 0.02 seconds to detach 1 volumes for instance.
Oct 16 11:39:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-7117f7cd-2020-4626-9313-2ef8ee4a6cb9 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:39:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-7117f7cd-2020-4626-9313-2ef8ee4a6cb9 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:39:38 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-7117f7cd-2020-4626-9313-2ef8ee4a6cb9 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:39:38 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-7117f7cd-2020-4626-9313-2ef8ee4a6cb9 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:39:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-7117f7cd-2020-4626-9313-2ef8ee4a6cb9 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.188s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:39:38 user nova-compute[74683]: INFO nova.scheduler.client.report [None req-7117f7cd-2020-4626-9313-2ef8ee4a6cb9 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Deleted allocations for instance e88445f0-2b1c-4cc1-94ca-33a1e3bec929
Oct 16 11:39:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-7117f7cd-2020-4626-9313-2ef8ee4a6cb9 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lock "e88445f0-2b1c-4cc1-94ca-33a1e3bec929" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.235s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:39:40 user nova-compute[74683]: DEBUG nova.compute.manager [req-6b2b070d-612e-46c9-bd39-7273d1507dd1 req-4e9ce6cb-3c4b-45ad-a8af-7a8a1df3a111 service nova] [instance: e88445f0-2b1c-4cc1-94ca-33a1e3bec929] Received event network-vif-deleted-4ecf301e-0a4b-42f1-8e27-b8f46b00886c {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:39:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:46 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:39:46 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec63ea4a-1874-4e61-aa73-d22320f9f980 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Calling os-brick to attach iSCSI Volume {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 11:39:46 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec63ea4a-1874-4e61-aa73-d22320f9f980 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bc0034fd-87f8-471e-bb72-83a4bce0c1a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QbaCSmkx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:39:46 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-ec63ea4a-1874-4e61-aa73-d22320f9f980 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:39:46 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-ec63ea4a-1874-4e61-aa73-d22320f9f980 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:39:46 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-ec63ea4a-1874-4e61-aa73-d22320f9f980 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:39:46 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-ec63ea4a-1874-4e61-aa73-d22320f9f980 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:39:46 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-ec63ea4a-1874-4e61-aa73-d22320f9f980 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc0034fd-87f8-471e-bb72-83a4bce0c1a9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:39:46 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-ec63ea4a-1874-4e61-aa73-d22320f9f980 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc0034fd-87f8-471e-bb72-83a4bce0c1a9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:39:46 user nova-compute[74683]: INFO os_brick.initiator.connectors.iscsi [None req-ec63ea4a-1874-4e61-aa73-d22320f9f980 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 11:39:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc0034fd-87f8-471e-bb72-83a4bce0c1a9 -p 172.16.0.220:3260 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:39:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc0034fd-87f8-471e-bb72-83a4bce0c1a9 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:39:46 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[855f98bd-3d10-4b12-9c9d-cd19129fa3ff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:39:46 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec63ea4a-1874-4e61-aa73-d22320f9f980 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 11:39:46 user nova-compute[74683]:  {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:39:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc0034fd-87f8-471e-bb72-83a4bce0c1a9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:39:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc0034fd-87f8-471e-bb72-83a4bce0c1a9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:39:46 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[091a9e13-9642-40a8-a6a8-e0d746982158]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc0034fd-87f8-471e-bb72-83a4bce0c1a9] added\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:39:46 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec63ea4a-1874-4e61-aa73-d22320f9f980 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc0034fd-87f8-471e-bb72-83a4bce0c1a9] added
Oct 16 11:39:46 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:39:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc0034fd-87f8-471e-bb72-83a4bce0c1a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:39:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc0034fd-87f8-471e-bb72-83a4bce0c1a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:39:46 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f647a9-db2f-4623-8442-594e127eae97]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:39:46 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec63ea4a-1874-4e61-aa73-d22320f9f980 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:39:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc0034fd-87f8-471e-bb72-83a4bce0c1a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:39:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc0034fd-87f8-471e-bb72-83a4bce0c1a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:39:46 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d24133a-8746-458d-8fc6-c4c2bbb2f9d5]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:39:46 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec63ea4a-1874-4e61-aa73-d22320f9f980 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:39:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc0034fd-87f8-471e-bb72-83a4bce0c1a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QbaCSmkx {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:39:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc0034fd-87f8-471e-bb72-83a4bce0c1a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QbaCSmkx" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:39:46 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[0247de64-dfd3-4b7d-8281-f84cfb2df19e]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:39:46 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec63ea4a-1874-4e61-aa73-d22320f9f980 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QbaCSmkx'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:39:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc0034fd-87f8-471e-bb72-83a4bce0c1a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:39:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc0034fd-87f8-471e-bb72-83a4bce0c1a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:39:46 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[468106f1-30a5-49ae-9030-51e2e16bf83a]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:39:46 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec63ea4a-1874-4e61-aa73-d22320f9f980 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:39:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:39:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:39:46 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a72db56b-bdc9-4878-83ab-f63f1889c080]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:39:46 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec63ea4a-1874-4e61-aa73-d22320f9f980 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 16 11:39:46 user nova-compute[74683]:  {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:39:46 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec63ea4a-1874-4e61-aa73-d22320f9f980 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 16 11:39:46 user nova-compute[74683]:  {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:39:46 user nova-compute[74683]: WARNING os_brick.initiator.connectors.iscsi [None req-ec63ea4a-1874-4e61-aa73-d22320f9f980 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 16 11:39:46 user nova-compute[74683]: 
Oct 16 11:39:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc0034fd-87f8-471e-bb72-83a4bce0c1a9 -p 172.16.0.220:3260 --login {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:39:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc0034fd-87f8-471e-bb72-83a4bce0c1a9 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:39:46 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[0713b4b6-846d-4b01-aa1a-15a5c805ae41]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc0034fd-87f8-471e-bb72-83a4bce0c1a9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bc0034fd-87f8-471e-bb72-83a4bce0c1a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:39:46 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec63ea4a-1874-4e61-aa73-d22320f9f980 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc0034fd-87f8-471e-bb72-83a4bce0c1a9, portal: 172.16.0.220,3260]
Oct 16 11:39:46 user nova-compute[74683]: Login to [iface: default, target: iqn.2010-10.org.openstack:bc0034fd-87f8-471e-bb72-83a4bce0c1a9, portal: 172.16.0.220,3260] successful.
Oct 16 11:39:46 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:39:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc0034fd-87f8-471e-bb72-83a4bce0c1a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:39:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc0034fd-87f8-471e-bb72-83a4bce0c1a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:39:46 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22b8d50-d504-49b6-9c01-3799e77e24a7]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:39:46 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec63ea4a-1874-4e61-aa73-d22320f9f980 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:39:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:39:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:39:46 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8152c94-b0ed-4953-a82b-e8f897baec09]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0034fd-87f8-471e-bb72-83a4bce0c1a9 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:39:46 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec63ea4a-1874-4e61-aa73-d22320f9f980 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0034fd-87f8-471e-bb72-83a4bce0c1a9 (non-flash)
Oct 16 11:39:46 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:39:46 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec63ea4a-1874-4e61-aa73-d22320f9f980 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0034fd-87f8-471e-bb72-83a4bce0c1a9 (non-flash)
Oct 16 11:39:46 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:39:46 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-ec63ea4a-1874-4e61-aa73-d22320f9f980 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc0034fd-87f8-471e-bb72-83a4bce0c1a9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:39:46 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec63ea4a-1874-4e61-aa73-d22320f9f980 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Connected to 172.16.0.220:3260 {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 11:39:46 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-ec63ea4a-1874-4e61-aa73-d22320f9f980 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=74683) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 11:39:46 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-ec63ea4a-1874-4e61-aa73-d22320f9f980 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74683) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 11:39:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:39:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:39:46 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[367bf480-2379-4056-afb6-cc38a22f4ffa]: (4, ('- - 0', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:39:46 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-ec63ea4a-1874-4e61-aa73-d22320f9f980 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:39:46 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec63ea4a-1874-4e61-aa73-d22320f9f980 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bc0034fd-87f8-471e-bb72-83a4bce0c1a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QbaCSmkx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 11:39:46 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:39:46 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:46 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74683) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 11:39:46 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:39:46 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:39:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:47 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-ec63ea4a-1874-4e61-aa73-d22320f9f980 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:39:47 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec63ea4a-1874-4e61-aa73-d22320f9f980 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '26664313261663763', 'path': '/dev/sdb'} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:39:47 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec63ea4a-1874-4e61-aa73-d22320f9f980 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26664313261663763', 'path': '/dev/sdb'} {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 11:39:47 user nova-compute[74683]: DEBUG nova.objects.instance [None req-ec63ea4a-1874-4e61-aa73-d22320f9f980 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lazy-loading 'flavor' on Instance uuid 8d94b70c-4056-4c58-9df4-73684e0d164f {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:39:47 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-ec63ea4a-1874-4e61-aa73-d22320f9f980 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 11:39:47 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:39:47 user nova-compute[74683]:   <source dev="/dev/sdb"/>
Oct 16 11:39:47 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:39:47 user nova-compute[74683]:   <serial>bc0034fd-87f8-471e-bb72-83a4bce0c1a9</serial>
Oct 16 11:39:47 user nova-compute[74683]: </disk>
Oct 16 11:39:47 user nova-compute[74683]:  {{(pid=74683) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 11:39:48 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-ec63ea4a-1874-4e61-aa73-d22320f9f980 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:39:48 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-ec63ea4a-1874-4e61-aa73-d22320f9f980 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:39:48 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-ec63ea4a-1874-4e61-aa73-d22320f9f980 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] No VIF found with MAC fa:16:3e:67:41:41, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:39:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ec63ea4a-1874-4e61-aa73-d22320f9f980 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lock "8d94b70c-4056-4c58-9df4-73684e0d164f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.124s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:39:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-700b0dd7-c105-452c-8f80-429754d2da20 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Acquiring lock "8d94b70c-4056-4c58-9df4-73684e0d164f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:39:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-700b0dd7-c105-452c-8f80-429754d2da20 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lock "8d94b70c-4056-4c58-9df4-73684e0d164f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:39:50 user nova-compute[74683]: INFO nova.compute.manager [None req-700b0dd7-c105-452c-8f80-429754d2da20 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Detaching volume bc0034fd-87f8-471e-bb72-83a4bce0c1a9
Oct 16 11:39:50 user nova-compute[74683]: INFO nova.virt.block_device [None req-700b0dd7-c105-452c-8f80-429754d2da20 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Attempting to driver detach volume bc0034fd-87f8-471e-bb72-83a4bce0c1a9 from mountpoint /dev/vdb
Oct 16 11:39:50 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-700b0dd7-c105-452c-8f80-429754d2da20 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Attempting to detach device vdb from instance 8d94b70c-4056-4c58-9df4-73684e0d164f from the persistent domain config. {{(pid=74683) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 11:39:50 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-700b0dd7-c105-452c-8f80-429754d2da20 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 11:39:50 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:39:50 user nova-compute[74683]:   <source dev="/dev/sdb"/>
Oct 16 11:39:50 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:39:50 user nova-compute[74683]:   <serial>bc0034fd-87f8-471e-bb72-83a4bce0c1a9</serial>
Oct 16 11:39:50 user nova-compute[74683]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 11:39:50 user nova-compute[74683]: </disk>
Oct 16 11:39:50 user nova-compute[74683]:  {{(pid=74683) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 11:39:50 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-700b0dd7-c105-452c-8f80-429754d2da20 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Successfully detached device vdb from instance 8d94b70c-4056-4c58-9df4-73684e0d164f from the persistent domain config.
Oct 16 11:39:50 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-700b0dd7-c105-452c-8f80-429754d2da20 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8d94b70c-4056-4c58-9df4-73684e0d164f from the live domain config. {{(pid=74683) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 11:39:50 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-700b0dd7-c105-452c-8f80-429754d2da20 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 11:39:50 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:39:50 user nova-compute[74683]:   <source dev="/dev/sdb"/>
Oct 16 11:39:50 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:39:50 user nova-compute[74683]:   <serial>bc0034fd-87f8-471e-bb72-83a4bce0c1a9</serial>
Oct 16 11:39:50 user nova-compute[74683]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 11:39:50 user nova-compute[74683]: </disk>
Oct 16 11:39:50 user nova-compute[74683]:  {{(pid=74683) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 11:39:50 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-700b0dd7-c105-452c-8f80-429754d2da20 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8d94b70c-4056-4c58-9df4-73684e0d164f {{(pid=74683) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 11:39:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:39:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74683) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 11:39:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:39:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:39:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:39:59 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:40:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:40:03 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:40:04 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._sync_power_states {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:40:04 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Triggering sync for uuid f5ad764c-638d-4dac-b032-6680917e46df {{(pid=74683) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 11:40:04 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Triggering sync for uuid 8d94b70c-4056-4c58-9df4-73684e0d164f {{(pid=74683) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 11:40:04 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Triggering sync for uuid 1986f9b5-30fb-4290-802d-ee699a19b608 {{(pid=74683) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 11:40:04 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "f5ad764c-638d-4dac-b032-6680917e46df" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:40:04 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "f5ad764c-638d-4dac-b032-6680917e46df" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:40:04 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "8d94b70c-4056-4c58-9df4-73684e0d164f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:40:04 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "1986f9b5-30fb-4290-802d-ee699a19b608" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:40:04 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "1986f9b5-30fb-4290-802d-ee699a19b608" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:40:04 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "1986f9b5-30fb-4290-802d-ee699a19b608" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:40:04 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "f5ad764c-638d-4dac-b032-6680917e46df" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:40:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:40:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:40:10 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-700b0dd7-c105-452c-8f80-429754d2da20 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8d94b70c-4056-4c58-9df4-73684e0d164f is timed out.
Oct 16 11:40:10 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-700b0dd7-c105-452c-8f80-429754d2da20 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Successfully detached device vdb from instance 8d94b70c-4056-4c58-9df4-73684e0d164f from the live domain config.
Oct 16 11:40:10 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-700b0dd7-c105-452c-8f80-429754d2da20 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] calling os-brick to detach iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 11:40:10 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-700b0dd7-c105-452c-8f80-429754d2da20 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, {'target_iqn': 'iqn.2010-10.org.openstack:bc0034fd-87f8-471e-bb72-83a4bce0c1a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QbaCSmkx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:40:10 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-700b0dd7-c105-452c-8f80-429754d2da20 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:40:10 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-700b0dd7-c105-452c-8f80-429754d2da20 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:40:10 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-700b0dd7-c105-452c-8f80-429754d2da20 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:40:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:40:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:40:10 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e246fd-7240-4669-9a54-062dc9aafcdb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bc0034fd-87f8-471e-bb72-83a4bce0c1a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:40:10 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-700b0dd7-c105-452c-8f80-429754d2da20 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 11:40:10 user nova-compute[74683]: No targets found.
Oct 16 11:40:10 user nova-compute[74683]: iSNS:
Oct 16 11:40:10 user nova-compute[74683]: No targets found.
Oct 16 11:40:10 user nova-compute[74683]: STATIC:
Oct 16 11:40:10 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:bc0034fd-87f8-471e-bb72-83a4bce0c1a9
Oct 16 11:40:10 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:40:10 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:40:10 user nova-compute[74683]: FIRMWARE:
Oct 16 11:40:10 user nova-compute[74683]: No targets found.
Oct 16 11:40:10 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:40:10 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-700b0dd7-c105-452c-8f80-429754d2da20 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 11:40:10 user nova-compute[74683]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 11:40:10 user nova-compute[74683]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74683) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 11:40:10 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-700b0dd7-c105-452c-8f80-429754d2da20 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc0034fd-87f8-471e-bb72-83a4bce0c1a9', 0)] {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 11:40:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:40:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:40:10 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7bb6b4-13de-4e77-ba21-ac5d9611e8be]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc0034fd-87f8-471e-bb72-83a4bce0c1a9\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:40:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:40:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:40:10 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a271886-96ce-416d-a1c0-9799c8a4617b]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0034fd-87f8-471e-bb72-83a4bce0c1a9 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:40:10 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-700b0dd7-c105-452c-8f80-429754d2da20 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0034fd-87f8-471e-bb72-83a4bce0c1a9 (non-flash)
Oct 16 11:40:10 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:40:10 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-700b0dd7-c105-452c-8f80-429754d2da20 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0034fd-87f8-471e-bb72-83a4bce0c1a9 (non-flash)
Oct 16 11:40:10 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:40:10 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-700b0dd7-c105-452c-8f80-429754d2da20 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda64105750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc0034fd-87f8-471e-bb72-83a4bce0c1a9'): ({'sdb'}, set())}) {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 11:40:10 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-700b0dd7-c105-452c-8f80-429754d2da20 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Removing single pathed devices sdb {{(pid=74683) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 11:40:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:40:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:40:10 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb004c44-a4f9-41ae-8938-a093e159cf2b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:40:10 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:40:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:40:11 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5de61ac-333f-44e2-ad95-eeb8cfbb3f1e]: (4, ('ok\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:40:11 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-700b0dd7-c105-452c-8f80-429754d2da20 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Flushing IO for device /dev/sdb {{(pid=74683) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 11:40:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:40:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:40:11 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03e43cb-0236-4305-9850-1ae7a439cf87]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:40:11 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-700b0dd7-c105-452c-8f80-429754d2da20 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74683) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 11:40:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:40:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:40:11 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[95451fed-dbdf-4f09-9f96-c13f259b3162]: (4, ('1', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:40:11 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-700b0dd7-c105-452c-8f80-429754d2da20 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 11:40:11 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-700b0dd7-c105-452c-8f80-429754d2da20 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] SCSI volumes sdb have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 11:40:11 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-700b0dd7-c105-452c-8f80-429754d2da20 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc0034fd-87f8-471e-bb72-83a4bce0c1a9')] {{(pid=74683) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 11:40:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc0034fd-87f8-471e-bb72-83a4bce0c1a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:40:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc0034fd-87f8-471e-bb72-83a4bce0c1a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:40:11 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ad9560-0863-46a8-9a84-95312e63aa1b]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:40:11 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-700b0dd7-c105-452c-8f80-429754d2da20 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:40:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc0034fd-87f8-471e-bb72-83a4bce0c1a9 -p 172.16.0.220:3260 --logout {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:40:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc0034fd-87f8-471e-bb72-83a4bce0c1a9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:40:11 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4381c86-0ecb-41b7-8de5-a270f332ee0a]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:bc0034fd-87f8-471e-bb72-83a4bce0c1a9, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:bc0034fd-87f8-471e-bb72-83a4bce0c1a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:40:11 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-700b0dd7-c105-452c-8f80-429754d2da20 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:bc0034fd-87f8-471e-bb72-83a4bce0c1a9, portal: 172.16.0.220,3260]
Oct 16 11:40:11 user nova-compute[74683]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:bc0034fd-87f8-471e-bb72-83a4bce0c1a9, portal: 172.16.0.220,3260] successful.
Oct 16 11:40:11 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:40:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc0034fd-87f8-471e-bb72-83a4bce0c1a9 -p 172.16.0.220:3260 --op delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:40:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc0034fd-87f8-471e-bb72-83a4bce0c1a9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:40:11 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00a46fd-c7fa-4675-a00d-7422dd1b3a20]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:40:11 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-700b0dd7-c105-452c-8f80-429754d2da20 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:40:11 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-700b0dd7-c105-452c-8f80-429754d2da20 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:40:11 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-700b0dd7-c105-452c-8f80-429754d2da20 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] <== disconnect_volume: return (279ms) None {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:40:11 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-700b0dd7-c105-452c-8f80-429754d2da20 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Disconnected iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 11:40:12 user nova-compute[74683]: DEBUG nova.objects.instance [None req-700b0dd7-c105-452c-8f80-429754d2da20 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lazy-loading 'flavor' on Instance uuid 8d94b70c-4056-4c58-9df4-73684e0d164f {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:40:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:40:12 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-700b0dd7-c105-452c-8f80-429754d2da20 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lock "8d94b70c-4056-4c58-9df4-73684e0d164f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.687s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:40:12 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "8d94b70c-4056-4c58-9df4-73684e0d164f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 7.603s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:40:12 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "8d94b70c-4056-4c58-9df4-73684e0d164f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:40:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:40:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:40:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:40:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74683) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 11:40:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:40:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:40:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:40:23 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:40:23 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:40:24 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:40:24 user nova-compute[74683]: DEBUG nova.objects.instance [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lazy-loading 'flavor' on Instance uuid f5ad764c-638d-4dac-b032-6680917e46df {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:40:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Acquiring lock "refresh_cache-f5ad764c-638d-4dac-b032-6680917e46df" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:40:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Acquired lock "refresh_cache-f5ad764c-638d-4dac-b032-6680917e46df" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:40:24 user nova-compute[74683]: DEBUG nova.network.neutron [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:40:24 user nova-compute[74683]: DEBUG nova.objects.instance [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lazy-loading 'info_cache' on Instance uuid f5ad764c-638d-4dac-b032-6680917e46df {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:40:25 user nova-compute[74683]: DEBUG nova.objects.base [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Object Instance<f5ad764c-638d-4dac-b032-6680917e46df> lazy-loaded attributes: flavor,info_cache {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:40:25 user nova-compute[74683]: DEBUG nova.network.neutron [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Updating instance_info_cache with network_info: [{"id": "eb80f49f-da30-478a-900a-5d3da8ec7fa9", "address": "fa:16:3e:c8:02:4d", "network": {"id": "badd2db9-6c0f-40cc-afe9-a199e040399a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1368098259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "889cb980200446c0933fe965738a62df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb80f49f-da", "ovs_interfaceid": "eb80f49f-da30-478a-900a-5d3da8ec7fa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:40:25 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Releasing lock "refresh_cache-f5ad764c-638d-4dac-b032-6680917e46df" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:40:25 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Instance destroyed successfully.
Oct 16 11:40:25 user nova-compute[74683]: DEBUG nova.objects.instance [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lazy-loading 'resources' on Instance uuid f5ad764c-638d-4dac-b032-6680917e46df {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:40:25 user nova-compute[74683]: DEBUG nova.objects.base [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Object Instance<f5ad764c-638d-4dac-b032-6680917e46df> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:40:25 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:32:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1312798176',display_name='tempest-AttachVolumeTestJSON-server-1312798176',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1312798176',id=37,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK71ozq2/KpO5RlTCFqfn2Y2zadWP27MahKIqPNvvjn6AoGcB4vtAlejjcQWpo0ZyUGWpGjLegzCVDVvdR5EwjFBNV5GDYZr2laQXH53s66DwTCeGEg2DbbqZiQTOGLfAw==',key_name='tempest-keypair-1447279783',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:32:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='889cb980200446c0933fe965738a62df',ramdisk_id='',reservation_id='r-acd30a2f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-263939305',owner_user_name='tempest-AttachVolumeTestJSON-263939305-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:38:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c38fd3bc86ba4b7a95e06b926d22e60f',uuid=f5ad764c-638d-4dac-b032-6680917e46df,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "eb80f49f-da30-478a-900a-5d3da8ec7fa9", "address": "fa:16:3e:c8:02:4d", "network": {"id": "badd2db9-6c0f-40cc-afe9-a199e040399a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1368098259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "889cb980200446c0933fe965738a62df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb80f49f-da", "ovs_interfaceid": "eb80f49f-da30-478a-900a-5d3da8ec7fa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:40:25 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Converting VIF {"id": "eb80f49f-da30-478a-900a-5d3da8ec7fa9", "address": "fa:16:3e:c8:02:4d", "network": {"id": "badd2db9-6c0f-40cc-afe9-a199e040399a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1368098259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "889cb980200446c0933fe965738a62df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb80f49f-da", "ovs_interfaceid": "eb80f49f-da30-478a-900a-5d3da8ec7fa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:40:25 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:02:4d,bridge_name='br-int',has_traffic_filtering=True,id=eb80f49f-da30-478a-900a-5d3da8ec7fa9,network=Network(badd2db9-6c0f-40cc-afe9-a199e040399a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb80f49f-da') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:40:25 user nova-compute[74683]: DEBUG os_vif [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:02:4d,bridge_name='br-int',has_traffic_filtering=True,id=eb80f49f-da30-478a-900a-5d3da8ec7fa9,network=Network(badd2db9-6c0f-40cc-afe9-a199e040399a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb80f49f-da') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:40:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:40:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeb80f49f-da, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:40:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:40:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:40:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:40:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a24882a7-6fb1-415e-8b66-25678fd75589) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:40:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:40:25 user nova-compute[74683]: INFO os_vif [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:02:4d,bridge_name='br-int',has_traffic_filtering=True,id=eb80f49f-da30-478a-900a-5d3da8ec7fa9,network=Network(badd2db9-6c0f-40cc-afe9-a199e040399a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb80f49f-da')
Oct 16 11:40:25 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Start _get_guest_xml network_info=[{"id": "eb80f49f-da30-478a-900a-5d3da8ec7fa9", "address": "fa:16:3e:c8:02:4d", "network": {"id": "badd2db9-6c0f-40cc-afe9-a199e040399a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1368098259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "889cb980200446c0933fe965738a62df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb80f49f-da", "ovs_interfaceid": "eb80f49f-da30-478a-900a-5d3da8ec7fa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:40:25 user nova-compute[74683]: DEBUG nova.objects.instance [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lazy-loading 'numa_topology' on Instance uuid f5ad764c-638d-4dac-b032-6680917e46df {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:40:25 user nova-compute[74683]: DEBUG nova.objects.base [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Object Instance<f5ad764c-638d-4dac-b032-6680917e46df> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:40:25 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:40:25 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:40:25 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:40:25 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:40:25 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:40:25 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:40:25 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:40:25 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:40:25 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:40:25 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:40:25 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:40:25 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:40:25 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:40:25 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:40:25 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:40:25 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:40:25 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:40:25 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:40:25 user nova-compute[74683]: DEBUG nova.objects.instance [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lazy-loading 'vcpu_model' on Instance uuid f5ad764c-638d-4dac-b032-6680917e46df {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:40:25 user nova-compute[74683]: DEBUG nova.objects.base [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Object Instance<f5ad764c-638d-4dac-b032-6680917e46df> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:40:25 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:32:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1312798176',display_name='tempest-AttachVolumeTestJSON-server-1312798176',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1312798176',id=37,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK71ozq2/KpO5RlTCFqfn2Y2zadWP27MahKIqPNvvjn6AoGcB4vtAlejjcQWpo0ZyUGWpGjLegzCVDVvdR5EwjFBNV5GDYZr2laQXH53s66DwTCeGEg2DbbqZiQTOGLfAw==',key_name='tempest-keypair-1447279783',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:32:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='889cb980200446c0933fe965738a62df',ramdisk_id='',reservation_id='r-acd30a2f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-263939305',owner_user_name='tempest-AttachVolumeTestJSON-263939305-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:38:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c38fd3bc86ba4b7a95e06b926d22e60f',uuid=f5ad764c-638d-4dac-b032-6680917e46df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "eb80f49f-da30-478a-900a-5d3da8ec7fa9", "address": "fa:16:3e:c8:02:4d", "network": {"id": "badd2db9-6c0f-40cc-afe9-a199e040399a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1368098259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "889cb980200446c0933fe965738a62df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb80f49f-da", "ovs_interfaceid": "eb80f49f-da30-478a-900a-5d3da8ec7fa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:40:25 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Converting VIF {"id": "eb80f49f-da30-478a-900a-5d3da8ec7fa9", "address": "fa:16:3e:c8:02:4d", "network": {"id": "badd2db9-6c0f-40cc-afe9-a199e040399a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1368098259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "889cb980200446c0933fe965738a62df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb80f49f-da", "ovs_interfaceid": "eb80f49f-da30-478a-900a-5d3da8ec7fa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:40:25 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:02:4d,bridge_name='br-int',has_traffic_filtering=True,id=eb80f49f-da30-478a-900a-5d3da8ec7fa9,network=Network(badd2db9-6c0f-40cc-afe9-a199e040399a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb80f49f-da') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:40:25 user nova-compute[74683]: DEBUG nova.objects.instance [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lazy-loading 'pci_devices' on Instance uuid f5ad764c-638d-4dac-b032-6680917e46df {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:40:25 user nova-compute[74683]: DEBUG nova.objects.base [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Object Instance<f5ad764c-638d-4dac-b032-6680917e46df> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:40:25 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:40:25 user nova-compute[74683]:   <uuid>f5ad764c-638d-4dac-b032-6680917e46df</uuid>
Oct 16 11:40:25 user nova-compute[74683]:   <name>instance-00000025</name>
Oct 16 11:40:25 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:40:25 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:40:25 user nova-compute[74683]:   <metadata>
Oct 16 11:40:25 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:40:25 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:40:25 user nova-compute[74683]:       <nova:name>tempest-AttachVolumeTestJSON-server-1312798176</nova:name>
Oct 16 11:40:25 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:40:25</nova:creationTime>
Oct 16 11:40:25 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:40:25 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:40:25 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:40:25 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:40:25 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:40:25 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:40:25 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:40:25 user nova-compute[74683]:       <nova:owner>
Oct 16 11:40:25 user nova-compute[74683]:         <nova:user uuid="c38fd3bc86ba4b7a95e06b926d22e60f">tempest-AttachVolumeTestJSON-263939305-project-member</nova:user>
Oct 16 11:40:25 user nova-compute[74683]:         <nova:project uuid="889cb980200446c0933fe965738a62df">tempest-AttachVolumeTestJSON-263939305</nova:project>
Oct 16 11:40:25 user nova-compute[74683]:       </nova:owner>
Oct 16 11:40:25 user nova-compute[74683]:       <nova:root type="image" uuid="0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f"/>
Oct 16 11:40:25 user nova-compute[74683]:       <nova:ports>
Oct 16 11:40:25 user nova-compute[74683]:         <nova:port uuid="eb80f49f-da30-478a-900a-5d3da8ec7fa9">
Oct 16 11:40:25 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 16 11:40:25 user nova-compute[74683]:         </nova:port>
Oct 16 11:40:25 user nova-compute[74683]:       </nova:ports>
Oct 16 11:40:25 user nova-compute[74683]:     </nova:instance>
Oct 16 11:40:25 user nova-compute[74683]:   </metadata>
Oct 16 11:40:25 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:40:25 user nova-compute[74683]:     <system>
Oct 16 11:40:25 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:40:25 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:40:25 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:40:25 user nova-compute[74683]:       <entry name="serial">f5ad764c-638d-4dac-b032-6680917e46df</entry>
Oct 16 11:40:25 user nova-compute[74683]:       <entry name="uuid">f5ad764c-638d-4dac-b032-6680917e46df</entry>
Oct 16 11:40:25 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:40:25 user nova-compute[74683]:     </system>
Oct 16 11:40:25 user nova-compute[74683]:   </sysinfo>
Oct 16 11:40:25 user nova-compute[74683]:   <os>
Oct 16 11:40:25 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:40:25 user nova-compute[74683]:     <boot dev="hd"/>
Oct 16 11:40:25 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:40:25 user nova-compute[74683]:   </os>
Oct 16 11:40:25 user nova-compute[74683]:   <features>
Oct 16 11:40:25 user nova-compute[74683]:     <acpi/>
Oct 16 11:40:25 user nova-compute[74683]:     <apic/>
Oct 16 11:40:25 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:40:25 user nova-compute[74683]:   </features>
Oct 16 11:40:25 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:40:25 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:40:25 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:40:25 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:40:25 user nova-compute[74683]:   </clock>
Oct 16 11:40:25 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:40:25 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:40:25 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:40:25 user nova-compute[74683]:   </cpu>
Oct 16 11:40:25 user nova-compute[74683]:   <devices>
Oct 16 11:40:25 user nova-compute[74683]:     <disk type="file" device="disk">
Oct 16 11:40:25 user nova-compute[74683]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 11:40:25 user nova-compute[74683]:       <source file="/opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk"/>
Oct 16 11:40:25 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:40:25 user nova-compute[74683]:     </disk>
Oct 16 11:40:25 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:40:25 user nova-compute[74683]:       <mac address="fa:16:3e:c8:02:4d"/>
Oct 16 11:40:25 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:40:25 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:40:25 user nova-compute[74683]:       <target dev="tapeb80f49f-da"/>
Oct 16 11:40:25 user nova-compute[74683]:     </interface>
Oct 16 11:40:25 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:40:25 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/console.log" append="off"/>
Oct 16 11:40:25 user nova-compute[74683]:     </serial>
Oct 16 11:40:25 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:40:25 user nova-compute[74683]:     <video>
Oct 16 11:40:25 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:40:25 user nova-compute[74683]:     </video>
Oct 16 11:40:25 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:40:25 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:40:25 user nova-compute[74683]:     </rng>
Oct 16 11:40:25 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:40:25 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:40:25 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:40:25 user nova-compute[74683]:     </memballoon>
Oct 16 11:40:25 user nova-compute[74683]:   </devices>
Oct 16 11:40:25 user nova-compute[74683]: </domain>
Oct 16 11:40:25 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:40:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:40:25 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:40:25 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Starting heal instance info cache {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 11:40:25 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Rebuilding the list of instances to heal {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 11:40:25 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "refresh_cache-f5ad764c-638d-4dac-b032-6680917e46df" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:40:25 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquired lock "refresh_cache-f5ad764c-638d-4dac-b032-6680917e46df" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:40:25 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Forcefully refreshing network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 11:40:25 user nova-compute[74683]: DEBUG nova.objects.instance [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lazy-loading 'info_cache' on Instance uuid f5ad764c-638d-4dac-b032-6680917e46df {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:40:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:40:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:40:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:40:26 user nova-compute[74683]: DEBUG nova.objects.instance [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lazy-loading 'trusted_certs' on Instance uuid f5ad764c-638d-4dac-b032-6680917e46df {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:40:26 user nova-compute[74683]: DEBUG nova.objects.base [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Object Instance<f5ad764c-638d-4dac-b032-6680917e46df> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:40:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:40:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.188s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:40:26 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk. size=1073741824 {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 11:40:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:40:26 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Updating instance_info_cache with network_info: [{"id": "eb80f49f-da30-478a-900a-5d3da8ec7fa9", "address": "fa:16:3e:c8:02:4d", "network": {"id": "badd2db9-6c0f-40cc-afe9-a199e040399a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1368098259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "889cb980200446c0933fe965738a62df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb80f49f-da", "ovs_interfaceid": "eb80f49f-da30-478a-900a-5d3da8ec7fa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:40:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Releasing lock "refresh_cache-f5ad764c-638d-4dac-b032-6680917e46df" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:40:26 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Updated the network info_cache for instance {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 11:40:26 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:40:26 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:40:26 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:40:26 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Cannot resize image /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk to a smaller size. {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 11:40:26 user nova-compute[74683]: DEBUG nova.objects.instance [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lazy-loading 'migration_context' on Instance uuid f5ad764c-638d-4dac-b032-6680917e46df {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:40:26 user nova-compute[74683]: DEBUG nova.objects.base [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Object Instance<f5ad764c-638d-4dac-b032-6680917e46df> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:40:26 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:32:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1312798176',display_name='tempest-AttachVolumeTestJSON-server-1312798176',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1312798176',id=37,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK71ozq2/KpO5RlTCFqfn2Y2zadWP27MahKIqPNvvjn6AoGcB4vtAlejjcQWpo0ZyUGWpGjLegzCVDVvdR5EwjFBNV5GDYZr2laQXH53s66DwTCeGEg2DbbqZiQTOGLfAw==',key_name='tempest-keypair-1447279783',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:32:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='889cb980200446c0933fe965738a62df',ramdisk_id='',reservation_id='r-acd30a2f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-263939305',owner_user_name='tempest-AttachVolumeTestJSON-263939305-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:38:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c38fd3bc86ba4b7a95e06b926d22e60f',uuid=f5ad764c-638d-4dac-b032-6680917e46df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "eb80f49f-da30-478a-900a-5d3da8ec7fa9", "address": "fa:16:3e:c8:02:4d", "network": {"id": "badd2db9-6c0f-40cc-afe9-a199e040399a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1368098259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "889cb980200446c0933fe965738a62df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb80f49f-da", "ovs_interfaceid": "eb80f49f-da30-478a-900a-5d3da8ec7fa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:40:26 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Converting VIF {"id": "eb80f49f-da30-478a-900a-5d3da8ec7fa9", "address": "fa:16:3e:c8:02:4d", "network": {"id": "badd2db9-6c0f-40cc-afe9-a199e040399a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1368098259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "889cb980200446c0933fe965738a62df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb80f49f-da", "ovs_interfaceid": "eb80f49f-da30-478a-900a-5d3da8ec7fa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:40:26 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:02:4d,bridge_name='br-int',has_traffic_filtering=True,id=eb80f49f-da30-478a-900a-5d3da8ec7fa9,network=Network(badd2db9-6c0f-40cc-afe9-a199e040399a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb80f49f-da') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:40:26 user nova-compute[74683]: DEBUG os_vif [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:02:4d,bridge_name='br-int',has_traffic_filtering=True,id=eb80f49f-da30-478a-900a-5d3da8ec7fa9,network=Network(badd2db9-6c0f-40cc-afe9-a199e040399a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb80f49f-da') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:40:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:40:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:40:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:40:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:40:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '62e33a0e-1db6-509e-9031-ed30d2e60514', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:40:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:40:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:40:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:40:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeb80f49f-da, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:40:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeb80f49f-da, col_values=(('qos', UUID('a844b793-55b7-457e-9713-bfe8e6a891a8')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:40:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeb80f49f-da, col_values=(('external_ids', {'iface-id': 'eb80f49f-da30-478a-900a-5d3da8ec7fa9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:02:4d', 'vm-uuid': 'f5ad764c-638d-4dac-b032-6680917e46df'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:40:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:40:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:40:26 user nova-compute[74683]: INFO os_vif [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:02:4d,bridge_name='br-int',has_traffic_filtering=True,id=eb80f49f-da30-478a-900a-5d3da8ec7fa9,network=Network(badd2db9-6c0f-40cc-afe9-a199e040399a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb80f49f-da')
Oct 16 11:40:27 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:40:27 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74683) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 11:40:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:40:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:40:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:40:28 user nova-compute[74683]: DEBUG nova.compute.manager [req-0c6d5f55-dfee-4c4c-aae1-c037b0f04e15 req-446f61dc-8463-4871-8b58-a9346e7996e5 service nova] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Received event network-vif-plugged-eb80f49f-da30-478a-900a-5d3da8ec7fa9 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:40:28 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-0c6d5f55-dfee-4c4c-aae1-c037b0f04e15 req-446f61dc-8463-4871-8b58-a9346e7996e5 service nova] Acquiring lock "f5ad764c-638d-4dac-b032-6680917e46df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:40:28 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-0c6d5f55-dfee-4c4c-aae1-c037b0f04e15 req-446f61dc-8463-4871-8b58-a9346e7996e5 service nova] Lock "f5ad764c-638d-4dac-b032-6680917e46df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:40:28 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-0c6d5f55-dfee-4c4c-aae1-c037b0f04e15 req-446f61dc-8463-4871-8b58-a9346e7996e5 service nova] Lock "f5ad764c-638d-4dac-b032-6680917e46df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:40:28 user nova-compute[74683]: DEBUG nova.compute.manager [req-0c6d5f55-dfee-4c4c-aae1-c037b0f04e15 req-446f61dc-8463-4871-8b58-a9346e7996e5 service nova] [instance: f5ad764c-638d-4dac-b032-6680917e46df] No waiting events found dispatching network-vif-plugged-eb80f49f-da30-478a-900a-5d3da8ec7fa9 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:40:28 user nova-compute[74683]: WARNING nova.compute.manager [req-0c6d5f55-dfee-4c4c-aae1-c037b0f04e15 req-446f61dc-8463-4871-8b58-a9346e7996e5 service nova] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Received unexpected event network-vif-plugged-eb80f49f-da30-478a-900a-5d3da8ec7fa9 for instance with vm_state stopped and task_state powering-on.
Oct 16 11:40:28 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:40:28 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:40:28 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:40:28 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:40:28 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:40:28 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:40:28 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Auditing locally available compute resources for user (node: user) {{(pid=74683) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 11:40:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1986f9b5-30fb-4290-802d-ee699a19b608/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:40:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1986f9b5-30fb-4290-802d-ee699a19b608/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:40:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1986f9b5-30fb-4290-802d-ee699a19b608/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:40:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:40:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1986f9b5-30fb-4290-802d-ee699a19b608/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:40:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:40:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:40:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:40:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:40:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d94b70c-4056-4c58-9df4-73684e0d164f/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:40:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d94b70c-4056-4c58-9df4-73684e0d164f/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:40:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d94b70c-4056-4c58-9df4-73684e0d164f/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:40:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d94b70c-4056-4c58-9df4-73684e0d164f/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:40:30 user nova-compute[74683]: DEBUG nova.compute.manager [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Instance event wait completed in 0 seconds for  {{(pid=74683) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 11:40:30 user nova-compute[74683]: DEBUG nova.compute.manager [req-222af40f-2d9d-4e64-8130-684cb325711c req-f5efe2b8-3b56-4a44-92aa-e34bc809d5c9 service nova] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Received event network-vif-plugged-eb80f49f-da30-478a-900a-5d3da8ec7fa9 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:40:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-222af40f-2d9d-4e64-8130-684cb325711c req-f5efe2b8-3b56-4a44-92aa-e34bc809d5c9 service nova] Acquiring lock "f5ad764c-638d-4dac-b032-6680917e46df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:40:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-222af40f-2d9d-4e64-8130-684cb325711c req-f5efe2b8-3b56-4a44-92aa-e34bc809d5c9 service nova] Lock "f5ad764c-638d-4dac-b032-6680917e46df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:40:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-222af40f-2d9d-4e64-8130-684cb325711c req-f5efe2b8-3b56-4a44-92aa-e34bc809d5c9 service nova] Lock "f5ad764c-638d-4dac-b032-6680917e46df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:40:30 user nova-compute[74683]: DEBUG nova.compute.manager [req-222af40f-2d9d-4e64-8130-684cb325711c req-f5efe2b8-3b56-4a44-92aa-e34bc809d5c9 service nova] [instance: f5ad764c-638d-4dac-b032-6680917e46df] No waiting events found dispatching network-vif-plugged-eb80f49f-da30-478a-900a-5d3da8ec7fa9 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:40:30 user nova-compute[74683]: WARNING nova.compute.manager [req-222af40f-2d9d-4e64-8130-684cb325711c req-f5efe2b8-3b56-4a44-92aa-e34bc809d5c9 service nova] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Received unexpected event network-vif-plugged-eb80f49f-da30-478a-900a-5d3da8ec7fa9 for instance with vm_state stopped and task_state powering-on.
Oct 16 11:40:30 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Instance rebooted successfully.
Oct 16 11:40:30 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:40:30 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:40:30 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Hypervisor/Node resource view: name=user free_ram=8561MB free_disk=25.14672088623047GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74683) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 11:40:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:40:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:40:30 user nova-compute[74683]: DEBUG nova.compute.manager [None req-5a32f193-711f-4869-8c2e-24e01c4e4694 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:40:30 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance f5ad764c-638d-4dac-b032-6680917e46df actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:40:30 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 8d94b70c-4056-4c58-9df4-73684e0d164f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:40:30 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 1986f9b5-30fb-4290-802d-ee699a19b608 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:40:30 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 11:40:30 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 11:40:31 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:40:31 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:40:31 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Compute_service record updated for user:user {{(pid=74683) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 11:40:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.462s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:40:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:40:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:40:34 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:40:35 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:40:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:40:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:40:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:40:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Acquiring lock "ec2b88a5-6571-4f46-a07d-47ccfc1761e4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:40:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "ec2b88a5-6571-4f46-a07d-47ccfc1761e4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:40:41 user nova-compute[74683]: DEBUG nova.compute.manager [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Starting instance... {{(pid=74683) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 11:40:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:40:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:40:41 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74683) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 11:40:41 user nova-compute[74683]: INFO nova.compute.claims [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Claim successful on node user
Oct 16 11:40:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:40:41 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:40:41 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:40:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.497s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:40:41 user nova-compute[74683]: DEBUG nova.compute.manager [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Start building networks asynchronously for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 11:40:41 user nova-compute[74683]: DEBUG nova.compute.manager [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Allocating IP information in the background. {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 11:40:41 user nova-compute[74683]: DEBUG nova.network.neutron [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] allocate_for_instance() {{(pid=74683) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 11:40:41 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 11:40:41 user nova-compute[74683]: DEBUG nova.compute.manager [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Start building block device mappings for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 11:40:41 user nova-compute[74683]: DEBUG nova.policy [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '11130271beb44b368f9eb55bd4946cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622d2c7c33914a068b448c447db50b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74683) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 11:40:41 user nova-compute[74683]: DEBUG nova.compute.manager [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Start spawning the instance on the hypervisor. {{(pid=74683) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 11:40:41 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Creating instance directory {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 11:40:41 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Creating image(s)
Oct 16 11:40:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Acquiring lock "/opt/stack/data/nova/instances/ec2b88a5-6571-4f46-a07d-47ccfc1761e4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:40:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "/opt/stack/data/nova/instances/ec2b88a5-6571-4f46-a07d-47ccfc1761e4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:40:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "/opt/stack/data/nova/instances/ec2b88a5-6571-4f46-a07d-47ccfc1761e4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:40:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:40:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.221s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:40:42 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Acquiring lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:40:42 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:40:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:40:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:40:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.186s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:40:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/ec2b88a5-6571-4f46-a07d-47ccfc1761e4/disk 1073741824 {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:40:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/ec2b88a5-6571-4f46-a07d-47ccfc1761e4/disk 1073741824" returned: 0 in 0.099s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:40:42 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.292s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:40:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:40:42 user nova-compute[74683]: DEBUG nova.network.neutron [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Successfully created port: 75e552bb-fec2-47bd-adda-d562f27f8a36 {{(pid=74683) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 11:40:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.218s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:40:42 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ec2b88a5-6571-4f46-a07d-47ccfc1761e4/disk. size=1073741824 {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 11:40:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec2b88a5-6571-4f46-a07d-47ccfc1761e4/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:40:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec2b88a5-6571-4f46-a07d-47ccfc1761e4/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:40:42 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Cannot resize image /opt/stack/data/nova/instances/ec2b88a5-6571-4f46-a07d-47ccfc1761e4/disk to a smaller size. {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 11:40:42 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Created local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 11:40:42 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Ensure instance console log exists: /opt/stack/data/nova/instances/ec2b88a5-6571-4f46-a07d-47ccfc1761e4/console.log {{(pid=74683) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 11:40:42 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:40:42 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:40:42 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:40:43 user nova-compute[74683]: DEBUG nova.network.neutron [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Successfully updated port: 75e552bb-fec2-47bd-adda-d562f27f8a36 {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:40:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Acquiring lock "refresh_cache-ec2b88a5-6571-4f46-a07d-47ccfc1761e4" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:40:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Acquired lock "refresh_cache-ec2b88a5-6571-4f46-a07d-47ccfc1761e4" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:40:43 user nova-compute[74683]: DEBUG nova.network.neutron [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:40:43 user nova-compute[74683]: DEBUG nova.compute.manager [req-be1521ae-a541-4823-b387-e467737bbcf5 req-2fd4661e-7e96-4bf3-9502-a9dc5f9a96b2 service nova] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Received event network-changed-75e552bb-fec2-47bd-adda-d562f27f8a36 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:40:43 user nova-compute[74683]: DEBUG nova.compute.manager [req-be1521ae-a541-4823-b387-e467737bbcf5 req-2fd4661e-7e96-4bf3-9502-a9dc5f9a96b2 service nova] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Refreshing instance network info cache due to event network-changed-75e552bb-fec2-47bd-adda-d562f27f8a36. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:40:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-be1521ae-a541-4823-b387-e467737bbcf5 req-2fd4661e-7e96-4bf3-9502-a9dc5f9a96b2 service nova] Acquiring lock "refresh_cache-ec2b88a5-6571-4f46-a07d-47ccfc1761e4" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:40:43 user nova-compute[74683]: DEBUG nova.network.neutron [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:40:43 user nova-compute[74683]: DEBUG nova.network.neutron [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Updating instance_info_cache with network_info: [{"id": "75e552bb-fec2-47bd-adda-d562f27f8a36", "address": "fa:16:3e:f5:74:eb", "network": {"id": "2ea750a5-8511-4e40-b149-062e10e0096c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-563467594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d2c7c33914a068b448c447db50b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75e552bb-fe", "ovs_interfaceid": "75e552bb-fec2-47bd-adda-d562f27f8a36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:40:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Releasing lock "refresh_cache-ec2b88a5-6571-4f46-a07d-47ccfc1761e4" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:40:43 user nova-compute[74683]: DEBUG nova.compute.manager [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Instance network_info: |[{"id": "75e552bb-fec2-47bd-adda-d562f27f8a36", "address": "fa:16:3e:f5:74:eb", "network": {"id": "2ea750a5-8511-4e40-b149-062e10e0096c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-563467594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d2c7c33914a068b448c447db50b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75e552bb-fe", "ovs_interfaceid": "75e552bb-fec2-47bd-adda-d562f27f8a36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 11:40:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-be1521ae-a541-4823-b387-e467737bbcf5 req-2fd4661e-7e96-4bf3-9502-a9dc5f9a96b2 service nova] Acquired lock "refresh_cache-ec2b88a5-6571-4f46-a07d-47ccfc1761e4" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:40:43 user nova-compute[74683]: DEBUG nova.network.neutron [req-be1521ae-a541-4823-b387-e467737bbcf5 req-2fd4661e-7e96-4bf3-9502-a9dc5f9a96b2 service nova] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Refreshing network info cache for port 75e552bb-fec2-47bd-adda-d562f27f8a36 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:40:43 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Start _get_guest_xml network_info=[{"id": "75e552bb-fec2-47bd-adda-d562f27f8a36", "address": "fa:16:3e:f5:74:eb", "network": {"id": "2ea750a5-8511-4e40-b149-062e10e0096c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-563467594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d2c7c33914a068b448c447db50b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75e552bb-fe", "ovs_interfaceid": "75e552bb-fec2-47bd-adda-d562f27f8a36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:40:43 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:40:43 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:40:43 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:40:43 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:40:43 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:40:43 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:40:43 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:40:43 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:40:43 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:40:43 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:40:43 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:40:43 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:40:43 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:40:43 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:40:43 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:40:43 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:40:43 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:40:43 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:40:43 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:40:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2110881689',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2110881689',id=45,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDrHmOsUhrm4YYKYARdlKrqlcDFGMaTykPh+zb4tGBwYVOfh9pZUyKRTzLOgTUyJT2LVaX7B+7+kT/t6ev3xOPaVzmYiORuHL6ffe3eYJ1lXFNVKMGK5E0k7O/PLikdAqQ==',key_name='tempest-keypair-127654640',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='622d2c7c33914a068b448c447db50b3c',ramdisk_id='',reservation_id='r-3kki01l8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-291825158',owner_user_name='tempest-AttachVolumeShelveTestJSON-291825158-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:40:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11130271beb44b368f9eb55bd4946cbc',uuid=ec2b88a5-6571-4f46-a07d-47ccfc1761e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75e552bb-fec2-47bd-adda-d562f27f8a36", "address": "fa:16:3e:f5:74:eb", "network": {"id": "2ea750a5-8511-4e40-b149-062e10e0096c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-563467594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d2c7c33914a068b448c447db50b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75e552bb-fe", "ovs_interfaceid": "75e552bb-fec2-47bd-adda-d562f27f8a36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:40:43 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Converting VIF {"id": "75e552bb-fec2-47bd-adda-d562f27f8a36", "address": "fa:16:3e:f5:74:eb", "network": {"id": "2ea750a5-8511-4e40-b149-062e10e0096c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-563467594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d2c7c33914a068b448c447db50b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75e552bb-fe", "ovs_interfaceid": "75e552bb-fec2-47bd-adda-d562f27f8a36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:40:43 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:74:eb,bridge_name='br-int',has_traffic_filtering=True,id=75e552bb-fec2-47bd-adda-d562f27f8a36,network=Network(2ea750a5-8511-4e40-b149-062e10e0096c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75e552bb-fe') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:40:43 user nova-compute[74683]: DEBUG nova.objects.instance [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lazy-loading 'pci_devices' on Instance uuid ec2b88a5-6571-4f46-a07d-47ccfc1761e4 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:40:43 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:40:43 user nova-compute[74683]:   <uuid>ec2b88a5-6571-4f46-a07d-47ccfc1761e4</uuid>
Oct 16 11:40:43 user nova-compute[74683]:   <name>instance-0000002d</name>
Oct 16 11:40:43 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:40:43 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:40:43 user nova-compute[74683]:   <metadata>
Oct 16 11:40:43 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:40:43 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:40:43 user nova-compute[74683]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2110881689</nova:name>
Oct 16 11:40:43 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:40:43</nova:creationTime>
Oct 16 11:40:43 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:40:43 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:40:43 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:40:43 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:40:43 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:40:43 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:40:43 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:40:43 user nova-compute[74683]:       <nova:owner>
Oct 16 11:40:43 user nova-compute[74683]:         <nova:user uuid="11130271beb44b368f9eb55bd4946cbc">tempest-AttachVolumeShelveTestJSON-291825158-project-member</nova:user>
Oct 16 11:40:43 user nova-compute[74683]:         <nova:project uuid="622d2c7c33914a068b448c447db50b3c">tempest-AttachVolumeShelveTestJSON-291825158</nova:project>
Oct 16 11:40:43 user nova-compute[74683]:       </nova:owner>
Oct 16 11:40:43 user nova-compute[74683]:       <nova:root type="image" uuid="0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f"/>
Oct 16 11:40:43 user nova-compute[74683]:       <nova:ports>
Oct 16 11:40:43 user nova-compute[74683]:         <nova:port uuid="75e552bb-fec2-47bd-adda-d562f27f8a36">
Oct 16 11:40:43 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 16 11:40:43 user nova-compute[74683]:         </nova:port>
Oct 16 11:40:43 user nova-compute[74683]:       </nova:ports>
Oct 16 11:40:43 user nova-compute[74683]:     </nova:instance>
Oct 16 11:40:43 user nova-compute[74683]:   </metadata>
Oct 16 11:40:43 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:40:43 user nova-compute[74683]:     <system>
Oct 16 11:40:43 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:40:43 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:40:43 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:40:43 user nova-compute[74683]:       <entry name="serial">ec2b88a5-6571-4f46-a07d-47ccfc1761e4</entry>
Oct 16 11:40:43 user nova-compute[74683]:       <entry name="uuid">ec2b88a5-6571-4f46-a07d-47ccfc1761e4</entry>
Oct 16 11:40:43 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:40:43 user nova-compute[74683]:     </system>
Oct 16 11:40:43 user nova-compute[74683]:   </sysinfo>
Oct 16 11:40:43 user nova-compute[74683]:   <os>
Oct 16 11:40:43 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:40:43 user nova-compute[74683]:     <boot dev="hd"/>
Oct 16 11:40:43 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:40:43 user nova-compute[74683]:   </os>
Oct 16 11:40:43 user nova-compute[74683]:   <features>
Oct 16 11:40:43 user nova-compute[74683]:     <acpi/>
Oct 16 11:40:43 user nova-compute[74683]:     <apic/>
Oct 16 11:40:43 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:40:43 user nova-compute[74683]:   </features>
Oct 16 11:40:43 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:40:43 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:40:43 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:40:43 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:40:43 user nova-compute[74683]:   </clock>
Oct 16 11:40:43 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:40:43 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:40:43 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:40:43 user nova-compute[74683]:   </cpu>
Oct 16 11:40:43 user nova-compute[74683]:   <devices>
Oct 16 11:40:43 user nova-compute[74683]:     <disk type="file" device="disk">
Oct 16 11:40:43 user nova-compute[74683]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 11:40:43 user nova-compute[74683]:       <source file="/opt/stack/data/nova/instances/ec2b88a5-6571-4f46-a07d-47ccfc1761e4/disk"/>
Oct 16 11:40:43 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:40:43 user nova-compute[74683]:     </disk>
Oct 16 11:40:43 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:40:43 user nova-compute[74683]:       <mac address="fa:16:3e:f5:74:eb"/>
Oct 16 11:40:43 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:40:43 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:40:43 user nova-compute[74683]:       <target dev="tap75e552bb-fe"/>
Oct 16 11:40:43 user nova-compute[74683]:     </interface>
Oct 16 11:40:43 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:40:43 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/ec2b88a5-6571-4f46-a07d-47ccfc1761e4/console.log" append="off"/>
Oct 16 11:40:43 user nova-compute[74683]:     </serial>
Oct 16 11:40:43 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:40:43 user nova-compute[74683]:     <video>
Oct 16 11:40:43 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:40:43 user nova-compute[74683]:     </video>
Oct 16 11:40:43 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:40:43 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:40:43 user nova-compute[74683]:     </rng>
Oct 16 11:40:43 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:40:43 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:40:43 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:40:43 user nova-compute[74683]:     </memballoon>
Oct 16 11:40:43 user nova-compute[74683]:   </devices>
Oct 16 11:40:43 user nova-compute[74683]: </domain>
Oct 16 11:40:43 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:40:43 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:40:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2110881689',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2110881689',id=45,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDrHmOsUhrm4YYKYARdlKrqlcDFGMaTykPh+zb4tGBwYVOfh9pZUyKRTzLOgTUyJT2LVaX7B+7+kT/t6ev3xOPaVzmYiORuHL6ffe3eYJ1lXFNVKMGK5E0k7O/PLikdAqQ==',key_name='tempest-keypair-127654640',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='622d2c7c33914a068b448c447db50b3c',ramdisk_id='',reservation_id='r-3kki01l8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-291825158',owner_user_name='tempest-AttachVolumeShelveTestJSON-291825158-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:40:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11130271beb44b368f9eb55bd4946cbc',uuid=ec2b88a5-6571-4f46-a07d-47ccfc1761e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75e552bb-fec2-47bd-adda-d562f27f8a36", "address": "fa:16:3e:f5:74:eb", "network": {"id": "2ea750a5-8511-4e40-b149-062e10e0096c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-563467594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d2c7c33914a068b448c447db50b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75e552bb-fe", "ovs_interfaceid": "75e552bb-fec2-47bd-adda-d562f27f8a36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:40:43 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Converting VIF {"id": "75e552bb-fec2-47bd-adda-d562f27f8a36", "address": "fa:16:3e:f5:74:eb", "network": {"id": "2ea750a5-8511-4e40-b149-062e10e0096c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-563467594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d2c7c33914a068b448c447db50b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75e552bb-fe", "ovs_interfaceid": "75e552bb-fec2-47bd-adda-d562f27f8a36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:40:43 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:74:eb,bridge_name='br-int',has_traffic_filtering=True,id=75e552bb-fec2-47bd-adda-d562f27f8a36,network=Network(2ea750a5-8511-4e40-b149-062e10e0096c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75e552bb-fe') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:40:43 user nova-compute[74683]: DEBUG os_vif [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:74:eb,bridge_name='br-int',has_traffic_filtering=True,id=75e552bb-fec2-47bd-adda-d562f27f8a36,network=Network(2ea750a5-8511-4e40-b149-062e10e0096c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75e552bb-fe') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:40:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:40:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:40:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:40:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:40:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5f53b278-eb00-5997-96ab-23db6c815e00', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:40:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:40:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:40:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:40:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap75e552bb-fe, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:40:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap75e552bb-fe, col_values=(('qos', UUID('e87ca5c3-2c37-48a9-9a77-e8d45b5c3490')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:40:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap75e552bb-fe, col_values=(('external_ids', {'iface-id': '75e552bb-fec2-47bd-adda-d562f27f8a36', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:74:eb', 'vm-uuid': 'ec2b88a5-6571-4f46-a07d-47ccfc1761e4'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:40:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:40:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:40:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:40:43 user nova-compute[74683]: INFO os_vif [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:74:eb,bridge_name='br-int',has_traffic_filtering=True,id=75e552bb-fec2-47bd-adda-d562f27f8a36,network=Network(2ea750a5-8511-4e40-b149-062e10e0096c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75e552bb-fe')
Oct 16 11:40:43 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:40:43 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] No VIF found with MAC fa:16:3e:f5:74:eb, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:40:43 user nova-compute[74683]: DEBUG nova.network.neutron [req-be1521ae-a541-4823-b387-e467737bbcf5 req-2fd4661e-7e96-4bf3-9502-a9dc5f9a96b2 service nova] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Updated VIF entry in instance network info cache for port 75e552bb-fec2-47bd-adda-d562f27f8a36. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:40:43 user nova-compute[74683]: DEBUG nova.network.neutron [req-be1521ae-a541-4823-b387-e467737bbcf5 req-2fd4661e-7e96-4bf3-9502-a9dc5f9a96b2 service nova] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Updating instance_info_cache with network_info: [{"id": "75e552bb-fec2-47bd-adda-d562f27f8a36", "address": "fa:16:3e:f5:74:eb", "network": {"id": "2ea750a5-8511-4e40-b149-062e10e0096c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-563467594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d2c7c33914a068b448c447db50b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75e552bb-fe", "ovs_interfaceid": "75e552bb-fec2-47bd-adda-d562f27f8a36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:40:44 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-be1521ae-a541-4823-b387-e467737bbcf5 req-2fd4661e-7e96-4bf3-9502-a9dc5f9a96b2 service nova] Releasing lock "refresh_cache-ec2b88a5-6571-4f46-a07d-47ccfc1761e4" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:40:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:40:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:40:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:40:45 user nova-compute[74683]: DEBUG nova.compute.manager [req-87616832-3d6b-4e27-9ae6-282108961910 req-03a830c3-3127-4c81-8014-89f6ac075427 service nova] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Received event network-vif-plugged-75e552bb-fec2-47bd-adda-d562f27f8a36 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:40:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-87616832-3d6b-4e27-9ae6-282108961910 req-03a830c3-3127-4c81-8014-89f6ac075427 service nova] Acquiring lock "ec2b88a5-6571-4f46-a07d-47ccfc1761e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:40:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-87616832-3d6b-4e27-9ae6-282108961910 req-03a830c3-3127-4c81-8014-89f6ac075427 service nova] Lock "ec2b88a5-6571-4f46-a07d-47ccfc1761e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:40:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-87616832-3d6b-4e27-9ae6-282108961910 req-03a830c3-3127-4c81-8014-89f6ac075427 service nova] Lock "ec2b88a5-6571-4f46-a07d-47ccfc1761e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:40:45 user nova-compute[74683]: DEBUG nova.compute.manager [req-87616832-3d6b-4e27-9ae6-282108961910 req-03a830c3-3127-4c81-8014-89f6ac075427 service nova] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] No waiting events found dispatching network-vif-plugged-75e552bb-fec2-47bd-adda-d562f27f8a36 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:40:45 user nova-compute[74683]: WARNING nova.compute.manager [req-87616832-3d6b-4e27-9ae6-282108961910 req-03a830c3-3127-4c81-8014-89f6ac075427 service nova] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Received unexpected event network-vif-plugged-75e552bb-fec2-47bd-adda-d562f27f8a36 for instance with vm_state building and task_state spawning.
Oct 16 11:40:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:40:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:40:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Acquiring lock "af8104c2-2ea1-4e66-bf74-08074566111f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:40:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lock "af8104c2-2ea1-4e66-bf74-08074566111f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:40:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:40:45 user nova-compute[74683]: DEBUG nova.compute.manager [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Starting instance... {{(pid=74683) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 11:40:46 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:40:46 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:40:46 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74683) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 11:40:46 user nova-compute[74683]: INFO nova.compute.claims [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Claim successful on node user
Oct 16 11:40:46 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:40:46 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:40:46 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.311s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:40:46 user nova-compute[74683]: DEBUG nova.compute.manager [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Start building networks asynchronously for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 11:40:46 user nova-compute[74683]: DEBUG nova.compute.manager [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Allocating IP information in the background. {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 11:40:46 user nova-compute[74683]: DEBUG nova.network.neutron [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] allocate_for_instance() {{(pid=74683) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 11:40:46 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 11:40:46 user nova-compute[74683]: DEBUG nova.compute.manager [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Start building block device mappings for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 11:40:46 user nova-compute[74683]: DEBUG nova.policy [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '395a6fc9aa93428c95593000c9caeb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d9daeec42a4e73a8ff2c0137f91128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74683) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 11:40:46 user nova-compute[74683]: DEBUG nova.compute.manager [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Start spawning the instance on the hypervisor. {{(pid=74683) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 11:40:46 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Creating instance directory {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 11:40:46 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Creating image(s)
Oct 16 11:40:46 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Acquiring lock "/opt/stack/data/nova/instances/af8104c2-2ea1-4e66-bf74-08074566111f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:40:46 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lock "/opt/stack/data/nova/instances/af8104c2-2ea1-4e66-bf74-08074566111f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:40:46 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lock "/opt/stack/data/nova/instances/af8104c2-2ea1-4e66-bf74-08074566111f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:40:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:40:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.174s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:40:46 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Acquiring lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:40:46 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:40:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:40:47 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.196s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:40:47 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/af8104c2-2ea1-4e66-bf74-08074566111f/disk 1073741824 {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:40:47 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/af8104c2-2ea1-4e66-bf74-08074566111f/disk 1073741824" returned: 0 in 0.067s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:40:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:40:47 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:40:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-a8926748-74cb-4740-8a7a-aafa18aea71a tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Acquiring lock "8d94b70c-4056-4c58-9df4-73684e0d164f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:40:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-a8926748-74cb-4740-8a7a-aafa18aea71a tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lock "8d94b70c-4056-4c58-9df4-73684e0d164f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:40:47 user nova-compute[74683]: DEBUG nova.objects.instance [None req-a8926748-74cb-4740-8a7a-aafa18aea71a tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lazy-loading 'flavor' on Instance uuid 8d94b70c-4056-4c58-9df4-73684e0d164f {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:40:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-a8926748-74cb-4740-8a7a-aafa18aea71a tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lock "8d94b70c-4056-4c58-9df4-73684e0d164f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:40:47 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.210s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:40:47 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Checking if we can resize image /opt/stack/data/nova/instances/af8104c2-2ea1-4e66-bf74-08074566111f/disk. size=1073741824 {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 11:40:47 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8104c2-2ea1-4e66-bf74-08074566111f/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:40:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:40:47 user nova-compute[74683]: DEBUG nova.network.neutron [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Successfully created port: 0fd9270c-aa16-42b8-98e8-cacb699cee50 {{(pid=74683) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 11:40:47 user nova-compute[74683]: DEBUG nova.compute.manager [req-a02e7f91-6e26-4f8e-9b89-f587490098cf req-612d9143-766c-43fc-8ea5-bb0da825aaf9 service nova] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Received event network-vif-plugged-75e552bb-fec2-47bd-adda-d562f27f8a36 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:40:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a02e7f91-6e26-4f8e-9b89-f587490098cf req-612d9143-766c-43fc-8ea5-bb0da825aaf9 service nova] Acquiring lock "ec2b88a5-6571-4f46-a07d-47ccfc1761e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:40:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a02e7f91-6e26-4f8e-9b89-f587490098cf req-612d9143-766c-43fc-8ea5-bb0da825aaf9 service nova] Lock "ec2b88a5-6571-4f46-a07d-47ccfc1761e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:40:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a02e7f91-6e26-4f8e-9b89-f587490098cf req-612d9143-766c-43fc-8ea5-bb0da825aaf9 service nova] Lock "ec2b88a5-6571-4f46-a07d-47ccfc1761e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:40:47 user nova-compute[74683]: DEBUG nova.compute.manager [req-a02e7f91-6e26-4f8e-9b89-f587490098cf req-612d9143-766c-43fc-8ea5-bb0da825aaf9 service nova] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] No waiting events found dispatching network-vif-plugged-75e552bb-fec2-47bd-adda-d562f27f8a36 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:40:47 user nova-compute[74683]: WARNING nova.compute.manager [req-a02e7f91-6e26-4f8e-9b89-f587490098cf req-612d9143-766c-43fc-8ea5-bb0da825aaf9 service nova] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Received unexpected event network-vif-plugged-75e552bb-fec2-47bd-adda-d562f27f8a36 for instance with vm_state building and task_state spawning.
Oct 16 11:40:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-a8926748-74cb-4740-8a7a-aafa18aea71a tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Acquiring lock "8d94b70c-4056-4c58-9df4-73684e0d164f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:40:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-a8926748-74cb-4740-8a7a-aafa18aea71a tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lock "8d94b70c-4056-4c58-9df4-73684e0d164f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:40:47 user nova-compute[74683]: INFO nova.compute.manager [None req-a8926748-74cb-4740-8a7a-aafa18aea71a tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Attaching volume baad223c-0efc-463f-a718-0fa8bfb0016d to /dev/vdb
Oct 16 11:40:47 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8104c2-2ea1-4e66-bf74-08074566111f/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:40:47 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Cannot resize image /opt/stack/data/nova/instances/af8104c2-2ea1-4e66-bf74-08074566111f/disk to a smaller size. {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 11:40:47 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Created local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 11:40:47 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Ensure instance console log exists: /opt/stack/data/nova/instances/af8104c2-2ea1-4e66-bf74-08074566111f/console.log {{(pid=74683) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 11:40:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:40:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:40:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:40:47 user nova-compute[74683]: DEBUG nova.compute.manager [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Instance event wait completed in 0 seconds for  {{(pid=74683) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 11:40:47 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Guest created on hypervisor {{(pid=74683) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 11:40:47 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Instance spawned successfully.
Oct 16 11:40:47 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 11:40:47 user nova-compute[74683]: DEBUG os_brick.utils [None req-a8926748-74cb-4740-8a7a-aafa18aea71a tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:40:47 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:40:47 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:40:47 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81e2626-78c8-40c1-bad8-996587c81740]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:70b9d336ab7d\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:40:47 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:40:47 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Found default for hw_cdrom_bus of ide {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:40:47 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Found default for hw_disk_bus of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:40:47 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Found default for hw_input_bus of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:40:47 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Found default for hw_pointer_model of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:40:47 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Found default for hw_video_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:40:47 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Found default for hw_vif_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:40:47 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:40:47 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f646e273-27ba-4e62-bf8d-5c156bd6a914]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:40:47 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:40:47 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:40:47 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d239997-227b-43ea-94d8-56a3e1ec33fc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:40:47 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[af28c1ad-de53-4773-9794-9e056c591ff3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:40:47 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-a8926748-74cb-4740-8a7a-aafa18aea71a tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Running cmd (subprocess): nvme version {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:40:47 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-a8926748-74cb-4740-8a7a-aafa18aea71a tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] 'nvme version' failed. Not Retrying. {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:40:47 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a8926748-74cb-4740-8a7a-aafa18aea71a tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] nvme not present on system {{(pid=74683) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 11:40:47 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:40:47 user nova-compute[74683]: INFO nova.compute.manager [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Took 5.79 seconds to spawn the instance on the hypervisor.
Oct 16 11:40:47 user nova-compute[74683]: DEBUG nova.compute.manager [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:40:47 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:40:47 user nova-compute[74683]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 11:40:47 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7bb090-5e37-448b-8c0d-c8709c02a7ad]: (4, '') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:40:47 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-a8926748-74cb-4740-8a7a-aafa18aea71a tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74683) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 11:40:47 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-a8926748-74cb-4740-8a7a-aafa18aea71a tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 11:40:47 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-a8926748-74cb-4740-8a7a-aafa18aea71a tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] LIGHTOS: no hostnqn found. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 11:40:47 user nova-compute[74683]: DEBUG os_brick.utils [None req-a8926748-74cb-4740-8a7a-aafa18aea71a tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:70b9d336ab7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:40:47 user nova-compute[74683]: DEBUG nova.virt.block_device [None req-a8926748-74cb-4740-8a7a-aafa18aea71a tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Updating existing volume attachment record: 2549d665-fee5-44f2-b720-43b0d5513b63 {{(pid=74683) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 11:40:47 user nova-compute[74683]: INFO nova.compute.manager [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Took 6.67 seconds to build instance.
Oct 16 11:40:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-574124e2-e1a2-4e65-8bf3-ab792ec75b67 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "ec2b88a5-6571-4f46-a07d-47ccfc1761e4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.881s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:40:48 user nova-compute[74683]: DEBUG nova.network.neutron [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Successfully updated port: 0fd9270c-aa16-42b8-98e8-cacb699cee50 {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:40:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Acquiring lock "refresh_cache-af8104c2-2ea1-4e66-bf74-08074566111f" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:40:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Acquired lock "refresh_cache-af8104c2-2ea1-4e66-bf74-08074566111f" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:40:48 user nova-compute[74683]: DEBUG nova.network.neutron [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:40:48 user nova-compute[74683]: DEBUG nova.compute.manager [req-e18bddb8-e93d-4126-88cc-65f1d2d85d18 req-da891731-4afd-45c4-9396-278c489a3596 service nova] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Received event network-changed-0fd9270c-aa16-42b8-98e8-cacb699cee50 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:40:48 user nova-compute[74683]: DEBUG nova.compute.manager [req-e18bddb8-e93d-4126-88cc-65f1d2d85d18 req-da891731-4afd-45c4-9396-278c489a3596 service nova] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Refreshing instance network info cache due to event network-changed-0fd9270c-aa16-42b8-98e8-cacb699cee50. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:40:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e18bddb8-e93d-4126-88cc-65f1d2d85d18 req-da891731-4afd-45c4-9396-278c489a3596 service nova] Acquiring lock "refresh_cache-af8104c2-2ea1-4e66-bf74-08074566111f" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:40:48 user nova-compute[74683]: DEBUG nova.network.neutron [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:40:48 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:40:48 user nova-compute[74683]: DEBUG nova.network.neutron [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Updating instance_info_cache with network_info: [{"id": "0fd9270c-aa16-42b8-98e8-cacb699cee50", "address": "fa:16:3e:a5:05:18", "network": {"id": "3f02f591-1fa0-477f-8730-b41445fd41b4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1932917211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d9daeec42a4e73a8ff2c0137f91128", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd9270c-aa", "ovs_interfaceid": "0fd9270c-aa16-42b8-98e8-cacb699cee50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:40:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Releasing lock "refresh_cache-af8104c2-2ea1-4e66-bf74-08074566111f" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:40:48 user nova-compute[74683]: DEBUG nova.compute.manager [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Instance network_info: |[{"id": "0fd9270c-aa16-42b8-98e8-cacb699cee50", "address": "fa:16:3e:a5:05:18", "network": {"id": "3f02f591-1fa0-477f-8730-b41445fd41b4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1932917211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d9daeec42a4e73a8ff2c0137f91128", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd9270c-aa", "ovs_interfaceid": "0fd9270c-aa16-42b8-98e8-cacb699cee50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 11:40:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e18bddb8-e93d-4126-88cc-65f1d2d85d18 req-da891731-4afd-45c4-9396-278c489a3596 service nova] Acquired lock "refresh_cache-af8104c2-2ea1-4e66-bf74-08074566111f" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:40:48 user nova-compute[74683]: DEBUG nova.network.neutron [req-e18bddb8-e93d-4126-88cc-65f1d2d85d18 req-da891731-4afd-45c4-9396-278c489a3596 service nova] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Refreshing network info cache for port 0fd9270c-aa16-42b8-98e8-cacb699cee50 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:40:48 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Start _get_guest_xml network_info=[{"id": "0fd9270c-aa16-42b8-98e8-cacb699cee50", "address": "fa:16:3e:a5:05:18", "network": {"id": "3f02f591-1fa0-477f-8730-b41445fd41b4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1932917211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d9daeec42a4e73a8ff2c0137f91128", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd9270c-aa", "ovs_interfaceid": "0fd9270c-aa16-42b8-98e8-cacb699cee50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:40:48 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:40:48 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:40:48 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:40:48 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:40:48 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:40:48 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:40:48 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:40:48 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:40:48 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:40:48 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:40:48 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:40:48 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:40:48 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:40:48 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:40:48 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:40:48 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:40:48 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:40:48 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:40:48 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:40:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-142132556',display_name='tempest-VolumesSnapshotTestJSON-instance-142132556',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-142132556',id=46,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIf2BaisNiOQkbtMcyprEiD6k0IWVmsRGgVJDodEzVGZYdJ2amYVYQ/W518wUH/AxrP3tdeOACMgOn9n760KwgwdyAuvbmOaiM/YsOQZ05oydYGQk0f5Dngy0zM30xk+ag==',key_name='tempest-keypair-1211521238',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7d9daeec42a4e73a8ff2c0137f91128',ramdisk_id='',reservation_id='r-kbhry0h0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-919495777',owner_user_name='tempest-VolumesSnapshotTestJSON-919495777-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:40:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='395a6fc9aa93428c95593000c9caeb81',uuid=af8104c2-2ea1-4e66-bf74-08074566111f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0fd9270c-aa16-42b8-98e8-cacb699cee50", "address": "fa:16:3e:a5:05:18", "network": {"id": "3f02f591-1fa0-477f-8730-b41445fd41b4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1932917211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d9daeec42a4e73a8ff2c0137f91128", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd9270c-aa", "ovs_interfaceid": "0fd9270c-aa16-42b8-98e8-cacb699cee50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:40:48 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Converting VIF {"id": "0fd9270c-aa16-42b8-98e8-cacb699cee50", "address": "fa:16:3e:a5:05:18", "network": {"id": "3f02f591-1fa0-477f-8730-b41445fd41b4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1932917211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d9daeec42a4e73a8ff2c0137f91128", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd9270c-aa", "ovs_interfaceid": "0fd9270c-aa16-42b8-98e8-cacb699cee50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:40:48 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:05:18,bridge_name='br-int',has_traffic_filtering=True,id=0fd9270c-aa16-42b8-98e8-cacb699cee50,network=Network(3f02f591-1fa0-477f-8730-b41445fd41b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fd9270c-aa') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:40:48 user nova-compute[74683]: DEBUG nova.objects.instance [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lazy-loading 'pci_devices' on Instance uuid af8104c2-2ea1-4e66-bf74-08074566111f {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:40:48 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:40:48 user nova-compute[74683]:   <uuid>af8104c2-2ea1-4e66-bf74-08074566111f</uuid>
Oct 16 11:40:48 user nova-compute[74683]:   <name>instance-0000002e</name>
Oct 16 11:40:48 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:40:48 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:40:48 user nova-compute[74683]:   <metadata>
Oct 16 11:40:48 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:40:48 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:40:48 user nova-compute[74683]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-142132556</nova:name>
Oct 16 11:40:48 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:40:48</nova:creationTime>
Oct 16 11:40:48 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:40:48 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:40:48 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:40:48 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:40:48 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:40:48 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:40:48 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:40:48 user nova-compute[74683]:       <nova:owner>
Oct 16 11:40:48 user nova-compute[74683]:         <nova:user uuid="395a6fc9aa93428c95593000c9caeb81">tempest-VolumesSnapshotTestJSON-919495777-project-member</nova:user>
Oct 16 11:40:48 user nova-compute[74683]:         <nova:project uuid="b7d9daeec42a4e73a8ff2c0137f91128">tempest-VolumesSnapshotTestJSON-919495777</nova:project>
Oct 16 11:40:48 user nova-compute[74683]:       </nova:owner>
Oct 16 11:40:48 user nova-compute[74683]:       <nova:root type="image" uuid="0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f"/>
Oct 16 11:40:48 user nova-compute[74683]:       <nova:ports>
Oct 16 11:40:48 user nova-compute[74683]:         <nova:port uuid="0fd9270c-aa16-42b8-98e8-cacb699cee50">
Oct 16 11:40:48 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 16 11:40:48 user nova-compute[74683]:         </nova:port>
Oct 16 11:40:48 user nova-compute[74683]:       </nova:ports>
Oct 16 11:40:48 user nova-compute[74683]:     </nova:instance>
Oct 16 11:40:48 user nova-compute[74683]:   </metadata>
Oct 16 11:40:48 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:40:48 user nova-compute[74683]:     <system>
Oct 16 11:40:48 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:40:48 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:40:48 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:40:48 user nova-compute[74683]:       <entry name="serial">af8104c2-2ea1-4e66-bf74-08074566111f</entry>
Oct 16 11:40:48 user nova-compute[74683]:       <entry name="uuid">af8104c2-2ea1-4e66-bf74-08074566111f</entry>
Oct 16 11:40:48 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:40:48 user nova-compute[74683]:     </system>
Oct 16 11:40:48 user nova-compute[74683]:   </sysinfo>
Oct 16 11:40:48 user nova-compute[74683]:   <os>
Oct 16 11:40:48 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:40:48 user nova-compute[74683]:     <boot dev="hd"/>
Oct 16 11:40:48 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:40:48 user nova-compute[74683]:   </os>
Oct 16 11:40:48 user nova-compute[74683]:   <features>
Oct 16 11:40:48 user nova-compute[74683]:     <acpi/>
Oct 16 11:40:48 user nova-compute[74683]:     <apic/>
Oct 16 11:40:48 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:40:48 user nova-compute[74683]:   </features>
Oct 16 11:40:48 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:40:48 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:40:48 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:40:48 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:40:48 user nova-compute[74683]:   </clock>
Oct 16 11:40:48 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:40:48 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:40:48 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:40:48 user nova-compute[74683]:   </cpu>
Oct 16 11:40:48 user nova-compute[74683]:   <devices>
Oct 16 11:40:48 user nova-compute[74683]:     <disk type="file" device="disk">
Oct 16 11:40:48 user nova-compute[74683]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 11:40:48 user nova-compute[74683]:       <source file="/opt/stack/data/nova/instances/af8104c2-2ea1-4e66-bf74-08074566111f/disk"/>
Oct 16 11:40:48 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:40:48 user nova-compute[74683]:     </disk>
Oct 16 11:40:48 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:40:48 user nova-compute[74683]:       <mac address="fa:16:3e:a5:05:18"/>
Oct 16 11:40:48 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:40:48 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:40:48 user nova-compute[74683]:       <target dev="tap0fd9270c-aa"/>
Oct 16 11:40:48 user nova-compute[74683]:     </interface>
Oct 16 11:40:48 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:40:48 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/af8104c2-2ea1-4e66-bf74-08074566111f/console.log" append="off"/>
Oct 16 11:40:48 user nova-compute[74683]:     </serial>
Oct 16 11:40:48 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:40:48 user nova-compute[74683]:     <video>
Oct 16 11:40:48 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:40:48 user nova-compute[74683]:     </video>
Oct 16 11:40:48 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:40:48 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:40:48 user nova-compute[74683]:     </rng>
Oct 16 11:40:48 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:40:48 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:40:48 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:40:48 user nova-compute[74683]:     </memballoon>
Oct 16 11:40:48 user nova-compute[74683]:   </devices>
Oct 16 11:40:48 user nova-compute[74683]: </domain>
Oct 16 11:40:48 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:40:48 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:40:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-142132556',display_name='tempest-VolumesSnapshotTestJSON-instance-142132556',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-142132556',id=46,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIf2BaisNiOQkbtMcyprEiD6k0IWVmsRGgVJDodEzVGZYdJ2amYVYQ/W518wUH/AxrP3tdeOACMgOn9n760KwgwdyAuvbmOaiM/YsOQZ05oydYGQk0f5Dngy0zM30xk+ag==',key_name='tempest-keypair-1211521238',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7d9daeec42a4e73a8ff2c0137f91128',ramdisk_id='',reservation_id='r-kbhry0h0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-919495777',owner_user_name='tempest-VolumesSnapshotTestJSON-919495777-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:40:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='395a6fc9aa93428c95593000c9caeb81',uuid=af8104c2-2ea1-4e66-bf74-08074566111f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0fd9270c-aa16-42b8-98e8-cacb699cee50", "address": "fa:16:3e:a5:05:18", "network": {"id": "3f02f591-1fa0-477f-8730-b41445fd41b4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1932917211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d9daeec42a4e73a8ff2c0137f91128", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd9270c-aa", "ovs_interfaceid": "0fd9270c-aa16-42b8-98e8-cacb699cee50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:40:48 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Converting VIF {"id": "0fd9270c-aa16-42b8-98e8-cacb699cee50", "address": "fa:16:3e:a5:05:18", "network": {"id": "3f02f591-1fa0-477f-8730-b41445fd41b4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1932917211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d9daeec42a4e73a8ff2c0137f91128", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd9270c-aa", "ovs_interfaceid": "0fd9270c-aa16-42b8-98e8-cacb699cee50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:40:48 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:05:18,bridge_name='br-int',has_traffic_filtering=True,id=0fd9270c-aa16-42b8-98e8-cacb699cee50,network=Network(3f02f591-1fa0-477f-8730-b41445fd41b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fd9270c-aa') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:40:48 user nova-compute[74683]: DEBUG os_vif [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:05:18,bridge_name='br-int',has_traffic_filtering=True,id=0fd9270c-aa16-42b8-98e8-cacb699cee50,network=Network(3f02f591-1fa0-477f-8730-b41445fd41b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fd9270c-aa') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:40:48 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:40:48 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:40:48 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:40:48 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:40:48 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '25bcacda-4d5f-5c2f-967c-edd7f2712a5e', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:40:48 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:40:48 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:40:48 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:40:48 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0fd9270c-aa, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:40:48 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0fd9270c-aa, col_values=(('qos', UUID('972b965d-7e77-4258-8059-dba72b8080c4')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:40:48 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0fd9270c-aa, col_values=(('external_ids', {'iface-id': '0fd9270c-aa16-42b8-98e8-cacb699cee50', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:05:18', 'vm-uuid': 'af8104c2-2ea1-4e66-bf74-08074566111f'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:40:48 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:40:48 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:40:49 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:40:49 user nova-compute[74683]: INFO os_vif [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:05:18,bridge_name='br-int',has_traffic_filtering=True,id=0fd9270c-aa16-42b8-98e8-cacb699cee50,network=Network(3f02f591-1fa0-477f-8730-b41445fd41b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fd9270c-aa')
Oct 16 11:40:49 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:40:49 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] No VIF found with MAC fa:16:3e:a5:05:18, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:40:49 user nova-compute[74683]: DEBUG nova.network.neutron [req-e18bddb8-e93d-4126-88cc-65f1d2d85d18 req-da891731-4afd-45c4-9396-278c489a3596 service nova] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Updated VIF entry in instance network info cache for port 0fd9270c-aa16-42b8-98e8-cacb699cee50. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:40:49 user nova-compute[74683]: DEBUG nova.network.neutron [req-e18bddb8-e93d-4126-88cc-65f1d2d85d18 req-da891731-4afd-45c4-9396-278c489a3596 service nova] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Updating instance_info_cache with network_info: [{"id": "0fd9270c-aa16-42b8-98e8-cacb699cee50", "address": "fa:16:3e:a5:05:18", "network": {"id": "3f02f591-1fa0-477f-8730-b41445fd41b4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1932917211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d9daeec42a4e73a8ff2c0137f91128", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd9270c-aa", "ovs_interfaceid": "0fd9270c-aa16-42b8-98e8-cacb699cee50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:40:49 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e18bddb8-e93d-4126-88cc-65f1d2d85d18 req-da891731-4afd-45c4-9396-278c489a3596 service nova] Releasing lock "refresh_cache-af8104c2-2ea1-4e66-bf74-08074566111f" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:40:50 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:40:50 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:40:50 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:40:50 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:40:50 user nova-compute[74683]: DEBUG nova.compute.manager [req-83003031-341a-4fa7-932a-9fff441aa960 req-619575ec-94de-42b0-8544-595894c3e6e4 service nova] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Received event network-vif-plugged-0fd9270c-aa16-42b8-98e8-cacb699cee50 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:40:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-83003031-341a-4fa7-932a-9fff441aa960 req-619575ec-94de-42b0-8544-595894c3e6e4 service nova] Acquiring lock "af8104c2-2ea1-4e66-bf74-08074566111f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:40:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-83003031-341a-4fa7-932a-9fff441aa960 req-619575ec-94de-42b0-8544-595894c3e6e4 service nova] Lock "af8104c2-2ea1-4e66-bf74-08074566111f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:40:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-83003031-341a-4fa7-932a-9fff441aa960 req-619575ec-94de-42b0-8544-595894c3e6e4 service nova] Lock "af8104c2-2ea1-4e66-bf74-08074566111f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:40:50 user nova-compute[74683]: DEBUG nova.compute.manager [req-83003031-341a-4fa7-932a-9fff441aa960 req-619575ec-94de-42b0-8544-595894c3e6e4 service nova] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] No waiting events found dispatching network-vif-plugged-0fd9270c-aa16-42b8-98e8-cacb699cee50 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:40:50 user nova-compute[74683]: WARNING nova.compute.manager [req-83003031-341a-4fa7-932a-9fff441aa960 req-619575ec-94de-42b0-8544-595894c3e6e4 service nova] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Received unexpected event network-vif-plugged-0fd9270c-aa16-42b8-98e8-cacb699cee50 for instance with vm_state building and task_state spawning.
Oct 16 11:40:51 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:40:51 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:40:51 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:40:51 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:40:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:40:52 user nova-compute[74683]: DEBUG nova.compute.manager [req-43c2fff8-0e38-4f5a-9907-ec51be1dcca2 req-4e647a32-430c-40e6-8f57-ac48135bfb11 service nova] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Received event network-vif-plugged-0fd9270c-aa16-42b8-98e8-cacb699cee50 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:40:52 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-43c2fff8-0e38-4f5a-9907-ec51be1dcca2 req-4e647a32-430c-40e6-8f57-ac48135bfb11 service nova] Acquiring lock "af8104c2-2ea1-4e66-bf74-08074566111f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:40:52 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-43c2fff8-0e38-4f5a-9907-ec51be1dcca2 req-4e647a32-430c-40e6-8f57-ac48135bfb11 service nova] Lock "af8104c2-2ea1-4e66-bf74-08074566111f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:40:52 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-43c2fff8-0e38-4f5a-9907-ec51be1dcca2 req-4e647a32-430c-40e6-8f57-ac48135bfb11 service nova] Lock "af8104c2-2ea1-4e66-bf74-08074566111f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:40:52 user nova-compute[74683]: DEBUG nova.compute.manager [req-43c2fff8-0e38-4f5a-9907-ec51be1dcca2 req-4e647a32-430c-40e6-8f57-ac48135bfb11 service nova] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] No waiting events found dispatching network-vif-plugged-0fd9270c-aa16-42b8-98e8-cacb699cee50 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:40:52 user nova-compute[74683]: WARNING nova.compute.manager [req-43c2fff8-0e38-4f5a-9907-ec51be1dcca2 req-4e647a32-430c-40e6-8f57-ac48135bfb11 service nova] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Received unexpected event network-vif-plugged-0fd9270c-aa16-42b8-98e8-cacb699cee50 for instance with vm_state building and task_state spawning.
Oct 16 11:40:53 user nova-compute[74683]: DEBUG nova.compute.manager [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Instance event wait completed in 0 seconds for  {{(pid=74683) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 11:40:53 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Guest created on hypervisor {{(pid=74683) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 11:40:53 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Instance spawned successfully.
Oct 16 11:40:53 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 11:40:53 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Found default for hw_cdrom_bus of ide {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:40:53 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Found default for hw_disk_bus of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:40:53 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Found default for hw_input_bus of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:40:53 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Found default for hw_pointer_model of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:40:53 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Found default for hw_video_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:40:53 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Found default for hw_vif_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:40:53 user nova-compute[74683]: INFO nova.compute.manager [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Took 6.82 seconds to spawn the instance on the hypervisor.
Oct 16 11:40:53 user nova-compute[74683]: DEBUG nova.compute.manager [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:40:53 user nova-compute[74683]: INFO nova.compute.manager [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Took 7.52 seconds to build instance.
Oct 16 11:40:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-d6ab19cc-aa47-4921-a536-9a562a6de941 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lock "af8104c2-2ea1-4e66-bf74-08074566111f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.681s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:40:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-77b26d42-2590-431b-b5fe-0ba5951163fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Acquiring lock "1986f9b5-30fb-4290-802d-ee699a19b608" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:40:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-77b26d42-2590-431b-b5fe-0ba5951163fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "1986f9b5-30fb-4290-802d-ee699a19b608" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:40:53 user nova-compute[74683]: DEBUG nova.objects.instance [None req-77b26d42-2590-431b-b5fe-0ba5951163fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lazy-loading 'flavor' on Instance uuid 1986f9b5-30fb-4290-802d-ee699a19b608 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:40:53 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:40:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-77b26d42-2590-431b-b5fe-0ba5951163fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "1986f9b5-30fb-4290-802d-ee699a19b608" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:40:54 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-77b26d42-2590-431b-b5fe-0ba5951163fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Acquiring lock "1986f9b5-30fb-4290-802d-ee699a19b608" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:40:54 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-77b26d42-2590-431b-b5fe-0ba5951163fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "1986f9b5-30fb-4290-802d-ee699a19b608" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:40:54 user nova-compute[74683]: INFO nova.compute.manager [None req-77b26d42-2590-431b-b5fe-0ba5951163fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Attaching volume 322c0976-a7e3-40b7-8d70-4ed65eb496f0 to /dev/vdb
Oct 16 11:40:54 user nova-compute[74683]: DEBUG os_brick.utils [None req-77b26d42-2590-431b-b5fe-0ba5951163fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:40:54 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:40:54 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:40:54 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66b2d63-9654-4e4f-9321-524349a46e94]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:70b9d336ab7d\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:40:54 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:40:54 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:40:54 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[207017dc-3c2c-4285-b4be-90a78c9aa08e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:40:54 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:40:54 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:40:54 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[56dda3b0-a90a-4fee-beb5-ccb3c4ebe69c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:40:54 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2f78f7-dc72-4656-a8b3-042fc6a2c8d1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:40:54 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-77b26d42-2590-431b-b5fe-0ba5951163fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Running cmd (subprocess): nvme version {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:40:54 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-77b26d42-2590-431b-b5fe-0ba5951163fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] 'nvme version' failed. Not Retrying. {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:40:54 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.nvmeof [None req-77b26d42-2590-431b-b5fe-0ba5951163fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] nvme not present on system {{(pid=74683) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 11:40:54 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:40:54 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:40:54 user nova-compute[74683]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 11:40:54 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5064e1a-9154-45e3-864f-3c061c11021e]: (4, '') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:40:54 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-77b26d42-2590-431b-b5fe-0ba5951163fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74683) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 11:40:54 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-77b26d42-2590-431b-b5fe-0ba5951163fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 11:40:54 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-77b26d42-2590-431b-b5fe-0ba5951163fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] LIGHTOS: no hostnqn found. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 11:40:54 user nova-compute[74683]: DEBUG os_brick.utils [None req-77b26d42-2590-431b-b5fe-0ba5951163fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:70b9d336ab7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:40:54 user nova-compute[74683]: DEBUG nova.virt.block_device [None req-77b26d42-2590-431b-b5fe-0ba5951163fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Updating existing volume attachment record: 23f27f4d-e50d-4f6c-9b15-ca3870559afb {{(pid=74683) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 11:40:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:40:58 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:41:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:41:03 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:41:05 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8926748-74cb-4740-8a7a-aafa18aea71a tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Calling os-brick to attach iSCSI Volume {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 11:41:05 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8926748-74cb-4740-8a7a-aafa18aea71a tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:baad223c-0efc-463f-a718-0fa8bfb0016d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pnAQYqid', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:41:05 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-a8926748-74cb-4740-8a7a-aafa18aea71a tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:41:05 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-a8926748-74cb-4740-8a7a-aafa18aea71a tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:41:05 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-a8926748-74cb-4740-8a7a-aafa18aea71a tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:41:05 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-a8926748-74cb-4740-8a7a-aafa18aea71a tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:41:05 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-a8926748-74cb-4740-8a7a-aafa18aea71a tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:baad223c-0efc-463f-a718-0fa8bfb0016d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:41:05 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-a8926748-74cb-4740-8a7a-aafa18aea71a tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:baad223c-0efc-463f-a718-0fa8bfb0016d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:41:05 user nova-compute[74683]: INFO os_brick.initiator.connectors.iscsi [None req-a8926748-74cb-4740-8a7a-aafa18aea71a tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 11:41:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baad223c-0efc-463f-a718-0fa8bfb0016d -p 172.16.0.220:3260 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baad223c-0efc-463f-a718-0fa8bfb0016d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:05 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[99280bd2-3246-4d1d-9908-520ef0656635]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:41:05 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8926748-74cb-4740-8a7a-aafa18aea71a tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 11:41:05 user nova-compute[74683]:  {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:41:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baad223c-0efc-463f-a718-0fa8bfb0016d -p 172.16.0.220:3260 --interface default --op new {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baad223c-0efc-463f-a718-0fa8bfb0016d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:05 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d4c26c-0aef-475f-8fa6-2a34db185d8d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:baad223c-0efc-463f-a718-0fa8bfb0016d] added\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:41:05 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8926748-74cb-4740-8a7a-aafa18aea71a tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:baad223c-0efc-463f-a718-0fa8bfb0016d] added
Oct 16 11:41:05 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:41:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baad223c-0efc-463f-a718-0fa8bfb0016d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baad223c-0efc-463f-a718-0fa8bfb0016d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:05 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff749acf-ea10-4797-b791-688231aa2649]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:41:05 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8926748-74cb-4740-8a7a-aafa18aea71a tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:41:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baad223c-0efc-463f-a718-0fa8bfb0016d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baad223c-0efc-463f-a718-0fa8bfb0016d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:05 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1bbab17-c212-4e28-bf81-28419e561d68]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:41:05 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8926748-74cb-4740-8a7a-aafa18aea71a tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:41:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baad223c-0efc-463f-a718-0fa8bfb0016d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pnAQYqid {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baad223c-0efc-463f-a718-0fa8bfb0016d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pnAQYqid" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:05 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[871243d0-3cd4-4470-9348-35ea6e81ba6c]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:41:05 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8926748-74cb-4740-8a7a-aafa18aea71a tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pnAQYqid'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:41:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baad223c-0efc-463f-a718-0fa8bfb0016d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baad223c-0efc-463f-a718-0fa8bfb0016d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:05 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9e381d-ec26-4ef1-9190-2a6ee5fea04c]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:41:05 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8926748-74cb-4740-8a7a-aafa18aea71a tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:41:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:05 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1072553-0ddd-43d5-9142-7dc2882d0eec]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:41:05 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8926748-74cb-4740-8a7a-aafa18aea71a tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 16 11:41:05 user nova-compute[74683]:  {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:41:05 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8926748-74cb-4740-8a7a-aafa18aea71a tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 16 11:41:05 user nova-compute[74683]:  {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:41:05 user nova-compute[74683]: WARNING os_brick.initiator.connectors.iscsi [None req-a8926748-74cb-4740-8a7a-aafa18aea71a tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 16 11:41:05 user nova-compute[74683]: 
Oct 16 11:41:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baad223c-0efc-463f-a718-0fa8bfb0016d -p 172.16.0.220:3260 --login {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baad223c-0efc-463f-a718-0fa8bfb0016d -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:05 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d59842-d450-45cf-a418-c1c45246851e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:baad223c-0efc-463f-a718-0fa8bfb0016d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:baad223c-0efc-463f-a718-0fa8bfb0016d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:41:05 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8926748-74cb-4740-8a7a-aafa18aea71a tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:baad223c-0efc-463f-a718-0fa8bfb0016d, portal: 172.16.0.220,3260]
Oct 16 11:41:05 user nova-compute[74683]: Login to [iface: default, target: iqn.2010-10.org.openstack:baad223c-0efc-463f-a718-0fa8bfb0016d, portal: 172.16.0.220,3260] successful.
Oct 16 11:41:05 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:41:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baad223c-0efc-463f-a718-0fa8bfb0016d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baad223c-0efc-463f-a718-0fa8bfb0016d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:05 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7350ca8-4ce6-40fd-9621-098c74b91662]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:41:05 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8926748-74cb-4740-8a7a-aafa18aea71a tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:41:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:05 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[738d2f89-e287-4ce5-b593-3129dea9dfbe]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baad223c-0efc-463f-a718-0fa8bfb0016d (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:41:05 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8926748-74cb-4740-8a7a-aafa18aea71a tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baad223c-0efc-463f-a718-0fa8bfb0016d (non-flash)
Oct 16 11:41:05 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:41:05 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8926748-74cb-4740-8a7a-aafa18aea71a tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baad223c-0efc-463f-a718-0fa8bfb0016d (non-flash)
Oct 16 11:41:05 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:41:05 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-a8926748-74cb-4740-8a7a-aafa18aea71a tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:baad223c-0efc-463f-a718-0fa8bfb0016d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:41:05 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8926748-74cb-4740-8a7a-aafa18aea71a tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Connected to 172.16.0.220:3260 {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 11:41:05 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-a8926748-74cb-4740-8a7a-aafa18aea71a tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=74683) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 11:41:05 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-a8926748-74cb-4740-8a7a-aafa18aea71a tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74683) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 11:41:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:05 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[3965eff2-80e6-4374-a062-b0fe02d87bcd]: (4, ('- - 0', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:41:05 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-a8926748-74cb-4740-8a7a-aafa18aea71a tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:41:05 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8926748-74cb-4740-8a7a-aafa18aea71a tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:baad223c-0efc-463f-a718-0fa8bfb0016d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pnAQYqid', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 11:41:06 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-a8926748-74cb-4740-8a7a-aafa18aea71a tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:41:06 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8926748-74cb-4740-8a7a-aafa18aea71a tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23135343165363539', 'path': '/dev/sdb'} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:41:06 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8926748-74cb-4740-8a7a-aafa18aea71a tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135343165363539', 'path': '/dev/sdb'} {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 11:41:06 user nova-compute[74683]: DEBUG nova.objects.instance [None req-a8926748-74cb-4740-8a7a-aafa18aea71a tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lazy-loading 'flavor' on Instance uuid 8d94b70c-4056-4c58-9df4-73684e0d164f {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:41:06 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-a8926748-74cb-4740-8a7a-aafa18aea71a tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 11:41:06 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:41:06 user nova-compute[74683]:   <source dev="/dev/sdb"/>
Oct 16 11:41:06 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:41:06 user nova-compute[74683]:   <serial>baad223c-0efc-463f-a718-0fa8bfb0016d</serial>
Oct 16 11:41:06 user nova-compute[74683]: </disk>
Oct 16 11:41:06 user nova-compute[74683]:  {{(pid=74683) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 11:41:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:41:07 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-a8926748-74cb-4740-8a7a-aafa18aea71a tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:41:07 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-a8926748-74cb-4740-8a7a-aafa18aea71a tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:41:07 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-a8926748-74cb-4740-8a7a-aafa18aea71a tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] No VIF found with MAC fa:16:3e:67:41:41, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:41:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-a8926748-74cb-4740-8a7a-aafa18aea71a tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lock "8d94b70c-4056-4c58-9df4-73684e0d164f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.035s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:41:09 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:41:09 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-db07e92f-484e-48a0-b82f-b9a0a4940709 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Acquiring lock "8d94b70c-4056-4c58-9df4-73684e0d164f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:41:09 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-db07e92f-484e-48a0-b82f-b9a0a4940709 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lock "8d94b70c-4056-4c58-9df4-73684e0d164f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:41:09 user nova-compute[74683]: INFO nova.compute.manager [None req-db07e92f-484e-48a0-b82f-b9a0a4940709 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Detaching volume baad223c-0efc-463f-a718-0fa8bfb0016d
Oct 16 11:41:09 user nova-compute[74683]: INFO nova.virt.block_device [None req-db07e92f-484e-48a0-b82f-b9a0a4940709 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Attempting to driver detach volume baad223c-0efc-463f-a718-0fa8bfb0016d from mountpoint /dev/vdb
Oct 16 11:41:09 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-db07e92f-484e-48a0-b82f-b9a0a4940709 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Attempting to detach device vdb from instance 8d94b70c-4056-4c58-9df4-73684e0d164f from the persistent domain config. {{(pid=74683) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 11:41:09 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-db07e92f-484e-48a0-b82f-b9a0a4940709 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 11:41:09 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:41:09 user nova-compute[74683]:   <source dev="/dev/sdb"/>
Oct 16 11:41:09 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:41:09 user nova-compute[74683]:   <serial>baad223c-0efc-463f-a718-0fa8bfb0016d</serial>
Oct 16 11:41:09 user nova-compute[74683]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 11:41:09 user nova-compute[74683]: </disk>
Oct 16 11:41:09 user nova-compute[74683]:  {{(pid=74683) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 11:41:09 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-db07e92f-484e-48a0-b82f-b9a0a4940709 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Successfully detached device vdb from instance 8d94b70c-4056-4c58-9df4-73684e0d164f from the persistent domain config.
Oct 16 11:41:09 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-db07e92f-484e-48a0-b82f-b9a0a4940709 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8d94b70c-4056-4c58-9df4-73684e0d164f from the live domain config. {{(pid=74683) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 11:41:09 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-db07e92f-484e-48a0-b82f-b9a0a4940709 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 11:41:09 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:41:09 user nova-compute[74683]:   <source dev="/dev/sdb"/>
Oct 16 11:41:09 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:41:09 user nova-compute[74683]:   <serial>baad223c-0efc-463f-a718-0fa8bfb0016d</serial>
Oct 16 11:41:09 user nova-compute[74683]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 11:41:09 user nova-compute[74683]: </disk>
Oct 16 11:41:09 user nova-compute[74683]:  {{(pid=74683) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 11:41:10 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-db07e92f-484e-48a0-b82f-b9a0a4940709 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8d94b70c-4056-4c58-9df4-73684e0d164f {{(pid=74683) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 11:41:11 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77b26d42-2590-431b-b5fe-0ba5951163fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Calling os-brick to attach iSCSI Volume {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 11:41:11 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b26d42-2590-431b-b5fe-0ba5951163fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RqTMudPb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:41:11 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-77b26d42-2590-431b-b5fe-0ba5951163fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:41:11 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-77b26d42-2590-431b-b5fe-0ba5951163fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:41:11 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-77b26d42-2590-431b-b5fe-0ba5951163fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:41:11 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-77b26d42-2590-431b-b5fe-0ba5951163fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:41:11 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-77b26d42-2590-431b-b5fe-0ba5951163fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:41:11 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-77b26d42-2590-431b-b5fe-0ba5951163fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:41:11 user nova-compute[74683]: INFO os_brick.initiator.connectors.iscsi [None req-77b26d42-2590-431b-b5fe-0ba5951163fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 11:41:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 -p 172.16.0.220:3260 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:11 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[289a526e-e973-4a8a-a504-4941a89b061a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:41:11 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b26d42-2590-431b-b5fe-0ba5951163fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 11:41:11 user nova-compute[74683]:  {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:41:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:11 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00bce9a-d35a-4d39-a275-77c55a04e655]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0] added\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:41:11 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b26d42-2590-431b-b5fe-0ba5951163fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0] added
Oct 16 11:41:11 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:41:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:11 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[844d4651-a220-4af3-8b4f-ffd53a37d9d3]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:41:11 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b26d42-2590-431b-b5fe-0ba5951163fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:41:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:11 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dfb8c63-e3dd-4d74-a042-7b37ccdace49]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:41:11 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b26d42-2590-431b-b5fe-0ba5951163fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:41:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RqTMudPb {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RqTMudPb" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:11 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[b870782d-729f-407c-9eb8-9b65310b4a9d]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:41:11 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b26d42-2590-431b-b5fe-0ba5951163fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RqTMudPb'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:41:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:11 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4276b3-7164-43c9-9adf-06d8e05cda91]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:41:11 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b26d42-2590-431b-b5fe-0ba5951163fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:41:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:11 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d6a29f-bfb3-41db-bf23-9bad42f0e10e]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baad223c-0efc-463f-a718-0fa8bfb0016d (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:41:11 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b26d42-2590-431b-b5fe-0ba5951163fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baad223c-0efc-463f-a718-0fa8bfb0016d (non-flash)
Oct 16 11:41:11 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:41:11 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b26d42-2590-431b-b5fe-0ba5951163fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baad223c-0efc-463f-a718-0fa8bfb0016d (non-flash)
Oct 16 11:41:11 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:41:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 -p 172.16.0.220:3260 --login {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:11 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[06684e9e-b64c-4cf8-99b3-164553b03a35]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:41:11 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b26d42-2590-431b-b5fe-0ba5951163fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0, portal: 172.16.0.220,3260]
Oct 16 11:41:11 user nova-compute[74683]: Login to [iface: default, target: iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0, portal: 172.16.0.220,3260] successful.
Oct 16 11:41:11 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:41:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:11 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a1722a-825d-4ada-a0aa-c7c0f2d37d83]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:41:11 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b26d42-2590-431b-b5fe-0ba5951163fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:41:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:11 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b01519-d1ee-4632-9fdd-2e56c0504d7b]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baad223c-0efc-463f-a718-0fa8bfb0016d (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:41:11 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b26d42-2590-431b-b5fe-0ba5951163fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baad223c-0efc-463f-a718-0fa8bfb0016d (non-flash)
Oct 16 11:41:11 user nova-compute[74683]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 (non-flash)
Oct 16 11:41:11 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:41:11 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b26d42-2590-431b-b5fe-0ba5951163fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baad223c-0efc-463f-a718-0fa8bfb0016d (non-flash)
Oct 16 11:41:11 user nova-compute[74683]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 (non-flash)
Oct 16 11:41:11 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:41:11 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-77b26d42-2590-431b-b5fe-0ba5951163fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:41:11 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b26d42-2590-431b-b5fe-0ba5951163fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Connected to 172.16.0.220:3260 {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 11:41:11 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-77b26d42-2590-431b-b5fe-0ba5951163fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] HCTL ('34', '-', '-', 0) found on session 49 with lun 0 {{(pid=74683) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 11:41:11 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-77b26d42-2590-431b-b5fe-0ba5951163fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74683) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 11:41:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:11 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f856d5-c38c-4830-a899-e9146076f3e4]: (4, ('- - 0', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:41:11 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-77b26d42-2590-431b-b5fe-0ba5951163fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: None {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:41:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:41:12 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-77b26d42-2590-431b-b5fe-0ba5951163fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:41:12 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b26d42-2590-431b-b5fe-0ba5951163fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RqTMudPb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 11:41:12 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-77b26d42-2590-431b-b5fe-0ba5951163fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:41:12 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b26d42-2590-431b-b5fe-0ba5951163fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '23065646334306366', 'path': '/dev/sdc'} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:41:12 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77b26d42-2590-431b-b5fe-0ba5951163fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065646334306366', 'path': '/dev/sdc'} {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 11:41:12 user nova-compute[74683]: DEBUG nova.objects.instance [None req-77b26d42-2590-431b-b5fe-0ba5951163fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lazy-loading 'flavor' on Instance uuid 1986f9b5-30fb-4290-802d-ee699a19b608 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:41:12 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-77b26d42-2590-431b-b5fe-0ba5951163fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 11:41:12 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:41:12 user nova-compute[74683]:   <source dev="/dev/sdc"/>
Oct 16 11:41:12 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:41:12 user nova-compute[74683]:   <serial>322c0976-a7e3-40b7-8d70-4ed65eb496f0</serial>
Oct 16 11:41:12 user nova-compute[74683]: </disk>
Oct 16 11:41:12 user nova-compute[74683]:  {{(pid=74683) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 11:41:12 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-77b26d42-2590-431b-b5fe-0ba5951163fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:41:12 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-77b26d42-2590-431b-b5fe-0ba5951163fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:41:12 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-77b26d42-2590-431b-b5fe-0ba5951163fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] No VIF found with MAC fa:16:3e:c9:39:63, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:41:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-77b26d42-2590-431b-b5fe-0ba5951163fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "1986f9b5-30fb-4290-802d-ee699a19b608" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.896s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:41:14 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:41:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:41:19 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:41:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:41:23 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:41:23 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:41:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:41:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:41:24 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:41:24 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:41:24 user nova-compute[74683]: DEBUG nova.compute.manager [req-5ae9e751-43e0-444c-94b9-631dfa27e72e req-3a76bc84-a496-4699-a583-67cbb80c040d service nova] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Received event network-changed-f6b38471-41ce-443b-8562-bee2b4f64d31 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:41:24 user nova-compute[74683]: DEBUG nova.compute.manager [req-5ae9e751-43e0-444c-94b9-631dfa27e72e req-3a76bc84-a496-4699-a583-67cbb80c040d service nova] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Refreshing instance network info cache due to event network-changed-f6b38471-41ce-443b-8562-bee2b4f64d31. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:41:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-5ae9e751-43e0-444c-94b9-631dfa27e72e req-3a76bc84-a496-4699-a583-67cbb80c040d service nova] Acquiring lock "refresh_cache-1986f9b5-30fb-4290-802d-ee699a19b608" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:41:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-5ae9e751-43e0-444c-94b9-631dfa27e72e req-3a76bc84-a496-4699-a583-67cbb80c040d service nova] Acquired lock "refresh_cache-1986f9b5-30fb-4290-802d-ee699a19b608" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:41:24 user nova-compute[74683]: DEBUG nova.network.neutron [req-5ae9e751-43e0-444c-94b9-631dfa27e72e req-3a76bc84-a496-4699-a583-67cbb80c040d service nova] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Refreshing network info cache for port f6b38471-41ce-443b-8562-bee2b4f64d31 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:41:25 user nova-compute[74683]: DEBUG nova.network.neutron [req-5ae9e751-43e0-444c-94b9-631dfa27e72e req-3a76bc84-a496-4699-a583-67cbb80c040d service nova] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Updated VIF entry in instance network info cache for port f6b38471-41ce-443b-8562-bee2b4f64d31. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:41:25 user nova-compute[74683]: DEBUG nova.network.neutron [req-5ae9e751-43e0-444c-94b9-631dfa27e72e req-3a76bc84-a496-4699-a583-67cbb80c040d service nova] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Updating instance_info_cache with network_info: [{"id": "f6b38471-41ce-443b-8562-bee2b4f64d31", "address": "fa:16:3e:c9:39:63", "network": {"id": "1fa0852d-814a-45ef-80fa-171693e4d02a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-184537544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ce607a3614fc493d33e6ba8ca5807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6b38471-41", "ovs_interfaceid": "f6b38471-41ce-443b-8562-bee2b4f64d31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:41:25 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-5ae9e751-43e0-444c-94b9-631dfa27e72e req-3a76bc84-a496-4699-a583-67cbb80c040d service nova] Releasing lock "refresh_cache-1986f9b5-30fb-4290-802d-ee699a19b608" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:41:25 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:41:26 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:41:26 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Starting heal instance info cache {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 11:41:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "refresh_cache-8d94b70c-4056-4c58-9df4-73684e0d164f" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:41:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquired lock "refresh_cache-8d94b70c-4056-4c58-9df4-73684e0d164f" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:41:26 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Forcefully refreshing network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 11:41:27 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Updating instance_info_cache with network_info: [{"id": "80bcc661-5bbf-4b87-87c3-0b4a7e6aa31b", "address": "fa:16:3e:67:41:41", "network": {"id": "f131c862-9d83-4df6-af88-56d3202105fc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-544805614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12fd84a1f38a41dc8e4ab6c697028d9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80bcc661-5b", "ovs_interfaceid": "80bcc661-5bbf-4b87-87c3-0b4a7e6aa31b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:41:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Releasing lock "refresh_cache-8d94b70c-4056-4c58-9df4-73684e0d164f" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:41:27 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Updated the network info_cache for instance {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 11:41:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:41:27 user nova-compute[74683]: DEBUG nova.compute.manager [req-e40a4576-88b7-4021-90e0-7f1008b1ca52 req-4ae9a8b1-1d14-4903-9aac-616cf403e8d7 service nova] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Received event network-changed-f6b38471-41ce-443b-8562-bee2b4f64d31 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:41:27 user nova-compute[74683]: DEBUG nova.compute.manager [req-e40a4576-88b7-4021-90e0-7f1008b1ca52 req-4ae9a8b1-1d14-4903-9aac-616cf403e8d7 service nova] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Refreshing instance network info cache due to event network-changed-f6b38471-41ce-443b-8562-bee2b4f64d31. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:41:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e40a4576-88b7-4021-90e0-7f1008b1ca52 req-4ae9a8b1-1d14-4903-9aac-616cf403e8d7 service nova] Acquiring lock "refresh_cache-1986f9b5-30fb-4290-802d-ee699a19b608" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:41:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e40a4576-88b7-4021-90e0-7f1008b1ca52 req-4ae9a8b1-1d14-4903-9aac-616cf403e8d7 service nova] Acquired lock "refresh_cache-1986f9b5-30fb-4290-802d-ee699a19b608" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:41:27 user nova-compute[74683]: DEBUG nova.network.neutron [req-e40a4576-88b7-4021-90e0-7f1008b1ca52 req-4ae9a8b1-1d14-4903-9aac-616cf403e8d7 service nova] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Refreshing network info cache for port f6b38471-41ce-443b-8562-bee2b4f64d31 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:41:27 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:41:27 user nova-compute[74683]: DEBUG nova.network.neutron [req-e40a4576-88b7-4021-90e0-7f1008b1ca52 req-4ae9a8b1-1d14-4903-9aac-616cf403e8d7 service nova] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Updated VIF entry in instance network info cache for port f6b38471-41ce-443b-8562-bee2b4f64d31. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:41:27 user nova-compute[74683]: DEBUG nova.network.neutron [req-e40a4576-88b7-4021-90e0-7f1008b1ca52 req-4ae9a8b1-1d14-4903-9aac-616cf403e8d7 service nova] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Updating instance_info_cache with network_info: [{"id": "f6b38471-41ce-443b-8562-bee2b4f64d31", "address": "fa:16:3e:c9:39:63", "network": {"id": "1fa0852d-814a-45ef-80fa-171693e4d02a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-184537544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ce607a3614fc493d33e6ba8ca5807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6b38471-41", "ovs_interfaceid": "f6b38471-41ce-443b-8562-bee2b4f64d31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:41:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e40a4576-88b7-4021-90e0-7f1008b1ca52 req-4ae9a8b1-1d14-4903-9aac-616cf403e8d7 service nova] Releasing lock "refresh_cache-1986f9b5-30fb-4290-802d-ee699a19b608" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:41:28 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:41:28 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74683) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 11:41:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:41:30 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-db07e92f-484e-48a0-b82f-b9a0a4940709 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8d94b70c-4056-4c58-9df4-73684e0d164f is timed out.
Oct 16 11:41:30 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-db07e92f-484e-48a0-b82f-b9a0a4940709 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Successfully detached device vdb from instance 8d94b70c-4056-4c58-9df4-73684e0d164f from the live domain config.
Oct 16 11:41:30 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db07e92f-484e-48a0-b82f-b9a0a4940709 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] calling os-brick to detach iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 11:41:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-db07e92f-484e-48a0-b82f-b9a0a4940709 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, {'target_iqn': 'iqn.2010-10.org.openstack:baad223c-0efc-463f-a718-0fa8bfb0016d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pnAQYqid', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:41:30 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-db07e92f-484e-48a0-b82f-b9a0a4940709 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:41:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-db07e92f-484e-48a0-b82f-b9a0a4940709 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:41:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-db07e92f-484e-48a0-b82f-b9a0a4940709 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:41:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c61440f-e562-4a0d-8fef-769f4dbe2cb5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:baad223c-0efc-463f-a718-0fa8bfb0016d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:41:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-db07e92f-484e-48a0-b82f-b9a0a4940709 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 11:41:30 user nova-compute[74683]: No targets found.
Oct 16 11:41:30 user nova-compute[74683]: iSNS:
Oct 16 11:41:30 user nova-compute[74683]: No targets found.
Oct 16 11:41:30 user nova-compute[74683]: STATIC:
Oct 16 11:41:30 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:baad223c-0efc-463f-a718-0fa8bfb0016d
Oct 16 11:41:30 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:41:30 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:41:30 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0
Oct 16 11:41:30 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:41:30 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:41:30 user nova-compute[74683]: FIRMWARE:
Oct 16 11:41:30 user nova-compute[74683]: No targets found.
Oct 16 11:41:30 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:41:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-db07e92f-484e-48a0-b82f-b9a0a4940709 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 11:41:30 user nova-compute[74683]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 11:41:30 user nova-compute[74683]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74683) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 11:41:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-db07e92f-484e-48a0-b82f-b9a0a4940709 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:baad223c-0efc-463f-a718-0fa8bfb0016d', 0)] {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 11:41:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[b212e300-0dbf-436f-abde-7a7d9ea624f8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:baad223c-0efc-463f-a718-0fa8bfb0016d\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:41:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[36bcdb4f-ff7f-4cee-b907-f3ed7adc727c]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baad223c-0efc-463f-a718-0fa8bfb0016d (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:41:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-db07e92f-484e-48a0-b82f-b9a0a4940709 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baad223c-0efc-463f-a718-0fa8bfb0016d (non-flash)
Oct 16 11:41:30 user nova-compute[74683]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 (non-flash)
Oct 16 11:41:30 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:41:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-db07e92f-484e-48a0-b82f-b9a0a4940709 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baad223c-0efc-463f-a718-0fa8bfb0016d (non-flash)
Oct 16 11:41:30 user nova-compute[74683]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 (non-flash)
Oct 16 11:41:30 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:41:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-db07e92f-484e-48a0-b82f-b9a0a4940709 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda4c5b64d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:baad223c-0efc-463f-a718-0fa8bfb0016d'): ({'sdb'}, set())}) {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 11:41:30 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-db07e92f-484e-48a0-b82f-b9a0a4940709 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Removing single pathed devices sdb {{(pid=74683) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 11:41:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5ebcae-40bc-448d-9fde-5cc54094348c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:41:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46bd16d-6d62-4484-b968-6f1857cc496b]: (4, ('ok\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:41:30 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-db07e92f-484e-48a0-b82f-b9a0a4940709 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Flushing IO for device /dev/sdb {{(pid=74683) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 11:41:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b5dbea-eab5-4cd3-bba3-b3392e015cb4]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:41:30 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-db07e92f-484e-48a0-b82f-b9a0a4940709 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74683) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 11:41:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[5947d141-b04f-4a17-b6f7-32fb2067ef89]: (4, ('1', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:41:30 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-db07e92f-484e-48a0-b82f-b9a0a4940709 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 11:41:30 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-db07e92f-484e-48a0-b82f-b9a0a4940709 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] SCSI volumes sdb have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 11:41:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-db07e92f-484e-48a0-b82f-b9a0a4940709 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:baad223c-0efc-463f-a718-0fa8bfb0016d')] {{(pid=74683) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 11:41:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baad223c-0efc-463f-a718-0fa8bfb0016d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baad223c-0efc-463f-a718-0fa8bfb0016d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a018985c-7d01-4b4b-9770-8ff071263bcc]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:41:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-db07e92f-484e-48a0-b82f-b9a0a4940709 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:41:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baad223c-0efc-463f-a718-0fa8bfb0016d -p 172.16.0.220:3260 --logout {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baad223c-0efc-463f-a718-0fa8bfb0016d -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12f4e48-6342-4d8c-a154-ff86e0672614]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:baad223c-0efc-463f-a718-0fa8bfb0016d, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:baad223c-0efc-463f-a718-0fa8bfb0016d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:41:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-db07e92f-484e-48a0-b82f-b9a0a4940709 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:baad223c-0efc-463f-a718-0fa8bfb0016d, portal: 172.16.0.220,3260]
Oct 16 11:41:30 user nova-compute[74683]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:baad223c-0efc-463f-a718-0fa8bfb0016d, portal: 172.16.0.220,3260] successful.
Oct 16 11:41:30 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:41:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baad223c-0efc-463f-a718-0fa8bfb0016d -p 172.16.0.220:3260 --op delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baad223c-0efc-463f-a718-0fa8bfb0016d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[4960c292-ddfb-4849-a89b-c20fe1cb74e2]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:41:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-db07e92f-484e-48a0-b82f-b9a0a4940709 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:41:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-db07e92f-484e-48a0-b82f-b9a0a4940709 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:41:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-db07e92f-484e-48a0-b82f-b9a0a4940709 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] <== disconnect_volume: return (296ms) None {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:41:30 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db07e92f-484e-48a0-b82f-b9a0a4940709 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Disconnected iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 11:41:30 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:41:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:41:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:41:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:41:30 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Auditing locally available compute resources for user (node: user) {{(pid=74683) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 11:41:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8104c2-2ea1-4e66-bf74-08074566111f/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:31 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8104c2-2ea1-4e66-bf74-08074566111f/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:31 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8104c2-2ea1-4e66-bf74-08074566111f/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:31 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8104c2-2ea1-4e66-bf74-08074566111f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:31 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec2b88a5-6571-4f46-a07d-47ccfc1761e4/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:31 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec2b88a5-6571-4f46-a07d-47ccfc1761e4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:31 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec2b88a5-6571-4f46-a07d-47ccfc1761e4/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:31 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec2b88a5-6571-4f46-a07d-47ccfc1761e4/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:31 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1986f9b5-30fb-4290-802d-ee699a19b608/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:31 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1986f9b5-30fb-4290-802d-ee699a19b608/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:31 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1986f9b5-30fb-4290-802d-ee699a19b608/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:31 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1986f9b5-30fb-4290-802d-ee699a19b608/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:31 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:41:31 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:32 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:32 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:41:32 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:32 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d94b70c-4056-4c58-9df4-73684e0d164f/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:32 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d94b70c-4056-4c58-9df4-73684e0d164f/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:32 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d94b70c-4056-4c58-9df4-73684e0d164f/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:32 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d94b70c-4056-4c58-9df4-73684e0d164f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:33 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:41:33 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:41:33 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Hypervisor/Node resource view: name=user free_ram=8217MB free_disk=25.08462905883789GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74683) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 11:41:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:41:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:41:33 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance f5ad764c-638d-4dac-b032-6680917e46df actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:41:33 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 8d94b70c-4056-4c58-9df4-73684e0d164f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:41:33 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 1986f9b5-30fb-4290-802d-ee699a19b608 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:41:33 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance ec2b88a5-6571-4f46-a07d-47ccfc1761e4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:41:33 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance af8104c2-2ea1-4e66-bf74-08074566111f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:41:33 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 11:41:33 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 11:41:33 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:41:33 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:41:33 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Compute_service record updated for user:user {{(pid=74683) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 11:41:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.299s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:41:34 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:41:34 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:41:37 user nova-compute[74683]: DEBUG nova.objects.instance [None req-db07e92f-484e-48a0-b82f-b9a0a4940709 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lazy-loading 'flavor' on Instance uuid 8d94b70c-4056-4c58-9df4-73684e0d164f {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:41:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-db07e92f-484e-48a0-b82f-b9a0a4940709 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lock "8d94b70c-4056-4c58-9df4-73684e0d164f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 27.727s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:41:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Acquiring lock "1986f9b5-30fb-4290-802d-ee699a19b608" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:41:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "1986f9b5-30fb-4290-802d-ee699a19b608" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:41:37 user nova-compute[74683]: INFO nova.compute.manager [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Rebooting instance
Oct 16 11:41:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Acquiring lock "refresh_cache-1986f9b5-30fb-4290-802d-ee699a19b608" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:41:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Acquired lock "refresh_cache-1986f9b5-30fb-4290-802d-ee699a19b608" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:41:37 user nova-compute[74683]: DEBUG nova.network.neutron [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:41:38 user nova-compute[74683]: DEBUG nova.network.neutron [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Updating instance_info_cache with network_info: [{"id": "f6b38471-41ce-443b-8562-bee2b4f64d31", "address": "fa:16:3e:c9:39:63", "network": {"id": "1fa0852d-814a-45ef-80fa-171693e4d02a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-184537544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ce607a3614fc493d33e6ba8ca5807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6b38471-41", "ovs_interfaceid": "f6b38471-41ce-443b-8562-bee2b4f64d31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:41:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Releasing lock "refresh_cache-1986f9b5-30fb-4290-802d-ee699a19b608" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:41:38 user nova-compute[74683]: DEBUG nova.compute.manager [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:41:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:41:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:41:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:41:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:41:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:41:38 user nova-compute[74683]: DEBUG nova.compute.manager [req-9cfc5139-a3ea-41e7-a525-6128167d7722 req-055ae0af-dd9e-4297-88f4-dc37ee8808a4 service nova] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Received event network-vif-unplugged-f6b38471-41ce-443b-8562-bee2b4f64d31 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:41:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-9cfc5139-a3ea-41e7-a525-6128167d7722 req-055ae0af-dd9e-4297-88f4-dc37ee8808a4 service nova] Acquiring lock "1986f9b5-30fb-4290-802d-ee699a19b608-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:41:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-9cfc5139-a3ea-41e7-a525-6128167d7722 req-055ae0af-dd9e-4297-88f4-dc37ee8808a4 service nova] Lock "1986f9b5-30fb-4290-802d-ee699a19b608-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:41:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-9cfc5139-a3ea-41e7-a525-6128167d7722 req-055ae0af-dd9e-4297-88f4-dc37ee8808a4 service nova] Lock "1986f9b5-30fb-4290-802d-ee699a19b608-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:41:38 user nova-compute[74683]: DEBUG nova.compute.manager [req-9cfc5139-a3ea-41e7-a525-6128167d7722 req-055ae0af-dd9e-4297-88f4-dc37ee8808a4 service nova] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] No waiting events found dispatching network-vif-unplugged-f6b38471-41ce-443b-8562-bee2b4f64d31 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:41:38 user nova-compute[74683]: WARNING nova.compute.manager [req-9cfc5139-a3ea-41e7-a525-6128167d7722 req-055ae0af-dd9e-4297-88f4-dc37ee8808a4 service nova] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Received unexpected event network-vif-unplugged-f6b38471-41ce-443b-8562-bee2b4f64d31 for instance with vm_state active and task_state reboot_started_hard.
Oct 16 11:41:38 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Instance destroyed successfully.
Oct 16 11:41:38 user nova-compute[74683]: DEBUG nova.objects.instance [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lazy-loading 'resources' on Instance uuid 1986f9b5-30fb-4290-802d-ee699a19b608 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:41:38 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:38:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1431918915',display_name='tempest-TestMinimumBasicScenario-server-1431918915',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1431918915',id=44,image_ref='3655c371-474c-4f9f-ba8b-0d7456865849',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCI5nTHN+Qfkky+jJW3BD5AjS3zBFf7VOxBEwGAWRlhhO37Od80oayCaWewTkSYmErNkZl6VLo4/JM0tQtAYq4JzjY6pa6GzBXSeQpF5WvAUIkacc81Db7rcQJLH79d+dg==',key_name='tempest-TestMinimumBasicScenario-1795285557',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:39:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f1ce607a3614fc493d33e6ba8ca5807',ramdisk_id='',reservation_id='r-04floz6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3655c371-474c-4f9f-ba8b-0d7456865849',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-470564601',owner_user_name='tempest-TestMinimumBasicScenario-470564601-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:41:38Z,user_data=None,user_id='7bd40e88d3914927a7804e3b4fb26549',uuid=1986f9b5-30fb-4290-802d-ee699a19b608,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f6b38471-41ce-443b-8562-bee2b4f64d31", "address": "fa:16:3e:c9:39:63", "network": {"id": "1fa0852d-814a-45ef-80fa-171693e4d02a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-184537544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ce607a3614fc493d33e6ba8ca5807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6b38471-41", "ovs_interfaceid": "f6b38471-41ce-443b-8562-bee2b4f64d31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:41:38 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Converting VIF {"id": "f6b38471-41ce-443b-8562-bee2b4f64d31", "address": "fa:16:3e:c9:39:63", "network": {"id": "1fa0852d-814a-45ef-80fa-171693e4d02a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-184537544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ce607a3614fc493d33e6ba8ca5807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6b38471-41", "ovs_interfaceid": "f6b38471-41ce-443b-8562-bee2b4f64d31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:41:38 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c9:39:63,bridge_name='br-int',has_traffic_filtering=True,id=f6b38471-41ce-443b-8562-bee2b4f64d31,network=Network(1fa0852d-814a-45ef-80fa-171693e4d02a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6b38471-41') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:41:38 user nova-compute[74683]: DEBUG os_vif [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:39:63,bridge_name='br-int',has_traffic_filtering=True,id=f6b38471-41ce-443b-8562-bee2b4f64d31,network=Network(1fa0852d-814a-45ef-80fa-171693e4d02a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6b38471-41') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:41:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:41:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf6b38471-41, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:41:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:41:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:41:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:41:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4f8a9e61-a7fb-4ebe-8ff1-d19526261cdd) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:41:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:41:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:41:38 user nova-compute[74683]: INFO os_vif [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:39:63,bridge_name='br-int',has_traffic_filtering=True,id=f6b38471-41ce-443b-8562-bee2b4f64d31,network=Network(1fa0852d-814a-45ef-80fa-171693e4d02a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6b38471-41')
Oct 16 11:41:38 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] calling os-brick to detach iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 11:41:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, {'target_iqn': 'iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RqTMudPb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:41:38 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:41:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:41:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:41:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8f4c1f-e185-4e32-b79a-97b3017f0e73]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 11:41:39 user nova-compute[74683]: No targets found.
Oct 16 11:41:39 user nova-compute[74683]: iSNS:
Oct 16 11:41:39 user nova-compute[74683]: No targets found.
Oct 16 11:41:39 user nova-compute[74683]: STATIC:
Oct 16 11:41:39 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0
Oct 16 11:41:39 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:41:39 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:41:39 user nova-compute[74683]: FIRMWARE:
Oct 16 11:41:39 user nova-compute[74683]: No targets found.
Oct 16 11:41:39 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 11:41:39 user nova-compute[74683]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 11:41:39 user nova-compute[74683]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74683) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0', 0)] {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[be75f3e4-5052-415a-bb86-5c8f6f505456]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[18274d9f-d2c9-45b6-9ee5-d0970dbb4457]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 (non-flash)
Oct 16 11:41:39 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 (non-flash)
Oct 16 11:41:39 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda6c294940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0'): ({'sdc'}, set())}) {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Removing single pathed devices sdc {{(pid=74683) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa8f9cf-1c89-4bd8-9996-1fd254b284db]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1221893-a59c-4399-9770-1c02acc043a1]: (4, ('ok\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Flushing IO for device /dev/sdc {{(pid=74683) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f443e7-c0c2-4eaa-8bb6-afecf723169a]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74683) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[4991c6c6-cfba-4635-9dd4-99927a8b20c2]: (4, ('1', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] SCSI volumes sdc have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0')] {{(pid=74683) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[0253b694-43dc-45c1-9da6-fb72f7824cea]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 -p 172.16.0.220:3260 --logout {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc515340-679a-4b1d-8e04-3a64f5be7570]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0, portal: 172.16.0.220,3260]
Oct 16 11:41:39 user nova-compute[74683]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0, portal: 172.16.0.220,3260] successful.
Oct 16 11:41:39 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 -p 172.16.0.220:3260 --op delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d18e255-928e-479e-9ece-b1fc97679582]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] <== disconnect_volume: return (297ms) None {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Disconnected iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Start _get_guest_xml network_info=[{"id": "f6b38471-41ce-443b-8562-bee2b4f64d31", "address": "fa:16:3e:c9:39:63", "network": {"id": "1fa0852d-814a-45ef-80fa-171693e4d02a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-184537544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ce607a3614fc493d33e6ba8ca5807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6b38471-41", "ovs_interfaceid": "f6b38471-41ce-443b-8562-bee2b4f64d31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=3655c371-474c-4f9f-ba8b-0d7456865849,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '3655c371-474c-4f9f-ba8b-0d7456865849'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RqTMudPb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '1986f9b5-30fb-4290-802d-ee699a19b608', 'attached_at': '', 'detached_at': '', 'volume_id': '322c0976-a7e3-40b7-8d70-4ed65eb496f0', 'serial': '322c0976-a7e3-40b7-8d70-4ed65eb496f0'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': None, 'delete_on_termination': False, 'attachment_id': '23f27f4d-e50d-4f6c-9b15-ca3870559afb', 'volume_type': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:41:39 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:41:39 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:41:39 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=3655c371-474c-4f9f-ba8b-0d7456865849,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG nova.objects.instance [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1986f9b5-30fb-4290-802d-ee699a19b608 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG nova.objects.base [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Object Instance<1986f9b5-30fb-4290-802d-ee699a19b608> lazy-loaded attributes: resources,vcpu_model {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Calling os-brick to attach iSCSI Volume {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RqTMudPb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:41:39 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:41:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:41:39 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:41:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:41:39 user nova-compute[74683]: INFO os_brick.initiator.connectors.iscsi [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 11:41:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 -p 172.16.0.220:3260 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb4afb0-0c8f-4c2d-8040-51257d5ab66f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 11:41:39 user nova-compute[74683]:  {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3679de-ecfd-4e73-a1c7-c3260a5f87fe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0] added\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0] added
Oct 16 11:41:39 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[3825c436-1413-490f-843c-61a95e73595d]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[4968cca5-4a2a-4712-8898-08da2a05039d]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RqTMudPb {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RqTMudPb" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e8728d-3016-4a0a-973b-9536e5a63d73]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RqTMudPb'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82dd019-6f10-4f03-a383-2c7cd25fbc9d]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[648c7b11-2bf6-43e1-ac6f-caf7206d98a2]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 16 11:41:39 user nova-compute[74683]:  {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 16 11:41:39 user nova-compute[74683]:  {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:41:39 user nova-compute[74683]: WARNING os_brick.initiator.connectors.iscsi [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 16 11:41:39 user nova-compute[74683]: 
Oct 16 11:41:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 -p 172.16.0.220:3260 --login {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e5fae3-0fdd-49de-bc70-4880f3b8c20b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0, portal: 172.16.0.220,3260]
Oct 16 11:41:39 user nova-compute[74683]: Login to [iface: default, target: iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0, portal: 172.16.0.220,3260] successful.
Oct 16 11:41:39 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3564e69-76cd-48aa-921e-6f479ced9134]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc3fe74-f83d-4ece-9a85-63f5938365e3]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 (non-flash)
Oct 16 11:41:39 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 (non-flash)
Oct 16 11:41:39 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.245s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Connected to 172.16.0.220:3260 {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=74683) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74683) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac93fd61-8a64-47a1-b296-be230d4070fa]: (4, ('- - 0', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:41:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RqTMudPb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 11:41:40 user nova-compute[74683]: DEBUG nova.compute.manager [req-0a0388d4-3456-445a-bfc9-a45bfd5d9af2 req-07404366-42e7-4b41-91c7-caa20077b510 service nova] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Received event network-vif-plugged-f6b38471-41ce-443b-8562-bee2b4f64d31 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:41:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-0a0388d4-3456-445a-bfc9-a45bfd5d9af2 req-07404366-42e7-4b41-91c7-caa20077b510 service nova] Acquiring lock "1986f9b5-30fb-4290-802d-ee699a19b608-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:41:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-0a0388d4-3456-445a-bfc9-a45bfd5d9af2 req-07404366-42e7-4b41-91c7-caa20077b510 service nova] Lock "1986f9b5-30fb-4290-802d-ee699a19b608-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:41:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-0a0388d4-3456-445a-bfc9-a45bfd5d9af2 req-07404366-42e7-4b41-91c7-caa20077b510 service nova] Lock "1986f9b5-30fb-4290-802d-ee699a19b608-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:41:40 user nova-compute[74683]: DEBUG nova.compute.manager [req-0a0388d4-3456-445a-bfc9-a45bfd5d9af2 req-07404366-42e7-4b41-91c7-caa20077b510 service nova] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] No waiting events found dispatching network-vif-plugged-f6b38471-41ce-443b-8562-bee2b4f64d31 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:41:40 user nova-compute[74683]: WARNING nova.compute.manager [req-0a0388d4-3456-445a-bfc9-a45bfd5d9af2 req-07404366-42e7-4b41-91c7-caa20077b510 service nova] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Received unexpected event network-vif-plugged-f6b38471-41ce-443b-8562-bee2b4f64d31 for instance with vm_state active and task_state reboot_started_hard.
Oct 16 11:41:40 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.273s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:41:40 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] <== connect_volume: return (1274ms) {'type': 'block', 'scsi_wwn': '23065646334306366', 'path': '/dev/sdb'} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:41:40 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065646334306366', 'path': '/dev/sdb'} {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 11:41:40 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:38:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1431918915',display_name='tempest-TestMinimumBasicScenario-server-1431918915',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1431918915',id=44,image_ref='3655c371-474c-4f9f-ba8b-0d7456865849',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCI5nTHN+Qfkky+jJW3BD5AjS3zBFf7VOxBEwGAWRlhhO37Od80oayCaWewTkSYmErNkZl6VLo4/JM0tQtAYq4JzjY6pa6GzBXSeQpF5WvAUIkacc81Db7rcQJLH79d+dg==',key_name='tempest-TestMinimumBasicScenario-1795285557',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:39:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f1ce607a3614fc493d33e6ba8ca5807',ramdisk_id='',reservation_id='r-04floz6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3655c371-474c-4f9f-ba8b-0d7456865849',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-470564601',owner_user_name='tempest-TestMinimumBasicScenario-470564601-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:41:38Z,user_data=None,user_id='7bd40e88d3914927a7804e3b4fb26549',uuid=1986f9b5-30fb-4290-802d-ee699a19b608,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f6b38471-41ce-443b-8562-bee2b4f64d31", "address": "fa:16:3e:c9:39:63", "network": {"id": "1fa0852d-814a-45ef-80fa-171693e4d02a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-184537544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ce607a3614fc493d33e6ba8ca5807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6b38471-41", "ovs_interfaceid": "f6b38471-41ce-443b-8562-bee2b4f64d31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:41:40 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Converting VIF {"id": "f6b38471-41ce-443b-8562-bee2b4f64d31", "address": "fa:16:3e:c9:39:63", "network": {"id": "1fa0852d-814a-45ef-80fa-171693e4d02a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-184537544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ce607a3614fc493d33e6ba8ca5807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6b38471-41", "ovs_interfaceid": "f6b38471-41ce-443b-8562-bee2b4f64d31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:41:40 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c9:39:63,bridge_name='br-int',has_traffic_filtering=True,id=f6b38471-41ce-443b-8562-bee2b4f64d31,network=Network(1fa0852d-814a-45ef-80fa-171693e4d02a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6b38471-41') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:41:40 user nova-compute[74683]: DEBUG nova.objects.instance [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lazy-loading 'pci_devices' on Instance uuid 1986f9b5-30fb-4290-802d-ee699a19b608 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:41:40 user nova-compute[74683]: DEBUG nova.objects.base [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Object Instance<1986f9b5-30fb-4290-802d-ee699a19b608> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:41:40 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:41:40 user nova-compute[74683]:   <uuid>1986f9b5-30fb-4290-802d-ee699a19b608</uuid>
Oct 16 11:41:40 user nova-compute[74683]:   <name>instance-0000002c</name>
Oct 16 11:41:40 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:41:40 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:41:40 user nova-compute[74683]:   <metadata>
Oct 16 11:41:40 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:41:40 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:41:40 user nova-compute[74683]:       <nova:name>tempest-TestMinimumBasicScenario-server-1431918915</nova:name>
Oct 16 11:41:40 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:41:39</nova:creationTime>
Oct 16 11:41:40 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:41:40 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:41:40 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:41:40 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:41:40 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:41:40 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:41:40 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:41:40 user nova-compute[74683]:       <nova:owner>
Oct 16 11:41:40 user nova-compute[74683]:         <nova:user uuid="7bd40e88d3914927a7804e3b4fb26549">tempest-TestMinimumBasicScenario-470564601-project-member</nova:user>
Oct 16 11:41:40 user nova-compute[74683]:         <nova:project uuid="5f1ce607a3614fc493d33e6ba8ca5807">tempest-TestMinimumBasicScenario-470564601</nova:project>
Oct 16 11:41:40 user nova-compute[74683]:       </nova:owner>
Oct 16 11:41:40 user nova-compute[74683]:       <nova:root type="image" uuid="3655c371-474c-4f9f-ba8b-0d7456865849"/>
Oct 16 11:41:40 user nova-compute[74683]:       <nova:ports>
Oct 16 11:41:40 user nova-compute[74683]:         <nova:port uuid="f6b38471-41ce-443b-8562-bee2b4f64d31">
Oct 16 11:41:40 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 16 11:41:40 user nova-compute[74683]:         </nova:port>
Oct 16 11:41:40 user nova-compute[74683]:       </nova:ports>
Oct 16 11:41:40 user nova-compute[74683]:     </nova:instance>
Oct 16 11:41:40 user nova-compute[74683]:   </metadata>
Oct 16 11:41:40 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:41:40 user nova-compute[74683]:     <system>
Oct 16 11:41:40 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:41:40 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:41:40 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:41:40 user nova-compute[74683]:       <entry name="serial">1986f9b5-30fb-4290-802d-ee699a19b608</entry>
Oct 16 11:41:40 user nova-compute[74683]:       <entry name="uuid">1986f9b5-30fb-4290-802d-ee699a19b608</entry>
Oct 16 11:41:40 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:41:40 user nova-compute[74683]:     </system>
Oct 16 11:41:40 user nova-compute[74683]:   </sysinfo>
Oct 16 11:41:40 user nova-compute[74683]:   <os>
Oct 16 11:41:40 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:41:40 user nova-compute[74683]:     <boot dev="hd"/>
Oct 16 11:41:40 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:41:40 user nova-compute[74683]:   </os>
Oct 16 11:41:40 user nova-compute[74683]:   <features>
Oct 16 11:41:40 user nova-compute[74683]:     <acpi/>
Oct 16 11:41:40 user nova-compute[74683]:     <apic/>
Oct 16 11:41:40 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:41:40 user nova-compute[74683]:   </features>
Oct 16 11:41:40 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:41:40 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:41:40 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:41:40 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:41:40 user nova-compute[74683]:   </clock>
Oct 16 11:41:40 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:41:40 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:41:40 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:41:40 user nova-compute[74683]:   </cpu>
Oct 16 11:41:40 user nova-compute[74683]:   <devices>
Oct 16 11:41:40 user nova-compute[74683]:     <disk type="file" device="disk">
Oct 16 11:41:40 user nova-compute[74683]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 11:41:40 user nova-compute[74683]:       <source file="/opt/stack/data/nova/instances/1986f9b5-30fb-4290-802d-ee699a19b608/disk"/>
Oct 16 11:41:40 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:41:40 user nova-compute[74683]:     </disk>
Oct 16 11:41:40 user nova-compute[74683]:     <disk type="block" device="disk">
Oct 16 11:41:40 user nova-compute[74683]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:41:40 user nova-compute[74683]:       <source dev="/dev/sdb"/>
Oct 16 11:41:40 user nova-compute[74683]:       <target dev="vdb" bus="virtio"/>
Oct 16 11:41:40 user nova-compute[74683]:       <serial>322c0976-a7e3-40b7-8d70-4ed65eb496f0</serial>
Oct 16 11:41:40 user nova-compute[74683]:     </disk>
Oct 16 11:41:40 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:41:40 user nova-compute[74683]:       <mac address="fa:16:3e:c9:39:63"/>
Oct 16 11:41:40 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:41:40 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:41:40 user nova-compute[74683]:       <target dev="tapf6b38471-41"/>
Oct 16 11:41:40 user nova-compute[74683]:     </interface>
Oct 16 11:41:40 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:41:40 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/1986f9b5-30fb-4290-802d-ee699a19b608/console.log" append="off"/>
Oct 16 11:41:40 user nova-compute[74683]:     </serial>
Oct 16 11:41:40 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:41:40 user nova-compute[74683]:     <video>
Oct 16 11:41:40 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:41:40 user nova-compute[74683]:     </video>
Oct 16 11:41:40 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:41:40 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:41:40 user nova-compute[74683]:     </rng>
Oct 16 11:41:40 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:41:40 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:41:40 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:41:40 user nova-compute[74683]:     </memballoon>
Oct 16 11:41:40 user nova-compute[74683]:   </devices>
Oct 16 11:41:40 user nova-compute[74683]: </domain>
Oct 16 11:41:40 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:41:40 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1986f9b5-30fb-4290-802d-ee699a19b608/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:40 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1986f9b5-30fb-4290-802d-ee699a19b608/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:40 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1986f9b5-30fb-4290-802d-ee699a19b608/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1986f9b5-30fb-4290-802d-ee699a19b608/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:41 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:41:41 user nova-compute[74683]: DEBUG nova.objects.instance [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1986f9b5-30fb-4290-802d-ee699a19b608 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:41:41 user nova-compute[74683]: DEBUG nova.objects.base [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Object Instance<1986f9b5-30fb-4290-802d-ee699a19b608> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:41:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/599effbe8b015f8f32845bbe528a552caba4a42c --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/599effbe8b015f8f32845bbe528a552caba4a42c --force-share --output=json" returned: 0 in 0.176s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:41 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1986f9b5-30fb-4290-802d-ee699a19b608/disk. size=1073741824 {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 11:41:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1986f9b5-30fb-4290-802d-ee699a19b608/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:41:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1986f9b5-30fb-4290-802d-ee699a19b608/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:41:41 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Cannot resize image /opt/stack/data/nova/instances/1986f9b5-30fb-4290-802d-ee699a19b608/disk to a smaller size. {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 11:41:41 user nova-compute[74683]: DEBUG nova.objects.instance [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lazy-loading 'migration_context' on Instance uuid 1986f9b5-30fb-4290-802d-ee699a19b608 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:41:41 user nova-compute[74683]: DEBUG nova.objects.base [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Object Instance<1986f9b5-30fb-4290-802d-ee699a19b608> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:41:41 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:38:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1431918915',display_name='tempest-TestMinimumBasicScenario-server-1431918915',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1431918915',id=44,image_ref='3655c371-474c-4f9f-ba8b-0d7456865849',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCI5nTHN+Qfkky+jJW3BD5AjS3zBFf7VOxBEwGAWRlhhO37Od80oayCaWewTkSYmErNkZl6VLo4/JM0tQtAYq4JzjY6pa6GzBXSeQpF5WvAUIkacc81Db7rcQJLH79d+dg==',key_name='tempest-TestMinimumBasicScenario-1795285557',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:39:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='5f1ce607a3614fc493d33e6ba8ca5807',ramdisk_id='',reservation_id='r-04floz6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3655c371-474c-4f9f-ba8b-0d7456865849',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-470564601',owner_user_name='tempest-TestMinimumBasicScenario-470564601-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:41:38Z,user_data=None,user_id='7bd40e88d3914927a7804e3b4fb26549',uuid=1986f9b5-30fb-4290-802d-ee699a19b608,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f6b38471-41ce-443b-8562-bee2b4f64d31", "address": "fa:16:3e:c9:39:63", "network": {"id": "1fa0852d-814a-45ef-80fa-171693e4d02a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-184537544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ce607a3614fc493d33e6ba8ca5807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6b38471-41", "ovs_interfaceid": "f6b38471-41ce-443b-8562-bee2b4f64d31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:41:41 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Converting VIF {"id": "f6b38471-41ce-443b-8562-bee2b4f64d31", "address": "fa:16:3e:c9:39:63", "network": {"id": "1fa0852d-814a-45ef-80fa-171693e4d02a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-184537544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ce607a3614fc493d33e6ba8ca5807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6b38471-41", "ovs_interfaceid": "f6b38471-41ce-443b-8562-bee2b4f64d31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:41:41 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c9:39:63,bridge_name='br-int',has_traffic_filtering=True,id=f6b38471-41ce-443b-8562-bee2b4f64d31,network=Network(1fa0852d-814a-45ef-80fa-171693e4d02a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6b38471-41') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:41:41 user nova-compute[74683]: DEBUG os_vif [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:39:63,bridge_name='br-int',has_traffic_filtering=True,id=f6b38471-41ce-443b-8562-bee2b4f64d31,network=Network(1fa0852d-814a-45ef-80fa-171693e4d02a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6b38471-41') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:41:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:41:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:41:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:41:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:41:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8602ef39-64d2-5851-9343-fe46ee1beaf0', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:41:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:41:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:41:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:41:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf6b38471-41, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:41:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf6b38471-41, col_values=(('qos', UUID('9c89a340-6c72-4662-b7d1-fd6e56bf0620')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:41:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf6b38471-41, col_values=(('external_ids', {'iface-id': 'f6b38471-41ce-443b-8562-bee2b4f64d31', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:39:63', 'vm-uuid': '1986f9b5-30fb-4290-802d-ee699a19b608'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:41:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:41:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:41:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:41:41 user nova-compute[74683]: INFO os_vif [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:39:63,bridge_name='br-int',has_traffic_filtering=True,id=f6b38471-41ce-443b-8562-bee2b4f64d31,network=Network(1fa0852d-814a-45ef-80fa-171693e4d02a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6b38471-41')
Oct 16 11:41:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:41:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:41:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:41:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:41:42 user nova-compute[74683]: DEBUG nova.compute.manager [req-9fce5966-d768-4043-8438-a8202a165498 req-333f52ab-eff6-4b5d-b62f-c3640fa2c57d service nova] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Received event network-vif-plugged-f6b38471-41ce-443b-8562-bee2b4f64d31 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:41:42 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-9fce5966-d768-4043-8438-a8202a165498 req-333f52ab-eff6-4b5d-b62f-c3640fa2c57d service nova] Acquiring lock "1986f9b5-30fb-4290-802d-ee699a19b608-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:41:42 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-9fce5966-d768-4043-8438-a8202a165498 req-333f52ab-eff6-4b5d-b62f-c3640fa2c57d service nova] Lock "1986f9b5-30fb-4290-802d-ee699a19b608-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:41:42 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-9fce5966-d768-4043-8438-a8202a165498 req-333f52ab-eff6-4b5d-b62f-c3640fa2c57d service nova] Lock "1986f9b5-30fb-4290-802d-ee699a19b608-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:41:42 user nova-compute[74683]: DEBUG nova.compute.manager [req-9fce5966-d768-4043-8438-a8202a165498 req-333f52ab-eff6-4b5d-b62f-c3640fa2c57d service nova] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] No waiting events found dispatching network-vif-plugged-f6b38471-41ce-443b-8562-bee2b4f64d31 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:41:42 user nova-compute[74683]: WARNING nova.compute.manager [req-9fce5966-d768-4043-8438-a8202a165498 req-333f52ab-eff6-4b5d-b62f-c3640fa2c57d service nova] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Received unexpected event network-vif-plugged-f6b38471-41ce-443b-8562-bee2b4f64d31 for instance with vm_state active and task_state reboot_started_hard.
Oct 16 11:41:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:41:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:41:44 user nova-compute[74683]: DEBUG nova.compute.manager [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Instance event wait completed in 0 seconds for  {{(pid=74683) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 11:41:44 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Instance rebooted successfully.
Oct 16 11:41:44 user nova-compute[74683]: DEBUG nova.compute.manager [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:41:44 user nova-compute[74683]: DEBUG nova.compute.manager [req-53a3f3ea-28e9-4349-a03b-7e122eb6bafd req-c197b0c3-9ce6-4fa0-9e40-4c5dc27cb492 service nova] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Received event network-vif-plugged-f6b38471-41ce-443b-8562-bee2b4f64d31 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:41:44 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-53a3f3ea-28e9-4349-a03b-7e122eb6bafd req-c197b0c3-9ce6-4fa0-9e40-4c5dc27cb492 service nova] Acquiring lock "1986f9b5-30fb-4290-802d-ee699a19b608-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:41:44 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-53a3f3ea-28e9-4349-a03b-7e122eb6bafd req-c197b0c3-9ce6-4fa0-9e40-4c5dc27cb492 service nova] Lock "1986f9b5-30fb-4290-802d-ee699a19b608-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:41:44 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-53a3f3ea-28e9-4349-a03b-7e122eb6bafd req-c197b0c3-9ce6-4fa0-9e40-4c5dc27cb492 service nova] Lock "1986f9b5-30fb-4290-802d-ee699a19b608-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:41:44 user nova-compute[74683]: DEBUG nova.compute.manager [req-53a3f3ea-28e9-4349-a03b-7e122eb6bafd req-c197b0c3-9ce6-4fa0-9e40-4c5dc27cb492 service nova] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] No waiting events found dispatching network-vif-plugged-f6b38471-41ce-443b-8562-bee2b4f64d31 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:41:44 user nova-compute[74683]: WARNING nova.compute.manager [req-53a3f3ea-28e9-4349-a03b-7e122eb6bafd req-c197b0c3-9ce6-4fa0-9e40-4c5dc27cb492 service nova] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Received unexpected event network-vif-plugged-f6b38471-41ce-443b-8562-bee2b4f64d31 for instance with vm_state active and task_state reboot_started_hard.
Oct 16 11:41:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-789d424a-b213-4e54-af08-d791b0006f03 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "1986f9b5-30fb-4290-802d-ee699a19b608" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.407s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:41:46 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:41:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:41:51 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:41:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:41:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:42:01 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:42:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:42:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:42:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:42:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9a1cb1d0-d5d7-4a15-b907-4c8f2b9e8492 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Acquiring lock "8d94b70c-4056-4c58-9df4-73684e0d164f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:42:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9a1cb1d0-d5d7-4a15-b907-4c8f2b9e8492 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lock "8d94b70c-4056-4c58-9df4-73684e0d164f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:42:11 user nova-compute[74683]: DEBUG nova.objects.instance [None req-9a1cb1d0-d5d7-4a15-b907-4c8f2b9e8492 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lazy-loading 'flavor' on Instance uuid 8d94b70c-4056-4c58-9df4-73684e0d164f {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:42:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9a1cb1d0-d5d7-4a15-b907-4c8f2b9e8492 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lock "8d94b70c-4056-4c58-9df4-73684e0d164f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:42:11 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:42:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9a1cb1d0-d5d7-4a15-b907-4c8f2b9e8492 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Acquiring lock "8d94b70c-4056-4c58-9df4-73684e0d164f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:42:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9a1cb1d0-d5d7-4a15-b907-4c8f2b9e8492 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lock "8d94b70c-4056-4c58-9df4-73684e0d164f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:42:11 user nova-compute[74683]: INFO nova.compute.manager [None req-9a1cb1d0-d5d7-4a15-b907-4c8f2b9e8492 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Attaching volume e5563290-1621-4304-9322-1e86da69432f to /dev/vdb
Oct 16 11:42:11 user nova-compute[74683]: DEBUG os_brick.utils [None req-9a1cb1d0-d5d7-4a15-b907-4c8f2b9e8492 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:42:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:42:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:42:11 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6d8a50-5012-443f-99cf-9760b669ec31]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:70b9d336ab7d\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:42:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:42:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:42:11 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d66ce8-1bfe-4ba1-ad63-dff566a426e4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:42:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:42:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:42:11 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c4b47c-a99a-4bc9-9405-be69ea149598]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:42:11 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[43028ad9-cd80-4979-bb0d-004eb3d6a371]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:42:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9a1cb1d0-d5d7-4a15-b907-4c8f2b9e8492 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Running cmd (subprocess): nvme version {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:42:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9a1cb1d0-d5d7-4a15-b907-4c8f2b9e8492 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] 'nvme version' failed. Not Retrying. {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:42:11 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9a1cb1d0-d5d7-4a15-b907-4c8f2b9e8492 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] nvme not present on system {{(pid=74683) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 11:42:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:42:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:42:11 user nova-compute[74683]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 11:42:11 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed818f0-61ef-4b87-af9d-39e5d0071c6c]: (4, '') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:42:11 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-9a1cb1d0-d5d7-4a15-b907-4c8f2b9e8492 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74683) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 11:42:11 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-9a1cb1d0-d5d7-4a15-b907-4c8f2b9e8492 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 11:42:11 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-9a1cb1d0-d5d7-4a15-b907-4c8f2b9e8492 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] LIGHTOS: no hostnqn found. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 11:42:11 user nova-compute[74683]: DEBUG os_brick.utils [None req-9a1cb1d0-d5d7-4a15-b907-4c8f2b9e8492 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:70b9d336ab7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:42:11 user nova-compute[74683]: DEBUG nova.virt.block_device [None req-9a1cb1d0-d5d7-4a15-b907-4c8f2b9e8492 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Updating existing volume attachment record: 4ba939ab-1e87-48b9-a22a-731d3a3e4fc6 {{(pid=74683) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 11:42:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:42:16 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2a5dbef3-a572-44e1-b240-22874c842d12 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Acquiring lock "f5ad764c-638d-4dac-b032-6680917e46df" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:42:16 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2a5dbef3-a572-44e1-b240-22874c842d12 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "f5ad764c-638d-4dac-b032-6680917e46df" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:42:16 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2a5dbef3-a572-44e1-b240-22874c842d12 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Acquiring lock "f5ad764c-638d-4dac-b032-6680917e46df-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:42:16 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2a5dbef3-a572-44e1-b240-22874c842d12 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "f5ad764c-638d-4dac-b032-6680917e46df-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:42:16 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2a5dbef3-a572-44e1-b240-22874c842d12 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "f5ad764c-638d-4dac-b032-6680917e46df-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:42:16 user nova-compute[74683]: INFO nova.compute.manager [None req-2a5dbef3-a572-44e1-b240-22874c842d12 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Terminating instance
Oct 16 11:42:16 user nova-compute[74683]: DEBUG nova.compute.manager [None req-2a5dbef3-a572-44e1-b240-22874c842d12 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Start destroying the instance on the hypervisor. {{(pid=74683) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 11:42:16 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:42:16 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:42:16 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:42:16 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:42:16 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:42:16 user nova-compute[74683]: DEBUG nova.compute.manager [req-b0d0bdba-3038-47b4-9767-c867e0e3e44c req-a497f17f-3c4a-46cb-83be-5d59a237d86d service nova] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Received event network-vif-unplugged-eb80f49f-da30-478a-900a-5d3da8ec7fa9 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:42:16 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b0d0bdba-3038-47b4-9767-c867e0e3e44c req-a497f17f-3c4a-46cb-83be-5d59a237d86d service nova] Acquiring lock "f5ad764c-638d-4dac-b032-6680917e46df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:42:16 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b0d0bdba-3038-47b4-9767-c867e0e3e44c req-a497f17f-3c4a-46cb-83be-5d59a237d86d service nova] Lock "f5ad764c-638d-4dac-b032-6680917e46df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:42:16 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b0d0bdba-3038-47b4-9767-c867e0e3e44c req-a497f17f-3c4a-46cb-83be-5d59a237d86d service nova] Lock "f5ad764c-638d-4dac-b032-6680917e46df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:42:16 user nova-compute[74683]: DEBUG nova.compute.manager [req-b0d0bdba-3038-47b4-9767-c867e0e3e44c req-a497f17f-3c4a-46cb-83be-5d59a237d86d service nova] [instance: f5ad764c-638d-4dac-b032-6680917e46df] No waiting events found dispatching network-vif-unplugged-eb80f49f-da30-478a-900a-5d3da8ec7fa9 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:42:16 user nova-compute[74683]: DEBUG nova.compute.manager [req-b0d0bdba-3038-47b4-9767-c867e0e3e44c req-a497f17f-3c4a-46cb-83be-5d59a237d86d service nova] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Received event network-vif-unplugged-eb80f49f-da30-478a-900a-5d3da8ec7fa9 for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 11:42:17 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Instance destroyed successfully.
Oct 16 11:42:17 user nova-compute[74683]: DEBUG nova.objects.instance [None req-2a5dbef3-a572-44e1-b240-22874c842d12 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lazy-loading 'resources' on Instance uuid f5ad764c-638d-4dac-b032-6680917e46df {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:42:17 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-2a5dbef3-a572-44e1-b240-22874c842d12 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:32:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1312798176',display_name='tempest-AttachVolumeTestJSON-server-1312798176',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1312798176',id=37,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK71ozq2/KpO5RlTCFqfn2Y2zadWP27MahKIqPNvvjn6AoGcB4vtAlejjcQWpo0ZyUGWpGjLegzCVDVvdR5EwjFBNV5GDYZr2laQXH53s66DwTCeGEg2DbbqZiQTOGLfAw==',key_name='tempest-keypair-1447279783',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:32:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='889cb980200446c0933fe965738a62df',ramdisk_id='',reservation_id='r-acd30a2f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-263939305',owner_user_name='tempest-AttachVolumeTestJSON-263939305-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:40:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c38fd3bc86ba4b7a95e06b926d22e60f',uuid=f5ad764c-638d-4dac-b032-6680917e46df,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb80f49f-da30-478a-900a-5d3da8ec7fa9", "address": "fa:16:3e:c8:02:4d", "network": {"id": "badd2db9-6c0f-40cc-afe9-a199e040399a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1368098259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "889cb980200446c0933fe965738a62df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb80f49f-da", "ovs_interfaceid": "eb80f49f-da30-478a-900a-5d3da8ec7fa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:42:17 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-2a5dbef3-a572-44e1-b240-22874c842d12 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Converting VIF {"id": "eb80f49f-da30-478a-900a-5d3da8ec7fa9", "address": "fa:16:3e:c8:02:4d", "network": {"id": "badd2db9-6c0f-40cc-afe9-a199e040399a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1368098259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "889cb980200446c0933fe965738a62df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb80f49f-da", "ovs_interfaceid": "eb80f49f-da30-478a-900a-5d3da8ec7fa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:42:17 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-2a5dbef3-a572-44e1-b240-22874c842d12 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:02:4d,bridge_name='br-int',has_traffic_filtering=True,id=eb80f49f-da30-478a-900a-5d3da8ec7fa9,network=Network(badd2db9-6c0f-40cc-afe9-a199e040399a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb80f49f-da') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:42:17 user nova-compute[74683]: DEBUG os_vif [None req-2a5dbef3-a572-44e1-b240-22874c842d12 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:02:4d,bridge_name='br-int',has_traffic_filtering=True,id=eb80f49f-da30-478a-900a-5d3da8ec7fa9,network=Network(badd2db9-6c0f-40cc-afe9-a199e040399a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb80f49f-da') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:42:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:42:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeb80f49f-da, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:42:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:42:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:42:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:42:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a844b793-55b7-457e-9713-bfe8e6a891a8) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:42:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:42:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:42:17 user nova-compute[74683]: INFO os_vif [None req-2a5dbef3-a572-44e1-b240-22874c842d12 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:02:4d,bridge_name='br-int',has_traffic_filtering=True,id=eb80f49f-da30-478a-900a-5d3da8ec7fa9,network=Network(badd2db9-6c0f-40cc-afe9-a199e040399a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb80f49f-da')
Oct 16 11:42:17 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-2a5dbef3-a572-44e1-b240-22874c842d12 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Deleting instance files /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df_del
Oct 16 11:42:17 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-2a5dbef3-a572-44e1-b240-22874c842d12 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Deletion of /opt/stack/data/nova/instances/f5ad764c-638d-4dac-b032-6680917e46df_del complete
Oct 16 11:42:17 user nova-compute[74683]: INFO nova.compute.manager [None req-2a5dbef3-a572-44e1-b240-22874c842d12 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Took 0.86 seconds to destroy the instance on the hypervisor.
Oct 16 11:42:17 user nova-compute[74683]: DEBUG oslo.service.loopingcall [None req-2a5dbef3-a572-44e1-b240-22874c842d12 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74683) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 11:42:17 user nova-compute[74683]: DEBUG nova.compute.manager [-] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Deallocating network for instance {{(pid=74683) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 11:42:17 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: f5ad764c-638d-4dac-b032-6680917e46df] deallocate_for_instance() {{(pid=74683) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 11:42:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:42:18 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:42:18 user nova-compute[74683]: INFO nova.compute.manager [-] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Took 1.03 seconds to deallocate network for instance.
Oct 16 11:42:18 user nova-compute[74683]: DEBUG nova.compute.manager [req-69abf2eb-8c5d-4dbd-a219-1e9f95600182 req-77374c76-e674-48aa-b999-7297b8bf53e7 service nova] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Received event network-vif-deleted-eb80f49f-da30-478a-900a-5d3da8ec7fa9 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:42:18 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2a5dbef3-a572-44e1-b240-22874c842d12 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:42:18 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2a5dbef3-a572-44e1-b240-22874c842d12 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:42:18 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-2a5dbef3-a572-44e1-b240-22874c842d12 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:42:18 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-2a5dbef3-a572-44e1-b240-22874c842d12 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:42:18 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2a5dbef3-a572-44e1-b240-22874c842d12 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.230s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:42:18 user nova-compute[74683]: INFO nova.scheduler.client.report [None req-2a5dbef3-a572-44e1-b240-22874c842d12 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Deleted allocations for instance f5ad764c-638d-4dac-b032-6680917e46df
Oct 16 11:42:18 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2a5dbef3-a572-44e1-b240-22874c842d12 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "f5ad764c-638d-4dac-b032-6680917e46df" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.302s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:42:18 user nova-compute[74683]: DEBUG nova.compute.manager [req-c8c65694-3ccf-490e-8c76-4ef85149361e req-28898504-8505-47c1-9031-fab044bc7a49 service nova] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Received event network-vif-plugged-eb80f49f-da30-478a-900a-5d3da8ec7fa9 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:42:18 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c8c65694-3ccf-490e-8c76-4ef85149361e req-28898504-8505-47c1-9031-fab044bc7a49 service nova] Acquiring lock "f5ad764c-638d-4dac-b032-6680917e46df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:42:18 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c8c65694-3ccf-490e-8c76-4ef85149361e req-28898504-8505-47c1-9031-fab044bc7a49 service nova] Lock "f5ad764c-638d-4dac-b032-6680917e46df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:42:18 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c8c65694-3ccf-490e-8c76-4ef85149361e req-28898504-8505-47c1-9031-fab044bc7a49 service nova] Lock "f5ad764c-638d-4dac-b032-6680917e46df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:42:18 user nova-compute[74683]: DEBUG nova.compute.manager [req-c8c65694-3ccf-490e-8c76-4ef85149361e req-28898504-8505-47c1-9031-fab044bc7a49 service nova] [instance: f5ad764c-638d-4dac-b032-6680917e46df] No waiting events found dispatching network-vif-plugged-eb80f49f-da30-478a-900a-5d3da8ec7fa9 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:42:18 user nova-compute[74683]: WARNING nova.compute.manager [req-c8c65694-3ccf-490e-8c76-4ef85149361e req-28898504-8505-47c1-9031-fab044bc7a49 service nova] [instance: f5ad764c-638d-4dac-b032-6680917e46df] Received unexpected event network-vif-plugged-eb80f49f-da30-478a-900a-5d3da8ec7fa9 for instance with vm_state deleted and task_state None.
Oct 16 11:42:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:42:24 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:42:24 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:42:24 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:42:26 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:42:26 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Starting heal instance info cache {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 11:42:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "refresh_cache-1986f9b5-30fb-4290-802d-ee699a19b608" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:42:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquired lock "refresh_cache-1986f9b5-30fb-4290-802d-ee699a19b608" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:42:26 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Forcefully refreshing network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 11:42:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:42:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:42:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74683) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 11:42:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:42:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:42:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:42:27 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Updating instance_info_cache with network_info: [{"id": "f6b38471-41ce-443b-8562-bee2b4f64d31", "address": "fa:16:3e:c9:39:63", "network": {"id": "1fa0852d-814a-45ef-80fa-171693e4d02a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-184537544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ce607a3614fc493d33e6ba8ca5807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6b38471-41", "ovs_interfaceid": "f6b38471-41ce-443b-8562-bee2b4f64d31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:42:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Releasing lock "refresh_cache-1986f9b5-30fb-4290-802d-ee699a19b608" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:42:27 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Updated the network info_cache for instance {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 11:42:27 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:42:27 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:42:29 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:42:29 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74683) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 11:42:31 user nova-compute[74683]: DEBUG nova.compute.manager [req-7c935a73-e0fb-4716-b440-5720d8f3bd3b req-9f157890-743c-4d6c-8f72-5848357b1502 service nova] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Received event network-changed-75e552bb-fec2-47bd-adda-d562f27f8a36 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:42:31 user nova-compute[74683]: DEBUG nova.compute.manager [req-7c935a73-e0fb-4716-b440-5720d8f3bd3b req-9f157890-743c-4d6c-8f72-5848357b1502 service nova] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Refreshing instance network info cache due to event network-changed-75e552bb-fec2-47bd-adda-d562f27f8a36. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:42:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-7c935a73-e0fb-4716-b440-5720d8f3bd3b req-9f157890-743c-4d6c-8f72-5848357b1502 service nova] Acquiring lock "refresh_cache-ec2b88a5-6571-4f46-a07d-47ccfc1761e4" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:42:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-7c935a73-e0fb-4716-b440-5720d8f3bd3b req-9f157890-743c-4d6c-8f72-5848357b1502 service nova] Acquired lock "refresh_cache-ec2b88a5-6571-4f46-a07d-47ccfc1761e4" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:42:31 user nova-compute[74683]: DEBUG nova.network.neutron [req-7c935a73-e0fb-4716-b440-5720d8f3bd3b req-9f157890-743c-4d6c-8f72-5848357b1502 service nova] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Refreshing network info cache for port 75e552bb-fec2-47bd-adda-d562f27f8a36 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:42:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:42:32 user nova-compute[74683]: DEBUG nova.network.neutron [req-7c935a73-e0fb-4716-b440-5720d8f3bd3b req-9f157890-743c-4d6c-8f72-5848357b1502 service nova] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Updated VIF entry in instance network info cache for port 75e552bb-fec2-47bd-adda-d562f27f8a36. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:42:32 user nova-compute[74683]: DEBUG nova.network.neutron [req-7c935a73-e0fb-4716-b440-5720d8f3bd3b req-9f157890-743c-4d6c-8f72-5848357b1502 service nova] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Updating instance_info_cache with network_info: [{"id": "75e552bb-fec2-47bd-adda-d562f27f8a36", "address": "fa:16:3e:f5:74:eb", "network": {"id": "2ea750a5-8511-4e40-b149-062e10e0096c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-563467594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d2c7c33914a068b448c447db50b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75e552bb-fe", "ovs_interfaceid": "75e552bb-fec2-47bd-adda-d562f27f8a36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:42:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:42:32 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-7c935a73-e0fb-4716-b440-5720d8f3bd3b req-9f157890-743c-4d6c-8f72-5848357b1502 service nova] Releasing lock "refresh_cache-ec2b88a5-6571-4f46-a07d-47ccfc1761e4" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:42:32 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:42:32 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:42:32 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:42:32 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:42:32 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:42:32 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Auditing locally available compute resources for user (node: user) {{(pid=74683) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 11:42:32 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8104c2-2ea1-4e66-bf74-08074566111f/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:42:33 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8104c2-2ea1-4e66-bf74-08074566111f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:42:33 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8104c2-2ea1-4e66-bf74-08074566111f/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:42:33 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8104c2-2ea1-4e66-bf74-08074566111f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:42:33 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec2b88a5-6571-4f46-a07d-47ccfc1761e4/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:42:33 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec2b88a5-6571-4f46-a07d-47ccfc1761e4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:42:33 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec2b88a5-6571-4f46-a07d-47ccfc1761e4/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:42:33 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec2b88a5-6571-4f46-a07d-47ccfc1761e4/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:42:33 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1986f9b5-30fb-4290-802d-ee699a19b608/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:42:33 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1986f9b5-30fb-4290-802d-ee699a19b608/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:42:33 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1986f9b5-30fb-4290-802d-ee699a19b608/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:42:33 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1986f9b5-30fb-4290-802d-ee699a19b608/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:42:33 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:42:33 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d94b70c-4056-4c58-9df4-73684e0d164f/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:42:34 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d94b70c-4056-4c58-9df4-73684e0d164f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:42:34 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d94b70c-4056-4c58-9df4-73684e0d164f/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:42:34 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d94b70c-4056-4c58-9df4-73684e0d164f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:42:34 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:42:34 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:42:34 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Hypervisor/Node resource view: name=user free_ram=8429MB free_disk=25.101924896240234GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74683) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 11:42:34 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:42:34 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:42:35 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 8d94b70c-4056-4c58-9df4-73684e0d164f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:42:35 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 1986f9b5-30fb-4290-802d-ee699a19b608 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:42:35 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance ec2b88a5-6571-4f46-a07d-47ccfc1761e4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:42:35 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance af8104c2-2ea1-4e66-bf74-08074566111f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:42:35 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 11:42:35 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 11:42:35 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:42:35 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:42:35 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Compute_service record updated for user:user {{(pid=74683) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 11:42:35 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.564s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:42:36 user nova-compute[74683]: DEBUG nova.compute.manager [req-42b643cf-6d19-468a-a62d-7c073640bbe4 req-56f9f8aa-d524-4f85-9657-db9f1551a8ea service nova] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Received event network-changed-0fd9270c-aa16-42b8-98e8-cacb699cee50 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:42:36 user nova-compute[74683]: DEBUG nova.compute.manager [req-42b643cf-6d19-468a-a62d-7c073640bbe4 req-56f9f8aa-d524-4f85-9657-db9f1551a8ea service nova] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Refreshing instance network info cache due to event network-changed-0fd9270c-aa16-42b8-98e8-cacb699cee50. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:42:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-42b643cf-6d19-468a-a62d-7c073640bbe4 req-56f9f8aa-d524-4f85-9657-db9f1551a8ea service nova] Acquiring lock "refresh_cache-af8104c2-2ea1-4e66-bf74-08074566111f" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:42:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-42b643cf-6d19-468a-a62d-7c073640bbe4 req-56f9f8aa-d524-4f85-9657-db9f1551a8ea service nova] Acquired lock "refresh_cache-af8104c2-2ea1-4e66-bf74-08074566111f" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:42:36 user nova-compute[74683]: DEBUG nova.network.neutron [req-42b643cf-6d19-468a-a62d-7c073640bbe4 req-56f9f8aa-d524-4f85-9657-db9f1551a8ea service nova] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Refreshing network info cache for port 0fd9270c-aa16-42b8-98e8-cacb699cee50 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:42:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:42:37 user nova-compute[74683]: DEBUG nova.network.neutron [req-42b643cf-6d19-468a-a62d-7c073640bbe4 req-56f9f8aa-d524-4f85-9657-db9f1551a8ea service nova] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Updated VIF entry in instance network info cache for port 0fd9270c-aa16-42b8-98e8-cacb699cee50. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:42:37 user nova-compute[74683]: DEBUG nova.network.neutron [req-42b643cf-6d19-468a-a62d-7c073640bbe4 req-56f9f8aa-d524-4f85-9657-db9f1551a8ea service nova] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Updating instance_info_cache with network_info: [{"id": "0fd9270c-aa16-42b8-98e8-cacb699cee50", "address": "fa:16:3e:a5:05:18", "network": {"id": "3f02f591-1fa0-477f-8730-b41445fd41b4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1932917211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d9daeec42a4e73a8ff2c0137f91128", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd9270c-aa", "ovs_interfaceid": "0fd9270c-aa16-42b8-98e8-cacb699cee50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:42:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-42b643cf-6d19-468a-a62d-7c073640bbe4 req-56f9f8aa-d524-4f85-9657-db9f1551a8ea service nova] Releasing lock "refresh_cache-af8104c2-2ea1-4e66-bf74-08074566111f" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:42:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-249f25f7-b021-485e-bbcf-f9d1c1b65b39 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Acquiring lock "ec2b88a5-6571-4f46-a07d-47ccfc1761e4" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-249f25f7-b021-485e-bbcf-f9d1c1b65b39 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "ec2b88a5-6571-4f46-a07d-47ccfc1761e4" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:42:38 user nova-compute[74683]: INFO nova.compute.manager [None req-249f25f7-b021-485e-bbcf-f9d1c1b65b39 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Shelving
Oct 16 11:42:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-14f89a2a-6b57-46e3-be4c-f05f3e3b04a7 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Acquiring lock "af8104c2-2ea1-4e66-bf74-08074566111f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-14f89a2a-6b57-46e3-be4c-f05f3e3b04a7 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lock "af8104c2-2ea1-4e66-bf74-08074566111f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG nova.objects.instance [None req-14f89a2a-6b57-46e3-be4c-f05f3e3b04a7 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lazy-loading 'flavor' on Instance uuid af8104c2-2ea1-4e66-bf74-08074566111f {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:42:38 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-14f89a2a-6b57-46e3-be4c-f05f3e3b04a7 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Ignoring supplied device name: /dev/vdb
Oct 16 11:42:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-14f89a2a-6b57-46e3-be4c-f05f3e3b04a7 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lock "af8104c2-2ea1-4e66-bf74-08074566111f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-14f89a2a-6b57-46e3-be4c-f05f3e3b04a7 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Acquiring lock "af8104c2-2ea1-4e66-bf74-08074566111f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-14f89a2a-6b57-46e3-be4c-f05f3e3b04a7 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lock "af8104c2-2ea1-4e66-bf74-08074566111f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:42:38 user nova-compute[74683]: INFO nova.compute.manager [None req-14f89a2a-6b57-46e3-be4c-f05f3e3b04a7 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Attaching volume 16c2f162-3f13-4e4d-b413-d1e6c684f93b to /dev/vdb
Oct 16 11:42:38 user nova-compute[74683]: DEBUG nova.compute.manager [req-a21e58aa-5bef-40ec-b172-2e11a07a6e3d req-a5913413-7721-45de-97e5-dea1998935e2 service nova] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Received event network-vif-unplugged-75e552bb-fec2-47bd-adda-d562f27f8a36 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a21e58aa-5bef-40ec-b172-2e11a07a6e3d req-a5913413-7721-45de-97e5-dea1998935e2 service nova] Acquiring lock "ec2b88a5-6571-4f46-a07d-47ccfc1761e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a21e58aa-5bef-40ec-b172-2e11a07a6e3d req-a5913413-7721-45de-97e5-dea1998935e2 service nova] Lock "ec2b88a5-6571-4f46-a07d-47ccfc1761e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a21e58aa-5bef-40ec-b172-2e11a07a6e3d req-a5913413-7721-45de-97e5-dea1998935e2 service nova] Lock "ec2b88a5-6571-4f46-a07d-47ccfc1761e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG nova.compute.manager [req-a21e58aa-5bef-40ec-b172-2e11a07a6e3d req-a5913413-7721-45de-97e5-dea1998935e2 service nova] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] No waiting events found dispatching network-vif-unplugged-75e552bb-fec2-47bd-adda-d562f27f8a36 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:42:38 user nova-compute[74683]: WARNING nova.compute.manager [req-a21e58aa-5bef-40ec-b172-2e11a07a6e3d req-a5913413-7721-45de-97e5-dea1998935e2 service nova] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Received unexpected event network-vif-unplugged-75e552bb-fec2-47bd-adda-d562f27f8a36 for instance with vm_state active and task_state shelving.
Oct 16 11:42:38 user nova-compute[74683]: DEBUG os_brick.utils [None req-14f89a2a-6b57-46e3-be4c-f05f3e3b04a7 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a1cb1d0-d5d7-4a15-b907-4c8f2b9e8492 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Calling os-brick to attach iSCSI Volume {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1cb1d0-d5d7-4a15-b907-4c8f2b9e8492 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e5563290-1621-4304-9322-1e86da69432f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YXPcEqBd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:42:38 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-9a1cb1d0-d5d7-4a15-b907-4c8f2b9e8492 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:42:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-9a1cb1d0-d5d7-4a15-b907-4c8f2b9e8492 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-9a1cb1d0-d5d7-4a15-b907-4c8f2b9e8492 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:42:38 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-9a1cb1d0-d5d7-4a15-b907-4c8f2b9e8492 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:42:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-9a1cb1d0-d5d7-4a15-b907-4c8f2b9e8492 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5563290-1621-4304-9322-1e86da69432f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-9a1cb1d0-d5d7-4a15-b907-4c8f2b9e8492 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5563290-1621-4304-9322-1e86da69432f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:42:38 user nova-compute[74683]: INFO os_brick.initiator.connectors.iscsi [None req-9a1cb1d0-d5d7-4a15-b907-4c8f2b9e8492 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 11:42:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5563290-1621-4304-9322-1e86da69432f -p 172.16.0.220:3260 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee746d38-b7cb-4a57-9e71-50bd7b9e43c5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:70b9d336ab7d\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5563290-1621-4304-9322-1e86da69432f -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede70289-a713-4df2-add9-859eca640b4b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1cb1d0-d5d7-4a15-b907-4c8f2b9e8492 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 11:42:38 user nova-compute[74683]:  {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5563290-1621-4304-9322-1e86da69432f -p 172.16.0.220:3260 --interface default --op new {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f51904-9c69-4edc-8cb8-2b0ee3d67233]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5563290-1621-4304-9322-1e86da69432f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[3970dd9d-c68c-4886-b1e5-2d9dc97c7c07]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5563290-1621-4304-9322-1e86da69432f] added\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1cb1d0-d5d7-4a15-b907-4c8f2b9e8492 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5563290-1621-4304-9322-1e86da69432f] added
Oct 16 11:42:38 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5563290-1621-4304-9322-1e86da69432f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94995de-9ac9-43f6-95f0-f7794fb7f636]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f081c6e-9d76-447a-bd2c-3655b7235ca8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-14f89a2a-6b57-46e3-be4c-f05f3e3b04a7 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Running cmd (subprocess): nvme version {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-14f89a2a-6b57-46e3-be4c-f05f3e3b04a7 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] 'nvme version' failed. Not Retrying. {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5563290-1621-4304-9322-1e86da69432f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e83d686f-05a4-45dc-8419-8f5ebca3ada0]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.nvmeof [None req-14f89a2a-6b57-46e3-be4c-f05f3e3b04a7 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] nvme not present on system {{(pid=74683) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1cb1d0-d5d7-4a15-b907-4c8f2b9e8492 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5563290-1621-4304-9322-1e86da69432f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5563290-1621-4304-9322-1e86da69432f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[101e35cc-f778-41b2-9dbd-2b89a37e410c]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1cb1d0-d5d7-4a15-b907-4c8f2b9e8492 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5563290-1621-4304-9322-1e86da69432f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YXPcEqBd {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:42:38 user nova-compute[74683]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 11:42:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a49fbc-a3c5-4212-9bfd-401070b442d8]: (4, '') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-14f89a2a-6b57-46e3-be4c-f05f3e3b04a7 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74683) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-14f89a2a-6b57-46e3-be4c-f05f3e3b04a7 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-14f89a2a-6b57-46e3-be4c-f05f3e3b04a7 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] LIGHTOS: no hostnqn found. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG os_brick.utils [None req-14f89a2a-6b57-46e3-be4c-f05f3e3b04a7 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:70b9d336ab7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG nova.virt.block_device [None req-14f89a2a-6b57-46e3-be4c-f05f3e3b04a7 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Updating existing volume attachment record: 0efebe89-554e-4e97-a62e-d1eda5a338ac {{(pid=74683) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5563290-1621-4304-9322-1e86da69432f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YXPcEqBd" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7ff4e1-54af-4df4-b7c6-7997670888fa]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1cb1d0-d5d7-4a15-b907-4c8f2b9e8492 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YXPcEqBd'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5563290-1621-4304-9322-1e86da69432f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5563290-1621-4304-9322-1e86da69432f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29b08db-148c-463c-a821-7c4ef7685db2]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1cb1d0-d5d7-4a15-b907-4c8f2b9e8492 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d0e794-cd43-4f97-b0b7-16cb95bea1eb]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1cb1d0-d5d7-4a15-b907-4c8f2b9e8492 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 (non-flash)
Oct 16 11:42:38 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1cb1d0-d5d7-4a15-b907-4c8f2b9e8492 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 (non-flash)
Oct 16 11:42:38 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5563290-1621-4304-9322-1e86da69432f -p 172.16.0.220:3260 --login {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5563290-1621-4304-9322-1e86da69432f -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba0fb1f-5908-4a6c-ab48-3ed353fbc11f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5563290-1621-4304-9322-1e86da69432f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e5563290-1621-4304-9322-1e86da69432f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1cb1d0-d5d7-4a15-b907-4c8f2b9e8492 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5563290-1621-4304-9322-1e86da69432f, portal: 172.16.0.220,3260]
Oct 16 11:42:38 user nova-compute[74683]: Login to [iface: default, target: iqn.2010-10.org.openstack:e5563290-1621-4304-9322-1e86da69432f, portal: 172.16.0.220,3260] successful.
Oct 16 11:42:38 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5563290-1621-4304-9322-1e86da69432f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5563290-1621-4304-9322-1e86da69432f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e56c1f-1a3c-4905-95e8-a5abb0cdb9d1]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1cb1d0-d5d7-4a15-b907-4c8f2b9e8492 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f72491d-f4ff-4b8d-b3de-e635cd3897bb]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5563290-1621-4304-9322-1e86da69432f (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1cb1d0-d5d7-4a15-b907-4c8f2b9e8492 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 (non-flash)
Oct 16 11:42:38 user nova-compute[74683]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5563290-1621-4304-9322-1e86da69432f (non-flash)
Oct 16 11:42:38 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1cb1d0-d5d7-4a15-b907-4c8f2b9e8492 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 (non-flash)
Oct 16 11:42:38 user nova-compute[74683]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5563290-1621-4304-9322-1e86da69432f (non-flash)
Oct 16 11:42:38 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-9a1cb1d0-d5d7-4a15-b907-4c8f2b9e8492 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5563290-1621-4304-9322-1e86da69432f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.356s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1cb1d0-d5d7-4a15-b907-4c8f2b9e8492 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Connected to 172.16.0.220:3260 {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-9a1cb1d0-d5d7-4a15-b907-4c8f2b9e8492 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=74683) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-9a1cb1d0-d5d7-4a15-b907-4c8f2b9e8492 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74683) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2a3057-f194-4b9a-af57-7c21196e3ff5]: (4, ('- - 0', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-9a1cb1d0-d5d7-4a15-b907-4c8f2b9e8492 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:42:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1cb1d0-d5d7-4a15-b907-4c8f2b9e8492 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e5563290-1621-4304-9322-1e86da69432f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YXPcEqBd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 11:42:38 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Instance destroyed successfully.
Oct 16 11:42:38 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-249f25f7-b021-485e-bbcf-f9d1c1b65b39 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Beginning cold snapshot process
Oct 16 11:42:39 user nova-compute[74683]: DEBUG nova.privsep.utils [None req-249f25f7-b021-485e-bbcf-f9d1c1b65b39 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74683) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 11:42:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-249f25f7-b021-485e-bbcf-f9d1c1b65b39 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/ec2b88a5-6571-4f46-a07d-47ccfc1761e4/disk /opt/stack/data/nova/instances/snapshots/tmp9llwrr_x/5e00ff8c3147456e9b61c0d1a7c21759 {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:42:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-249f25f7-b021-485e-bbcf-f9d1c1b65b39 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/ec2b88a5-6571-4f46-a07d-47ccfc1761e4/disk /opt/stack/data/nova/instances/snapshots/tmp9llwrr_x/5e00ff8c3147456e9b61c0d1a7c21759" returned: 0 in 0.771s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:42:39 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-249f25f7-b021-485e-bbcf-f9d1c1b65b39 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Snapshot extracted, beginning image upload
Oct 16 11:42:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-9a1cb1d0-d5d7-4a15-b907-4c8f2b9e8492 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.395s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:42:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1cb1d0-d5d7-4a15-b907-4c8f2b9e8492 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] <== connect_volume: return (1396ms) {'type': 'block', 'scsi_wwn': '23664366539613736', 'path': '/dev/sdc'} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:42:39 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a1cb1d0-d5d7-4a15-b907-4c8f2b9e8492 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23664366539613736', 'path': '/dev/sdc'} {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 11:42:39 user nova-compute[74683]: DEBUG nova.objects.instance [None req-9a1cb1d0-d5d7-4a15-b907-4c8f2b9e8492 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lazy-loading 'flavor' on Instance uuid 8d94b70c-4056-4c58-9df4-73684e0d164f {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:42:39 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-9a1cb1d0-d5d7-4a15-b907-4c8f2b9e8492 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 11:42:39 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:42:39 user nova-compute[74683]:   <source dev="/dev/sdc"/>
Oct 16 11:42:39 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:42:39 user nova-compute[74683]:   <serial>e5563290-1621-4304-9322-1e86da69432f</serial>
Oct 16 11:42:39 user nova-compute[74683]: </disk>
Oct 16 11:42:39 user nova-compute[74683]:  {{(pid=74683) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 11:42:40 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9a1cb1d0-d5d7-4a15-b907-4c8f2b9e8492 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:42:40 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9a1cb1d0-d5d7-4a15-b907-4c8f2b9e8492 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:42:40 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9a1cb1d0-d5d7-4a15-b907-4c8f2b9e8492 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] No VIF found with MAC fa:16:3e:67:41:41, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:42:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9a1cb1d0-d5d7-4a15-b907-4c8f2b9e8492 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lock "8d94b70c-4056-4c58-9df4-73684e0d164f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.880s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:42:40 user nova-compute[74683]: DEBUG nova.compute.manager [req-a6449497-4832-4951-a10e-00d3dc748f52 req-9e492772-33ac-42fb-b135-c9e379eef76f service nova] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Received event network-vif-plugged-75e552bb-fec2-47bd-adda-d562f27f8a36 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:42:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a6449497-4832-4951-a10e-00d3dc748f52 req-9e492772-33ac-42fb-b135-c9e379eef76f service nova] Acquiring lock "ec2b88a5-6571-4f46-a07d-47ccfc1761e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:42:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a6449497-4832-4951-a10e-00d3dc748f52 req-9e492772-33ac-42fb-b135-c9e379eef76f service nova] Lock "ec2b88a5-6571-4f46-a07d-47ccfc1761e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:42:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a6449497-4832-4951-a10e-00d3dc748f52 req-9e492772-33ac-42fb-b135-c9e379eef76f service nova] Lock "ec2b88a5-6571-4f46-a07d-47ccfc1761e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:42:40 user nova-compute[74683]: DEBUG nova.compute.manager [req-a6449497-4832-4951-a10e-00d3dc748f52 req-9e492772-33ac-42fb-b135-c9e379eef76f service nova] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] No waiting events found dispatching network-vif-plugged-75e552bb-fec2-47bd-adda-d562f27f8a36 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:42:40 user nova-compute[74683]: WARNING nova.compute.manager [req-a6449497-4832-4951-a10e-00d3dc748f52 req-9e492772-33ac-42fb-b135-c9e379eef76f service nova] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Received unexpected event network-vif-plugged-75e552bb-fec2-47bd-adda-d562f27f8a36 for instance with vm_state active and task_state shelving_image_uploading.
Oct 16 11:42:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:42:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:42:42 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-249f25f7-b021-485e-bbcf-f9d1c1b65b39 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Snapshot image upload complete
Oct 16 11:42:42 user nova-compute[74683]: DEBUG nova.compute.manager [None req-249f25f7-b021-485e-bbcf-f9d1c1b65b39 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:42:42 user nova-compute[74683]: INFO nova.compute.manager [None req-249f25f7-b021-485e-bbcf-f9d1c1b65b39 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Shelve offloading
Oct 16 11:42:42 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Instance destroyed successfully.
Oct 16 11:42:42 user nova-compute[74683]: DEBUG nova.compute.manager [None req-249f25f7-b021-485e-bbcf-f9d1c1b65b39 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:42:42 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-249f25f7-b021-485e-bbcf-f9d1c1b65b39 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Acquiring lock "refresh_cache-ec2b88a5-6571-4f46-a07d-47ccfc1761e4" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:42:42 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-249f25f7-b021-485e-bbcf-f9d1c1b65b39 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Acquired lock "refresh_cache-ec2b88a5-6571-4f46-a07d-47ccfc1761e4" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:42:42 user nova-compute[74683]: DEBUG nova.network.neutron [None req-249f25f7-b021-485e-bbcf-f9d1c1b65b39 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:42:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-a705fe10-540c-4bff-951f-3c7e62f9b8fc tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Acquiring lock "8d94b70c-4056-4c58-9df4-73684e0d164f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:42:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-a705fe10-540c-4bff-951f-3c7e62f9b8fc tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lock "8d94b70c-4056-4c58-9df4-73684e0d164f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:42:43 user nova-compute[74683]: INFO nova.compute.manager [None req-a705fe10-540c-4bff-951f-3c7e62f9b8fc tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Detaching volume e5563290-1621-4304-9322-1e86da69432f
Oct 16 11:42:43 user nova-compute[74683]: INFO nova.virt.block_device [None req-a705fe10-540c-4bff-951f-3c7e62f9b8fc tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Attempting to driver detach volume e5563290-1621-4304-9322-1e86da69432f from mountpoint /dev/vdb
Oct 16 11:42:43 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-a705fe10-540c-4bff-951f-3c7e62f9b8fc tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Attempting to detach device vdb from instance 8d94b70c-4056-4c58-9df4-73684e0d164f from the persistent domain config. {{(pid=74683) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 11:42:43 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-a705fe10-540c-4bff-951f-3c7e62f9b8fc tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 11:42:43 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:42:43 user nova-compute[74683]:   <source dev="/dev/sdc"/>
Oct 16 11:42:43 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:42:43 user nova-compute[74683]:   <serial>e5563290-1621-4304-9322-1e86da69432f</serial>
Oct 16 11:42:43 user nova-compute[74683]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 11:42:43 user nova-compute[74683]: </disk>
Oct 16 11:42:43 user nova-compute[74683]:  {{(pid=74683) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 11:42:43 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-a705fe10-540c-4bff-951f-3c7e62f9b8fc tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Successfully detached device vdb from instance 8d94b70c-4056-4c58-9df4-73684e0d164f from the persistent domain config.
Oct 16 11:42:43 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-a705fe10-540c-4bff-951f-3c7e62f9b8fc tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8d94b70c-4056-4c58-9df4-73684e0d164f from the live domain config. {{(pid=74683) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 11:42:43 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-a705fe10-540c-4bff-951f-3c7e62f9b8fc tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 11:42:43 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:42:43 user nova-compute[74683]:   <source dev="/dev/sdc"/>
Oct 16 11:42:43 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:42:43 user nova-compute[74683]:   <serial>e5563290-1621-4304-9322-1e86da69432f</serial>
Oct 16 11:42:43 user nova-compute[74683]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 11:42:43 user nova-compute[74683]: </disk>
Oct 16 11:42:43 user nova-compute[74683]:  {{(pid=74683) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 11:42:43 user nova-compute[74683]: DEBUG nova.network.neutron [None req-249f25f7-b021-485e-bbcf-f9d1c1b65b39 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Updating instance_info_cache with network_info: [{"id": "75e552bb-fec2-47bd-adda-d562f27f8a36", "address": "fa:16:3e:f5:74:eb", "network": {"id": "2ea750a5-8511-4e40-b149-062e10e0096c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-563467594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d2c7c33914a068b448c447db50b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75e552bb-fe", "ovs_interfaceid": "75e552bb-fec2-47bd-adda-d562f27f8a36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:42:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-249f25f7-b021-485e-bbcf-f9d1c1b65b39 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Releasing lock "refresh_cache-ec2b88a5-6571-4f46-a07d-47ccfc1761e4" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:42:43 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-a705fe10-540c-4bff-951f-3c7e62f9b8fc tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8d94b70c-4056-4c58-9df4-73684e0d164f {{(pid=74683) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 11:42:44 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Instance destroyed successfully.
Oct 16 11:42:44 user nova-compute[74683]: DEBUG nova.objects.instance [None req-249f25f7-b021-485e-bbcf-f9d1c1b65b39 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lazy-loading 'resources' on Instance uuid ec2b88a5-6571-4f46-a07d-47ccfc1761e4 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:42:44 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-249f25f7-b021-485e-bbcf-f9d1c1b65b39 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:40:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2110881689',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2110881689',id=45,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDrHmOsUhrm4YYKYARdlKrqlcDFGMaTykPh+zb4tGBwYVOfh9pZUyKRTzLOgTUyJT2LVaX7B+7+kT/t6ev3xOPaVzmYiORuHL6ffe3eYJ1lXFNVKMGK5E0k7O/PLikdAqQ==',key_name='tempest-keypair-127654640',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:40:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='622d2c7c33914a068b448c447db50b3c',ramdisk_id='',reservation_id='r-3kki01l8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-291825158',owner_user_name='tempest-AttachVolumeShelveTestJSON-291825158-project-member',shelved_at='2023-10-16T11:42:42.646944',shelved_host='user',shelved_image_id='6d67bec9-afc0-45d6-a866-9613c3f356b4'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:42:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11130271beb44b368f9eb55bd4946cbc',uuid=ec2b88a5-6571-4f46-a07d-47ccfc1761e4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "75e552bb-fec2-47bd-adda-d562f27f8a36", "address": "fa:16:3e:f5:74:eb", "network": {"id": "2ea750a5-8511-4e40-b149-062e10e0096c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-563467594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d2c7c33914a068b448c447db50b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75e552bb-fe", "ovs_interfaceid": "75e552bb-fec2-47bd-adda-d562f27f8a36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:42:44 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-249f25f7-b021-485e-bbcf-f9d1c1b65b39 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Converting VIF {"id": "75e552bb-fec2-47bd-adda-d562f27f8a36", "address": "fa:16:3e:f5:74:eb", "network": {"id": "2ea750a5-8511-4e40-b149-062e10e0096c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-563467594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d2c7c33914a068b448c447db50b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75e552bb-fe", "ovs_interfaceid": "75e552bb-fec2-47bd-adda-d562f27f8a36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:42:44 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-249f25f7-b021-485e-bbcf-f9d1c1b65b39 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:74:eb,bridge_name='br-int',has_traffic_filtering=True,id=75e552bb-fec2-47bd-adda-d562f27f8a36,network=Network(2ea750a5-8511-4e40-b149-062e10e0096c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75e552bb-fe') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:42:44 user nova-compute[74683]: DEBUG os_vif [None req-249f25f7-b021-485e-bbcf-f9d1c1b65b39 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:74:eb,bridge_name='br-int',has_traffic_filtering=True,id=75e552bb-fec2-47bd-adda-d562f27f8a36,network=Network(2ea750a5-8511-4e40-b149-062e10e0096c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75e552bb-fe') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:42:44 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:42:44 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap75e552bb-fe, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:42:44 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:42:44 user nova-compute[74683]: DEBUG nova.compute.manager [req-30f3abe3-3b55-4a95-869d-204f2bbea7a7 req-aee68a35-304d-4c7e-a9a2-bd60322d3aae service nova] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Received event network-changed-75e552bb-fec2-47bd-adda-d562f27f8a36 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:42:44 user nova-compute[74683]: DEBUG nova.compute.manager [req-30f3abe3-3b55-4a95-869d-204f2bbea7a7 req-aee68a35-304d-4c7e-a9a2-bd60322d3aae service nova] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Refreshing instance network info cache due to event network-changed-75e552bb-fec2-47bd-adda-d562f27f8a36. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:42:44 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-30f3abe3-3b55-4a95-869d-204f2bbea7a7 req-aee68a35-304d-4c7e-a9a2-bd60322d3aae service nova] Acquiring lock "refresh_cache-ec2b88a5-6571-4f46-a07d-47ccfc1761e4" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:42:44 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-30f3abe3-3b55-4a95-869d-204f2bbea7a7 req-aee68a35-304d-4c7e-a9a2-bd60322d3aae service nova] Acquired lock "refresh_cache-ec2b88a5-6571-4f46-a07d-47ccfc1761e4" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:42:44 user nova-compute[74683]: DEBUG nova.network.neutron [req-30f3abe3-3b55-4a95-869d-204f2bbea7a7 req-aee68a35-304d-4c7e-a9a2-bd60322d3aae service nova] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Refreshing network info cache for port 75e552bb-fec2-47bd-adda-d562f27f8a36 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:42:44 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:42:44 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:42:44 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e87ca5c3-2c37-48a9-9a77-e8d45b5c3490) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:42:44 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:42:44 user nova-compute[74683]: INFO os_vif [None req-249f25f7-b021-485e-bbcf-f9d1c1b65b39 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:74:eb,bridge_name='br-int',has_traffic_filtering=True,id=75e552bb-fec2-47bd-adda-d562f27f8a36,network=Network(2ea750a5-8511-4e40-b149-062e10e0096c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75e552bb-fe')
Oct 16 11:42:44 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-249f25f7-b021-485e-bbcf-f9d1c1b65b39 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Deleting instance files /opt/stack/data/nova/instances/ec2b88a5-6571-4f46-a07d-47ccfc1761e4_del
Oct 16 11:42:44 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-249f25f7-b021-485e-bbcf-f9d1c1b65b39 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Deletion of /opt/stack/data/nova/instances/ec2b88a5-6571-4f46-a07d-47ccfc1761e4_del complete
Oct 16 11:42:44 user nova-compute[74683]: INFO nova.scheduler.client.report [None req-249f25f7-b021-485e-bbcf-f9d1c1b65b39 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Deleted allocations for instance ec2b88a5-6571-4f46-a07d-47ccfc1761e4
Oct 16 11:42:44 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-249f25f7-b021-485e-bbcf-f9d1c1b65b39 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:42:44 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-249f25f7-b021-485e-bbcf-f9d1c1b65b39 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:42:44 user nova-compute[74683]: DEBUG nova.objects.instance [None req-249f25f7-b021-485e-bbcf-f9d1c1b65b39 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lazy-loading 'numa_topology' on Instance uuid ec2b88a5-6571-4f46-a07d-47ccfc1761e4 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:42:44 user nova-compute[74683]: DEBUG nova.objects.base [None req-249f25f7-b021-485e-bbcf-f9d1c1b65b39 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Object Instance<ec2b88a5-6571-4f46-a07d-47ccfc1761e4> lazy-loaded attributes: resources,numa_topology {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:42:44 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-249f25f7-b021-485e-bbcf-f9d1c1b65b39 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:42:44 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-249f25f7-b021-485e-bbcf-f9d1c1b65b39 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:42:44 user nova-compute[74683]: DEBUG nova.network.neutron [req-30f3abe3-3b55-4a95-869d-204f2bbea7a7 req-aee68a35-304d-4c7e-a9a2-bd60322d3aae service nova] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Updated VIF entry in instance network info cache for port 75e552bb-fec2-47bd-adda-d562f27f8a36. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:42:44 user nova-compute[74683]: DEBUG nova.network.neutron [req-30f3abe3-3b55-4a95-869d-204f2bbea7a7 req-aee68a35-304d-4c7e-a9a2-bd60322d3aae service nova] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Updating instance_info_cache with network_info: [{"id": "75e552bb-fec2-47bd-adda-d562f27f8a36", "address": "fa:16:3e:f5:74:eb", "network": {"id": "2ea750a5-8511-4e40-b149-062e10e0096c", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-563467594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d2c7c33914a068b448c447db50b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap75e552bb-fe", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:42:44 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-249f25f7-b021-485e-bbcf-f9d1c1b65b39 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.225s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:42:44 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-30f3abe3-3b55-4a95-869d-204f2bbea7a7 req-aee68a35-304d-4c7e-a9a2-bd60322d3aae service nova] Releasing lock "refresh_cache-ec2b88a5-6571-4f46-a07d-47ccfc1761e4" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:42:44 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-249f25f7-b021-485e-bbcf-f9d1c1b65b39 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "ec2b88a5-6571-4f46-a07d-47ccfc1761e4" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.598s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:42:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:42:49 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:42:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:42:54 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:42:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:42:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:42:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:42:59 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:43:01 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:43:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:43:03 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-a705fe10-540c-4bff-951f-3c7e62f9b8fc tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8d94b70c-4056-4c58-9df4-73684e0d164f is timed out.
Oct 16 11:43:03 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-a705fe10-540c-4bff-951f-3c7e62f9b8fc tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Successfully detached device vdb from instance 8d94b70c-4056-4c58-9df4-73684e0d164f from the live domain config.
Oct 16 11:43:03 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a705fe10-540c-4bff-951f-3c7e62f9b8fc tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] calling os-brick to detach iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 11:43:03 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a705fe10-540c-4bff-951f-3c7e62f9b8fc tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, {'target_iqn': 'iqn.2010-10.org.openstack:e5563290-1621-4304-9322-1e86da69432f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YXPcEqBd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:43:03 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-a705fe10-540c-4bff-951f-3c7e62f9b8fc tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:43:03 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-a705fe10-540c-4bff-951f-3c7e62f9b8fc tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:43:03 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-a705fe10-540c-4bff-951f-3c7e62f9b8fc tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:43:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:43:03 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14f89a2a-6b57-46e3-be4c-f05f3e3b04a7 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Calling os-brick to attach iSCSI Volume {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 11:43:03 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f89a2a-6b57-46e3-be4c-f05f3e3b04a7 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:16c2f162-3f13-4e4d-b413-d1e6c684f93b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tGWnUPel', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:43:03 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-14f89a2a-6b57-46e3-be4c-f05f3e3b04a7 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:43:03 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-14f89a2a-6b57-46e3-be4c-f05f3e3b04a7 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:43:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:43:03 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6daf8c-ab13-4463-a62e-f7ae2e846de2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e5563290-1621-4304-9322-1e86da69432f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:43:03 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a705fe10-540c-4bff-951f-3c7e62f9b8fc tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 11:43:03 user nova-compute[74683]: No targets found.
Oct 16 11:43:03 user nova-compute[74683]: iSNS:
Oct 16 11:43:03 user nova-compute[74683]: No targets found.
Oct 16 11:43:03 user nova-compute[74683]: STATIC:
Oct 16 11:43:03 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:e5563290-1621-4304-9322-1e86da69432f
Oct 16 11:43:03 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:43:03 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:43:03 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0
Oct 16 11:43:03 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:43:03 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:43:03 user nova-compute[74683]: FIRMWARE:
Oct 16 11:43:03 user nova-compute[74683]: No targets found.
Oct 16 11:43:03 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:43:03 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a705fe10-540c-4bff-951f-3c7e62f9b8fc tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 11:43:03 user nova-compute[74683]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 11:43:03 user nova-compute[74683]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74683) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 11:43:03 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a705fe10-540c-4bff-951f-3c7e62f9b8fc tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5563290-1621-4304-9322-1e86da69432f', 0)] {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 11:43:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:43:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:43:03 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e45a79c-9d3d-4432-a026-2acf1b1ad17a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5563290-1621-4304-9322-1e86da69432f\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:43:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:43:03 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:43:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:43:03 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff144d5-f11b-47db-b525-688b080929ad]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5563290-1621-4304-9322-1e86da69432f (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:43:03 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a705fe10-540c-4bff-951f-3c7e62f9b8fc tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 (non-flash)
Oct 16 11:43:03 user nova-compute[74683]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5563290-1621-4304-9322-1e86da69432f (non-flash)
Oct 16 11:43:03 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:43:03 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a705fe10-540c-4bff-951f-3c7e62f9b8fc tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 (non-flash)
Oct 16 11:43:03 user nova-compute[74683]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5563290-1621-4304-9322-1e86da69432f (non-flash)
Oct 16 11:43:03 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:43:03 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a705fe10-540c-4bff-951f-3c7e62f9b8fc tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda6c4417e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5563290-1621-4304-9322-1e86da69432f'): ({'sdc'}, set())}) {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 11:43:03 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-a705fe10-540c-4bff-951f-3c7e62f9b8fc tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Removing single pathed devices sdc {{(pid=74683) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 11:43:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:43:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:43:03 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab699dd-1022-4322-bca3-62f3212dcefc]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:43:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:43:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:43:03 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a782e99d-32dd-4548-a0d4-46769c13591d]: (4, ('ok\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:43:03 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-a705fe10-540c-4bff-951f-3c7e62f9b8fc tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Flushing IO for device /dev/sdc {{(pid=74683) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 11:43:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:43:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:43:03 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8b5dde-c488-49e2-9cdb-2312783802b0]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:43:03 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-a705fe10-540c-4bff-951f-3c7e62f9b8fc tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74683) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 11:43:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:43:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.033s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:43:03 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d5dfad-3904-4a1d-9a01-4aec34086b2d]: (4, ('1', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:43:03 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-a705fe10-540c-4bff-951f-3c7e62f9b8fc tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 11:43:03 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-a705fe10-540c-4bff-951f-3c7e62f9b8fc tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] SCSI volumes sdc have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 11:43:03 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a705fe10-540c-4bff-951f-3c7e62f9b8fc tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5563290-1621-4304-9322-1e86da69432f')] {{(pid=74683) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 11:43:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5563290-1621-4304-9322-1e86da69432f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:43:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5563290-1621-4304-9322-1e86da69432f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:43:03 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[70017728-1717-4265-b1a4-94ed7a1ab132]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:43:03 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a705fe10-540c-4bff-951f-3c7e62f9b8fc tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:43:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5563290-1621-4304-9322-1e86da69432f -p 172.16.0.220:3260 --logout {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:43:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5563290-1621-4304-9322-1e86da69432f -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:43:03 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c87ffa0-3a81-4e66-9ad4-2b64f8e9df38]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:e5563290-1621-4304-9322-1e86da69432f, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:e5563290-1621-4304-9322-1e86da69432f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:43:03 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a705fe10-540c-4bff-951f-3c7e62f9b8fc tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:e5563290-1621-4304-9322-1e86da69432f, portal: 172.16.0.220,3260]
Oct 16 11:43:03 user nova-compute[74683]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:e5563290-1621-4304-9322-1e86da69432f, portal: 172.16.0.220,3260] successful.
Oct 16 11:43:03 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:43:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5563290-1621-4304-9322-1e86da69432f -p 172.16.0.220:3260 --op delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:43:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5563290-1621-4304-9322-1e86da69432f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:43:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[af194881-c09c-4d33-a190-15aec3c13f76]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:43:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a705fe10-540c-4bff-951f-3c7e62f9b8fc tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:43:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-a705fe10-540c-4bff-951f-3c7e62f9b8fc tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.267s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:43:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-a705fe10-540c-4bff-951f-3c7e62f9b8fc tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] <== disconnect_volume: return (268ms) None {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:43:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a705fe10-540c-4bff-951f-3c7e62f9b8fc tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Disconnected iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 11:43:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-14f89a2a-6b57-46e3-be4c-f05f3e3b04a7 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.266s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:43:04 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-14f89a2a-6b57-46e3-be4c-f05f3e3b04a7 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:43:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-14f89a2a-6b57-46e3-be4c-f05f3e3b04a7 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16c2f162-3f13-4e4d-b413-d1e6c684f93b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:43:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-14f89a2a-6b57-46e3-be4c-f05f3e3b04a7 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16c2f162-3f13-4e4d-b413-d1e6c684f93b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:43:04 user nova-compute[74683]: INFO os_brick.initiator.connectors.iscsi [None req-14f89a2a-6b57-46e3-be4c-f05f3e3b04a7 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 11:43:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c2f162-3f13-4e4d-b413-d1e6c684f93b -p 172.16.0.220:3260 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:43:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c2f162-3f13-4e4d-b413-d1e6c684f93b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:43:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2ea979-9b56-465f-bd7f-be22a417e5d8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:43:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f89a2a-6b57-46e3-be4c-f05f3e3b04a7 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 11:43:04 user nova-compute[74683]:  {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:43:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c2f162-3f13-4e4d-b413-d1e6c684f93b -p 172.16.0.220:3260 --interface default --op new {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:43:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c2f162-3f13-4e4d-b413-d1e6c684f93b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:43:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca1872f-d35e-4c28-9b0b-10b3831c9b56]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16c2f162-3f13-4e4d-b413-d1e6c684f93b] added\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:43:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f89a2a-6b57-46e3-be4c-f05f3e3b04a7 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16c2f162-3f13-4e4d-b413-d1e6c684f93b] added
Oct 16 11:43:04 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:43:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c2f162-3f13-4e4d-b413-d1e6c684f93b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:43:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c2f162-3f13-4e4d-b413-d1e6c684f93b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:43:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe6eb8f-4ae9-4020-ab76-e223a0fc40ef]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:43:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f89a2a-6b57-46e3-be4c-f05f3e3b04a7 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:43:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c2f162-3f13-4e4d-b413-d1e6c684f93b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:43:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c2f162-3f13-4e4d-b413-d1e6c684f93b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:43:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[504a7a27-3529-49dc-8168-22e23ac53560]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:43:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f89a2a-6b57-46e3-be4c-f05f3e3b04a7 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:43:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c2f162-3f13-4e4d-b413-d1e6c684f93b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tGWnUPel {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:43:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c2f162-3f13-4e4d-b413-d1e6c684f93b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tGWnUPel" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:43:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f59753-4c1a-46e7-b4f6-3da753b64839]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:43:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f89a2a-6b57-46e3-be4c-f05f3e3b04a7 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tGWnUPel'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:43:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c2f162-3f13-4e4d-b413-d1e6c684f93b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:43:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c2f162-3f13-4e4d-b413-d1e6c684f93b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:43:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[69bbff76-436d-4e4a-b537-a737ac73c3bc]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:43:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f89a2a-6b57-46e3-be4c-f05f3e3b04a7 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:43:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:43:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:43:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[8082381d-3cb9-48fd-9d1f-86994a526fae]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:43:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f89a2a-6b57-46e3-be4c-f05f3e3b04a7 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 (non-flash)
Oct 16 11:43:04 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:43:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f89a2a-6b57-46e3-be4c-f05f3e3b04a7 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 (non-flash)
Oct 16 11:43:04 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:43:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c2f162-3f13-4e4d-b413-d1e6c684f93b -p 172.16.0.220:3260 --login {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:43:04 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:43:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c2f162-3f13-4e4d-b413-d1e6c684f93b -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:43:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3ef83c-2995-4b7f-89a3-bc9bbaa7fe4c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:16c2f162-3f13-4e4d-b413-d1e6c684f93b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:16c2f162-3f13-4e4d-b413-d1e6c684f93b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:43:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f89a2a-6b57-46e3-be4c-f05f3e3b04a7 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:16c2f162-3f13-4e4d-b413-d1e6c684f93b, portal: 172.16.0.220,3260]
Oct 16 11:43:04 user nova-compute[74683]: Login to [iface: default, target: iqn.2010-10.org.openstack:16c2f162-3f13-4e4d-b413-d1e6c684f93b, portal: 172.16.0.220,3260] successful.
Oct 16 11:43:04 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:43:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c2f162-3f13-4e4d-b413-d1e6c684f93b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:43:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c2f162-3f13-4e4d-b413-d1e6c684f93b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:43:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bce709b-33b1-46c6-aade-0dfa036595d8]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:43:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f89a2a-6b57-46e3-be4c-f05f3e3b04a7 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:43:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:43:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:43:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[b828da3e-07a5-45ba-ba06-4875366de450]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c2f162-3f13-4e4d-b413-d1e6c684f93b (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:43:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f89a2a-6b57-46e3-be4c-f05f3e3b04a7 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 (non-flash)
Oct 16 11:43:04 user nova-compute[74683]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c2f162-3f13-4e4d-b413-d1e6c684f93b (non-flash)
Oct 16 11:43:04 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:43:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f89a2a-6b57-46e3-be4c-f05f3e3b04a7 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 (non-flash)
Oct 16 11:43:04 user nova-compute[74683]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c2f162-3f13-4e4d-b413-d1e6c684f93b (non-flash)
Oct 16 11:43:04 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:43:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-14f89a2a-6b57-46e3-be4c-f05f3e3b04a7 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16c2f162-3f13-4e4d-b413-d1e6c684f93b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:43:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f89a2a-6b57-46e3-be4c-f05f3e3b04a7 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Connected to 172.16.0.220:3260 {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 11:43:04 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-14f89a2a-6b57-46e3-be4c-f05f3e3b04a7 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=74683) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 11:43:04 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-14f89a2a-6b57-46e3-be4c-f05f3e3b04a7 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74683) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 11:43:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:43:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:43:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f02d56-f09d-428b-9386-d01be381dd76]: (4, ('- - 0', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:43:04 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-14f89a2a-6b57-46e3-be4c-f05f3e3b04a7 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:43:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f89a2a-6b57-46e3-be4c-f05f3e3b04a7 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:16c2f162-3f13-4e4d-b413-d1e6c684f93b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tGWnUPel', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 11:43:04 user nova-compute[74683]: DEBUG nova.objects.instance [None req-a705fe10-540c-4bff-951f-3c7e62f9b8fc tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lazy-loading 'flavor' on Instance uuid 8d94b70c-4056-4c58-9df4-73684e0d164f {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:43:05 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-a705fe10-540c-4bff-951f-3c7e62f9b8fc tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lock "8d94b70c-4056-4c58-9df4-73684e0d164f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.837s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:43:05 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-14f89a2a-6b57-46e3-be4c-f05f3e3b04a7 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:43:05 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f89a2a-6b57-46e3-be4c-f05f3e3b04a7 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] <== connect_volume: return (1559ms) {'type': 'block', 'scsi_wwn': '26163303234613964', 'path': '/dev/sdc'} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:43:05 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14f89a2a-6b57-46e3-be4c-f05f3e3b04a7 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163303234613964', 'path': '/dev/sdc'} {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 11:43:05 user nova-compute[74683]: DEBUG nova.objects.instance [None req-14f89a2a-6b57-46e3-be4c-f05f3e3b04a7 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lazy-loading 'flavor' on Instance uuid af8104c2-2ea1-4e66-bf74-08074566111f {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:43:05 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-14f89a2a-6b57-46e3-be4c-f05f3e3b04a7 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 11:43:05 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:43:05 user nova-compute[74683]:   <source dev="/dev/sdc"/>
Oct 16 11:43:05 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:43:05 user nova-compute[74683]:   <serial>16c2f162-3f13-4e4d-b413-d1e6c684f93b</serial>
Oct 16 11:43:05 user nova-compute[74683]: </disk>
Oct 16 11:43:05 user nova-compute[74683]:  {{(pid=74683) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 11:43:05 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-14f89a2a-6b57-46e3-be4c-f05f3e3b04a7 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:43:05 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-14f89a2a-6b57-46e3-be4c-f05f3e3b04a7 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:43:05 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-14f89a2a-6b57-46e3-be4c-f05f3e3b04a7 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] No VIF found with MAC fa:16:3e:a5:05:18, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:43:05 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-14f89a2a-6b57-46e3-be4c-f05f3e3b04a7 tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lock "af8104c2-2ea1-4e66-bf74-08074566111f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.592s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:43:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:43:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Acquiring lock "3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:43:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Lock "3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:43:08 user nova-compute[74683]: DEBUG nova.compute.manager [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Starting instance... {{(pid=74683) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 11:43:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:43:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:43:08 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74683) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 11:43:08 user nova-compute[74683]: INFO nova.compute.claims [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Claim successful on node user
Oct 16 11:43:08 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:43:08 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:43:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.353s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:43:08 user nova-compute[74683]: DEBUG nova.compute.manager [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Start building networks asynchronously for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 11:43:08 user nova-compute[74683]: DEBUG nova.compute.manager [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Allocating IP information in the background. {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 11:43:08 user nova-compute[74683]: DEBUG nova.network.neutron [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] allocate_for_instance() {{(pid=74683) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 11:43:08 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 11:43:08 user nova-compute[74683]: DEBUG nova.compute.manager [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Start building block device mappings for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 11:43:08 user nova-compute[74683]: DEBUG nova.policy [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c8c416a490ca45d7946ae9fdd7f4896a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05dd191b8dd44be397c64d283cd5d441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74683) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 11:43:08 user nova-compute[74683]: DEBUG nova.compute.manager [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Start spawning the instance on the hypervisor. {{(pid=74683) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 11:43:08 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Creating instance directory {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 11:43:08 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Creating image(s)
Oct 16 11:43:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Acquiring lock "/opt/stack/data/nova/instances/3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:43:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Lock "/opt/stack/data/nova/instances/3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:43:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Lock "/opt/stack/data/nova/instances/3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:43:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:43:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.193s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:43:09 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Acquiring lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:43:09 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:43:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:43:09 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:43:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.190s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:43:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94/disk 1073741824 {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:43:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94/disk 1073741824" returned: 0 in 0.057s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:43:09 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:43:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:43:09 user nova-compute[74683]: DEBUG nova.network.neutron [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Successfully created port: 89990cc1-ff0b-45bf-b1e5-b61492762fef {{(pid=74683) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 11:43:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.232s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:43:09 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94/disk. size=1073741824 {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 11:43:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:43:09 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:43:09 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Cannot resize image /opt/stack/data/nova/instances/3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94/disk to a smaller size. {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 11:43:09 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Created local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 11:43:09 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Ensure instance console log exists: /opt/stack/data/nova/instances/3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94/console.log {{(pid=74683) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 11:43:09 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:43:09 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:43:09 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG nova.network.neutron [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Successfully updated port: 89990cc1-ff0b-45bf-b1e5-b61492762fef {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Acquiring lock "refresh_cache-3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Acquired lock "refresh_cache-3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG nova.network.neutron [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG nova.compute.manager [req-36e49d89-0af2-465e-b811-1fa9e5f9edee req-03e6dccc-255f-4a08-8663-54a3bf06092a service nova] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Received event network-changed-89990cc1-ff0b-45bf-b1e5-b61492762fef {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG nova.compute.manager [req-36e49d89-0af2-465e-b811-1fa9e5f9edee req-03e6dccc-255f-4a08-8663-54a3bf06092a service nova] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Refreshing instance network info cache due to event network-changed-89990cc1-ff0b-45bf-b1e5-b61492762fef. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-36e49d89-0af2-465e-b811-1fa9e5f9edee req-03e6dccc-255f-4a08-8663-54a3bf06092a service nova] Acquiring lock "refresh_cache-3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG nova.network.neutron [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Acquiring lock "d6acbac6-01f7-4c5e-ba2f-1650713d1452" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "d6acbac6-01f7-4c5e-ba2f-1650713d1452" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG nova.compute.manager [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Starting instance... {{(pid=74683) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG nova.network.neutron [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Updating instance_info_cache with network_info: [{"id": "89990cc1-ff0b-45bf-b1e5-b61492762fef", "address": "fa:16:3e:8e:cd:08", "network": {"id": "f778eacd-969f-4106-913e-613bfb09ebfa", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-94933002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05dd191b8dd44be397c64d283cd5d441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89990cc1-ff", "ovs_interfaceid": "89990cc1-ff0b-45bf-b1e5-b61492762fef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74683) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 11:43:10 user nova-compute[74683]: INFO nova.compute.claims [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Claim successful on node user
Oct 16 11:43:10 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Releasing lock "refresh_cache-3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG nova.compute.manager [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Instance network_info: |[{"id": "89990cc1-ff0b-45bf-b1e5-b61492762fef", "address": "fa:16:3e:8e:cd:08", "network": {"id": "f778eacd-969f-4106-913e-613bfb09ebfa", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-94933002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05dd191b8dd44be397c64d283cd5d441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89990cc1-ff", "ovs_interfaceid": "89990cc1-ff0b-45bf-b1e5-b61492762fef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-36e49d89-0af2-465e-b811-1fa9e5f9edee req-03e6dccc-255f-4a08-8663-54a3bf06092a service nova] Acquired lock "refresh_cache-3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG nova.network.neutron [req-36e49d89-0af2-465e-b811-1fa9e5f9edee req-03e6dccc-255f-4a08-8663-54a3bf06092a service nova] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Refreshing network info cache for port 89990cc1-ff0b-45bf-b1e5-b61492762fef {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Start _get_guest_xml network_info=[{"id": "89990cc1-ff0b-45bf-b1e5-b61492762fef", "address": "fa:16:3e:8e:cd:08", "network": {"id": "f778eacd-969f-4106-913e-613bfb09ebfa", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-94933002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05dd191b8dd44be397c64d283cd5d441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89990cc1-ff", "ovs_interfaceid": "89990cc1-ff0b-45bf-b1e5-b61492762fef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:43:10 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:43:10 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:43:10 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:43:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-108034303',display_name='tempest-TestServerVolumeAttachmentScenario-server-108034303',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-108034303',id=47,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKg3PS17S/fJhgw4qUzmaKPMFx+xynYj3r6oNKDPVxa3pduB1I9bix5ZhH26j8N9SFpT0KXzaGPF0mnrBQ/UscE7IPlTPb7/Si8tF1COD8ki8dpoFg9yfFkg2cxlEM95gQ==',key_name='tempest-keypair-323076518',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05dd191b8dd44be397c64d283cd5d441',ramdisk_id='',reservation_id='r-qblqy7e5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1231121602',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1231121602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:43:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8c416a490ca45d7946ae9fdd7f4896a',uuid=3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89990cc1-ff0b-45bf-b1e5-b61492762fef", "address": "fa:16:3e:8e:cd:08", "network": {"id": "f778eacd-969f-4106-913e-613bfb09ebfa", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-94933002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05dd191b8dd44be397c64d283cd5d441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89990cc1-ff", "ovs_interfaceid": "89990cc1-ff0b-45bf-b1e5-b61492762fef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Converting VIF {"id": "89990cc1-ff0b-45bf-b1e5-b61492762fef", "address": "fa:16:3e:8e:cd:08", "network": {"id": "f778eacd-969f-4106-913e-613bfb09ebfa", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-94933002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05dd191b8dd44be397c64d283cd5d441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89990cc1-ff", "ovs_interfaceid": "89990cc1-ff0b-45bf-b1e5-b61492762fef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:cd:08,bridge_name='br-int',has_traffic_filtering=True,id=89990cc1-ff0b-45bf-b1e5-b61492762fef,network=Network(f778eacd-969f-4106-913e-613bfb09ebfa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89990cc1-ff') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG nova.objects.instance [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Lazy-loading 'pci_devices' on Instance uuid 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:43:10 user nova-compute[74683]:   <uuid>3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94</uuid>
Oct 16 11:43:10 user nova-compute[74683]:   <name>instance-0000002f</name>
Oct 16 11:43:10 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:43:10 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:43:10 user nova-compute[74683]:   <metadata>
Oct 16 11:43:10 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:43:10 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:43:10 user nova-compute[74683]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-108034303</nova:name>
Oct 16 11:43:10 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:43:10</nova:creationTime>
Oct 16 11:43:10 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:43:10 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:43:10 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:43:10 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:43:10 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:43:10 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:43:10 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:43:10 user nova-compute[74683]:       <nova:owner>
Oct 16 11:43:10 user nova-compute[74683]:         <nova:user uuid="c8c416a490ca45d7946ae9fdd7f4896a">tempest-TestServerVolumeAttachmentScenario-1231121602-project-member</nova:user>
Oct 16 11:43:10 user nova-compute[74683]:         <nova:project uuid="05dd191b8dd44be397c64d283cd5d441">tempest-TestServerVolumeAttachmentScenario-1231121602</nova:project>
Oct 16 11:43:10 user nova-compute[74683]:       </nova:owner>
Oct 16 11:43:10 user nova-compute[74683]:       <nova:root type="image" uuid="0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f"/>
Oct 16 11:43:10 user nova-compute[74683]:       <nova:ports>
Oct 16 11:43:10 user nova-compute[74683]:         <nova:port uuid="89990cc1-ff0b-45bf-b1e5-b61492762fef">
Oct 16 11:43:10 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 16 11:43:10 user nova-compute[74683]:         </nova:port>
Oct 16 11:43:10 user nova-compute[74683]:       </nova:ports>
Oct 16 11:43:10 user nova-compute[74683]:     </nova:instance>
Oct 16 11:43:10 user nova-compute[74683]:   </metadata>
Oct 16 11:43:10 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:43:10 user nova-compute[74683]:     <system>
Oct 16 11:43:10 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:43:10 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:43:10 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:43:10 user nova-compute[74683]:       <entry name="serial">3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94</entry>
Oct 16 11:43:10 user nova-compute[74683]:       <entry name="uuid">3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94</entry>
Oct 16 11:43:10 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:43:10 user nova-compute[74683]:     </system>
Oct 16 11:43:10 user nova-compute[74683]:   </sysinfo>
Oct 16 11:43:10 user nova-compute[74683]:   <os>
Oct 16 11:43:10 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:43:10 user nova-compute[74683]:     <boot dev="hd"/>
Oct 16 11:43:10 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:43:10 user nova-compute[74683]:   </os>
Oct 16 11:43:10 user nova-compute[74683]:   <features>
Oct 16 11:43:10 user nova-compute[74683]:     <acpi/>
Oct 16 11:43:10 user nova-compute[74683]:     <apic/>
Oct 16 11:43:10 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:43:10 user nova-compute[74683]:   </features>
Oct 16 11:43:10 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:43:10 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:43:10 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:43:10 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:43:10 user nova-compute[74683]:   </clock>
Oct 16 11:43:10 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:43:10 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:43:10 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:43:10 user nova-compute[74683]:   </cpu>
Oct 16 11:43:10 user nova-compute[74683]:   <devices>
Oct 16 11:43:10 user nova-compute[74683]:     <disk type="file" device="disk">
Oct 16 11:43:10 user nova-compute[74683]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 11:43:10 user nova-compute[74683]:       <source file="/opt/stack/data/nova/instances/3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94/disk"/>
Oct 16 11:43:10 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:43:10 user nova-compute[74683]:     </disk>
Oct 16 11:43:10 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:43:10 user nova-compute[74683]:       <mac address="fa:16:3e:8e:cd:08"/>
Oct 16 11:43:10 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:43:10 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:43:10 user nova-compute[74683]:       <target dev="tap89990cc1-ff"/>
Oct 16 11:43:10 user nova-compute[74683]:     </interface>
Oct 16 11:43:10 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:43:10 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94/console.log" append="off"/>
Oct 16 11:43:10 user nova-compute[74683]:     </serial>
Oct 16 11:43:10 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:43:10 user nova-compute[74683]:     <video>
Oct 16 11:43:10 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:43:10 user nova-compute[74683]:     </video>
Oct 16 11:43:10 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:43:10 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:43:10 user nova-compute[74683]:     </rng>
Oct 16 11:43:10 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:43:10 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:43:10 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:43:10 user nova-compute[74683]:     </memballoon>
Oct 16 11:43:10 user nova-compute[74683]:   </devices>
Oct 16 11:43:10 user nova-compute[74683]: </domain>
Oct 16 11:43:10 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:43:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-108034303',display_name='tempest-TestServerVolumeAttachmentScenario-server-108034303',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-108034303',id=47,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKg3PS17S/fJhgw4qUzmaKPMFx+xynYj3r6oNKDPVxa3pduB1I9bix5ZhH26j8N9SFpT0KXzaGPF0mnrBQ/UscE7IPlTPb7/Si8tF1COD8ki8dpoFg9yfFkg2cxlEM95gQ==',key_name='tempest-keypair-323076518',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05dd191b8dd44be397c64d283cd5d441',ramdisk_id='',reservation_id='r-qblqy7e5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1231121602',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1231121602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:43:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8c416a490ca45d7946ae9fdd7f4896a',uuid=3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89990cc1-ff0b-45bf-b1e5-b61492762fef", "address": "fa:16:3e:8e:cd:08", "network": {"id": "f778eacd-969f-4106-913e-613bfb09ebfa", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-94933002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05dd191b8dd44be397c64d283cd5d441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89990cc1-ff", "ovs_interfaceid": "89990cc1-ff0b-45bf-b1e5-b61492762fef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Converting VIF {"id": "89990cc1-ff0b-45bf-b1e5-b61492762fef", "address": "fa:16:3e:8e:cd:08", "network": {"id": "f778eacd-969f-4106-913e-613bfb09ebfa", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-94933002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05dd191b8dd44be397c64d283cd5d441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89990cc1-ff", "ovs_interfaceid": "89990cc1-ff0b-45bf-b1e5-b61492762fef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:cd:08,bridge_name='br-int',has_traffic_filtering=True,id=89990cc1-ff0b-45bf-b1e5-b61492762fef,network=Network(f778eacd-969f-4106-913e-613bfb09ebfa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89990cc1-ff') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG os_vif [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:cd:08,bridge_name='br-int',has_traffic_filtering=True,id=89990cc1-ff0b-45bf-b1e5-b61492762fef,network=Network(f778eacd-969f-4106-913e-613bfb09ebfa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89990cc1-ff') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c6862464-c468-5a76-878a-4da033b2c576', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap89990cc1-ff, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap89990cc1-ff, col_values=(('qos', UUID('3e33a92e-2d20-4770-9160-7e1e16b30d8f')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap89990cc1-ff, col_values=(('external_ids', {'iface-id': '89990cc1-ff0b-45bf-b1e5-b61492762fef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:cd:08', 'vm-uuid': '3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:43:10 user nova-compute[74683]: INFO os_vif [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:cd:08,bridge_name='br-int',has_traffic_filtering=True,id=89990cc1-ff0b-45bf-b1e5-b61492762fef,network=Network(f778eacd-969f-4106-913e-613bfb09ebfa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89990cc1-ff')
Oct 16 11:43:10 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] No VIF found with MAC fa:16:3e:8e:cd:08, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.354s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG nova.compute.manager [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Start building networks asynchronously for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG nova.compute.manager [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Allocating IP information in the background. {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG nova.network.neutron [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] allocate_for_instance() {{(pid=74683) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG nova.network.neutron [req-36e49d89-0af2-465e-b811-1fa9e5f9edee req-03e6dccc-255f-4a08-8663-54a3bf06092a service nova] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Updated VIF entry in instance network info cache for port 89990cc1-ff0b-45bf-b1e5-b61492762fef. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG nova.network.neutron [req-36e49d89-0af2-465e-b811-1fa9e5f9edee req-03e6dccc-255f-4a08-8663-54a3bf06092a service nova] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Updating instance_info_cache with network_info: [{"id": "89990cc1-ff0b-45bf-b1e5-b61492762fef", "address": "fa:16:3e:8e:cd:08", "network": {"id": "f778eacd-969f-4106-913e-613bfb09ebfa", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-94933002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05dd191b8dd44be397c64d283cd5d441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89990cc1-ff", "ovs_interfaceid": "89990cc1-ff0b-45bf-b1e5-b61492762fef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:43:10 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 11:43:10 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-36e49d89-0af2-465e-b811-1fa9e5f9edee req-03e6dccc-255f-4a08-8663-54a3bf06092a service nova] Releasing lock "refresh_cache-3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG nova.compute.manager [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Start building block device mappings for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 11:43:10 user nova-compute[74683]: DEBUG nova.policy [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c38fd3bc86ba4b7a95e06b926d22e60f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889cb980200446c0933fe965738a62df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74683) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 11:43:11 user nova-compute[74683]: DEBUG nova.compute.manager [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Start spawning the instance on the hypervisor. {{(pid=74683) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 11:43:11 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Creating instance directory {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 11:43:11 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Creating image(s)
Oct 16 11:43:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Acquiring lock "/opt/stack/data/nova/instances/d6acbac6-01f7-4c5e-ba2f-1650713d1452/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:43:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "/opt/stack/data/nova/instances/d6acbac6-01f7-4c5e-ba2f-1650713d1452/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:43:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "/opt/stack/data/nova/instances/d6acbac6-01f7-4c5e-ba2f-1650713d1452/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:43:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:43:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.175s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:43:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Acquiring lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:43:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:43:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:43:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.182s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:43:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/d6acbac6-01f7-4c5e-ba2f-1650713d1452/disk 1073741824 {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:43:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/d6acbac6-01f7-4c5e-ba2f-1650713d1452/disk 1073741824" returned: 0 in 0.062s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:43:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:43:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:43:11 user nova-compute[74683]: DEBUG nova.network.neutron [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Successfully created port: befa59d0-1d58-4231-a16b-d5981b3e8144 {{(pid=74683) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 11:43:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.204s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:43:11 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d6acbac6-01f7-4c5e-ba2f-1650713d1452/disk. size=1073741824 {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 11:43:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6acbac6-01f7-4c5e-ba2f-1650713d1452/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:43:11 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6acbac6-01f7-4c5e-ba2f-1650713d1452/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:43:11 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Cannot resize image /opt/stack/data/nova/instances/d6acbac6-01f7-4c5e-ba2f-1650713d1452/disk to a smaller size. {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 11:43:11 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Created local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 11:43:11 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Ensure instance console log exists: /opt/stack/data/nova/instances/d6acbac6-01f7-4c5e-ba2f-1650713d1452/console.log {{(pid=74683) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 11:43:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:43:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:43:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:43:11 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:43:11 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:43:11 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:43:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:43:12 user nova-compute[74683]: DEBUG nova.network.neutron [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Successfully updated port: befa59d0-1d58-4231-a16b-d5981b3e8144 {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:43:12 user nova-compute[74683]: DEBUG nova.compute.manager [req-7d0e49f8-5e84-48e8-bca6-c034e46015d3 req-afaafd2d-8856-4e80-8ac0-e67ddc961072 service nova] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Received event network-vif-plugged-89990cc1-ff0b-45bf-b1e5-b61492762fef {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:43:12 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-7d0e49f8-5e84-48e8-bca6-c034e46015d3 req-afaafd2d-8856-4e80-8ac0-e67ddc961072 service nova] Acquiring lock "3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:43:12 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-7d0e49f8-5e84-48e8-bca6-c034e46015d3 req-afaafd2d-8856-4e80-8ac0-e67ddc961072 service nova] Lock "3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:43:12 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-7d0e49f8-5e84-48e8-bca6-c034e46015d3 req-afaafd2d-8856-4e80-8ac0-e67ddc961072 service nova] Lock "3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:43:12 user nova-compute[74683]: DEBUG nova.compute.manager [req-7d0e49f8-5e84-48e8-bca6-c034e46015d3 req-afaafd2d-8856-4e80-8ac0-e67ddc961072 service nova] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] No waiting events found dispatching network-vif-plugged-89990cc1-ff0b-45bf-b1e5-b61492762fef {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:43:12 user nova-compute[74683]: WARNING nova.compute.manager [req-7d0e49f8-5e84-48e8-bca6-c034e46015d3 req-afaafd2d-8856-4e80-8ac0-e67ddc961072 service nova] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Received unexpected event network-vif-plugged-89990cc1-ff0b-45bf-b1e5-b61492762fef for instance with vm_state building and task_state spawning.
Oct 16 11:43:12 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Acquiring lock "refresh_cache-d6acbac6-01f7-4c5e-ba2f-1650713d1452" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:43:12 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Acquired lock "refresh_cache-d6acbac6-01f7-4c5e-ba2f-1650713d1452" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:43:12 user nova-compute[74683]: DEBUG nova.network.neutron [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:43:12 user nova-compute[74683]: DEBUG nova.compute.manager [req-bf7f2844-57f1-4b4b-84d8-1460c343d1d2 req-a366e2fe-9b63-4ccf-9d9c-579eb976fe62 service nova] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Received event network-changed-befa59d0-1d58-4231-a16b-d5981b3e8144 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:43:12 user nova-compute[74683]: DEBUG nova.compute.manager [req-bf7f2844-57f1-4b4b-84d8-1460c343d1d2 req-a366e2fe-9b63-4ccf-9d9c-579eb976fe62 service nova] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Refreshing instance network info cache due to event network-changed-befa59d0-1d58-4231-a16b-d5981b3e8144. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:43:12 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-bf7f2844-57f1-4b4b-84d8-1460c343d1d2 req-a366e2fe-9b63-4ccf-9d9c-579eb976fe62 service nova] Acquiring lock "refresh_cache-d6acbac6-01f7-4c5e-ba2f-1650713d1452" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:43:12 user nova-compute[74683]: DEBUG nova.network.neutron [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:43:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:43:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:43:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:43:12 user nova-compute[74683]: DEBUG nova.network.neutron [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Updating instance_info_cache with network_info: [{"id": "befa59d0-1d58-4231-a16b-d5981b3e8144", "address": "fa:16:3e:d7:38:8f", "network": {"id": "badd2db9-6c0f-40cc-afe9-a199e040399a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1368098259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "889cb980200446c0933fe965738a62df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbefa59d0-1d", "ovs_interfaceid": "befa59d0-1d58-4231-a16b-d5981b3e8144", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:43:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:43:12 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Releasing lock "refresh_cache-d6acbac6-01f7-4c5e-ba2f-1650713d1452" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:43:12 user nova-compute[74683]: DEBUG nova.compute.manager [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Instance network_info: |[{"id": "befa59d0-1d58-4231-a16b-d5981b3e8144", "address": "fa:16:3e:d7:38:8f", "network": {"id": "badd2db9-6c0f-40cc-afe9-a199e040399a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1368098259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "889cb980200446c0933fe965738a62df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbefa59d0-1d", "ovs_interfaceid": "befa59d0-1d58-4231-a16b-d5981b3e8144", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 11:43:12 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-bf7f2844-57f1-4b4b-84d8-1460c343d1d2 req-a366e2fe-9b63-4ccf-9d9c-579eb976fe62 service nova] Acquired lock "refresh_cache-d6acbac6-01f7-4c5e-ba2f-1650713d1452" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:43:12 user nova-compute[74683]: DEBUG nova.network.neutron [req-bf7f2844-57f1-4b4b-84d8-1460c343d1d2 req-a366e2fe-9b63-4ccf-9d9c-579eb976fe62 service nova] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Refreshing network info cache for port befa59d0-1d58-4231-a16b-d5981b3e8144 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:43:12 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Start _get_guest_xml network_info=[{"id": "befa59d0-1d58-4231-a16b-d5981b3e8144", "address": "fa:16:3e:d7:38:8f", "network": {"id": "badd2db9-6c0f-40cc-afe9-a199e040399a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1368098259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "889cb980200446c0933fe965738a62df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbefa59d0-1d", "ovs_interfaceid": "befa59d0-1d58-4231-a16b-d5981b3e8144", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:43:12 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:43:12 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:43:12 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:43:12 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:43:12 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:43:12 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:43:12 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:43:12 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:43:12 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:43:12 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:43:12 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:43:12 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:43:12 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:43:12 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:43:12 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:43:12 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:43:12 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:43:12 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:43:12 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:43:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1650330041',display_name='tempest-AttachVolumeTestJSON-server-1650330041',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1650330041',id=48,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9sH9tJo4P1YOMGkjnKhrKSGWCBqijUPy+RQJ9f5roAzPTpy1gDzjbiVEVpob9Q1bfwNGfbP4URb2sCpfv6WmEPnAViBpwF4ULLbyOJKQnMOI0KxH5FkyxYvUcTGst7cQ==',key_name='tempest-keypair-81233160',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='889cb980200446c0933fe965738a62df',ramdisk_id='',reservation_id='r-b629eewp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-263939305',owner_user_name='tempest-AttachVolumeTestJSON-263939305-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:43:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c38fd3bc86ba4b7a95e06b926d22e60f',uuid=d6acbac6-01f7-4c5e-ba2f-1650713d1452,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "befa59d0-1d58-4231-a16b-d5981b3e8144", "address": "fa:16:3e:d7:38:8f", "network": {"id": "badd2db9-6c0f-40cc-afe9-a199e040399a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1368098259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "889cb980200446c0933fe965738a62df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbefa59d0-1d", "ovs_interfaceid": "befa59d0-1d58-4231-a16b-d5981b3e8144", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:43:12 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Converting VIF {"id": "befa59d0-1d58-4231-a16b-d5981b3e8144", "address": "fa:16:3e:d7:38:8f", "network": {"id": "badd2db9-6c0f-40cc-afe9-a199e040399a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1368098259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "889cb980200446c0933fe965738a62df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbefa59d0-1d", "ovs_interfaceid": "befa59d0-1d58-4231-a16b-d5981b3e8144", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:43:12 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:38:8f,bridge_name='br-int',has_traffic_filtering=True,id=befa59d0-1d58-4231-a16b-d5981b3e8144,network=Network(badd2db9-6c0f-40cc-afe9-a199e040399a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbefa59d0-1d') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:43:12 user nova-compute[74683]: DEBUG nova.objects.instance [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lazy-loading 'pci_devices' on Instance uuid d6acbac6-01f7-4c5e-ba2f-1650713d1452 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:43:12 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:43:12 user nova-compute[74683]:   <uuid>d6acbac6-01f7-4c5e-ba2f-1650713d1452</uuid>
Oct 16 11:43:12 user nova-compute[74683]:   <name>instance-00000030</name>
Oct 16 11:43:12 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:43:12 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:43:12 user nova-compute[74683]:   <metadata>
Oct 16 11:43:12 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:43:12 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:43:12 user nova-compute[74683]:       <nova:name>tempest-AttachVolumeTestJSON-server-1650330041</nova:name>
Oct 16 11:43:12 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:43:12</nova:creationTime>
Oct 16 11:43:12 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:43:12 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:43:12 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:43:12 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:43:12 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:43:12 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:43:12 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:43:12 user nova-compute[74683]:       <nova:owner>
Oct 16 11:43:12 user nova-compute[74683]:         <nova:user uuid="c38fd3bc86ba4b7a95e06b926d22e60f">tempest-AttachVolumeTestJSON-263939305-project-member</nova:user>
Oct 16 11:43:12 user nova-compute[74683]:         <nova:project uuid="889cb980200446c0933fe965738a62df">tempest-AttachVolumeTestJSON-263939305</nova:project>
Oct 16 11:43:12 user nova-compute[74683]:       </nova:owner>
Oct 16 11:43:12 user nova-compute[74683]:       <nova:root type="image" uuid="0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f"/>
Oct 16 11:43:12 user nova-compute[74683]:       <nova:ports>
Oct 16 11:43:12 user nova-compute[74683]:         <nova:port uuid="befa59d0-1d58-4231-a16b-d5981b3e8144">
Oct 16 11:43:12 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 16 11:43:12 user nova-compute[74683]:         </nova:port>
Oct 16 11:43:12 user nova-compute[74683]:       </nova:ports>
Oct 16 11:43:12 user nova-compute[74683]:     </nova:instance>
Oct 16 11:43:12 user nova-compute[74683]:   </metadata>
Oct 16 11:43:12 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:43:12 user nova-compute[74683]:     <system>
Oct 16 11:43:12 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:43:12 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:43:12 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:43:12 user nova-compute[74683]:       <entry name="serial">d6acbac6-01f7-4c5e-ba2f-1650713d1452</entry>
Oct 16 11:43:12 user nova-compute[74683]:       <entry name="uuid">d6acbac6-01f7-4c5e-ba2f-1650713d1452</entry>
Oct 16 11:43:12 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:43:12 user nova-compute[74683]:     </system>
Oct 16 11:43:12 user nova-compute[74683]:   </sysinfo>
Oct 16 11:43:12 user nova-compute[74683]:   <os>
Oct 16 11:43:12 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:43:12 user nova-compute[74683]:     <boot dev="hd"/>
Oct 16 11:43:12 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:43:12 user nova-compute[74683]:   </os>
Oct 16 11:43:12 user nova-compute[74683]:   <features>
Oct 16 11:43:12 user nova-compute[74683]:     <acpi/>
Oct 16 11:43:12 user nova-compute[74683]:     <apic/>
Oct 16 11:43:12 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:43:12 user nova-compute[74683]:   </features>
Oct 16 11:43:12 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:43:12 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:43:12 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:43:12 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:43:12 user nova-compute[74683]:   </clock>
Oct 16 11:43:12 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:43:12 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:43:12 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:43:12 user nova-compute[74683]:   </cpu>
Oct 16 11:43:12 user nova-compute[74683]:   <devices>
Oct 16 11:43:12 user nova-compute[74683]:     <disk type="file" device="disk">
Oct 16 11:43:12 user nova-compute[74683]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 11:43:12 user nova-compute[74683]:       <source file="/opt/stack/data/nova/instances/d6acbac6-01f7-4c5e-ba2f-1650713d1452/disk"/>
Oct 16 11:43:12 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:43:12 user nova-compute[74683]:     </disk>
Oct 16 11:43:12 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:43:12 user nova-compute[74683]:       <mac address="fa:16:3e:d7:38:8f"/>
Oct 16 11:43:12 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:43:12 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:43:12 user nova-compute[74683]:       <target dev="tapbefa59d0-1d"/>
Oct 16 11:43:12 user nova-compute[74683]:     </interface>
Oct 16 11:43:12 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:43:12 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/d6acbac6-01f7-4c5e-ba2f-1650713d1452/console.log" append="off"/>
Oct 16 11:43:12 user nova-compute[74683]:     </serial>
Oct 16 11:43:12 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:43:12 user nova-compute[74683]:     <video>
Oct 16 11:43:12 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:43:12 user nova-compute[74683]:     </video>
Oct 16 11:43:12 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:43:12 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:43:12 user nova-compute[74683]:     </rng>
Oct 16 11:43:12 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:43:12 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:43:12 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:43:12 user nova-compute[74683]:     </memballoon>
Oct 16 11:43:12 user nova-compute[74683]:   </devices>
Oct 16 11:43:12 user nova-compute[74683]: </domain>
Oct 16 11:43:12 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:43:12 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:43:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1650330041',display_name='tempest-AttachVolumeTestJSON-server-1650330041',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1650330041',id=48,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9sH9tJo4P1YOMGkjnKhrKSGWCBqijUPy+RQJ9f5roAzPTpy1gDzjbiVEVpob9Q1bfwNGfbP4URb2sCpfv6WmEPnAViBpwF4ULLbyOJKQnMOI0KxH5FkyxYvUcTGst7cQ==',key_name='tempest-keypair-81233160',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='889cb980200446c0933fe965738a62df',ramdisk_id='',reservation_id='r-b629eewp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-263939305',owner_user_name='tempest-AttachVolumeTestJSON-263939305-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:43:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c38fd3bc86ba4b7a95e06b926d22e60f',uuid=d6acbac6-01f7-4c5e-ba2f-1650713d1452,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "befa59d0-1d58-4231-a16b-d5981b3e8144", "address": "fa:16:3e:d7:38:8f", "network": {"id": "badd2db9-6c0f-40cc-afe9-a199e040399a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1368098259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "889cb980200446c0933fe965738a62df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbefa59d0-1d", "ovs_interfaceid": "befa59d0-1d58-4231-a16b-d5981b3e8144", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:43:12 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Converting VIF {"id": "befa59d0-1d58-4231-a16b-d5981b3e8144", "address": "fa:16:3e:d7:38:8f", "network": {"id": "badd2db9-6c0f-40cc-afe9-a199e040399a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1368098259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "889cb980200446c0933fe965738a62df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbefa59d0-1d", "ovs_interfaceid": "befa59d0-1d58-4231-a16b-d5981b3e8144", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:43:12 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:38:8f,bridge_name='br-int',has_traffic_filtering=True,id=befa59d0-1d58-4231-a16b-d5981b3e8144,network=Network(badd2db9-6c0f-40cc-afe9-a199e040399a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbefa59d0-1d') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:43:12 user nova-compute[74683]: DEBUG os_vif [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:38:8f,bridge_name='br-int',has_traffic_filtering=True,id=befa59d0-1d58-4231-a16b-d5981b3e8144,network=Network(badd2db9-6c0f-40cc-afe9-a199e040399a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbefa59d0-1d') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:43:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:43:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:43:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:43:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:43:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '041a2820-b2aa-5817-a661-dc2193a494b8', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:43:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:43:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:43:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:43:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbefa59d0-1d, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:43:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbefa59d0-1d, col_values=(('qos', UUID('d27487d2-4439-4649-bd30-308e2313323f')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:43:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbefa59d0-1d, col_values=(('external_ids', {'iface-id': 'befa59d0-1d58-4231-a16b-d5981b3e8144', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:38:8f', 'vm-uuid': 'd6acbac6-01f7-4c5e-ba2f-1650713d1452'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:43:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:43:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:43:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:43:12 user nova-compute[74683]: INFO os_vif [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:38:8f,bridge_name='br-int',has_traffic_filtering=True,id=befa59d0-1d58-4231-a16b-d5981b3e8144,network=Network(badd2db9-6c0f-40cc-afe9-a199e040399a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbefa59d0-1d')
Oct 16 11:43:12 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:43:12 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] No VIF found with MAC fa:16:3e:d7:38:8f, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:43:13 user nova-compute[74683]: DEBUG nova.network.neutron [req-bf7f2844-57f1-4b4b-84d8-1460c343d1d2 req-a366e2fe-9b63-4ccf-9d9c-579eb976fe62 service nova] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Updated VIF entry in instance network info cache for port befa59d0-1d58-4231-a16b-d5981b3e8144. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:43:13 user nova-compute[74683]: DEBUG nova.network.neutron [req-bf7f2844-57f1-4b4b-84d8-1460c343d1d2 req-a366e2fe-9b63-4ccf-9d9c-579eb976fe62 service nova] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Updating instance_info_cache with network_info: [{"id": "befa59d0-1d58-4231-a16b-d5981b3e8144", "address": "fa:16:3e:d7:38:8f", "network": {"id": "badd2db9-6c0f-40cc-afe9-a199e040399a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1368098259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "889cb980200446c0933fe965738a62df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbefa59d0-1d", "ovs_interfaceid": "befa59d0-1d58-4231-a16b-d5981b3e8144", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:43:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-bf7f2844-57f1-4b4b-84d8-1460c343d1d2 req-a366e2fe-9b63-4ccf-9d9c-579eb976fe62 service nova] Releasing lock "refresh_cache-d6acbac6-01f7-4c5e-ba2f-1650713d1452" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:43:14 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:43:14 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:43:14 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:43:14 user nova-compute[74683]: DEBUG nova.compute.manager [req-343ae2ae-247a-46e3-b06f-447a0995f145 req-c986b99d-abc9-4cb1-9a3e-06b3e3a6b9d5 service nova] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Received event network-vif-plugged-89990cc1-ff0b-45bf-b1e5-b61492762fef {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:43:14 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-343ae2ae-247a-46e3-b06f-447a0995f145 req-c986b99d-abc9-4cb1-9a3e-06b3e3a6b9d5 service nova] Acquiring lock "3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:43:14 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-343ae2ae-247a-46e3-b06f-447a0995f145 req-c986b99d-abc9-4cb1-9a3e-06b3e3a6b9d5 service nova] Lock "3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:43:14 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-343ae2ae-247a-46e3-b06f-447a0995f145 req-c986b99d-abc9-4cb1-9a3e-06b3e3a6b9d5 service nova] Lock "3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:43:14 user nova-compute[74683]: DEBUG nova.compute.manager [req-343ae2ae-247a-46e3-b06f-447a0995f145 req-c986b99d-abc9-4cb1-9a3e-06b3e3a6b9d5 service nova] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] No waiting events found dispatching network-vif-plugged-89990cc1-ff0b-45bf-b1e5-b61492762fef {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:43:14 user nova-compute[74683]: WARNING nova.compute.manager [req-343ae2ae-247a-46e3-b06f-447a0995f145 req-c986b99d-abc9-4cb1-9a3e-06b3e3a6b9d5 service nova] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Received unexpected event network-vif-plugged-89990cc1-ff0b-45bf-b1e5-b61492762fef for instance with vm_state building and task_state spawning.
Oct 16 11:43:14 user nova-compute[74683]: DEBUG nova.compute.manager [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Instance event wait completed in 0 seconds for  {{(pid=74683) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 11:43:14 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Guest created on hypervisor {{(pid=74683) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 11:43:14 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Instance spawned successfully.
Oct 16 11:43:14 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 11:43:14 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Found default for hw_cdrom_bus of ide {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:43:14 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Found default for hw_disk_bus of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:43:14 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Found default for hw_input_bus of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:43:14 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Found default for hw_pointer_model of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:43:14 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Found default for hw_video_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:43:14 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Found default for hw_vif_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:43:14 user nova-compute[74683]: INFO nova.compute.manager [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Took 5.64 seconds to spawn the instance on the hypervisor.
Oct 16 11:43:14 user nova-compute[74683]: DEBUG nova.compute.manager [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:43:14 user nova-compute[74683]: INFO nova.compute.manager [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Took 6.48 seconds to build instance.
Oct 16 11:43:14 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-75e82b9d-8511-4a6c-940b-6ffd22c905e0 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Lock "3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.651s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:43:14 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:43:14 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:43:14 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:43:16 user nova-compute[74683]: DEBUG nova.compute.manager [req-bad3a6cb-ceca-4498-b3d3-203a1e9d07f4 req-cd84d683-9a40-4db1-88c5-2b1d23765ef0 service nova] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Received event network-vif-plugged-befa59d0-1d58-4231-a16b-d5981b3e8144 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:43:16 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-bad3a6cb-ceca-4498-b3d3-203a1e9d07f4 req-cd84d683-9a40-4db1-88c5-2b1d23765ef0 service nova] Acquiring lock "d6acbac6-01f7-4c5e-ba2f-1650713d1452-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:43:16 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-bad3a6cb-ceca-4498-b3d3-203a1e9d07f4 req-cd84d683-9a40-4db1-88c5-2b1d23765ef0 service nova] Lock "d6acbac6-01f7-4c5e-ba2f-1650713d1452-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:43:16 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-bad3a6cb-ceca-4498-b3d3-203a1e9d07f4 req-cd84d683-9a40-4db1-88c5-2b1d23765ef0 service nova] Lock "d6acbac6-01f7-4c5e-ba2f-1650713d1452-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:43:16 user nova-compute[74683]: DEBUG nova.compute.manager [req-bad3a6cb-ceca-4498-b3d3-203a1e9d07f4 req-cd84d683-9a40-4db1-88c5-2b1d23765ef0 service nova] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] No waiting events found dispatching network-vif-plugged-befa59d0-1d58-4231-a16b-d5981b3e8144 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:43:16 user nova-compute[74683]: WARNING nova.compute.manager [req-bad3a6cb-ceca-4498-b3d3-203a1e9d07f4 req-cd84d683-9a40-4db1-88c5-2b1d23765ef0 service nova] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Received unexpected event network-vif-plugged-befa59d0-1d58-4231-a16b-d5981b3e8144 for instance with vm_state building and task_state spawning.
Oct 16 11:43:16 user nova-compute[74683]: DEBUG nova.compute.manager [req-bad3a6cb-ceca-4498-b3d3-203a1e9d07f4 req-cd84d683-9a40-4db1-88c5-2b1d23765ef0 service nova] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Received event network-vif-plugged-befa59d0-1d58-4231-a16b-d5981b3e8144 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:43:16 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-bad3a6cb-ceca-4498-b3d3-203a1e9d07f4 req-cd84d683-9a40-4db1-88c5-2b1d23765ef0 service nova] Acquiring lock "d6acbac6-01f7-4c5e-ba2f-1650713d1452-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:43:16 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-bad3a6cb-ceca-4498-b3d3-203a1e9d07f4 req-cd84d683-9a40-4db1-88c5-2b1d23765ef0 service nova] Lock "d6acbac6-01f7-4c5e-ba2f-1650713d1452-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:43:16 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-bad3a6cb-ceca-4498-b3d3-203a1e9d07f4 req-cd84d683-9a40-4db1-88c5-2b1d23765ef0 service nova] Lock "d6acbac6-01f7-4c5e-ba2f-1650713d1452-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:43:16 user nova-compute[74683]: DEBUG nova.compute.manager [req-bad3a6cb-ceca-4498-b3d3-203a1e9d07f4 req-cd84d683-9a40-4db1-88c5-2b1d23765ef0 service nova] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] No waiting events found dispatching network-vif-plugged-befa59d0-1d58-4231-a16b-d5981b3e8144 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:43:16 user nova-compute[74683]: WARNING nova.compute.manager [req-bad3a6cb-ceca-4498-b3d3-203a1e9d07f4 req-cd84d683-9a40-4db1-88c5-2b1d23765ef0 service nova] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Received unexpected event network-vif-plugged-befa59d0-1d58-4231-a16b-d5981b3e8144 for instance with vm_state building and task_state spawning.
Oct 16 11:43:16 user nova-compute[74683]: DEBUG nova.compute.manager [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Instance event wait completed in 0 seconds for  {{(pid=74683) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 11:43:16 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Guest created on hypervisor {{(pid=74683) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 11:43:16 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Instance spawned successfully.
Oct 16 11:43:16 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 11:43:16 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Found default for hw_cdrom_bus of ide {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:43:16 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Found default for hw_disk_bus of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:43:16 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Found default for hw_input_bus of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:43:16 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Found default for hw_pointer_model of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:43:16 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Found default for hw_video_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:43:16 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Found default for hw_vif_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:43:16 user nova-compute[74683]: INFO nova.compute.manager [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Took 5.81 seconds to spawn the instance on the hypervisor.
Oct 16 11:43:16 user nova-compute[74683]: DEBUG nova.compute.manager [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:43:16 user nova-compute[74683]: INFO nova.compute.manager [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Took 6.57 seconds to build instance.
Oct 16 11:43:16 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-54445715-4126-4545-afbc-ac9319201db2 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "d6acbac6-01f7-4c5e-ba2f-1650713d1452" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.663s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:43:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:43:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:43:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:43:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:43:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74683) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 11:43:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:43:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:43:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:43:27 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:43:27 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:43:27 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:43:27 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Starting heal instance info cache {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 11:43:27 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Rebuilding the list of instances to heal {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 11:43:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:43:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "refresh_cache-8d94b70c-4056-4c58-9df4-73684e0d164f" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:43:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquired lock "refresh_cache-8d94b70c-4056-4c58-9df4-73684e0d164f" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:43:27 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Forcefully refreshing network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 11:43:27 user nova-compute[74683]: DEBUG nova.objects.instance [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lazy-loading 'info_cache' on Instance uuid 8d94b70c-4056-4c58-9df4-73684e0d164f {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:43:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:43:28 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Updating instance_info_cache with network_info: [{"id": "80bcc661-5bbf-4b87-87c3-0b4a7e6aa31b", "address": "fa:16:3e:67:41:41", "network": {"id": "f131c862-9d83-4df6-af88-56d3202105fc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-544805614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12fd84a1f38a41dc8e4ab6c697028d9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80bcc661-5b", "ovs_interfaceid": "80bcc661-5bbf-4b87-87c3-0b4a7e6aa31b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:43:28 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Releasing lock "refresh_cache-8d94b70c-4056-4c58-9df4-73684e0d164f" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:43:28 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Updated the network info_cache for instance {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 11:43:28 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:43:28 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:43:28 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:43:28 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:43:29 user nova-compute[74683]: DEBUG nova.compute.manager [req-7e3b52da-1c5e-41d8-a952-9e53dbb19e57 req-4547cf39-b972-48dd-8848-f8ff63fee1bd service nova] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Received event network-changed-f6b38471-41ce-443b-8562-bee2b4f64d31 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:43:29 user nova-compute[74683]: DEBUG nova.compute.manager [req-7e3b52da-1c5e-41d8-a952-9e53dbb19e57 req-4547cf39-b972-48dd-8848-f8ff63fee1bd service nova] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Refreshing instance network info cache due to event network-changed-f6b38471-41ce-443b-8562-bee2b4f64d31. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:43:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-7e3b52da-1c5e-41d8-a952-9e53dbb19e57 req-4547cf39-b972-48dd-8848-f8ff63fee1bd service nova] Acquiring lock "refresh_cache-1986f9b5-30fb-4290-802d-ee699a19b608" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:43:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-7e3b52da-1c5e-41d8-a952-9e53dbb19e57 req-4547cf39-b972-48dd-8848-f8ff63fee1bd service nova] Acquired lock "refresh_cache-1986f9b5-30fb-4290-802d-ee699a19b608" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:43:29 user nova-compute[74683]: DEBUG nova.network.neutron [req-7e3b52da-1c5e-41d8-a952-9e53dbb19e57 req-4547cf39-b972-48dd-8848-f8ff63fee1bd service nova] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Refreshing network info cache for port f6b38471-41ce-443b-8562-bee2b4f64d31 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:43:29 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:43:29 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74683) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 11:43:30 user nova-compute[74683]: DEBUG nova.network.neutron [req-7e3b52da-1c5e-41d8-a952-9e53dbb19e57 req-4547cf39-b972-48dd-8848-f8ff63fee1bd service nova] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Updated VIF entry in instance network info cache for port f6b38471-41ce-443b-8562-bee2b4f64d31. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:43:30 user nova-compute[74683]: DEBUG nova.network.neutron [req-7e3b52da-1c5e-41d8-a952-9e53dbb19e57 req-4547cf39-b972-48dd-8848-f8ff63fee1bd service nova] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Updating instance_info_cache with network_info: [{"id": "f6b38471-41ce-443b-8562-bee2b4f64d31", "address": "fa:16:3e:c9:39:63", "network": {"id": "1fa0852d-814a-45ef-80fa-171693e4d02a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-184537544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ce607a3614fc493d33e6ba8ca5807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6b38471-41", "ovs_interfaceid": "f6b38471-41ce-443b-8562-bee2b4f64d31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:43:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-7e3b52da-1c5e-41d8-a952-9e53dbb19e57 req-4547cf39-b972-48dd-8848-f8ff63fee1bd service nova] Releasing lock "refresh_cache-1986f9b5-30fb-4290-802d-ee699a19b608" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:43:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-37e41992-afb9-46fc-b253-9865af2a3b36 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Acquiring lock "1986f9b5-30fb-4290-802d-ee699a19b608" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:43:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-37e41992-afb9-46fc-b253-9865af2a3b36 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "1986f9b5-30fb-4290-802d-ee699a19b608" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:43:30 user nova-compute[74683]: INFO nova.compute.manager [None req-37e41992-afb9-46fc-b253-9865af2a3b36 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Detaching volume 322c0976-a7e3-40b7-8d70-4ed65eb496f0
Oct 16 11:43:30 user nova-compute[74683]: INFO nova.virt.block_device [None req-37e41992-afb9-46fc-b253-9865af2a3b36 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Attempting to driver detach volume 322c0976-a7e3-40b7-8d70-4ed65eb496f0 from mountpoint /dev/vdb
Oct 16 11:43:30 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-37e41992-afb9-46fc-b253-9865af2a3b36 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Attempting to detach device vdb from instance 1986f9b5-30fb-4290-802d-ee699a19b608 from the persistent domain config. {{(pid=74683) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 11:43:30 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-37e41992-afb9-46fc-b253-9865af2a3b36 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 11:43:30 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:43:30 user nova-compute[74683]:   <source dev="/dev/sdb"/>
Oct 16 11:43:30 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:43:30 user nova-compute[74683]:   <serial>322c0976-a7e3-40b7-8d70-4ed65eb496f0</serial>
Oct 16 11:43:30 user nova-compute[74683]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 16 11:43:30 user nova-compute[74683]: </disk>
Oct 16 11:43:30 user nova-compute[74683]:  {{(pid=74683) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 11:43:30 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-37e41992-afb9-46fc-b253-9865af2a3b36 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Successfully detached device vdb from instance 1986f9b5-30fb-4290-802d-ee699a19b608 from the persistent domain config.
Oct 16 11:43:30 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-37e41992-afb9-46fc-b253-9865af2a3b36 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1986f9b5-30fb-4290-802d-ee699a19b608 from the live domain config. {{(pid=74683) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 11:43:30 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-37e41992-afb9-46fc-b253-9865af2a3b36 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 11:43:30 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:43:30 user nova-compute[74683]:   <source dev="/dev/sdb"/>
Oct 16 11:43:30 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:43:30 user nova-compute[74683]:   <serial>322c0976-a7e3-40b7-8d70-4ed65eb496f0</serial>
Oct 16 11:43:30 user nova-compute[74683]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 16 11:43:30 user nova-compute[74683]: </disk>
Oct 16 11:43:30 user nova-compute[74683]:  {{(pid=74683) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 11:43:31 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-37e41992-afb9-46fc-b253-9865af2a3b36 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1986f9b5-30fb-4290-802d-ee699a19b608 {{(pid=74683) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 11:43:31 user nova-compute[74683]: DEBUG nova.compute.manager [req-36273f4e-0c7a-487a-ac5c-75cfb4b865f4 req-4534d0be-799e-408d-9a0b-0982e14d55ab service nova] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Received event network-changed-f6b38471-41ce-443b-8562-bee2b4f64d31 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:43:31 user nova-compute[74683]: DEBUG nova.compute.manager [req-36273f4e-0c7a-487a-ac5c-75cfb4b865f4 req-4534d0be-799e-408d-9a0b-0982e14d55ab service nova] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Refreshing instance network info cache due to event network-changed-f6b38471-41ce-443b-8562-bee2b4f64d31. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:43:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-36273f4e-0c7a-487a-ac5c-75cfb4b865f4 req-4534d0be-799e-408d-9a0b-0982e14d55ab service nova] Acquiring lock "refresh_cache-1986f9b5-30fb-4290-802d-ee699a19b608" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:43:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-36273f4e-0c7a-487a-ac5c-75cfb4b865f4 req-4534d0be-799e-408d-9a0b-0982e14d55ab service nova] Acquired lock "refresh_cache-1986f9b5-30fb-4290-802d-ee699a19b608" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:43:31 user nova-compute[74683]: DEBUG nova.network.neutron [req-36273f4e-0c7a-487a-ac5c-75cfb4b865f4 req-4534d0be-799e-408d-9a0b-0982e14d55ab service nova] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Refreshing network info cache for port f6b38471-41ce-443b-8562-bee2b4f64d31 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:43:31 user nova-compute[74683]: DEBUG nova.network.neutron [req-36273f4e-0c7a-487a-ac5c-75cfb4b865f4 req-4534d0be-799e-408d-9a0b-0982e14d55ab service nova] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Updated VIF entry in instance network info cache for port f6b38471-41ce-443b-8562-bee2b4f64d31. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:43:31 user nova-compute[74683]: DEBUG nova.network.neutron [req-36273f4e-0c7a-487a-ac5c-75cfb4b865f4 req-4534d0be-799e-408d-9a0b-0982e14d55ab service nova] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Updating instance_info_cache with network_info: [{"id": "f6b38471-41ce-443b-8562-bee2b4f64d31", "address": "fa:16:3e:c9:39:63", "network": {"id": "1fa0852d-814a-45ef-80fa-171693e4d02a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-184537544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ce607a3614fc493d33e6ba8ca5807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6b38471-41", "ovs_interfaceid": "f6b38471-41ce-443b-8562-bee2b4f64d31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:43:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-36273f4e-0c7a-487a-ac5c-75cfb4b865f4 req-4534d0be-799e-408d-9a0b-0982e14d55ab service nova] Releasing lock "refresh_cache-1986f9b5-30fb-4290-802d-ee699a19b608" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:43:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:43:32 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:43:32 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:43:32 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:43:32 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:43:32 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Auditing locally available compute resources for user (node: user) {{(pid=74683) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 11:43:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:43:32 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:43:33 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:43:33 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:43:33 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:43:33 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8104c2-2ea1-4e66-bf74-08074566111f/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:43:33 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8104c2-2ea1-4e66-bf74-08074566111f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:43:33 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8104c2-2ea1-4e66-bf74-08074566111f/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:43:33 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8104c2-2ea1-4e66-bf74-08074566111f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:43:33 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:43:33 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1986f9b5-30fb-4290-802d-ee699a19b608/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:43:33 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1986f9b5-30fb-4290-802d-ee699a19b608/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:43:33 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1986f9b5-30fb-4290-802d-ee699a19b608/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:43:33 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1986f9b5-30fb-4290-802d-ee699a19b608/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:43:33 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6acbac6-01f7-4c5e-ba2f-1650713d1452/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:43:34 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6acbac6-01f7-4c5e-ba2f-1650713d1452/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:43:34 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6acbac6-01f7-4c5e-ba2f-1650713d1452/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:43:34 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6acbac6-01f7-4c5e-ba2f-1650713d1452/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:43:34 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d94b70c-4056-4c58-9df4-73684e0d164f/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:43:34 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d94b70c-4056-4c58-9df4-73684e0d164f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:43:34 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d94b70c-4056-4c58-9df4-73684e0d164f/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:43:34 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d94b70c-4056-4c58-9df4-73684e0d164f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:43:35 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:43:35 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:43:35 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Hypervisor/Node resource view: name=user free_ram=8220MB free_disk=25.015159606933594GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74683) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 11:43:35 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:43:35 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:43:35 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 8d94b70c-4056-4c58-9df4-73684e0d164f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:43:35 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 1986f9b5-30fb-4290-802d-ee699a19b608 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:43:35 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance af8104c2-2ea1-4e66-bf74-08074566111f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:43:35 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:43:35 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance d6acbac6-01f7-4c5e-ba2f-1650713d1452 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:43:35 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 11:43:35 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 11:43:35 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:43:35 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:43:35 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Compute_service record updated for user:user {{(pid=74683) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 11:43:35 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.325s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:43:37 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:43:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:43:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:43:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:43:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:43:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:43:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:43:51 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-37e41992-afb9-46fc-b253-9865af2a3b36 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1986f9b5-30fb-4290-802d-ee699a19b608 is timed out.
Oct 16 11:43:51 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-37e41992-afb9-46fc-b253-9865af2a3b36 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Successfully detached device vdb from instance 1986f9b5-30fb-4290-802d-ee699a19b608 from the live domain config.
Oct 16 11:43:51 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37e41992-afb9-46fc-b253-9865af2a3b36 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] calling os-brick to detach iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 11:43:51 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e41992-afb9-46fc-b253-9865af2a3b36 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, {'target_iqn': 'iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RqTMudPb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:43:51 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-37e41992-afb9-46fc-b253-9865af2a3b36 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:43:51 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-37e41992-afb9-46fc-b253-9865af2a3b36 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:43:51 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-37e41992-afb9-46fc-b253-9865af2a3b36 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:43:51 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:43:51 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:43:51 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[91145540-363b-48ac-b5e9-18b69ae3af4f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:16c2f162-3f13-4e4d-b413-d1e6c684f93b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:43:51 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e41992-afb9-46fc-b253-9865af2a3b36 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 11:43:51 user nova-compute[74683]: No targets found.
Oct 16 11:43:51 user nova-compute[74683]: iSNS:
Oct 16 11:43:51 user nova-compute[74683]: No targets found.
Oct 16 11:43:51 user nova-compute[74683]: STATIC:
Oct 16 11:43:51 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0
Oct 16 11:43:51 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:43:51 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:43:51 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:16c2f162-3f13-4e4d-b413-d1e6c684f93b
Oct 16 11:43:51 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:43:51 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:43:51 user nova-compute[74683]: FIRMWARE:
Oct 16 11:43:51 user nova-compute[74683]: No targets found.
Oct 16 11:43:51 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:43:51 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e41992-afb9-46fc-b253-9865af2a3b36 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 11:43:51 user nova-compute[74683]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 11:43:51 user nova-compute[74683]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74683) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 11:43:51 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e41992-afb9-46fc-b253-9865af2a3b36 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0', 0)] {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 11:43:51 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:43:51 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:43:51 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d428882-2008-40e9-b79a-6d853699f183]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16c2f162-3f13-4e4d-b413-d1e6c684f93b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:43:51 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:43:51 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:43:51 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e5611d-01a0-4b6f-91bd-95b5a0cda05d]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c2f162-3f13-4e4d-b413-d1e6c684f93b (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:43:51 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e41992-afb9-46fc-b253-9865af2a3b36 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 (non-flash)
Oct 16 11:43:51 user nova-compute[74683]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c2f162-3f13-4e4d-b413-d1e6c684f93b (non-flash)
Oct 16 11:43:51 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:43:51 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e41992-afb9-46fc-b253-9865af2a3b36 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 (non-flash)
Oct 16 11:43:51 user nova-compute[74683]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c2f162-3f13-4e4d-b413-d1e6c684f93b (non-flash)
Oct 16 11:43:51 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:43:51 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e41992-afb9-46fc-b253-9865af2a3b36 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda4c5b5a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0'): ({'sdb'}, set())}) {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 11:43:51 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-37e41992-afb9-46fc-b253-9865af2a3b36 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Removing single pathed devices sdb {{(pid=74683) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 11:43:51 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:43:51 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:43:51 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[640a8f09-38c3-44ef-9e0c-b9572c3b9928]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:43:51 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:43:51 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:43:51 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ed6c80-0c01-4fde-8773-b7964176d77d]: (4, ('ok\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:43:51 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-37e41992-afb9-46fc-b253-9865af2a3b36 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Flushing IO for device /dev/sdb {{(pid=74683) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 11:43:51 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:43:51 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:43:51 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6071d2-d924-43e9-a03c-93991888bd90]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:43:51 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-37e41992-afb9-46fc-b253-9865af2a3b36 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74683) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 11:43:51 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:43:51 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:43:51 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc4724b-4074-47f1-be2d-cb096bea6732]: (4, ('1', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:43:51 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-37e41992-afb9-46fc-b253-9865af2a3b36 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 11:43:51 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-37e41992-afb9-46fc-b253-9865af2a3b36 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] SCSI volumes sdb have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 11:43:51 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e41992-afb9-46fc-b253-9865af2a3b36 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0')] {{(pid=74683) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 11:43:51 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:43:51 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:43:51 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[46becdd1-7184-4a4e-81ed-c30d5292c2b0]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:43:51 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e41992-afb9-46fc-b253-9865af2a3b36 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:43:51 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 -p 172.16.0.220:3260 --logout {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:43:51 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:43:51 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cca6dba-e89d-4491-b4b2-07cf5766facb]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:43:51 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e41992-afb9-46fc-b253-9865af2a3b36 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0, portal: 172.16.0.220,3260]
Oct 16 11:43:51 user nova-compute[74683]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0, portal: 172.16.0.220,3260] successful.
Oct 16 11:43:51 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:43:51 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 -p 172.16.0.220:3260 --op delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:43:51 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:322c0976-a7e3-40b7-8d70-4ed65eb496f0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:43:51 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31e70fd-9761-45a6-9974-a19070849429]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:43:51 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e41992-afb9-46fc-b253-9865af2a3b36 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:43:51 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-37e41992-afb9-46fc-b253-9865af2a3b36 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:43:51 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e41992-afb9-46fc-b253-9865af2a3b36 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] <== disconnect_volume: return (303ms) None {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:43:51 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37e41992-afb9-46fc-b253-9865af2a3b36 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Disconnected iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 11:43:52 user nova-compute[74683]: DEBUG nova.objects.instance [None req-37e41992-afb9-46fc-b253-9865af2a3b36 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lazy-loading 'flavor' on Instance uuid 1986f9b5-30fb-4290-802d-ee699a19b608 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:43:52 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-37e41992-afb9-46fc-b253-9865af2a3b36 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "1986f9b5-30fb-4290-802d-ee699a19b608" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.684s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:43:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:43:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:43:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74683) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 11:43:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:43:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:43:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:43:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:43:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:43:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74683) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 11:43:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:43:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:43:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:44:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:44:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:44:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74683) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 11:44:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:44:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:44:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:44:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ab370d94-5298-4745-8073-491a6e773e0e tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Acquiring lock "af8104c2-2ea1-4e66-bf74-08074566111f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:44:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ab370d94-5298-4745-8073-491a6e773e0e tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lock "af8104c2-2ea1-4e66-bf74-08074566111f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:44:07 user nova-compute[74683]: INFO nova.compute.manager [None req-ab370d94-5298-4745-8073-491a6e773e0e tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Detaching volume 16c2f162-3f13-4e4d-b413-d1e6c684f93b
Oct 16 11:44:07 user nova-compute[74683]: INFO nova.virt.block_device [None req-ab370d94-5298-4745-8073-491a6e773e0e tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Attempting to driver detach volume 16c2f162-3f13-4e4d-b413-d1e6c684f93b from mountpoint /dev/vdb
Oct 16 11:44:07 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-ab370d94-5298-4745-8073-491a6e773e0e tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Attempting to detach device vdb from instance af8104c2-2ea1-4e66-bf74-08074566111f from the persistent domain config. {{(pid=74683) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 11:44:07 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-ab370d94-5298-4745-8073-491a6e773e0e tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 11:44:07 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:44:07 user nova-compute[74683]:   <source dev="/dev/sdc"/>
Oct 16 11:44:07 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:44:07 user nova-compute[74683]:   <serial>16c2f162-3f13-4e4d-b413-d1e6c684f93b</serial>
Oct 16 11:44:07 user nova-compute[74683]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 11:44:07 user nova-compute[74683]: </disk>
Oct 16 11:44:07 user nova-compute[74683]:  {{(pid=74683) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 11:44:07 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-ab370d94-5298-4745-8073-491a6e773e0e tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Successfully detached device vdb from instance af8104c2-2ea1-4e66-bf74-08074566111f from the persistent domain config.
Oct 16 11:44:07 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-ab370d94-5298-4745-8073-491a6e773e0e tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance af8104c2-2ea1-4e66-bf74-08074566111f from the live domain config. {{(pid=74683) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 11:44:07 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-ab370d94-5298-4745-8073-491a6e773e0e tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 11:44:07 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:44:07 user nova-compute[74683]:   <source dev="/dev/sdc"/>
Oct 16 11:44:07 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:44:07 user nova-compute[74683]:   <serial>16c2f162-3f13-4e4d-b413-d1e6c684f93b</serial>
Oct 16 11:44:07 user nova-compute[74683]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 11:44:07 user nova-compute[74683]: </disk>
Oct 16 11:44:07 user nova-compute[74683]:  {{(pid=74683) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 11:44:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-4a344aae-a9c5-45cc-8e19-ff08b869ee6a tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Acquiring lock "af8104c2-2ea1-4e66-bf74-08074566111f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:44:07 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-ab370d94-5298-4745-8073-491a6e773e0e tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance af8104c2-2ea1-4e66-bf74-08074566111f {{(pid=74683) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 11:44:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:44:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:44:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74683) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 11:44:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:44:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:44:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:44:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:44:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:44:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74683) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 11:44:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:44:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:44:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:44:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:44:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:44:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74683) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 11:44:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:44:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:44:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:44:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:44:24 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:44:24 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Cleaning up deleted instances with incomplete migration  {{(pid=74683) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 16 11:44:25 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:44:26 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:44:27 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:44:27 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-ab370d94-5298-4745-8073-491a6e773e0e tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance af8104c2-2ea1-4e66-bf74-08074566111f is timed out.
Oct 16 11:44:27 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-ab370d94-5298-4745-8073-491a6e773e0e tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Successfully detached device vdb from instance af8104c2-2ea1-4e66-bf74-08074566111f from the live domain config.
Oct 16 11:44:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab370d94-5298-4745-8073-491a6e773e0e tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] calling os-brick to detach iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 11:44:27 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab370d94-5298-4745-8073-491a6e773e0e tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, {'target_iqn': 'iqn.2010-10.org.openstack:16c2f162-3f13-4e4d-b413-d1e6c684f93b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tGWnUPel', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:44:27 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-ab370d94-5298-4745-8073-491a6e773e0e tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:44:27 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-ab370d94-5298-4745-8073-491a6e773e0e tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:44:27 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-ab370d94-5298-4745-8073-491a6e773e0e tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:44:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:44:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:44:27 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[44951807-83db-4705-859b-ea3f7436f10a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:16c2f162-3f13-4e4d-b413-d1e6c684f93b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:44:27 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab370d94-5298-4745-8073-491a6e773e0e tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 11:44:27 user nova-compute[74683]: No targets found.
Oct 16 11:44:27 user nova-compute[74683]: iSNS:
Oct 16 11:44:27 user nova-compute[74683]: No targets found.
Oct 16 11:44:27 user nova-compute[74683]: STATIC:
Oct 16 11:44:27 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:16c2f162-3f13-4e4d-b413-d1e6c684f93b
Oct 16 11:44:27 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:44:27 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:44:27 user nova-compute[74683]: FIRMWARE:
Oct 16 11:44:27 user nova-compute[74683]: No targets found.
Oct 16 11:44:27 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:44:27 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab370d94-5298-4745-8073-491a6e773e0e tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 11:44:27 user nova-compute[74683]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 11:44:27 user nova-compute[74683]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74683) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 11:44:27 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab370d94-5298-4745-8073-491a6e773e0e tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16c2f162-3f13-4e4d-b413-d1e6c684f93b', 0)] {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 11:44:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:44:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:44:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:44:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:44:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74683) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 11:44:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:44:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:44:27 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[58585911-5626-48da-8611-7e1811ab6bb0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16c2f162-3f13-4e4d-b413-d1e6c684f93b\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:44:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:44:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:44:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:44:27 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a866da-11b5-433b-b651-7653872c43db]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c2f162-3f13-4e4d-b413-d1e6c684f93b (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:44:27 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab370d94-5298-4745-8073-491a6e773e0e tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c2f162-3f13-4e4d-b413-d1e6c684f93b (non-flash)
Oct 16 11:44:27 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:44:27 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab370d94-5298-4745-8073-491a6e773e0e tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c2f162-3f13-4e4d-b413-d1e6c684f93b (non-flash)
Oct 16 11:44:27 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:44:27 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab370d94-5298-4745-8073-491a6e773e0e tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda641043a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16c2f162-3f13-4e4d-b413-d1e6c684f93b'): ({'sdc'}, set())}) {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 11:44:27 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-ab370d94-5298-4745-8073-491a6e773e0e tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Removing single pathed devices sdc {{(pid=74683) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 11:44:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:44:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:44:27 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8581d1-715e-4eb0-b943-1922c86ecc7b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:44:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:44:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:44:27 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5d88f6-9816-47c2-8fbd-07b368966d01]: (4, ('ok\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:44:27 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-ab370d94-5298-4745-8073-491a6e773e0e tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Flushing IO for device /dev/sdc {{(pid=74683) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 11:44:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:44:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:44:27 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[746b6ff0-c16e-411a-8b65-c8a0f51602b9]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:44:27 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-ab370d94-5298-4745-8073-491a6e773e0e tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74683) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 11:44:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:44:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:44:27 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[435a6581-1d6b-4e34-a78c-3a51d0441f31]: (4, ('1', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:44:27 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-ab370d94-5298-4745-8073-491a6e773e0e tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 11:44:27 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-ab370d94-5298-4745-8073-491a6e773e0e tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] SCSI volumes sdc have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 11:44:27 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab370d94-5298-4745-8073-491a6e773e0e tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16c2f162-3f13-4e4d-b413-d1e6c684f93b')] {{(pid=74683) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 11:44:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c2f162-3f13-4e4d-b413-d1e6c684f93b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:44:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c2f162-3f13-4e4d-b413-d1e6c684f93b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:44:27 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[c759283b-5522-4122-8548-21451145abce]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:44:27 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab370d94-5298-4745-8073-491a6e773e0e tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:44:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c2f162-3f13-4e4d-b413-d1e6c684f93b -p 172.16.0.220:3260 --logout {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:44:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c2f162-3f13-4e4d-b413-d1e6c684f93b -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:44:28 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9511ea-b4c2-468a-b905-cffecb90e69b]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:16c2f162-3f13-4e4d-b413-d1e6c684f93b, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:16c2f162-3f13-4e4d-b413-d1e6c684f93b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:44:28 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab370d94-5298-4745-8073-491a6e773e0e tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:16c2f162-3f13-4e4d-b413-d1e6c684f93b, portal: 172.16.0.220,3260]
Oct 16 11:44:28 user nova-compute[74683]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:16c2f162-3f13-4e4d-b413-d1e6c684f93b, portal: 172.16.0.220,3260] successful.
Oct 16 11:44:28 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:44:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c2f162-3f13-4e4d-b413-d1e6c684f93b -p 172.16.0.220:3260 --op delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:44:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c2f162-3f13-4e4d-b413-d1e6c684f93b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:44:28 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4664000-8c69-409a-8acf-0f6d6b0e7d6f]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:44:28 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab370d94-5298-4745-8073-491a6e773e0e tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:44:28 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-ab370d94-5298-4745-8073-491a6e773e0e tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:44:28 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab370d94-5298-4745-8073-491a6e773e0e tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] <== disconnect_volume: return (285ms) None {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:44:28 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab370d94-5298-4745-8073-491a6e773e0e tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Disconnected iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 11:44:28 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:44:28 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Starting heal instance info cache {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 11:44:28 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "refresh_cache-1986f9b5-30fb-4290-802d-ee699a19b608" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:44:28 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquired lock "refresh_cache-1986f9b5-30fb-4290-802d-ee699a19b608" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:44:28 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Forcefully refreshing network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 11:44:29 user nova-compute[74683]: DEBUG nova.objects.instance [None req-ab370d94-5298-4745-8073-491a6e773e0e tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lazy-loading 'flavor' on Instance uuid af8104c2-2ea1-4e66-bf74-08074566111f {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:44:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ab370d94-5298-4745-8073-491a6e773e0e tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lock "af8104c2-2ea1-4e66-bf74-08074566111f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.016s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:44:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-4a344aae-a9c5-45cc-8e19-ff08b869ee6a tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lock "af8104c2-2ea1-4e66-bf74-08074566111f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.905s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:44:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-4a344aae-a9c5-45cc-8e19-ff08b869ee6a tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Acquiring lock "af8104c2-2ea1-4e66-bf74-08074566111f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:44:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-4a344aae-a9c5-45cc-8e19-ff08b869ee6a tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lock "af8104c2-2ea1-4e66-bf74-08074566111f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:44:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-4a344aae-a9c5-45cc-8e19-ff08b869ee6a tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lock "af8104c2-2ea1-4e66-bf74-08074566111f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:44:29 user nova-compute[74683]: INFO nova.compute.manager [None req-4a344aae-a9c5-45cc-8e19-ff08b869ee6a tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Terminating instance
Oct 16 11:44:29 user nova-compute[74683]: DEBUG nova.compute.manager [None req-4a344aae-a9c5-45cc-8e19-ff08b869ee6a tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Start destroying the instance on the hypervisor. {{(pid=74683) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 11:44:29 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Updating instance_info_cache with network_info: [{"id": "f6b38471-41ce-443b-8562-bee2b4f64d31", "address": "fa:16:3e:c9:39:63", "network": {"id": "1fa0852d-814a-45ef-80fa-171693e4d02a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-184537544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ce607a3614fc493d33e6ba8ca5807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6b38471-41", "ovs_interfaceid": "f6b38471-41ce-443b-8562-bee2b4f64d31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:44:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Releasing lock "refresh_cache-1986f9b5-30fb-4290-802d-ee699a19b608" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:44:29 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Updated the network info_cache for instance {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 11:44:29 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:44:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:44:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:44:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:44:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:44:29 user nova-compute[74683]: DEBUG nova.compute.manager [req-fb5deb6e-3b42-4fa0-9809-ef11f51f4624 req-4c49e26d-9019-417e-a7e8-4c6bcd0f6eb9 service nova] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Received event network-vif-unplugged-0fd9270c-aa16-42b8-98e8-cacb699cee50 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:44:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-fb5deb6e-3b42-4fa0-9809-ef11f51f4624 req-4c49e26d-9019-417e-a7e8-4c6bcd0f6eb9 service nova] Acquiring lock "af8104c2-2ea1-4e66-bf74-08074566111f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:44:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-fb5deb6e-3b42-4fa0-9809-ef11f51f4624 req-4c49e26d-9019-417e-a7e8-4c6bcd0f6eb9 service nova] Lock "af8104c2-2ea1-4e66-bf74-08074566111f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:44:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-fb5deb6e-3b42-4fa0-9809-ef11f51f4624 req-4c49e26d-9019-417e-a7e8-4c6bcd0f6eb9 service nova] Lock "af8104c2-2ea1-4e66-bf74-08074566111f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:44:29 user nova-compute[74683]: DEBUG nova.compute.manager [req-fb5deb6e-3b42-4fa0-9809-ef11f51f4624 req-4c49e26d-9019-417e-a7e8-4c6bcd0f6eb9 service nova] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] No waiting events found dispatching network-vif-unplugged-0fd9270c-aa16-42b8-98e8-cacb699cee50 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:44:29 user nova-compute[74683]: DEBUG nova.compute.manager [req-fb5deb6e-3b42-4fa0-9809-ef11f51f4624 req-4c49e26d-9019-417e-a7e8-4c6bcd0f6eb9 service nova] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Received event network-vif-unplugged-0fd9270c-aa16-42b8-98e8-cacb699cee50 for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 11:44:29 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:44:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:44:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:44:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:44:29 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Instance destroyed successfully.
Oct 16 11:44:29 user nova-compute[74683]: DEBUG nova.objects.instance [None req-4a344aae-a9c5-45cc-8e19-ff08b869ee6a tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lazy-loading 'resources' on Instance uuid af8104c2-2ea1-4e66-bf74-08074566111f {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:44:30 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-4a344aae-a9c5-45cc-8e19-ff08b869ee6a tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:40:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-142132556',display_name='tempest-VolumesSnapshotTestJSON-instance-142132556',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-142132556',id=46,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIf2BaisNiOQkbtMcyprEiD6k0IWVmsRGgVJDodEzVGZYdJ2amYVYQ/W518wUH/AxrP3tdeOACMgOn9n760KwgwdyAuvbmOaiM/YsOQZ05oydYGQk0f5Dngy0zM30xk+ag==',key_name='tempest-keypair-1211521238',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:40:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b7d9daeec42a4e73a8ff2c0137f91128',ramdisk_id='',reservation_id='r-kbhry0h0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-919495777',owner_user_name='tempest-VolumesSnapshotTestJSON-919495777-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:40:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='395a6fc9aa93428c95593000c9caeb81',uuid=af8104c2-2ea1-4e66-bf74-08074566111f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0fd9270c-aa16-42b8-98e8-cacb699cee50", "address": "fa:16:3e:a5:05:18", "network": {"id": "3f02f591-1fa0-477f-8730-b41445fd41b4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1932917211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d9daeec42a4e73a8ff2c0137f91128", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd9270c-aa", "ovs_interfaceid": "0fd9270c-aa16-42b8-98e8-cacb699cee50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:44:30 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-4a344aae-a9c5-45cc-8e19-ff08b869ee6a tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Converting VIF {"id": "0fd9270c-aa16-42b8-98e8-cacb699cee50", "address": "fa:16:3e:a5:05:18", "network": {"id": "3f02f591-1fa0-477f-8730-b41445fd41b4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1932917211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d9daeec42a4e73a8ff2c0137f91128", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd9270c-aa", "ovs_interfaceid": "0fd9270c-aa16-42b8-98e8-cacb699cee50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:44:30 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-4a344aae-a9c5-45cc-8e19-ff08b869ee6a tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:05:18,bridge_name='br-int',has_traffic_filtering=True,id=0fd9270c-aa16-42b8-98e8-cacb699cee50,network=Network(3f02f591-1fa0-477f-8730-b41445fd41b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fd9270c-aa') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:44:30 user nova-compute[74683]: DEBUG os_vif [None req-4a344aae-a9c5-45cc-8e19-ff08b869ee6a tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:05:18,bridge_name='br-int',has_traffic_filtering=True,id=0fd9270c-aa16-42b8-98e8-cacb699cee50,network=Network(3f02f591-1fa0-477f-8730-b41445fd41b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fd9270c-aa') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:44:30 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:44:30 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0fd9270c-aa, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:44:30 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:44:30 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:44:30 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:44:30 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=972b965d-7e77-4258-8059-dba72b8080c4) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:44:30 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:44:30 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:44:30 user nova-compute[74683]: INFO os_vif [None req-4a344aae-a9c5-45cc-8e19-ff08b869ee6a tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:05:18,bridge_name='br-int',has_traffic_filtering=True,id=0fd9270c-aa16-42b8-98e8-cacb699cee50,network=Network(3f02f591-1fa0-477f-8730-b41445fd41b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fd9270c-aa')
Oct 16 11:44:30 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a344aae-a9c5-45cc-8e19-ff08b869ee6a tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] calling os-brick to detach iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 11:44:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a344aae-a9c5-45cc-8e19-ff08b869ee6a tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, {'target_iqn': 'iqn.2010-10.org.openstack:16c2f162-3f13-4e4d-b413-d1e6c684f93b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tGWnUPel', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:44:30 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-4a344aae-a9c5-45cc-8e19-ff08b869ee6a tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:44:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-4a344aae-a9c5-45cc-8e19-ff08b869ee6a tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:44:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-4a344aae-a9c5-45cc-8e19-ff08b869ee6a tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:44:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:44:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:44:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:44:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[5eab51e7-2e9d-416d-9fea-67e0f5d3f88e]: Unexpected error while running command.
Oct 16 11:44:30 user nova-compute[74683]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 16 11:44:30 user nova-compute[74683]: Exit code: 21
Oct 16 11:44:30 user nova-compute[74683]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 16 11:44:30 user nova-compute[74683]: Stderr: '' {{(pid=85666) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Oct 16 11:44:30 user nova-compute[74683]: Traceback (most recent call last):
Oct 16 11:44:30 user nova-compute[74683]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Oct 16 11:44:30 user nova-compute[74683]:     ret = func(*f_args, **f_kwargs)
Oct 16 11:44:30 user nova-compute[74683]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Oct 16 11:44:30 user nova-compute[74683]:     return func(*args, **kwargs)
Oct 16 11:44:30 user nova-compute[74683]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Oct 16 11:44:30 user nova-compute[74683]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Oct 16 11:44:30 user nova-compute[74683]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Oct 16 11:44:30 user nova-compute[74683]:     return putils.execute(on_execute=on_execute,
Oct 16 11:44:30 user nova-compute[74683]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Oct 16 11:44:30 user nova-compute[74683]:     raise ProcessExecutionError(exit_code=_returncode,
Oct 16 11:44:30 user nova-compute[74683]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 16 11:44:30 user nova-compute[74683]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 16 11:44:30 user nova-compute[74683]: Exit code: 21
Oct 16 11:44:30 user nova-compute[74683]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 16 11:44:30 user nova-compute[74683]: Stderr: ''
Oct 16 11:44:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eab51e7-2e9d-416d-9fea-67e0f5d3f88e]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:44:30 user nova-compute[74683]: ERROR os_brick.initiator.connectors.iscsi [None req-4a344aae-a9c5-45cc-8e19-ff08b869ee6a tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 16 11:44:30 user nova-compute[74683]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 16 11:44:30 user nova-compute[74683]: Exit code: 21
Oct 16 11:44:30 user nova-compute[74683]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 16 11:44:30 user nova-compute[74683]: Stderr: ''
Oct 16 11:44:30 user nova-compute[74683]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Oct 16 11:44:30 user nova-compute[74683]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Oct 16 11:44:30 user nova-compute[74683]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Oct 16 11:44:30 user nova-compute[74683]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Oct 16 11:44:30 user nova-compute[74683]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Oct 16 11:44:30 user nova-compute[74683]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Oct 16 11:44:30 user nova-compute[74683]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Oct 16 11:44:30 user nova-compute[74683]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Oct 16 11:44:30 user nova-compute[74683]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Oct 16 11:44:30 user nova-compute[74683]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Oct 16 11:44:30 user nova-compute[74683]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Oct 16 11:44:30 user nova-compute[74683]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Oct 16 11:44:30 user nova-compute[74683]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Oct 16 11:44:30 user nova-compute[74683]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Oct 16 11:44:30 user nova-compute[74683]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Oct 16 11:44:30 user nova-compute[74683]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 16 11:44:30 user nova-compute[74683]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Oct 16 11:44:30 user nova-compute[74683]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Oct 16 11:44:30 user nova-compute[74683]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 16 11:44:30 user nova-compute[74683]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Oct 16 11:44:30 user nova-compute[74683]: ERROR os_brick.initiator.connectors.iscsi 
Oct 16 11:44:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a344aae-a9c5-45cc-8e19-ff08b869ee6a tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=74683) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Oct 16 11:44:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-4a344aae-a9c5-45cc-8e19-ff08b869ee6a tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.028s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:44:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a344aae-a9c5-45cc-8e19-ff08b869ee6a tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] <== disconnect_volume: return (29ms) None {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:44:30 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a344aae-a9c5-45cc-8e19-ff08b869ee6a tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Disconnected iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 11:44:30 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-4a344aae-a9c5-45cc-8e19-ff08b869ee6a tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Deleting instance files /opt/stack/data/nova/instances/af8104c2-2ea1-4e66-bf74-08074566111f_del
Oct 16 11:44:30 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-4a344aae-a9c5-45cc-8e19-ff08b869ee6a tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Deletion of /opt/stack/data/nova/instances/af8104c2-2ea1-4e66-bf74-08074566111f_del complete
Oct 16 11:44:30 user nova-compute[74683]: INFO nova.compute.manager [None req-4a344aae-a9c5-45cc-8e19-ff08b869ee6a tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 16 11:44:30 user nova-compute[74683]: DEBUG oslo.service.loopingcall [None req-4a344aae-a9c5-45cc-8e19-ff08b869ee6a tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74683) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 11:44:30 user nova-compute[74683]: DEBUG nova.compute.manager [-] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Deallocating network for instance {{(pid=74683) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 11:44:30 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] deallocate_for_instance() {{(pid=74683) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 11:44:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Acquiring lock "ec2b88a5-6571-4f46-a07d-47ccfc1761e4" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:44:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "ec2b88a5-6571-4f46-a07d-47ccfc1761e4" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:44:30 user nova-compute[74683]: INFO nova.compute.manager [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Unshelving
Oct 16 11:44:30 user nova-compute[74683]: INFO nova.virt.block_device [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Booting with volume 7ce79b34-e4db-42a6-b4be-08ece45a72a7 at /dev/vdc
Oct 16 11:44:30 user nova-compute[74683]: DEBUG os_brick.utils [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:44:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:44:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:44:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[362b6ddc-e051-4dbb-a4bd-2fc32b6c74ed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:70b9d336ab7d\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:44:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:44:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:44:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a90865-a796-48bf-8480-544775d67c0c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:44:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:44:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:44:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6115f3-b760-4875-9c8f-d9497ff43521]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:44:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8ff36b-e5e3-451e-a44d-869b1bcf51b6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:44:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Running cmd (subprocess): nvme version {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:44:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] 'nvme version' failed. Not Retrying. {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:44:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] nvme not present on system {{(pid=74683) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 11:44:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:44:30 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:44:30 user nova-compute[74683]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 11:44:30 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3741ff-8d16-42bb-8c66-8cff71c5273e]: (4, '') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:44:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74683) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 11:44:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 11:44:30 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] LIGHTOS: no hostnqn found. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 11:44:30 user nova-compute[74683]: DEBUG os_brick.utils [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:70b9d336ab7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:44:30 user nova-compute[74683]: DEBUG nova.virt.block_device [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Updating existing volume attachment record: c9a97cee-2683-4a8d-b806-1a9c212ef17f {{(pid=74683) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 11:44:30 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:44:30 user nova-compute[74683]: INFO nova.compute.manager [-] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Took 0.82 seconds to deallocate network for instance.
Oct 16 11:44:30 user nova-compute[74683]: DEBUG nova.compute.manager [req-cedfc431-085a-49f1-9225-a6c9e3808efd req-b3bd3397-22b0-4547-9318-c84056eff23d service nova] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Received event network-vif-deleted-0fd9270c-aa16-42b8-98e8-cacb699cee50 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:44:30 user nova-compute[74683]: WARNING nova.volume.cinder [None req-4a344aae-a9c5-45cc-8e19-ff08b869ee6a tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Attachment 0efebe89-554e-4e97-a62e-d1eda5a338ac does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 0efebe89-554e-4e97-a62e-d1eda5a338ac. (HTTP 404) (Request-ID: req-31803139-bf9e-4403-a66a-7740a6a7bc2f)
Oct 16 11:44:30 user nova-compute[74683]: INFO nova.compute.manager [None req-4a344aae-a9c5-45cc-8e19-ff08b869ee6a tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Took 0.03 seconds to detach 1 volumes for instance.
Oct 16 11:44:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-4a344aae-a9c5-45cc-8e19-ff08b869ee6a tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:44:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-4a344aae-a9c5-45cc-8e19-ff08b869ee6a tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:44:31 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-4a344aae-a9c5-45cc-8e19-ff08b869ee6a tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:44:31 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-4a344aae-a9c5-45cc-8e19-ff08b869ee6a tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:44:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-4a344aae-a9c5-45cc-8e19-ff08b869ee6a tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.304s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:44:31 user nova-compute[74683]: INFO nova.scheduler.client.report [None req-4a344aae-a9c5-45cc-8e19-ff08b869ee6a tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Deleted allocations for instance af8104c2-2ea1-4e66-bf74-08074566111f
Oct 16 11:44:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-4a344aae-a9c5-45cc-8e19-ff08b869ee6a tempest-VolumesSnapshotTestJSON-919495777 tempest-VolumesSnapshotTestJSON-919495777-project-member] Lock "af8104c2-2ea1-4e66-bf74-08074566111f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.341s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:44:31 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:44:31 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74683) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 11:44:31 user nova-compute[74683]: DEBUG nova.compute.manager [req-66488358-07dd-45d0-a9b0-9d081573ed33 req-e2b123a9-7841-461c-bb41-8ca98619e30b service nova] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Received event network-vif-plugged-0fd9270c-aa16-42b8-98e8-cacb699cee50 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:44:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-66488358-07dd-45d0-a9b0-9d081573ed33 req-e2b123a9-7841-461c-bb41-8ca98619e30b service nova] Acquiring lock "af8104c2-2ea1-4e66-bf74-08074566111f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:44:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-66488358-07dd-45d0-a9b0-9d081573ed33 req-e2b123a9-7841-461c-bb41-8ca98619e30b service nova] Lock "af8104c2-2ea1-4e66-bf74-08074566111f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:44:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-66488358-07dd-45d0-a9b0-9d081573ed33 req-e2b123a9-7841-461c-bb41-8ca98619e30b service nova] Lock "af8104c2-2ea1-4e66-bf74-08074566111f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:44:31 user nova-compute[74683]: DEBUG nova.compute.manager [req-66488358-07dd-45d0-a9b0-9d081573ed33 req-e2b123a9-7841-461c-bb41-8ca98619e30b service nova] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] No waiting events found dispatching network-vif-plugged-0fd9270c-aa16-42b8-98e8-cacb699cee50 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:44:31 user nova-compute[74683]: WARNING nova.compute.manager [req-66488358-07dd-45d0-a9b0-9d081573ed33 req-e2b123a9-7841-461c-bb41-8ca98619e30b service nova] [instance: af8104c2-2ea1-4e66-bf74-08074566111f] Received unexpected event network-vif-plugged-0fd9270c-aa16-42b8-98e8-cacb699cee50 for instance with vm_state deleted and task_state None.
Oct 16 11:44:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-e2092be3-b449-4d71-85b0-a967d6a3db44 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Acquiring lock "1986f9b5-30fb-4290-802d-ee699a19b608" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:44:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-e2092be3-b449-4d71-85b0-a967d6a3db44 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "1986f9b5-30fb-4290-802d-ee699a19b608" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:44:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-e2092be3-b449-4d71-85b0-a967d6a3db44 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Acquiring lock "1986f9b5-30fb-4290-802d-ee699a19b608-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:44:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-e2092be3-b449-4d71-85b0-a967d6a3db44 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "1986f9b5-30fb-4290-802d-ee699a19b608-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:44:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-e2092be3-b449-4d71-85b0-a967d6a3db44 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "1986f9b5-30fb-4290-802d-ee699a19b608-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:44:31 user nova-compute[74683]: INFO nova.compute.manager [None req-e2092be3-b449-4d71-85b0-a967d6a3db44 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Terminating instance
Oct 16 11:44:31 user nova-compute[74683]: DEBUG nova.compute.manager [None req-e2092be3-b449-4d71-85b0-a967d6a3db44 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Start destroying the instance on the hypervisor. {{(pid=74683) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 11:44:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:44:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:44:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:44:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:44:32 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Instance destroyed successfully.
Oct 16 11:44:32 user nova-compute[74683]: DEBUG nova.objects.instance [None req-e2092be3-b449-4d71-85b0-a967d6a3db44 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lazy-loading 'resources' on Instance uuid 1986f9b5-30fb-4290-802d-ee699a19b608 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:44:32 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-e2092be3-b449-4d71-85b0-a967d6a3db44 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:38:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1431918915',display_name='tempest-TestMinimumBasicScenario-server-1431918915',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1431918915',id=44,image_ref='3655c371-474c-4f9f-ba8b-0d7456865849',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCI5nTHN+Qfkky+jJW3BD5AjS3zBFf7VOxBEwGAWRlhhO37Od80oayCaWewTkSYmErNkZl6VLo4/JM0tQtAYq4JzjY6pa6GzBXSeQpF5WvAUIkacc81Db7rcQJLH79d+dg==',key_name='tempest-TestMinimumBasicScenario-1795285557',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:39:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f1ce607a3614fc493d33e6ba8ca5807',ramdisk_id='',reservation_id='r-04floz6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3655c371-474c-4f9f-ba8b-0d7456865849',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-470564601',owner_user_name='tempest-TestMinimumBasicScenario-470564601-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:41:45Z,user_data=None,user_id='7bd40e88d3914927a7804e3b4fb26549',uuid=1986f9b5-30fb-4290-802d-ee699a19b608,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f6b38471-41ce-443b-8562-bee2b4f64d31", "address": "fa:16:3e:c9:39:63", "network": {"id": "1fa0852d-814a-45ef-80fa-171693e4d02a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-184537544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ce607a3614fc493d33e6ba8ca5807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6b38471-41", "ovs_interfaceid": "f6b38471-41ce-443b-8562-bee2b4f64d31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:44:32 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-e2092be3-b449-4d71-85b0-a967d6a3db44 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Converting VIF {"id": "f6b38471-41ce-443b-8562-bee2b4f64d31", "address": "fa:16:3e:c9:39:63", "network": {"id": "1fa0852d-814a-45ef-80fa-171693e4d02a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-184537544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ce607a3614fc493d33e6ba8ca5807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6b38471-41", "ovs_interfaceid": "f6b38471-41ce-443b-8562-bee2b4f64d31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:44:32 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-e2092be3-b449-4d71-85b0-a967d6a3db44 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c9:39:63,bridge_name='br-int',has_traffic_filtering=True,id=f6b38471-41ce-443b-8562-bee2b4f64d31,network=Network(1fa0852d-814a-45ef-80fa-171693e4d02a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6b38471-41') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:44:32 user nova-compute[74683]: DEBUG os_vif [None req-e2092be3-b449-4d71-85b0-a967d6a3db44 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:39:63,bridge_name='br-int',has_traffic_filtering=True,id=f6b38471-41ce-443b-8562-bee2b4f64d31,network=Network(1fa0852d-814a-45ef-80fa-171693e4d02a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6b38471-41') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:44:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:44:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf6b38471-41, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:44:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:44:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:44:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:44:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9c89a340-6c72-4662-b7d1-fd6e56bf0620) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:44:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:44:32 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:44:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:44:32 user nova-compute[74683]: INFO os_vif [None req-e2092be3-b449-4d71-85b0-a967d6a3db44 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:39:63,bridge_name='br-int',has_traffic_filtering=True,id=f6b38471-41ce-443b-8562-bee2b4f64d31,network=Network(1fa0852d-814a-45ef-80fa-171693e4d02a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6b38471-41')
Oct 16 11:44:32 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-e2092be3-b449-4d71-85b0-a967d6a3db44 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Deleting instance files /opt/stack/data/nova/instances/1986f9b5-30fb-4290-802d-ee699a19b608_del
Oct 16 11:44:32 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-e2092be3-b449-4d71-85b0-a967d6a3db44 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Deletion of /opt/stack/data/nova/instances/1986f9b5-30fb-4290-802d-ee699a19b608_del complete
Oct 16 11:44:32 user nova-compute[74683]: INFO nova.compute.manager [None req-e2092be3-b449-4d71-85b0-a967d6a3db44 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Took 0.86 seconds to destroy the instance on the hypervisor.
Oct 16 11:44:32 user nova-compute[74683]: DEBUG oslo.service.loopingcall [None req-e2092be3-b449-4d71-85b0-a967d6a3db44 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74683) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 11:44:32 user nova-compute[74683]: DEBUG nova.compute.manager [-] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Deallocating network for instance {{(pid=74683) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 11:44:32 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] deallocate_for_instance() {{(pid=74683) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 11:44:33 user nova-compute[74683]: DEBUG nova.compute.manager [req-d2a3b8f8-4a6f-49ee-b3cd-0473e64b4491 req-fee0329e-2925-4150-a16c-07006d9b5012 service nova] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Received event network-vif-unplugged-f6b38471-41ce-443b-8562-bee2b4f64d31 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:44:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-d2a3b8f8-4a6f-49ee-b3cd-0473e64b4491 req-fee0329e-2925-4150-a16c-07006d9b5012 service nova] Acquiring lock "1986f9b5-30fb-4290-802d-ee699a19b608-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:44:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-d2a3b8f8-4a6f-49ee-b3cd-0473e64b4491 req-fee0329e-2925-4150-a16c-07006d9b5012 service nova] Lock "1986f9b5-30fb-4290-802d-ee699a19b608-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:44:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-d2a3b8f8-4a6f-49ee-b3cd-0473e64b4491 req-fee0329e-2925-4150-a16c-07006d9b5012 service nova] Lock "1986f9b5-30fb-4290-802d-ee699a19b608-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:44:33 user nova-compute[74683]: DEBUG nova.compute.manager [req-d2a3b8f8-4a6f-49ee-b3cd-0473e64b4491 req-fee0329e-2925-4150-a16c-07006d9b5012 service nova] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] No waiting events found dispatching network-vif-unplugged-f6b38471-41ce-443b-8562-bee2b4f64d31 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:44:33 user nova-compute[74683]: DEBUG nova.compute.manager [req-d2a3b8f8-4a6f-49ee-b3cd-0473e64b4491 req-fee0329e-2925-4150-a16c-07006d9b5012 service nova] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Received event network-vif-unplugged-f6b38471-41ce-443b-8562-bee2b4f64d31 for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 11:44:33 user nova-compute[74683]: DEBUG nova.compute.manager [req-d2a3b8f8-4a6f-49ee-b3cd-0473e64b4491 req-fee0329e-2925-4150-a16c-07006d9b5012 service nova] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Received event network-vif-plugged-f6b38471-41ce-443b-8562-bee2b4f64d31 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:44:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-d2a3b8f8-4a6f-49ee-b3cd-0473e64b4491 req-fee0329e-2925-4150-a16c-07006d9b5012 service nova] Acquiring lock "1986f9b5-30fb-4290-802d-ee699a19b608-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:44:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-d2a3b8f8-4a6f-49ee-b3cd-0473e64b4491 req-fee0329e-2925-4150-a16c-07006d9b5012 service nova] Lock "1986f9b5-30fb-4290-802d-ee699a19b608-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:44:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-d2a3b8f8-4a6f-49ee-b3cd-0473e64b4491 req-fee0329e-2925-4150-a16c-07006d9b5012 service nova] Lock "1986f9b5-30fb-4290-802d-ee699a19b608-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:44:33 user nova-compute[74683]: DEBUG nova.compute.manager [req-d2a3b8f8-4a6f-49ee-b3cd-0473e64b4491 req-fee0329e-2925-4150-a16c-07006d9b5012 service nova] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] No waiting events found dispatching network-vif-plugged-f6b38471-41ce-443b-8562-bee2b4f64d31 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:44:33 user nova-compute[74683]: WARNING nova.compute.manager [req-d2a3b8f8-4a6f-49ee-b3cd-0473e64b4491 req-fee0329e-2925-4150-a16c-07006d9b5012 service nova] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Received unexpected event network-vif-plugged-f6b38471-41ce-443b-8562-bee2b4f64d31 for instance with vm_state active and task_state deleting.
Oct 16 11:44:33 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:44:33 user nova-compute[74683]: INFO nova.compute.manager [-] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Took 0.55 seconds to deallocate network for instance.
Oct 16 11:44:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-e2092be3-b449-4d71-85b0-a967d6a3db44 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:44:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-e2092be3-b449-4d71-85b0-a967d6a3db44 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:44:33 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-e2092be3-b449-4d71-85b0-a967d6a3db44 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Refreshing inventories for resource provider 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 16 11:44:33 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-e2092be3-b449-4d71-85b0-a967d6a3db44 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Updating ProviderTree inventory for provider 7142d606-df50-4cbe-b5ed-1802caa31862 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 16 11:44:33 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-e2092be3-b449-4d71-85b0-a967d6a3db44 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Updating inventory in ProviderTree for provider 7142d606-df50-4cbe-b5ed-1802caa31862 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 16 11:44:33 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-e2092be3-b449-4d71-85b0-a967d6a3db44 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Refreshing aggregate associations for resource provider 7142d606-df50-4cbe-b5ed-1802caa31862, aggregates: None {{(pid=74683) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 16 11:44:33 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-e2092be3-b449-4d71-85b0-a967d6a3db44 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Refreshing trait associations for resource provider 7142d606-df50-4cbe-b5ed-1802caa31862, traits: COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VMVGA {{(pid=74683) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 16 11:44:33 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-e2092be3-b449-4d71-85b0-a967d6a3db44 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:44:33 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-e2092be3-b449-4d71-85b0-a967d6a3db44 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:44:33 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:44:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:44:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-e2092be3-b449-4d71-85b0-a967d6a3db44 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.351s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:44:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.010s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:44:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:44:33 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Auditing locally available compute resources for user (node: user) {{(pid=74683) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 11:44:33 user nova-compute[74683]: INFO nova.scheduler.client.report [None req-e2092be3-b449-4d71-85b0-a967d6a3db44 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Deleted allocations for instance 1986f9b5-30fb-4290-802d-ee699a19b608
Oct 16 11:44:33 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:44:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-e2092be3-b449-4d71-85b0-a967d6a3db44 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "1986f9b5-30fb-4290-802d-ee699a19b608" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.976s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:44:34 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:44:34 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:44:34 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:44:34 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6acbac6-01f7-4c5e-ba2f-1650713d1452/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:44:34 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6acbac6-01f7-4c5e-ba2f-1650713d1452/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:44:34 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6acbac6-01f7-4c5e-ba2f-1650713d1452/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:44:34 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6acbac6-01f7-4c5e-ba2f-1650713d1452/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:44:34 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d94b70c-4056-4c58-9df4-73684e0d164f/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:44:34 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d94b70c-4056-4c58-9df4-73684e0d164f/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:44:34 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d94b70c-4056-4c58-9df4-73684e0d164f/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:44:34 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d94b70c-4056-4c58-9df4-73684e0d164f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:44:35 user nova-compute[74683]: DEBUG nova.compute.manager [req-79c2bd62-4f85-48e4-b38c-92c81b9e841c req-51c15aa3-fea4-4981-a2d7-a660372f1dc6 service nova] [instance: 1986f9b5-30fb-4290-802d-ee699a19b608] Received event network-vif-deleted-f6b38471-41ce-443b-8562-bee2b4f64d31 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:44:35 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:44:35 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:44:35 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Hypervisor/Node resource view: name=user free_ram=8494MB free_disk=25.065750122070312GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74683) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 11:44:35 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:44:35 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:44:35 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 8d94b70c-4056-4c58-9df4-73684e0d164f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:44:35 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:44:35 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance d6acbac6-01f7-4c5e-ba2f-1650713d1452 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:44:35 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance ec2b88a5-6571-4f46-a07d-47ccfc1761e4 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 16 11:44:35 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 11:44:35 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 11:44:35 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:44:35 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:44:35 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Compute_service record updated for user:user {{(pid=74683) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 11:44:35 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.310s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:44:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:44:38 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:44:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:44:46 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:44:46 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:44:46 user nova-compute[74683]: DEBUG nova.objects.instance [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lazy-loading 'pci_requests' on Instance uuid ec2b88a5-6571-4f46-a07d-47ccfc1761e4 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:44:46 user nova-compute[74683]: DEBUG nova.objects.instance [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lazy-loading 'numa_topology' on Instance uuid ec2b88a5-6571-4f46-a07d-47ccfc1761e4 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:44:46 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74683) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 11:44:46 user nova-compute[74683]: INFO nova.compute.claims [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Claim successful on node user
Oct 16 11:44:46 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:44:46 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Cleaning up deleted instances {{(pid=74683) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 16 11:44:46 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] There are 0 instances to clean {{(pid=74683) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 16 11:44:46 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:44:46 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:44:46 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.344s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:44:46 user nova-compute[74683]: INFO nova.network.neutron [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Updating port 75e552bb-fec2-47bd-adda-d562f27f8a36 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 16 11:44:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Acquiring lock "refresh_cache-ec2b88a5-6571-4f46-a07d-47ccfc1761e4" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:44:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Acquired lock "refresh_cache-ec2b88a5-6571-4f46-a07d-47ccfc1761e4" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:44:47 user nova-compute[74683]: DEBUG nova.network.neutron [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:44:47 user nova-compute[74683]: DEBUG nova.compute.manager [req-a662847c-291f-412b-a308-354f9929b0aa req-4f385013-7cab-4cfa-9816-2150704c14b7 service nova] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Received event network-changed-75e552bb-fec2-47bd-adda-d562f27f8a36 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:44:47 user nova-compute[74683]: DEBUG nova.compute.manager [req-a662847c-291f-412b-a308-354f9929b0aa req-4f385013-7cab-4cfa-9816-2150704c14b7 service nova] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Refreshing instance network info cache due to event network-changed-75e552bb-fec2-47bd-adda-d562f27f8a36. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:44:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a662847c-291f-412b-a308-354f9929b0aa req-4f385013-7cab-4cfa-9816-2150704c14b7 service nova] Acquiring lock "refresh_cache-ec2b88a5-6571-4f46-a07d-47ccfc1761e4" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:44:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:44:47 user nova-compute[74683]: DEBUG nova.network.neutron [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Updating instance_info_cache with network_info: [{"id": "75e552bb-fec2-47bd-adda-d562f27f8a36", "address": "fa:16:3e:f5:74:eb", "network": {"id": "2ea750a5-8511-4e40-b149-062e10e0096c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-563467594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d2c7c33914a068b448c447db50b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75e552bb-fe", "ovs_interfaceid": "75e552bb-fec2-47bd-adda-d562f27f8a36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:44:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Releasing lock "refresh_cache-ec2b88a5-6571-4f46-a07d-47ccfc1761e4" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:44:47 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Creating instance directory {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 11:44:47 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Creating image(s)
Oct 16 11:44:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Acquiring lock "/opt/stack/data/nova/instances/ec2b88a5-6571-4f46-a07d-47ccfc1761e4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:44:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "/opt/stack/data/nova/instances/ec2b88a5-6571-4f46-a07d-47ccfc1761e4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:44:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "/opt/stack/data/nova/instances/ec2b88a5-6571-4f46-a07d-47ccfc1761e4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:44:48 user nova-compute[74683]: DEBUG nova.objects.instance [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lazy-loading 'trusted_certs' on Instance uuid ec2b88a5-6571-4f46-a07d-47ccfc1761e4 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:44:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a662847c-291f-412b-a308-354f9929b0aa req-4f385013-7cab-4cfa-9816-2150704c14b7 service nova] Acquired lock "refresh_cache-ec2b88a5-6571-4f46-a07d-47ccfc1761e4" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:44:48 user nova-compute[74683]: DEBUG nova.network.neutron [req-a662847c-291f-412b-a308-354f9929b0aa req-4f385013-7cab-4cfa-9816-2150704c14b7 service nova] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Refreshing network info cache for port 75e552bb-fec2-47bd-adda-d562f27f8a36 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:44:48 user nova-compute[74683]: DEBUG nova.objects.base [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Object Instance<ec2b88a5-6571-4f46-a07d-47ccfc1761e4> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:44:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Acquiring lock "d975990e8dce3e3d11242bd4cd8f6bd989b16568" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:44:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "d975990e8dce3e3d11242bd4cd8f6bd989b16568" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:44:49 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d975990e8dce3e3d11242bd4cd8f6bd989b16568.part --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:44:49 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d975990e8dce3e3d11242bd4cd8f6bd989b16568.part --force-share --output=json" returned: 0 in 0.237s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:44:49 user nova-compute[74683]: DEBUG nova.virt.images [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] 6d67bec9-afc0-45d6-a866-9613c3f356b4 was qcow2, converting to raw {{(pid=74683) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 16 11:44:49 user nova-compute[74683]: DEBUG nova.privsep.utils [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74683) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 11:44:49 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d975990e8dce3e3d11242bd4cd8f6bd989b16568.part /opt/stack/data/nova/instances/_base/d975990e8dce3e3d11242bd4cd8f6bd989b16568.converted {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:44:49 user nova-compute[74683]: DEBUG nova.network.neutron [req-a662847c-291f-412b-a308-354f9929b0aa req-4f385013-7cab-4cfa-9816-2150704c14b7 service nova] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Updated VIF entry in instance network info cache for port 75e552bb-fec2-47bd-adda-d562f27f8a36. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:44:49 user nova-compute[74683]: DEBUG nova.network.neutron [req-a662847c-291f-412b-a308-354f9929b0aa req-4f385013-7cab-4cfa-9816-2150704c14b7 service nova] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Updating instance_info_cache with network_info: [{"id": "75e552bb-fec2-47bd-adda-d562f27f8a36", "address": "fa:16:3e:f5:74:eb", "network": {"id": "2ea750a5-8511-4e40-b149-062e10e0096c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-563467594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d2c7c33914a068b448c447db50b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75e552bb-fe", "ovs_interfaceid": "75e552bb-fec2-47bd-adda-d562f27f8a36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:44:49 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a662847c-291f-412b-a308-354f9929b0aa req-4f385013-7cab-4cfa-9816-2150704c14b7 service nova] Releasing lock "refresh_cache-ec2b88a5-6571-4f46-a07d-47ccfc1761e4" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:44:49 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d975990e8dce3e3d11242bd4cd8f6bd989b16568.part /opt/stack/data/nova/instances/_base/d975990e8dce3e3d11242bd4cd8f6bd989b16568.converted" returned: 0 in 0.561s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:44:49 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d975990e8dce3e3d11242bd4cd8f6bd989b16568.converted --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:44:50 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d975990e8dce3e3d11242bd4cd8f6bd989b16568.converted --force-share --output=json" returned: 0 in 0.172s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:44:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "d975990e8dce3e3d11242bd4cd8f6bd989b16568" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.105s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:44:50 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d975990e8dce3e3d11242bd4cd8f6bd989b16568 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:44:50 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d975990e8dce3e3d11242bd4cd8f6bd989b16568 --force-share --output=json" returned: 0 in 0.177s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:44:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Acquiring lock "d975990e8dce3e3d11242bd4cd8f6bd989b16568" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:44:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "d975990e8dce3e3d11242bd4cd8f6bd989b16568" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:44:50 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d975990e8dce3e3d11242bd4cd8f6bd989b16568 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:44:50 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d975990e8dce3e3d11242bd4cd8f6bd989b16568 --force-share --output=json" returned: 0 in 0.171s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:44:50 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d975990e8dce3e3d11242bd4cd8f6bd989b16568,backing_fmt=raw /opt/stack/data/nova/instances/ec2b88a5-6571-4f46-a07d-47ccfc1761e4/disk 1073741824 {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:44:50 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d975990e8dce3e3d11242bd4cd8f6bd989b16568,backing_fmt=raw /opt/stack/data/nova/instances/ec2b88a5-6571-4f46-a07d-47ccfc1761e4/disk 1073741824" returned: 0 in 0.049s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:44:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "d975990e8dce3e3d11242bd4cd8f6bd989b16568" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:44:50 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d975990e8dce3e3d11242bd4cd8f6bd989b16568 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:44:50 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d975990e8dce3e3d11242bd4cd8f6bd989b16568 --force-share --output=json" returned: 0 in 0.172s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:44:50 user nova-compute[74683]: DEBUG nova.objects.instance [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lazy-loading 'migration_context' on Instance uuid ec2b88a5-6571-4f46-a07d-47ccfc1761e4 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:44:50 user nova-compute[74683]: DEBUG nova.objects.base [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Object Instance<ec2b88a5-6571-4f46-a07d-47ccfc1761e4> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:44:50 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Rebasing disk image.
Oct 16 11:44:50 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:44:50 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.172s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:44:50 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 -F raw /opt/stack/data/nova/instances/ec2b88a5-6571-4f46-a07d-47ccfc1761e4/disk {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:44:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 -F raw /opt/stack/data/nova/instances/ec2b88a5-6571-4f46-a07d-47ccfc1761e4/disk" returned: 0 in 2.359s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Created local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Ensure instance console log exists: /opt/stack/data/nova/instances/ec2b88a5-6571-4f46-a07d-47ccfc1761e4/console.log {{(pid=74683) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Start _get_guest_xml network_info=[{"id": "75e552bb-fec2-47bd-adda-d562f27f8a36", "address": "fa:16:3e:f5:74:eb", "network": {"id": "2ea750a5-8511-4e40-b149-062e10e0096c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-563467594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d2c7c33914a068b448c447db50b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75e552bb-fe", "ovs_interfaceid": "75e552bb-fec2-47bd-adda-d562f27f8a36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='86cd8f870bb79b399a884acb5308e2b3',container_format='bare',created_at=2023-10-16T11:42:38Z,direct_url=<?>,disk_format='qcow2',id=6d67bec9-afc0-45d6-a866-9613c3f356b4,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2110881689-shelved',owner='622d2c7c33914a068b448c447db50b3c',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-16T11:42:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TlkhIPMo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'ec2b88a5-6571-4f46-a07d-47ccfc1761e4', 'attached_at': '', 'detached_at': '', 'volume_id': '7ce79b34-e4db-42a6-b4be-08ece45a72a7', 'serial': '7ce79b34-e4db-42a6-b4be-08ece45a72a7'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': None, 'delete_on_termination': False, 'attachment_id': 'c9a97cee-2683-4a8d-b806-1a9c212ef17f', 'volume_type': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:44:53 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:44:53 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:44:53 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='86cd8f870bb79b399a884acb5308e2b3',container_format='bare',created_at=2023-10-16T11:42:38Z,direct_url=<?>,disk_format='qcow2',id=6d67bec9-afc0-45d6-a866-9613c3f356b4,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2110881689-shelved',owner='622d2c7c33914a068b448c447db50b3c',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-16T11:42:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG nova.objects.instance [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lazy-loading 'vcpu_model' on Instance uuid ec2b88a5-6571-4f46-a07d-47ccfc1761e4 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG nova.objects.base [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Object Instance<ec2b88a5-6571-4f46-a07d-47ccfc1761e4> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Calling os-brick to attach iSCSI Volume {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TlkhIPMo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:44:53 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:44:53 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:44:53 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:44:53 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.023s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:44:53 user nova-compute[74683]: INFO os_brick.initiator.connectors.iscsi [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 11:44:53 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7 -p 172.16.0.220:3260 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7 -p 172.16.0.220:3260" returned: 21 in 0.104s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92e63d9-75f4-4d49-a944-0845f2727ff7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 11:44:53 user nova-compute[74683]:  {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[7033078a-1d3d-43d4-ad28-dd3db1650fc4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7] added\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7] added
Oct 16 11:44:53 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4af3f66-81e4-48d6-a5b4-2bb3849c4bda]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[596952b7-e737-44d8-923c-a2679f831fc3]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TlkhIPMo {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TlkhIPMo" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb03fd7c-75b4-47cd-8728-c8aa6ec56b54]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TlkhIPMo'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5a2011-ab18-46ba-a245-14201a691ff4]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[35da4f27-bf70-4db8-bbc6-3b042369cffd]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 16 11:44:53 user nova-compute[74683]:  {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 16 11:44:53 user nova-compute[74683]:  {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:44:53 user nova-compute[74683]: WARNING os_brick.initiator.connectors.iscsi [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 16 11:44:53 user nova-compute[74683]: 
Oct 16 11:44:53 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7 -p 172.16.0.220:3260 --login {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdbe5242-eaf0-4d72-9c3b-133321b0d174]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7, portal: 172.16.0.220,3260]
Oct 16 11:44:53 user nova-compute[74683]: Login to [iface: default, target: iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7, portal: 172.16.0.220,3260] successful.
Oct 16 11:44:53 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[607d8e16-0253-4a42-9153-f937c54b62e5]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[3846a6d2-c223-4017-aecf-34734e3e2dd6]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7 (non-flash)
Oct 16 11:44:53 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7 (non-flash)
Oct 16 11:44:53 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Connected to 172.16.0.220:3260 {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=74683) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74683) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a359893-66ce-4560-a461-3632ed230a2b]: (4, ('- - 0', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:44:53 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TlkhIPMo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 11:44:54 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.386s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:44:54 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] <== connect_volume: return (1388ms) {'type': 'block', 'scsi_wwn': '26633633963623537', 'path': '/dev/sdb'} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:44:54 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633633963623537', 'path': '/dev/sdb'} {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 11:44:54 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-16T11:40:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2110881689',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2110881689',id=45,image_ref='6d67bec9-afc0-45d6-a866-9613c3f356b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-127654640',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:40:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='622d2c7c33914a068b448c447db50b3c',ramdisk_id='',reservation_id='r-3kki01l8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-291825158',owner_user_name='tempest-AttachVolumeShelveTestJSON-291825158-project-member',shelved_at='2023-10-16T11:42:42.646944',shelved_host='user',shelved_image_id='6d67bec9-afc0-45d6-a866-9613c3f356b4'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:44:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11130271beb44b368f9eb55bd4946cbc',uuid=ec2b88a5-6571-4f46-a07d-47ccfc1761e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "75e552bb-fec2-47bd-adda-d562f27f8a36", "address": "fa:16:3e:f5:74:eb", "network": {"id": "2ea750a5-8511-4e40-b149-062e10e0096c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-563467594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d2c7c33914a068b448c447db50b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75e552bb-fe", "ovs_interfaceid": "75e552bb-fec2-47bd-adda-d562f27f8a36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:44:54 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Converting VIF {"id": "75e552bb-fec2-47bd-adda-d562f27f8a36", "address": "fa:16:3e:f5:74:eb", "network": {"id": "2ea750a5-8511-4e40-b149-062e10e0096c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-563467594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d2c7c33914a068b448c447db50b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75e552bb-fe", "ovs_interfaceid": "75e552bb-fec2-47bd-adda-d562f27f8a36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:44:54 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:74:eb,bridge_name='br-int',has_traffic_filtering=True,id=75e552bb-fec2-47bd-adda-d562f27f8a36,network=Network(2ea750a5-8511-4e40-b149-062e10e0096c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75e552bb-fe') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:44:54 user nova-compute[74683]: DEBUG nova.objects.instance [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lazy-loading 'pci_devices' on Instance uuid ec2b88a5-6571-4f46-a07d-47ccfc1761e4 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:44:54 user nova-compute[74683]: DEBUG nova.objects.base [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Object Instance<ec2b88a5-6571-4f46-a07d-47ccfc1761e4> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:44:54 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:44:54 user nova-compute[74683]:   <uuid>ec2b88a5-6571-4f46-a07d-47ccfc1761e4</uuid>
Oct 16 11:44:54 user nova-compute[74683]:   <name>instance-0000002d</name>
Oct 16 11:44:54 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:44:54 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:44:54 user nova-compute[74683]:   <metadata>
Oct 16 11:44:54 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:44:54 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:44:54 user nova-compute[74683]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2110881689</nova:name>
Oct 16 11:44:54 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:44:53</nova:creationTime>
Oct 16 11:44:54 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:44:54 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:44:54 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:44:54 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:44:54 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:44:54 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:44:54 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:44:54 user nova-compute[74683]:       <nova:owner>
Oct 16 11:44:54 user nova-compute[74683]:         <nova:user uuid="11130271beb44b368f9eb55bd4946cbc">tempest-AttachVolumeShelveTestJSON-291825158-project-member</nova:user>
Oct 16 11:44:54 user nova-compute[74683]:         <nova:project uuid="622d2c7c33914a068b448c447db50b3c">tempest-AttachVolumeShelveTestJSON-291825158</nova:project>
Oct 16 11:44:54 user nova-compute[74683]:       </nova:owner>
Oct 16 11:44:54 user nova-compute[74683]:       <nova:root type="image" uuid="6d67bec9-afc0-45d6-a866-9613c3f356b4"/>
Oct 16 11:44:54 user nova-compute[74683]:       <nova:ports>
Oct 16 11:44:54 user nova-compute[74683]:         <nova:port uuid="75e552bb-fec2-47bd-adda-d562f27f8a36">
Oct 16 11:44:54 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 16 11:44:54 user nova-compute[74683]:         </nova:port>
Oct 16 11:44:54 user nova-compute[74683]:       </nova:ports>
Oct 16 11:44:54 user nova-compute[74683]:     </nova:instance>
Oct 16 11:44:54 user nova-compute[74683]:   </metadata>
Oct 16 11:44:54 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:44:54 user nova-compute[74683]:     <system>
Oct 16 11:44:54 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:44:54 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:44:54 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:44:54 user nova-compute[74683]:       <entry name="serial">ec2b88a5-6571-4f46-a07d-47ccfc1761e4</entry>
Oct 16 11:44:54 user nova-compute[74683]:       <entry name="uuid">ec2b88a5-6571-4f46-a07d-47ccfc1761e4</entry>
Oct 16 11:44:54 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:44:54 user nova-compute[74683]:     </system>
Oct 16 11:44:54 user nova-compute[74683]:   </sysinfo>
Oct 16 11:44:54 user nova-compute[74683]:   <os>
Oct 16 11:44:54 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:44:54 user nova-compute[74683]:     <boot dev="hd"/>
Oct 16 11:44:54 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:44:54 user nova-compute[74683]:   </os>
Oct 16 11:44:54 user nova-compute[74683]:   <features>
Oct 16 11:44:54 user nova-compute[74683]:     <acpi/>
Oct 16 11:44:54 user nova-compute[74683]:     <apic/>
Oct 16 11:44:54 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:44:54 user nova-compute[74683]:   </features>
Oct 16 11:44:54 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:44:54 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:44:54 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:44:54 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:44:54 user nova-compute[74683]:   </clock>
Oct 16 11:44:54 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:44:54 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:44:54 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:44:54 user nova-compute[74683]:   </cpu>
Oct 16 11:44:54 user nova-compute[74683]:   <devices>
Oct 16 11:44:54 user nova-compute[74683]:     <disk type="file" device="disk">
Oct 16 11:44:54 user nova-compute[74683]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 11:44:54 user nova-compute[74683]:       <source file="/opt/stack/data/nova/instances/ec2b88a5-6571-4f46-a07d-47ccfc1761e4/disk"/>
Oct 16 11:44:54 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:44:54 user nova-compute[74683]:     </disk>
Oct 16 11:44:54 user nova-compute[74683]:     <disk type="block" device="disk">
Oct 16 11:44:54 user nova-compute[74683]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:44:54 user nova-compute[74683]:       <source dev="/dev/sdb"/>
Oct 16 11:44:54 user nova-compute[74683]:       <target dev="vdc" bus="virtio"/>
Oct 16 11:44:54 user nova-compute[74683]:       <serial>7ce79b34-e4db-42a6-b4be-08ece45a72a7</serial>
Oct 16 11:44:54 user nova-compute[74683]:     </disk>
Oct 16 11:44:54 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:44:54 user nova-compute[74683]:       <mac address="fa:16:3e:f5:74:eb"/>
Oct 16 11:44:54 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:44:54 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:44:54 user nova-compute[74683]:       <target dev="tap75e552bb-fe"/>
Oct 16 11:44:54 user nova-compute[74683]:     </interface>
Oct 16 11:44:54 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:44:54 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/ec2b88a5-6571-4f46-a07d-47ccfc1761e4/console.log" append="off"/>
Oct 16 11:44:54 user nova-compute[74683]:     </serial>
Oct 16 11:44:54 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:44:54 user nova-compute[74683]:     <video>
Oct 16 11:44:54 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:44:54 user nova-compute[74683]:     </video>
Oct 16 11:44:54 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:44:54 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:44:54 user nova-compute[74683]:     </rng>
Oct 16 11:44:54 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:44:54 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:44:54 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:44:54 user nova-compute[74683]:     </memballoon>
Oct 16 11:44:54 user nova-compute[74683]:   </devices>
Oct 16 11:44:54 user nova-compute[74683]: </domain>
Oct 16 11:44:54 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:44:54 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-16T11:40:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2110881689',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2110881689',id=45,image_ref='6d67bec9-afc0-45d6-a866-9613c3f356b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-127654640',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:40:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='622d2c7c33914a068b448c447db50b3c',ramdisk_id='',reservation_id='r-3kki01l8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-291825158',owner_user_name='tempest-AttachVolumeShelveTestJSON-291825158-project-member',shelved_at='2023-10-16T11:42:42.646944',shelved_host='user',shelved_image_id='6d67bec9-afc0-45d6-a866-9613c3f356b4'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:44:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11130271beb44b368f9eb55bd4946cbc',uuid=ec2b88a5-6571-4f46-a07d-47ccfc1761e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "75e552bb-fec2-47bd-adda-d562f27f8a36", "address": "fa:16:3e:f5:74:eb", "network": {"id": "2ea750a5-8511-4e40-b149-062e10e0096c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-563467594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d2c7c33914a068b448c447db50b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75e552bb-fe", "ovs_interfaceid": "75e552bb-fec2-47bd-adda-d562f27f8a36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:44:54 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Converting VIF {"id": "75e552bb-fec2-47bd-adda-d562f27f8a36", "address": "fa:16:3e:f5:74:eb", "network": {"id": "2ea750a5-8511-4e40-b149-062e10e0096c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-563467594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d2c7c33914a068b448c447db50b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75e552bb-fe", "ovs_interfaceid": "75e552bb-fec2-47bd-adda-d562f27f8a36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:44:54 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:74:eb,bridge_name='br-int',has_traffic_filtering=True,id=75e552bb-fec2-47bd-adda-d562f27f8a36,network=Network(2ea750a5-8511-4e40-b149-062e10e0096c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75e552bb-fe') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:44:54 user nova-compute[74683]: DEBUG os_vif [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:74:eb,bridge_name='br-int',has_traffic_filtering=True,id=75e552bb-fec2-47bd-adda-d562f27f8a36,network=Network(2ea750a5-8511-4e40-b149-062e10e0096c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75e552bb-fe') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:44:54 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:44:54 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:44:54 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:44:54 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:44:54 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5f53b278-eb00-5997-96ab-23db6c815e00', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:44:54 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:44:54 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:44:54 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:44:54 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap75e552bb-fe, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:44:54 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap75e552bb-fe, col_values=(('qos', UUID('e9850c2f-cf13-4d8f-a62d-1d71af6ea05c')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:44:54 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap75e552bb-fe, col_values=(('external_ids', {'iface-id': '75e552bb-fec2-47bd-adda-d562f27f8a36', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:74:eb', 'vm-uuid': 'ec2b88a5-6571-4f46-a07d-47ccfc1761e4'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:44:54 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:44:54 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:44:54 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:44:54 user nova-compute[74683]: INFO os_vif [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:74:eb,bridge_name='br-int',has_traffic_filtering=True,id=75e552bb-fec2-47bd-adda-d562f27f8a36,network=Network(2ea750a5-8511-4e40-b149-062e10e0096c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75e552bb-fe')
Oct 16 11:44:54 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:44:54 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:44:54 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] No VIF found with MAC fa:16:3e:f5:74:eb, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:44:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:44:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:44:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:44:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:44:56 user nova-compute[74683]: DEBUG nova.compute.manager [req-e60d18e8-6ff9-4382-99cf-a44c799246f3 req-003d39a7-69ca-4a3a-87fe-0d000dcbf843 service nova] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Received event network-vif-plugged-75e552bb-fec2-47bd-adda-d562f27f8a36 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:44:56 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e60d18e8-6ff9-4382-99cf-a44c799246f3 req-003d39a7-69ca-4a3a-87fe-0d000dcbf843 service nova] Acquiring lock "ec2b88a5-6571-4f46-a07d-47ccfc1761e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:44:56 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e60d18e8-6ff9-4382-99cf-a44c799246f3 req-003d39a7-69ca-4a3a-87fe-0d000dcbf843 service nova] Lock "ec2b88a5-6571-4f46-a07d-47ccfc1761e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:44:56 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e60d18e8-6ff9-4382-99cf-a44c799246f3 req-003d39a7-69ca-4a3a-87fe-0d000dcbf843 service nova] Lock "ec2b88a5-6571-4f46-a07d-47ccfc1761e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:44:56 user nova-compute[74683]: DEBUG nova.compute.manager [req-e60d18e8-6ff9-4382-99cf-a44c799246f3 req-003d39a7-69ca-4a3a-87fe-0d000dcbf843 service nova] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] No waiting events found dispatching network-vif-plugged-75e552bb-fec2-47bd-adda-d562f27f8a36 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:44:56 user nova-compute[74683]: WARNING nova.compute.manager [req-e60d18e8-6ff9-4382-99cf-a44c799246f3 req-003d39a7-69ca-4a3a-87fe-0d000dcbf843 service nova] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Received unexpected event network-vif-plugged-75e552bb-fec2-47bd-adda-d562f27f8a36 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 16 11:44:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:44:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:44:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:44:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:44:58 user nova-compute[74683]: DEBUG nova.compute.manager [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Instance event wait completed in 0 seconds for  {{(pid=74683) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 11:44:58 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Guest created on hypervisor {{(pid=74683) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 11:44:58 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Instance spawned successfully.
Oct 16 11:44:58 user nova-compute[74683]: DEBUG nova.compute.manager [req-14b410db-d85d-4fdc-836b-85308cb0d773 req-10b12a37-7dd9-4397-ba91-288c85942755 service nova] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Received event network-vif-plugged-75e552bb-fec2-47bd-adda-d562f27f8a36 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:44:58 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-14b410db-d85d-4fdc-836b-85308cb0d773 req-10b12a37-7dd9-4397-ba91-288c85942755 service nova] Acquiring lock "ec2b88a5-6571-4f46-a07d-47ccfc1761e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:44:58 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-14b410db-d85d-4fdc-836b-85308cb0d773 req-10b12a37-7dd9-4397-ba91-288c85942755 service nova] Lock "ec2b88a5-6571-4f46-a07d-47ccfc1761e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:44:58 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-14b410db-d85d-4fdc-836b-85308cb0d773 req-10b12a37-7dd9-4397-ba91-288c85942755 service nova] Lock "ec2b88a5-6571-4f46-a07d-47ccfc1761e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:44:58 user nova-compute[74683]: DEBUG nova.compute.manager [req-14b410db-d85d-4fdc-836b-85308cb0d773 req-10b12a37-7dd9-4397-ba91-288c85942755 service nova] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] No waiting events found dispatching network-vif-plugged-75e552bb-fec2-47bd-adda-d562f27f8a36 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:44:58 user nova-compute[74683]: WARNING nova.compute.manager [req-14b410db-d85d-4fdc-836b-85308cb0d773 req-10b12a37-7dd9-4397-ba91-288c85942755 service nova] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Received unexpected event network-vif-plugged-75e552bb-fec2-47bd-adda-d562f27f8a36 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 16 11:44:58 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-521e97ec-f802-4650-8782-c6bd028aa568 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Acquiring lock "8d94b70c-4056-4c58-9df4-73684e0d164f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:44:58 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-521e97ec-f802-4650-8782-c6bd028aa568 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lock "8d94b70c-4056-4c58-9df4-73684e0d164f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:44:58 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-521e97ec-f802-4650-8782-c6bd028aa568 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Acquiring lock "8d94b70c-4056-4c58-9df4-73684e0d164f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:44:58 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-521e97ec-f802-4650-8782-c6bd028aa568 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lock "8d94b70c-4056-4c58-9df4-73684e0d164f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:44:58 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-521e97ec-f802-4650-8782-c6bd028aa568 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lock "8d94b70c-4056-4c58-9df4-73684e0d164f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:44:58 user nova-compute[74683]: INFO nova.compute.manager [None req-521e97ec-f802-4650-8782-c6bd028aa568 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Terminating instance
Oct 16 11:44:58 user nova-compute[74683]: DEBUG nova.compute.manager [None req-521e97ec-f802-4650-8782-c6bd028aa568 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Start destroying the instance on the hypervisor. {{(pid=74683) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 11:44:58 user nova-compute[74683]: DEBUG nova.compute.manager [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:44:58 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:44:58 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:44:58 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:44:59 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:44:59 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b98da317-7025-4a01-908b-0aa75b9665b6 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "ec2b88a5-6571-4f46-a07d-47ccfc1761e4" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 28.510s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:44:59 user nova-compute[74683]: DEBUG nova.compute.manager [req-f43c254b-d07d-44e7-b759-9729afd14b1e req-fc4c31da-812f-4b64-9da6-c52040207a7b service nova] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Received event network-vif-unplugged-80bcc661-5bbf-4b87-87c3-0b4a7e6aa31b {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:44:59 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f43c254b-d07d-44e7-b759-9729afd14b1e req-fc4c31da-812f-4b64-9da6-c52040207a7b service nova] Acquiring lock "8d94b70c-4056-4c58-9df4-73684e0d164f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:44:59 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f43c254b-d07d-44e7-b759-9729afd14b1e req-fc4c31da-812f-4b64-9da6-c52040207a7b service nova] Lock "8d94b70c-4056-4c58-9df4-73684e0d164f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:44:59 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f43c254b-d07d-44e7-b759-9729afd14b1e req-fc4c31da-812f-4b64-9da6-c52040207a7b service nova] Lock "8d94b70c-4056-4c58-9df4-73684e0d164f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:44:59 user nova-compute[74683]: DEBUG nova.compute.manager [req-f43c254b-d07d-44e7-b759-9729afd14b1e req-fc4c31da-812f-4b64-9da6-c52040207a7b service nova] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] No waiting events found dispatching network-vif-unplugged-80bcc661-5bbf-4b87-87c3-0b4a7e6aa31b {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:44:59 user nova-compute[74683]: DEBUG nova.compute.manager [req-f43c254b-d07d-44e7-b759-9729afd14b1e req-fc4c31da-812f-4b64-9da6-c52040207a7b service nova] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Received event network-vif-unplugged-80bcc661-5bbf-4b87-87c3-0b4a7e6aa31b for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 11:44:59 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Instance destroyed successfully.
Oct 16 11:44:59 user nova-compute[74683]: DEBUG nova.objects.instance [None req-521e97ec-f802-4650-8782-c6bd028aa568 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lazy-loading 'resources' on Instance uuid 8d94b70c-4056-4c58-9df4-73684e0d164f {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:44:59 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-521e97ec-f802-4650-8782-c6bd028aa568 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:35:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1435511601',display_name='tempest-SnapshotDataIntegrityTests-server-1435511601',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1435511601',id=41,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPMkI4BH6sE1S8VYJ2I7IEYPdT37wnqF1GhjF5l04y1YMKnK4gwdZRO+dHdrt73ZI37SU6vF7WEzYElFf3FhQxDWq0VgXGBcsHUAjCUljKHQLUAWAwH/sDew084SZzG+cg==',key_name='tempest-keypair-1968375565',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:35:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='12fd84a1f38a41dc8e4ab6c697028d9a',ramdisk_id='',reservation_id='r-5yirzcmp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-2137742616',owner_user_name='tempest-SnapshotDataIntegrityTests-2137742616-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:35:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8afda3d5e1f4c41b991b6e480473ba7',uuid=8d94b70c-4056-4c58-9df4-73684e0d164f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80bcc661-5bbf-4b87-87c3-0b4a7e6aa31b", "address": "fa:16:3e:67:41:41", "network": {"id": "f131c862-9d83-4df6-af88-56d3202105fc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-544805614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12fd84a1f38a41dc8e4ab6c697028d9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80bcc661-5b", "ovs_interfaceid": "80bcc661-5bbf-4b87-87c3-0b4a7e6aa31b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:44:59 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-521e97ec-f802-4650-8782-c6bd028aa568 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Converting VIF {"id": "80bcc661-5bbf-4b87-87c3-0b4a7e6aa31b", "address": "fa:16:3e:67:41:41", "network": {"id": "f131c862-9d83-4df6-af88-56d3202105fc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-544805614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12fd84a1f38a41dc8e4ab6c697028d9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80bcc661-5b", "ovs_interfaceid": "80bcc661-5bbf-4b87-87c3-0b4a7e6aa31b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:44:59 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-521e97ec-f802-4650-8782-c6bd028aa568 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:67:41:41,bridge_name='br-int',has_traffic_filtering=True,id=80bcc661-5bbf-4b87-87c3-0b4a7e6aa31b,network=Network(f131c862-9d83-4df6-af88-56d3202105fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80bcc661-5b') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:44:59 user nova-compute[74683]: DEBUG os_vif [None req-521e97ec-f802-4650-8782-c6bd028aa568 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:41:41,bridge_name='br-int',has_traffic_filtering=True,id=80bcc661-5bbf-4b87-87c3-0b4a7e6aa31b,network=Network(f131c862-9d83-4df6-af88-56d3202105fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80bcc661-5b') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:44:59 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:44:59 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap80bcc661-5b, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:44:59 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:44:59 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:44:59 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:44:59 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e23735f2-5f7e-469a-83a1-8e304b2a2f52) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:44:59 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:44:59 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:44:59 user nova-compute[74683]: INFO os_vif [None req-521e97ec-f802-4650-8782-c6bd028aa568 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:41:41,bridge_name='br-int',has_traffic_filtering=True,id=80bcc661-5bbf-4b87-87c3-0b4a7e6aa31b,network=Network(f131c862-9d83-4df6-af88-56d3202105fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80bcc661-5b')
Oct 16 11:44:59 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-521e97ec-f802-4650-8782-c6bd028aa568 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Deleting instance files /opt/stack/data/nova/instances/8d94b70c-4056-4c58-9df4-73684e0d164f_del
Oct 16 11:44:59 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-521e97ec-f802-4650-8782-c6bd028aa568 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Deletion of /opt/stack/data/nova/instances/8d94b70c-4056-4c58-9df4-73684e0d164f_del complete
Oct 16 11:44:59 user nova-compute[74683]: INFO nova.compute.manager [None req-521e97ec-f802-4650-8782-c6bd028aa568 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Took 0.91 seconds to destroy the instance on the hypervisor.
Oct 16 11:44:59 user nova-compute[74683]: DEBUG oslo.service.loopingcall [None req-521e97ec-f802-4650-8782-c6bd028aa568 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74683) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 11:44:59 user nova-compute[74683]: DEBUG nova.compute.manager [-] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Deallocating network for instance {{(pid=74683) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 11:44:59 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] deallocate_for_instance() {{(pid=74683) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 11:44:59 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-cdd7f84a-82a5-40bc-b092-3643baf01b7b tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Acquiring lock "3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:44:59 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-cdd7f84a-82a5-40bc-b092-3643baf01b7b tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Lock "3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:44:59 user nova-compute[74683]: DEBUG nova.objects.instance [None req-cdd7f84a-82a5-40bc-b092-3643baf01b7b tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Lazy-loading 'flavor' on Instance uuid 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:44:59 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-cdd7f84a-82a5-40bc-b092-3643baf01b7b tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Lock "3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:45:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-cdd7f84a-82a5-40bc-b092-3643baf01b7b tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Acquiring lock "3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:45:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-cdd7f84a-82a5-40bc-b092-3643baf01b7b tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Lock "3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:45:00 user nova-compute[74683]: INFO nova.compute.manager [None req-cdd7f84a-82a5-40bc-b092-3643baf01b7b tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Attaching volume 19aaf202-f868-4a7f-82a2-01f2a97d93ba to /dev/vdb
Oct 16 11:45:00 user nova-compute[74683]: DEBUG os_brick.utils [None req-cdd7f84a-82a5-40bc-b092-3643baf01b7b tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:45:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:45:00 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[7808c916-f8d1-4d24-9aeb-97629cea6c7c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:70b9d336ab7d\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:45:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:45:00 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94ebeea-92a4-4cd3-b4bb-9dd2f6e60819]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:45:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:45:00 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc3854a-a9a1-4983-9cd4-7440f5d70418]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:45:00 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[29daa3ab-2446-4b6f-a44a-16ecf67c50bd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:45:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-cdd7f84a-82a5-40bc-b092-3643baf01b7b tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Running cmd (subprocess): nvme version {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-cdd7f84a-82a5-40bc-b092-3643baf01b7b tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] 'nvme version' failed. Not Retrying. {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:45:00 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cdd7f84a-82a5-40bc-b092-3643baf01b7b tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] nvme not present on system {{(pid=74683) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 11:45:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:45:00 user nova-compute[74683]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 11:45:00 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf059274-328f-4690-a534-4ae6caf63336]: (4, '') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:45:00 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-cdd7f84a-82a5-40bc-b092-3643baf01b7b tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74683) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 11:45:00 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-cdd7f84a-82a5-40bc-b092-3643baf01b7b tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 11:45:00 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-cdd7f84a-82a5-40bc-b092-3643baf01b7b tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] LIGHTOS: no hostnqn found. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 11:45:00 user nova-compute[74683]: DEBUG os_brick.utils [None req-cdd7f84a-82a5-40bc-b092-3643baf01b7b tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:70b9d336ab7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:45:00 user nova-compute[74683]: DEBUG nova.virt.block_device [None req-cdd7f84a-82a5-40bc-b092-3643baf01b7b tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Updating existing volume attachment record: 7ac5faec-d13e-4747-bdd0-623b8801cda2 {{(pid=74683) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 11:45:00 user nova-compute[74683]: DEBUG nova.compute.manager [req-8f6bec42-9caa-4a84-80a5-c79fb6b3e9da req-c5b3f674-80e8-45f8-9f60-825c64ecb254 service nova] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Received event network-changed-89990cc1-ff0b-45bf-b1e5-b61492762fef {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:45:00 user nova-compute[74683]: DEBUG nova.compute.manager [req-8f6bec42-9caa-4a84-80a5-c79fb6b3e9da req-c5b3f674-80e8-45f8-9f60-825c64ecb254 service nova] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Refreshing instance network info cache due to event network-changed-89990cc1-ff0b-45bf-b1e5-b61492762fef. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:45:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-8f6bec42-9caa-4a84-80a5-c79fb6b3e9da req-c5b3f674-80e8-45f8-9f60-825c64ecb254 service nova] Acquiring lock "refresh_cache-3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:45:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-8f6bec42-9caa-4a84-80a5-c79fb6b3e9da req-c5b3f674-80e8-45f8-9f60-825c64ecb254 service nova] Acquired lock "refresh_cache-3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:45:00 user nova-compute[74683]: DEBUG nova.network.neutron [req-8f6bec42-9caa-4a84-80a5-c79fb6b3e9da req-c5b3f674-80e8-45f8-9f60-825c64ecb254 service nova] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Refreshing network info cache for port 89990cc1-ff0b-45bf-b1e5-b61492762fef {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:45:01 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:45:01 user nova-compute[74683]: INFO nova.compute.manager [-] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Took 1.35 seconds to deallocate network for instance.
Oct 16 11:45:01 user nova-compute[74683]: DEBUG nova.compute.manager [req-1b535d99-b56f-4037-98d0-d0f1bd670368 req-6e4b25e7-c297-45fa-ae11-110f26387276 service nova] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Received event network-vif-deleted-80bcc661-5bbf-4b87-87c3-0b4a7e6aa31b {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:45:01 user nova-compute[74683]: INFO nova.compute.manager [req-1b535d99-b56f-4037-98d0-d0f1bd670368 req-6e4b25e7-c297-45fa-ae11-110f26387276 service nova] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Neutron deleted interface 80bcc661-5bbf-4b87-87c3-0b4a7e6aa31b; detaching it from the instance and deleting it from the info cache
Oct 16 11:45:01 user nova-compute[74683]: DEBUG nova.network.neutron [req-1b535d99-b56f-4037-98d0-d0f1bd670368 req-6e4b25e7-c297-45fa-ae11-110f26387276 service nova] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:45:01 user nova-compute[74683]: DEBUG nova.compute.manager [req-1b535d99-b56f-4037-98d0-d0f1bd670368 req-6e4b25e7-c297-45fa-ae11-110f26387276 service nova] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Detach interface failed, port_id=80bcc661-5bbf-4b87-87c3-0b4a7e6aa31b, reason: Instance 8d94b70c-4056-4c58-9df4-73684e0d164f could not be found. {{(pid=74683) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 16 11:45:01 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-521e97ec-f802-4650-8782-c6bd028aa568 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:45:01 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-521e97ec-f802-4650-8782-c6bd028aa568 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:45:01 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-521e97ec-f802-4650-8782-c6bd028aa568 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:45:01 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-521e97ec-f802-4650-8782-c6bd028aa568 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:45:01 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-521e97ec-f802-4650-8782-c6bd028aa568 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.256s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:45:01 user nova-compute[74683]: DEBUG nova.compute.manager [req-2c21006f-7ff4-47b9-a079-98b60aa8f64a req-1bea391e-8039-42a3-bb73-8767766f803f service nova] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Received event network-vif-plugged-80bcc661-5bbf-4b87-87c3-0b4a7e6aa31b {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:45:01 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-2c21006f-7ff4-47b9-a079-98b60aa8f64a req-1bea391e-8039-42a3-bb73-8767766f803f service nova] Acquiring lock "8d94b70c-4056-4c58-9df4-73684e0d164f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:45:01 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-2c21006f-7ff4-47b9-a079-98b60aa8f64a req-1bea391e-8039-42a3-bb73-8767766f803f service nova] Lock "8d94b70c-4056-4c58-9df4-73684e0d164f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:45:01 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-2c21006f-7ff4-47b9-a079-98b60aa8f64a req-1bea391e-8039-42a3-bb73-8767766f803f service nova] Lock "8d94b70c-4056-4c58-9df4-73684e0d164f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:45:01 user nova-compute[74683]: DEBUG nova.compute.manager [req-2c21006f-7ff4-47b9-a079-98b60aa8f64a req-1bea391e-8039-42a3-bb73-8767766f803f service nova] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] No waiting events found dispatching network-vif-plugged-80bcc661-5bbf-4b87-87c3-0b4a7e6aa31b {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:45:01 user nova-compute[74683]: WARNING nova.compute.manager [req-2c21006f-7ff4-47b9-a079-98b60aa8f64a req-1bea391e-8039-42a3-bb73-8767766f803f service nova] [instance: 8d94b70c-4056-4c58-9df4-73684e0d164f] Received unexpected event network-vif-plugged-80bcc661-5bbf-4b87-87c3-0b4a7e6aa31b for instance with vm_state deleted and task_state None.
Oct 16 11:45:01 user nova-compute[74683]: INFO nova.scheduler.client.report [None req-521e97ec-f802-4650-8782-c6bd028aa568 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Deleted allocations for instance 8d94b70c-4056-4c58-9df4-73684e0d164f
Oct 16 11:45:01 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-521e97ec-f802-4650-8782-c6bd028aa568 tempest-SnapshotDataIntegrityTests-2137742616 tempest-SnapshotDataIntegrityTests-2137742616-project-member] Lock "8d94b70c-4056-4c58-9df4-73684e0d164f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.856s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:45:01 user nova-compute[74683]: DEBUG nova.network.neutron [req-8f6bec42-9caa-4a84-80a5-c79fb6b3e9da req-c5b3f674-80e8-45f8-9f60-825c64ecb254 service nova] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Updated VIF entry in instance network info cache for port 89990cc1-ff0b-45bf-b1e5-b61492762fef. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:45:01 user nova-compute[74683]: DEBUG nova.network.neutron [req-8f6bec42-9caa-4a84-80a5-c79fb6b3e9da req-c5b3f674-80e8-45f8-9f60-825c64ecb254 service nova] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Updating instance_info_cache with network_info: [{"id": "89990cc1-ff0b-45bf-b1e5-b61492762fef", "address": "fa:16:3e:8e:cd:08", "network": {"id": "f778eacd-969f-4106-913e-613bfb09ebfa", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-94933002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05dd191b8dd44be397c64d283cd5d441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89990cc1-ff", "ovs_interfaceid": "89990cc1-ff0b-45bf-b1e5-b61492762fef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:45:01 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-8f6bec42-9caa-4a84-80a5-c79fb6b3e9da req-c5b3f674-80e8-45f8-9f60-825c64ecb254 service nova] Releasing lock "refresh_cache-3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:45:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:45:02 user nova-compute[74683]: DEBUG nova.compute.manager [req-e9d80763-8b1f-42f3-b68f-2fa7381e2337 req-e566f5a6-6dc0-4dc6-949e-21ed68b64ca8 service nova] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Received event network-changed-befa59d0-1d58-4231-a16b-d5981b3e8144 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:45:02 user nova-compute[74683]: DEBUG nova.compute.manager [req-e9d80763-8b1f-42f3-b68f-2fa7381e2337 req-e566f5a6-6dc0-4dc6-949e-21ed68b64ca8 service nova] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Refreshing instance network info cache due to event network-changed-befa59d0-1d58-4231-a16b-d5981b3e8144. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:45:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e9d80763-8b1f-42f3-b68f-2fa7381e2337 req-e566f5a6-6dc0-4dc6-949e-21ed68b64ca8 service nova] Acquiring lock "refresh_cache-d6acbac6-01f7-4c5e-ba2f-1650713d1452" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:45:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e9d80763-8b1f-42f3-b68f-2fa7381e2337 req-e566f5a6-6dc0-4dc6-949e-21ed68b64ca8 service nova] Acquired lock "refresh_cache-d6acbac6-01f7-4c5e-ba2f-1650713d1452" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:45:02 user nova-compute[74683]: DEBUG nova.network.neutron [req-e9d80763-8b1f-42f3-b68f-2fa7381e2337 req-e566f5a6-6dc0-4dc6-949e-21ed68b64ca8 service nova] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Refreshing network info cache for port befa59d0-1d58-4231-a16b-d5981b3e8144 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:45:03 user nova-compute[74683]: DEBUG nova.network.neutron [req-e9d80763-8b1f-42f3-b68f-2fa7381e2337 req-e566f5a6-6dc0-4dc6-949e-21ed68b64ca8 service nova] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Updated VIF entry in instance network info cache for port befa59d0-1d58-4231-a16b-d5981b3e8144. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:45:03 user nova-compute[74683]: DEBUG nova.network.neutron [req-e9d80763-8b1f-42f3-b68f-2fa7381e2337 req-e566f5a6-6dc0-4dc6-949e-21ed68b64ca8 service nova] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Updating instance_info_cache with network_info: [{"id": "befa59d0-1d58-4231-a16b-d5981b3e8144", "address": "fa:16:3e:d7:38:8f", "network": {"id": "badd2db9-6c0f-40cc-afe9-a199e040399a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1368098259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "889cb980200446c0933fe965738a62df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbefa59d0-1d", "ovs_interfaceid": "befa59d0-1d58-4231-a16b-d5981b3e8144", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:45:03 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e9d80763-8b1f-42f3-b68f-2fa7381e2337 req-e566f5a6-6dc0-4dc6-949e-21ed68b64ca8 service nova] Releasing lock "refresh_cache-d6acbac6-01f7-4c5e-ba2f-1650713d1452" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:45:04 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:45:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:45:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-28c2d0e6-af85-4c50-b8e6-86beb47143f4 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Acquiring lock "d6acbac6-01f7-4c5e-ba2f-1650713d1452" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:45:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-28c2d0e6-af85-4c50-b8e6-86beb47143f4 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "d6acbac6-01f7-4c5e-ba2f-1650713d1452" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:45:08 user nova-compute[74683]: DEBUG nova.objects.instance [None req-28c2d0e6-af85-4c50-b8e6-86beb47143f4 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lazy-loading 'flavor' on Instance uuid d6acbac6-01f7-4c5e-ba2f-1650713d1452 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:45:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-28c2d0e6-af85-4c50-b8e6-86beb47143f4 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "d6acbac6-01f7-4c5e-ba2f-1650713d1452" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:45:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-28c2d0e6-af85-4c50-b8e6-86beb47143f4 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Acquiring lock "d6acbac6-01f7-4c5e-ba2f-1650713d1452" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:45:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-28c2d0e6-af85-4c50-b8e6-86beb47143f4 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "d6acbac6-01f7-4c5e-ba2f-1650713d1452" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:45:08 user nova-compute[74683]: INFO nova.compute.manager [None req-28c2d0e6-af85-4c50-b8e6-86beb47143f4 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Attaching volume da423e28-b07f-4647-bc4c-8e12d7e44bbd to /dev/vdb
Oct 16 11:45:08 user nova-compute[74683]: DEBUG os_brick.utils [None req-28c2d0e6-af85-4c50-b8e6-86beb47143f4 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:45:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:45:08 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceda0282-4759-4777-aee1-2f03bf21aa56]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:70b9d336ab7d\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:45:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:45:08 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d072b52-85a0-4200-a96e-902da461d12d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:45:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:45:08 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4ac4e9-d5a4-47c3-ae92-7a83bb89df24]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:45:08 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[190cd854-c14a-45f9-a7f9-677387c8a002]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:45:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-28c2d0e6-af85-4c50-b8e6-86beb47143f4 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Running cmd (subprocess): nvme version {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-28c2d0e6-af85-4c50-b8e6-86beb47143f4 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] 'nvme version' failed. Not Retrying. {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:45:08 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.nvmeof [None req-28c2d0e6-af85-4c50-b8e6-86beb47143f4 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] nvme not present on system {{(pid=74683) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 11:45:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:08 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:45:08 user nova-compute[74683]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 11:45:08 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f957c3-20d1-427b-b912-de534962b66c]: (4, '') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:45:08 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-28c2d0e6-af85-4c50-b8e6-86beb47143f4 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74683) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 11:45:08 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-28c2d0e6-af85-4c50-b8e6-86beb47143f4 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 11:45:08 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-28c2d0e6-af85-4c50-b8e6-86beb47143f4 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] LIGHTOS: no hostnqn found. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 11:45:08 user nova-compute[74683]: DEBUG os_brick.utils [None req-28c2d0e6-af85-4c50-b8e6-86beb47143f4 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:70b9d336ab7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:45:08 user nova-compute[74683]: DEBUG nova.virt.block_device [None req-28c2d0e6-af85-4c50-b8e6-86beb47143f4 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Updating existing volume attachment record: 5df5db34-897c-422a-95b1-f3f66a902a6f {{(pid=74683) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 11:45:09 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:45:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:45:14 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:45:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:45:17 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cdd7f84a-82a5-40bc-b092-3643baf01b7b tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Calling os-brick to attach iSCSI Volume {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 11:45:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd7f84a-82a5-40bc-b092-3643baf01b7b tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wBeciVNH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:45:17 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-cdd7f84a-82a5-40bc-b092-3643baf01b7b tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:45:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-cdd7f84a-82a5-40bc-b092-3643baf01b7b tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:45:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-cdd7f84a-82a5-40bc-b092-3643baf01b7b tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:45:17 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-cdd7f84a-82a5-40bc-b092-3643baf01b7b tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:45:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-cdd7f84a-82a5-40bc-b092-3643baf01b7b tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:45:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-cdd7f84a-82a5-40bc-b092-3643baf01b7b tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:45:17 user nova-compute[74683]: INFO os_brick.initiator.connectors.iscsi [None req-cdd7f84a-82a5-40bc-b092-3643baf01b7b tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 11:45:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba -p 172.16.0.220:3260 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:45:17 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[310286b4-dfd8-45a5-9147-69970a6979a4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:45:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd7f84a-82a5-40bc-b092-3643baf01b7b tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 11:45:17 user nova-compute[74683]:  {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:45:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba -p 172.16.0.220:3260 --interface default --op new {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:45:17 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8a5bb3-dd72-4eac-b440-b9a0965942f2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba] added\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:45:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd7f84a-82a5-40bc-b092-3643baf01b7b tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba] added
Oct 16 11:45:17 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:45:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:45:17 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f87d1ef-78ed-4403-9e27-c6f1218ff177]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:45:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd7f84a-82a5-40bc-b092-3643baf01b7b tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:45:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:45:17 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[483fe122-bcff-4a9c-bffc-3c11509be949]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:45:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd7f84a-82a5-40bc-b092-3643baf01b7b tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:45:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wBeciVNH {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wBeciVNH" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:45:17 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[1230a89c-ee11-4311-be18-81865f044566]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:45:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd7f84a-82a5-40bc-b092-3643baf01b7b tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wBeciVNH'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:45:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:45:17 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c862be-eb2f-4ca9-b9ea-68e1af7a549b]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:45:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd7f84a-82a5-40bc-b092-3643baf01b7b tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:45:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:45:17 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[13822be2-cea6-476e-bf69-28cd85c23163]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:45:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd7f84a-82a5-40bc-b092-3643baf01b7b tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7 (non-flash)
Oct 16 11:45:17 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:45:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd7f84a-82a5-40bc-b092-3643baf01b7b tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7 (non-flash)
Oct 16 11:45:17 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:45:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba -p 172.16.0.220:3260 --login {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:45:17 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c0559f-f133-4072-a350-6a1d60feea0c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:45:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd7f84a-82a5-40bc-b092-3643baf01b7b tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba, portal: 172.16.0.220,3260]
Oct 16 11:45:17 user nova-compute[74683]: Login to [iface: default, target: iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba, portal: 172.16.0.220,3260] successful.
Oct 16 11:45:17 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:45:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:45:17 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[002f3972-2037-4073-912b-e22d8a748cd9]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:45:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd7f84a-82a5-40bc-b092-3643baf01b7b tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:45:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:45:17 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[777acb98-8bb3-4db5-af4c-9bf15661cf7e]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:45:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd7f84a-82a5-40bc-b092-3643baf01b7b tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7 (non-flash)
Oct 16 11:45:17 user nova-compute[74683]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba (non-flash)
Oct 16 11:45:17 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:45:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd7f84a-82a5-40bc-b092-3643baf01b7b tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7 (non-flash)
Oct 16 11:45:17 user nova-compute[74683]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba (non-flash)
Oct 16 11:45:17 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:45:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-cdd7f84a-82a5-40bc-b092-3643baf01b7b tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:45:17 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd7f84a-82a5-40bc-b092-3643baf01b7b tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Connected to 172.16.0.220:3260 {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 11:45:17 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-cdd7f84a-82a5-40bc-b092-3643baf01b7b tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=74683) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 11:45:17 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-cdd7f84a-82a5-40bc-b092-3643baf01b7b tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74683) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 11:45:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:17 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:45:17 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe1788d-8f22-46df-88c9-20446f1b368b]: (4, ('- - 0', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:45:17 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-cdd7f84a-82a5-40bc-b092-3643baf01b7b tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: None {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:45:18 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-cdd7f84a-82a5-40bc-b092-3643baf01b7b tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:45:18 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd7f84a-82a5-40bc-b092-3643baf01b7b tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wBeciVNH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 11:45:18 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-cdd7f84a-82a5-40bc-b092-3643baf01b7b tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:45:18 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd7f84a-82a5-40bc-b092-3643baf01b7b tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '26430336630376637', 'path': '/dev/sdc'} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:45:18 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cdd7f84a-82a5-40bc-b092-3643baf01b7b tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430336630376637', 'path': '/dev/sdc'} {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 11:45:18 user nova-compute[74683]: DEBUG nova.objects.instance [None req-cdd7f84a-82a5-40bc-b092-3643baf01b7b tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Lazy-loading 'flavor' on Instance uuid 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:45:19 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-cdd7f84a-82a5-40bc-b092-3643baf01b7b tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 11:45:19 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:45:19 user nova-compute[74683]:   <source dev="/dev/sdc"/>
Oct 16 11:45:19 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:45:19 user nova-compute[74683]:   <serial>19aaf202-f868-4a7f-82a2-01f2a97d93ba</serial>
Oct 16 11:45:19 user nova-compute[74683]: </disk>
Oct 16 11:45:19 user nova-compute[74683]:  {{(pid=74683) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 11:45:19 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-cdd7f84a-82a5-40bc-b092-3643baf01b7b tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:45:19 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-cdd7f84a-82a5-40bc-b092-3643baf01b7b tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:45:19 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-cdd7f84a-82a5-40bc-b092-3643baf01b7b tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] No VIF found with MAC fa:16:3e:8e:cd:08, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:45:19 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-cdd7f84a-82a5-40bc-b092-3643baf01b7b tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Lock "3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.519s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:45:19 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:45:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:45:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b8a3dcba-bb98-4a97-bc7c-da5efd0d7f74 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Acquiring lock "3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:45:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b8a3dcba-bb98-4a97-bc7c-da5efd0d7f74 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Lock "3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:45:22 user nova-compute[74683]: DEBUG nova.objects.instance [None req-b8a3dcba-bb98-4a97-bc7c-da5efd0d7f74 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Lazy-loading 'flavor' on Instance uuid 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:45:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b8a3dcba-bb98-4a97-bc7c-da5efd0d7f74 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Lock "3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:45:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b8a3dcba-bb98-4a97-bc7c-da5efd0d7f74 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Acquiring lock "3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:45:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b8a3dcba-bb98-4a97-bc7c-da5efd0d7f74 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Lock "3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:45:22 user nova-compute[74683]: INFO nova.compute.manager [None req-b8a3dcba-bb98-4a97-bc7c-da5efd0d7f74 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Attaching volume ab1e1d15-933a-4966-860e-bea21a15969c to /dev/vdc
Oct 16 11:45:22 user nova-compute[74683]: DEBUG os_brick.utils [None req-b8a3dcba-bb98-4a97-bc7c-da5efd0d7f74 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:45:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:45:22 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b49c01-2104-45a6-82be-f9d78f41869e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:70b9d336ab7d\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:45:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:45:22 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f181b941-18f0-47a8-9c72-79486725cd6a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:45:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:45:22 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[577e7950-e722-45c2-9f06-50bd839a1ff7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:45:22 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a869ad-28a7-4f7c-ab79-cfbec52cf52d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:45:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b8a3dcba-bb98-4a97-bc7c-da5efd0d7f74 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Running cmd (subprocess): nvme version {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b8a3dcba-bb98-4a97-bc7c-da5efd0d7f74 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] 'nvme version' failed. Not Retrying. {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:45:23 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b8a3dcba-bb98-4a97-bc7c-da5efd0d7f74 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] nvme not present on system {{(pid=74683) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 11:45:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:23 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:45:23 user nova-compute[74683]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 11:45:23 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[87bc4076-3620-4b97-9613-bfb74acc5d6a]: (4, '') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:45:23 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-b8a3dcba-bb98-4a97-bc7c-da5efd0d7f74 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74683) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 11:45:23 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-b8a3dcba-bb98-4a97-bc7c-da5efd0d7f74 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 11:45:23 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-b8a3dcba-bb98-4a97-bc7c-da5efd0d7f74 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] LIGHTOS: no hostnqn found. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 11:45:23 user nova-compute[74683]: DEBUG os_brick.utils [None req-b8a3dcba-bb98-4a97-bc7c-da5efd0d7f74 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:70b9d336ab7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:45:23 user nova-compute[74683]: DEBUG nova.virt.block_device [None req-b8a3dcba-bb98-4a97-bc7c-da5efd0d7f74 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Updating existing volume attachment record: d38bb1c2-c7d6-441f-a184-e3f4e9c70182 {{(pid=74683) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 11:45:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:45:25 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28c2d0e6-af85-4c50-b8e6-86beb47143f4 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Calling os-brick to attach iSCSI Volume {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 11:45:25 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c2d0e6-af85-4c50-b8e6-86beb47143f4 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:da423e28-b07f-4647-bc4c-8e12d7e44bbd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uszQpKIc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:45:25 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-28c2d0e6-af85-4c50-b8e6-86beb47143f4 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:45:25 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-28c2d0e6-af85-4c50-b8e6-86beb47143f4 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:45:25 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-28c2d0e6-af85-4c50-b8e6-86beb47143f4 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:45:25 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-28c2d0e6-af85-4c50-b8e6-86beb47143f4 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:45:25 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-28c2d0e6-af85-4c50-b8e6-86beb47143f4 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da423e28-b07f-4647-bc4c-8e12d7e44bbd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:45:25 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-28c2d0e6-af85-4c50-b8e6-86beb47143f4 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da423e28-b07f-4647-bc4c-8e12d7e44bbd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:45:25 user nova-compute[74683]: INFO os_brick.initiator.connectors.iscsi [None req-28c2d0e6-af85-4c50-b8e6-86beb47143f4 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 11:45:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da423e28-b07f-4647-bc4c-8e12d7e44bbd -p 172.16.0.220:3260 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da423e28-b07f-4647-bc4c-8e12d7e44bbd -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:45:25 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e232b0-b761-462a-a5ad-6c38cd89c405]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:45:25 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c2d0e6-af85-4c50-b8e6-86beb47143f4 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 11:45:25 user nova-compute[74683]:  {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:45:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da423e28-b07f-4647-bc4c-8e12d7e44bbd -p 172.16.0.220:3260 --interface default --op new {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da423e28-b07f-4647-bc4c-8e12d7e44bbd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:45:25 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[00684767-2e96-428b-a413-44ed7dcc4a64]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da423e28-b07f-4647-bc4c-8e12d7e44bbd] added\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:45:25 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c2d0e6-af85-4c50-b8e6-86beb47143f4 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da423e28-b07f-4647-bc4c-8e12d7e44bbd] added
Oct 16 11:45:25 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:45:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da423e28-b07f-4647-bc4c-8e12d7e44bbd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da423e28-b07f-4647-bc4c-8e12d7e44bbd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.040s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:45:25 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[58cbdffb-a6cb-40f5-a84e-d462351636ae]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:45:25 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c2d0e6-af85-4c50-b8e6-86beb47143f4 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:45:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da423e28-b07f-4647-bc4c-8e12d7e44bbd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da423e28-b07f-4647-bc4c-8e12d7e44bbd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.038s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:45:25 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f596d0f-199d-41a5-ac58-dfd189839585]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:45:25 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c2d0e6-af85-4c50-b8e6-86beb47143f4 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:45:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da423e28-b07f-4647-bc4c-8e12d7e44bbd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uszQpKIc {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da423e28-b07f-4647-bc4c-8e12d7e44bbd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uszQpKIc" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:45:25 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b563cd-c90c-4480-b42b-88cfc57d1caf]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:45:25 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c2d0e6-af85-4c50-b8e6-86beb47143f4 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uszQpKIc'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:45:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da423e28-b07f-4647-bc4c-8e12d7e44bbd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da423e28-b07f-4647-bc4c-8e12d7e44bbd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:45:25 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf024d7-24dd-4e43-8ddf-47f179b1ddfc]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:45:25 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c2d0e6-af85-4c50-b8e6-86beb47143f4 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:45:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:45:25 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a343581-ad64-4d2b-afac-6e7ffd9738a1]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:45:25 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c2d0e6-af85-4c50-b8e6-86beb47143f4 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7 (non-flash)
Oct 16 11:45:25 user nova-compute[74683]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba (non-flash)
Oct 16 11:45:25 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:45:25 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c2d0e6-af85-4c50-b8e6-86beb47143f4 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7 (non-flash)
Oct 16 11:45:25 user nova-compute[74683]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba (non-flash)
Oct 16 11:45:25 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:45:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da423e28-b07f-4647-bc4c-8e12d7e44bbd -p 172.16.0.220:3260 --login {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da423e28-b07f-4647-bc4c-8e12d7e44bbd -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:45:25 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b2b0028-a223-4224-b28c-788cb9e3d10f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:da423e28-b07f-4647-bc4c-8e12d7e44bbd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:da423e28-b07f-4647-bc4c-8e12d7e44bbd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:45:25 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c2d0e6-af85-4c50-b8e6-86beb47143f4 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:da423e28-b07f-4647-bc4c-8e12d7e44bbd, portal: 172.16.0.220,3260]
Oct 16 11:45:25 user nova-compute[74683]: Login to [iface: default, target: iqn.2010-10.org.openstack:da423e28-b07f-4647-bc4c-8e12d7e44bbd, portal: 172.16.0.220,3260] successful.
Oct 16 11:45:25 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:45:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da423e28-b07f-4647-bc4c-8e12d7e44bbd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da423e28-b07f-4647-bc4c-8e12d7e44bbd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:45:25 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ba7a91-f9b4-426f-8750-71a51a3e2a25]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:45:25 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c2d0e6-af85-4c50-b8e6-86beb47143f4 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:45:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:45:25 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[724fbc85-d30d-4197-85fc-836ca1f0e67d]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da423e28-b07f-4647-bc4c-8e12d7e44bbd (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:45:25 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c2d0e6-af85-4c50-b8e6-86beb47143f4 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7 (non-flash)
Oct 16 11:45:25 user nova-compute[74683]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba (non-flash)
Oct 16 11:45:25 user nova-compute[74683]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da423e28-b07f-4647-bc4c-8e12d7e44bbd (non-flash)
Oct 16 11:45:25 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:45:25 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c2d0e6-af85-4c50-b8e6-86beb47143f4 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7 (non-flash)
Oct 16 11:45:25 user nova-compute[74683]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba (non-flash)
Oct 16 11:45:25 user nova-compute[74683]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da423e28-b07f-4647-bc4c-8e12d7e44bbd (non-flash)
Oct 16 11:45:25 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:45:25 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-28c2d0e6-af85-4c50-b8e6-86beb47143f4 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da423e28-b07f-4647-bc4c-8e12d7e44bbd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:45:25 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c2d0e6-af85-4c50-b8e6-86beb47143f4 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Connected to 172.16.0.220:3260 {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 11:45:25 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-28c2d0e6-af85-4c50-b8e6-86beb47143f4 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] HCTL ('35', '-', '-', 0) found on session 55 with lun 0 {{(pid=74683) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 11:45:25 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-28c2d0e6-af85-4c50-b8e6-86beb47143f4 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74683) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 11:45:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:45:25 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ac7de9-4117-4d76-9687-280ca5d8b694]: (4, ('- - 0', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:45:25 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-28c2d0e6-af85-4c50-b8e6-86beb47143f4 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Searching for a device in session 55 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:45:25 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c2d0e6-af85-4c50-b8e6-86beb47143f4 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:da423e28-b07f-4647-bc4c-8e12d7e44bbd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uszQpKIc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 11:45:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Acquiring lock "6b413793-f051-432c-83e0-57c3b0cd8fe0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:45:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "6b413793-f051-432c-83e0-57c3b0cd8fe0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.005s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:45:26 user nova-compute[74683]: DEBUG nova.compute.manager [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Starting instance... {{(pid=74683) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 11:45:26 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-28c2d0e6-af85-4c50-b8e6-86beb47143f4 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:45:26 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c2d0e6-af85-4c50-b8e6-86beb47143f4 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '26130363164323934', 'path': '/dev/sdd'} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:45:26 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28c2d0e6-af85-4c50-b8e6-86beb47143f4 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26130363164323934', 'path': '/dev/sdd'} {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 11:45:26 user nova-compute[74683]: DEBUG nova.objects.instance [None req-28c2d0e6-af85-4c50-b8e6-86beb47143f4 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lazy-loading 'flavor' on Instance uuid d6acbac6-01f7-4c5e-ba2f-1650713d1452 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:45:26 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-28c2d0e6-af85-4c50-b8e6-86beb47143f4 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 11:45:26 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:45:26 user nova-compute[74683]:   <source dev="/dev/sdd"/>
Oct 16 11:45:26 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:45:26 user nova-compute[74683]:   <serial>da423e28-b07f-4647-bc4c-8e12d7e44bbd</serial>
Oct 16 11:45:26 user nova-compute[74683]: </disk>
Oct 16 11:45:26 user nova-compute[74683]:  {{(pid=74683) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 11:45:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:45:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:45:26 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74683) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 11:45:26 user nova-compute[74683]: INFO nova.compute.claims [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Claim successful on node user
Oct 16 11:45:26 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:45:26 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:45:26 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:45:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.285s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:45:26 user nova-compute[74683]: DEBUG nova.compute.manager [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Start building networks asynchronously for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 11:45:27 user nova-compute[74683]: DEBUG nova.compute.manager [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Allocating IP information in the background. {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 11:45:27 user nova-compute[74683]: DEBUG nova.network.neutron [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] allocate_for_instance() {{(pid=74683) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 11:45:27 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 11:45:27 user nova-compute[74683]: DEBUG nova.compute.manager [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Start building block device mappings for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 11:45:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-28c2d0e6-af85-4c50-b8e6-86beb47143f4 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:45:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-28c2d0e6-af85-4c50-b8e6-86beb47143f4 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:45:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-28c2d0e6-af85-4c50-b8e6-86beb47143f4 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] No VIF found with MAC fa:16:3e:d7:38:8f, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:45:27 user nova-compute[74683]: DEBUG nova.policy [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7bd40e88d3914927a7804e3b4fb26549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1ce607a3614fc493d33e6ba8ca5807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74683) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 11:45:27 user nova-compute[74683]: DEBUG nova.compute.manager [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Start spawning the instance on the hypervisor. {{(pid=74683) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 11:45:27 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Creating instance directory {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 11:45:27 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Creating image(s)
Oct 16 11:45:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Acquiring lock "/opt/stack/data/nova/instances/6b413793-f051-432c-83e0-57c3b0cd8fe0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:45:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "/opt/stack/data/nova/instances/6b413793-f051-432c-83e0-57c3b0cd8fe0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:45:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "/opt/stack/data/nova/instances/6b413793-f051-432c-83e0-57c3b0cd8fe0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:45:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Acquiring lock "409609c6df6f77990abc03b8e29769dca3a69f22" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:45:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "409609c6df6f77990abc03b8e29769dca3a69f22" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:45:27 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-28c2d0e6-af85-4c50-b8e6-86beb47143f4 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "d6acbac6-01f7-4c5e-ba2f-1650713d1452" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.854s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:45:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/409609c6df6f77990abc03b8e29769dca3a69f22.part --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:27 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:45:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:45:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/409609c6df6f77990abc03b8e29769dca3a69f22.part --force-share --output=json" returned: 0 in 0.178s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:45:27 user nova-compute[74683]: DEBUG nova.virt.images [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] 0b5ca083-cbac-428b-995c-21d45c134ea3 was qcow2, converting to raw {{(pid=74683) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 16 11:45:27 user nova-compute[74683]: DEBUG nova.privsep.utils [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74683) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 11:45:27 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/409609c6df6f77990abc03b8e29769dca3a69f22.part /opt/stack/data/nova/instances/_base/409609c6df6f77990abc03b8e29769dca3a69f22.converted {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:28 user nova-compute[74683]: DEBUG nova.network.neutron [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Successfully created port: b704ce74-3ed5-4f87-9cc8-a2e79c5f2686 {{(pid=74683) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 11:45:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/409609c6df6f77990abc03b8e29769dca3a69f22.part /opt/stack/data/nova/instances/_base/409609c6df6f77990abc03b8e29769dca3a69f22.converted" returned: 0 in 0.404s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:45:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/409609c6df6f77990abc03b8e29769dca3a69f22.converted --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/409609c6df6f77990abc03b8e29769dca3a69f22.converted --force-share --output=json" returned: 0 in 0.188s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:45:28 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "409609c6df6f77990abc03b8e29769dca3a69f22" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.274s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:45:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/409609c6df6f77990abc03b8e29769dca3a69f22 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/409609c6df6f77990abc03b8e29769dca3a69f22 --force-share --output=json" returned: 0 in 0.182s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:45:28 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:45:28 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Starting heal instance info cache {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 11:45:28 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Acquiring lock "409609c6df6f77990abc03b8e29769dca3a69f22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:45:28 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "409609c6df6f77990abc03b8e29769dca3a69f22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:45:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/409609c6df6f77990abc03b8e29769dca3a69f22 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:28 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "refresh_cache-3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:45:28 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquired lock "refresh_cache-3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:45:28 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Forcefully refreshing network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 11:45:28 user nova-compute[74683]: DEBUG nova.network.neutron [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Successfully updated port: b704ce74-3ed5-4f87-9cc8-a2e79c5f2686 {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:45:28 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Acquiring lock "refresh_cache-6b413793-f051-432c-83e0-57c3b0cd8fe0" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:45:28 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Acquired lock "refresh_cache-6b413793-f051-432c-83e0-57c3b0cd8fe0" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:45:28 user nova-compute[74683]: DEBUG nova.network.neutron [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:45:28 user nova-compute[74683]: DEBUG nova.compute.manager [req-186c6909-dea6-4501-ba36-0b59c349c49d req-99627084-1235-4e5a-aae4-3a6eafe1c806 service nova] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Received event network-changed-b704ce74-3ed5-4f87-9cc8-a2e79c5f2686 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:45:28 user nova-compute[74683]: DEBUG nova.compute.manager [req-186c6909-dea6-4501-ba36-0b59c349c49d req-99627084-1235-4e5a-aae4-3a6eafe1c806 service nova] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Refreshing instance network info cache due to event network-changed-b704ce74-3ed5-4f87-9cc8-a2e79c5f2686. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:45:28 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-186c6909-dea6-4501-ba36-0b59c349c49d req-99627084-1235-4e5a-aae4-3a6eafe1c806 service nova] Acquiring lock "refresh_cache-6b413793-f051-432c-83e0-57c3b0cd8fe0" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:45:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/409609c6df6f77990abc03b8e29769dca3a69f22 --force-share --output=json" returned: 0 in 0.218s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:45:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/409609c6df6f77990abc03b8e29769dca3a69f22,backing_fmt=raw /opt/stack/data/nova/instances/6b413793-f051-432c-83e0-57c3b0cd8fe0/disk 1073741824 {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:28 user nova-compute[74683]: DEBUG nova.network.neutron [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:45:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/409609c6df6f77990abc03b8e29769dca3a69f22,backing_fmt=raw /opt/stack/data/nova/instances/6b413793-f051-432c-83e0-57c3b0cd8fe0/disk 1073741824" returned: 0 in 0.053s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:45:28 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "409609c6df6f77990abc03b8e29769dca3a69f22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:45:28 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/409609c6df6f77990abc03b8e29769dca3a69f22 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/409609c6df6f77990abc03b8e29769dca3a69f22 --force-share --output=json" returned: 0 in 0.181s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:45:29 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6b413793-f051-432c-83e0-57c3b0cd8fe0/disk. size=1073741824 {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 11:45:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b413793-f051-432c-83e0-57c3b0cd8fe0/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:29 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Updating instance_info_cache with network_info: [{"id": "89990cc1-ff0b-45bf-b1e5-b61492762fef", "address": "fa:16:3e:8e:cd:08", "network": {"id": "f778eacd-969f-4106-913e-613bfb09ebfa", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-94933002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05dd191b8dd44be397c64d283cd5d441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89990cc1-ff", "ovs_interfaceid": "89990cc1-ff0b-45bf-b1e5-b61492762fef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:45:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Releasing lock "refresh_cache-3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:45:29 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Updated the network info_cache for instance {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 11:45:29 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:45:29 user nova-compute[74683]: DEBUG nova.network.neutron [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Updating instance_info_cache with network_info: [{"id": "b704ce74-3ed5-4f87-9cc8-a2e79c5f2686", "address": "fa:16:3e:82:8e:5d", "network": {"id": "1fa0852d-814a-45ef-80fa-171693e4d02a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-184537544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ce607a3614fc493d33e6ba8ca5807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb704ce74-3e", "ovs_interfaceid": "b704ce74-3ed5-4f87-9cc8-a2e79c5f2686", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:45:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Releasing lock "refresh_cache-6b413793-f051-432c-83e0-57c3b0cd8fe0" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:45:29 user nova-compute[74683]: DEBUG nova.compute.manager [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Instance network_info: |[{"id": "b704ce74-3ed5-4f87-9cc8-a2e79c5f2686", "address": "fa:16:3e:82:8e:5d", "network": {"id": "1fa0852d-814a-45ef-80fa-171693e4d02a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-184537544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ce607a3614fc493d33e6ba8ca5807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb704ce74-3e", "ovs_interfaceid": "b704ce74-3ed5-4f87-9cc8-a2e79c5f2686", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 11:45:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-186c6909-dea6-4501-ba36-0b59c349c49d req-99627084-1235-4e5a-aae4-3a6eafe1c806 service nova] Acquired lock "refresh_cache-6b413793-f051-432c-83e0-57c3b0cd8fe0" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:45:29 user nova-compute[74683]: DEBUG nova.network.neutron [req-186c6909-dea6-4501-ba36-0b59c349c49d req-99627084-1235-4e5a-aae4-3a6eafe1c806 service nova] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Refreshing network info cache for port b704ce74-3ed5-4f87-9cc8-a2e79c5f2686 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:45:29 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b413793-f051-432c-83e0-57c3b0cd8fe0/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:45:29 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Cannot resize image /opt/stack/data/nova/instances/6b413793-f051-432c-83e0-57c3b0cd8fe0/disk to a smaller size. {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 11:45:29 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Created local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 11:45:29 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Ensure instance console log exists: /opt/stack/data/nova/instances/6b413793-f051-432c-83e0-57c3b0cd8fe0/console.log {{(pid=74683) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 11:45:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:45:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:45:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:45:29 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Start _get_guest_xml network_info=[{"id": "b704ce74-3ed5-4f87-9cc8-a2e79c5f2686", "address": "fa:16:3e:82:8e:5d", "network": {"id": "1fa0852d-814a-45ef-80fa-171693e4d02a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-184537544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ce607a3614fc493d33e6ba8ca5807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb704ce74-3e", "ovs_interfaceid": "b704ce74-3ed5-4f87-9cc8-a2e79c5f2686", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:45:24Z,direct_url=<?>,disk_format='qcow2',id=0b5ca083-cbac-428b-995c-21d45c134ea3,min_disk=0,min_ram=0,name='tempest-scenario-img--941760335',owner='5f1ce607a3614fc493d33e6ba8ca5807',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:45:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '0b5ca083-cbac-428b-995c-21d45c134ea3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:45:29 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:45:29 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:45:29 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:45:29 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:45:29 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:45:29 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:45:29 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:45:29 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:45:24Z,direct_url=<?>,disk_format='qcow2',id=0b5ca083-cbac-428b-995c-21d45c134ea3,min_disk=0,min_ram=0,name='tempest-scenario-img--941760335',owner='5f1ce607a3614fc493d33e6ba8ca5807',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:45:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:45:29 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:45:29 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:45:29 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:45:29 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:45:29 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:45:29 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:45:29 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:45:29 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:45:29 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:45:29 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:45:29 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:45:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1561153830',display_name='tempest-TestMinimumBasicScenario-server-1561153830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1561153830',id=49,image_ref='0b5ca083-cbac-428b-995c-21d45c134ea3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbq1M6CbTv9Kq87utCBwWTW5WPDtN6ZWdDN7lgZ8QpmolFhyUxlfMeLXmZZryk31Im7+Pr7xc6RYPPxwCVFM2+yNIsnT12OtbvwqrbSR537LGBEgcbNQrG3jKPWV0kmug==',key_name='tempest-TestMinimumBasicScenario-2029896967',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f1ce607a3614fc493d33e6ba8ca5807',ramdisk_id='',reservation_id='r-rl1o9dkm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b5ca083-cbac-428b-995c-21d45c134ea3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-470564601',owner_user_name='tempest-TestMinimumBasicScenario-470564601-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:45:27Z,user_data=None,user_id='7bd40e88d3914927a7804e3b4fb26549',uuid=6b413793-f051-432c-83e0-57c3b0cd8fe0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b704ce74-3ed5-4f87-9cc8-a2e79c5f2686", "address": "fa:16:3e:82:8e:5d", "network": {"id": "1fa0852d-814a-45ef-80fa-171693e4d02a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-184537544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ce607a3614fc493d33e6ba8ca5807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb704ce74-3e", "ovs_interfaceid": "b704ce74-3ed5-4f87-9cc8-a2e79c5f2686", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:45:29 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Converting VIF {"id": "b704ce74-3ed5-4f87-9cc8-a2e79c5f2686", "address": "fa:16:3e:82:8e:5d", "network": {"id": "1fa0852d-814a-45ef-80fa-171693e4d02a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-184537544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ce607a3614fc493d33e6ba8ca5807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb704ce74-3e", "ovs_interfaceid": "b704ce74-3ed5-4f87-9cc8-a2e79c5f2686", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:45:29 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:8e:5d,bridge_name='br-int',has_traffic_filtering=True,id=b704ce74-3ed5-4f87-9cc8-a2e79c5f2686,network=Network(1fa0852d-814a-45ef-80fa-171693e4d02a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb704ce74-3e') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:45:29 user nova-compute[74683]: DEBUG nova.objects.instance [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lazy-loading 'pci_devices' on Instance uuid 6b413793-f051-432c-83e0-57c3b0cd8fe0 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:45:29 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:45:29 user nova-compute[74683]:   <uuid>6b413793-f051-432c-83e0-57c3b0cd8fe0</uuid>
Oct 16 11:45:29 user nova-compute[74683]:   <name>instance-00000031</name>
Oct 16 11:45:29 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:45:29 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:45:29 user nova-compute[74683]:   <metadata>
Oct 16 11:45:29 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:45:29 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:45:29 user nova-compute[74683]:       <nova:name>tempest-TestMinimumBasicScenario-server-1561153830</nova:name>
Oct 16 11:45:29 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:45:29</nova:creationTime>
Oct 16 11:45:29 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:45:29 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:45:29 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:45:29 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:45:29 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:45:29 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:45:29 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:45:29 user nova-compute[74683]:       <nova:owner>
Oct 16 11:45:29 user nova-compute[74683]:         <nova:user uuid="7bd40e88d3914927a7804e3b4fb26549">tempest-TestMinimumBasicScenario-470564601-project-member</nova:user>
Oct 16 11:45:29 user nova-compute[74683]:         <nova:project uuid="5f1ce607a3614fc493d33e6ba8ca5807">tempest-TestMinimumBasicScenario-470564601</nova:project>
Oct 16 11:45:29 user nova-compute[74683]:       </nova:owner>
Oct 16 11:45:29 user nova-compute[74683]:       <nova:root type="image" uuid="0b5ca083-cbac-428b-995c-21d45c134ea3"/>
Oct 16 11:45:29 user nova-compute[74683]:       <nova:ports>
Oct 16 11:45:29 user nova-compute[74683]:         <nova:port uuid="b704ce74-3ed5-4f87-9cc8-a2e79c5f2686">
Oct 16 11:45:29 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 16 11:45:29 user nova-compute[74683]:         </nova:port>
Oct 16 11:45:29 user nova-compute[74683]:       </nova:ports>
Oct 16 11:45:29 user nova-compute[74683]:     </nova:instance>
Oct 16 11:45:29 user nova-compute[74683]:   </metadata>
Oct 16 11:45:29 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:45:29 user nova-compute[74683]:     <system>
Oct 16 11:45:29 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:45:29 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:45:29 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:45:29 user nova-compute[74683]:       <entry name="serial">6b413793-f051-432c-83e0-57c3b0cd8fe0</entry>
Oct 16 11:45:29 user nova-compute[74683]:       <entry name="uuid">6b413793-f051-432c-83e0-57c3b0cd8fe0</entry>
Oct 16 11:45:29 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:45:29 user nova-compute[74683]:     </system>
Oct 16 11:45:29 user nova-compute[74683]:   </sysinfo>
Oct 16 11:45:29 user nova-compute[74683]:   <os>
Oct 16 11:45:29 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:45:29 user nova-compute[74683]:     <boot dev="hd"/>
Oct 16 11:45:29 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:45:29 user nova-compute[74683]:   </os>
Oct 16 11:45:29 user nova-compute[74683]:   <features>
Oct 16 11:45:29 user nova-compute[74683]:     <acpi/>
Oct 16 11:45:29 user nova-compute[74683]:     <apic/>
Oct 16 11:45:29 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:45:29 user nova-compute[74683]:   </features>
Oct 16 11:45:29 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:45:29 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:45:29 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:45:29 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:45:29 user nova-compute[74683]:   </clock>
Oct 16 11:45:29 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:45:29 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:45:29 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:45:29 user nova-compute[74683]:   </cpu>
Oct 16 11:45:29 user nova-compute[74683]:   <devices>
Oct 16 11:45:29 user nova-compute[74683]:     <disk type="file" device="disk">
Oct 16 11:45:29 user nova-compute[74683]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 11:45:29 user nova-compute[74683]:       <source file="/opt/stack/data/nova/instances/6b413793-f051-432c-83e0-57c3b0cd8fe0/disk"/>
Oct 16 11:45:29 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:45:29 user nova-compute[74683]:     </disk>
Oct 16 11:45:29 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:45:29 user nova-compute[74683]:       <mac address="fa:16:3e:82:8e:5d"/>
Oct 16 11:45:29 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:45:29 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:45:29 user nova-compute[74683]:       <target dev="tapb704ce74-3e"/>
Oct 16 11:45:29 user nova-compute[74683]:     </interface>
Oct 16 11:45:29 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:45:29 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/6b413793-f051-432c-83e0-57c3b0cd8fe0/console.log" append="off"/>
Oct 16 11:45:29 user nova-compute[74683]:     </serial>
Oct 16 11:45:29 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:45:29 user nova-compute[74683]:     <video>
Oct 16 11:45:29 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:45:29 user nova-compute[74683]:     </video>
Oct 16 11:45:29 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:45:29 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:45:29 user nova-compute[74683]:     </rng>
Oct 16 11:45:29 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:45:29 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:45:29 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:45:29 user nova-compute[74683]:     </memballoon>
Oct 16 11:45:29 user nova-compute[74683]:   </devices>
Oct 16 11:45:29 user nova-compute[74683]: </domain>
Oct 16 11:45:29 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:45:29 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:45:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1561153830',display_name='tempest-TestMinimumBasicScenario-server-1561153830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1561153830',id=49,image_ref='0b5ca083-cbac-428b-995c-21d45c134ea3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbq1M6CbTv9Kq87utCBwWTW5WPDtN6ZWdDN7lgZ8QpmolFhyUxlfMeLXmZZryk31Im7+Pr7xc6RYPPxwCVFM2+yNIsnT12OtbvwqrbSR537LGBEgcbNQrG3jKPWV0kmug==',key_name='tempest-TestMinimumBasicScenario-2029896967',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f1ce607a3614fc493d33e6ba8ca5807',ramdisk_id='',reservation_id='r-rl1o9dkm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b5ca083-cbac-428b-995c-21d45c134ea3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-470564601',owner_user_name='tempest-TestMinimumBasicScenario-470564601-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:45:27Z,user_data=None,user_id='7bd40e88d3914927a7804e3b4fb26549',uuid=6b413793-f051-432c-83e0-57c3b0cd8fe0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b704ce74-3ed5-4f87-9cc8-a2e79c5f2686", "address": "fa:16:3e:82:8e:5d", "network": {"id": "1fa0852d-814a-45ef-80fa-171693e4d02a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-184537544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ce607a3614fc493d33e6ba8ca5807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb704ce74-3e", "ovs_interfaceid": "b704ce74-3ed5-4f87-9cc8-a2e79c5f2686", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:45:29 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Converting VIF {"id": "b704ce74-3ed5-4f87-9cc8-a2e79c5f2686", "address": "fa:16:3e:82:8e:5d", "network": {"id": "1fa0852d-814a-45ef-80fa-171693e4d02a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-184537544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ce607a3614fc493d33e6ba8ca5807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb704ce74-3e", "ovs_interfaceid": "b704ce74-3ed5-4f87-9cc8-a2e79c5f2686", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:45:29 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:8e:5d,bridge_name='br-int',has_traffic_filtering=True,id=b704ce74-3ed5-4f87-9cc8-a2e79c5f2686,network=Network(1fa0852d-814a-45ef-80fa-171693e4d02a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb704ce74-3e') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:45:29 user nova-compute[74683]: DEBUG os_vif [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:8e:5d,bridge_name='br-int',has_traffic_filtering=True,id=b704ce74-3ed5-4f87-9cc8-a2e79c5f2686,network=Network(1fa0852d-814a-45ef-80fa-171693e4d02a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb704ce74-3e') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:45:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:45:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:45:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:45:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:45:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '92d86fab-7aaf-50d4-ab3f-7b39fa474cec', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:45:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:45:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:45:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:45:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb704ce74-3e, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:45:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb704ce74-3e, col_values=(('qos', UUID('72c66859-e422-475c-9e2a-68fab20a3f1a')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:45:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb704ce74-3e, col_values=(('external_ids', {'iface-id': 'b704ce74-3ed5-4f87-9cc8-a2e79c5f2686', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:8e:5d', 'vm-uuid': '6b413793-f051-432c-83e0-57c3b0cd8fe0'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:45:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:45:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:45:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:45:29 user nova-compute[74683]: INFO os_vif [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:8e:5d,bridge_name='br-int',has_traffic_filtering=True,id=b704ce74-3ed5-4f87-9cc8-a2e79c5f2686,network=Network(1fa0852d-814a-45ef-80fa-171693e4d02a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb704ce74-3e')
Oct 16 11:45:29 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:45:29 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] No VIF found with MAC fa:16:3e:82:8e:5d, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:45:29 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:45:29 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:45:29 user nova-compute[74683]: DEBUG nova.network.neutron [req-186c6909-dea6-4501-ba36-0b59c349c49d req-99627084-1235-4e5a-aae4-3a6eafe1c806 service nova] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Updated VIF entry in instance network info cache for port b704ce74-3ed5-4f87-9cc8-a2e79c5f2686. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:45:29 user nova-compute[74683]: DEBUG nova.network.neutron [req-186c6909-dea6-4501-ba36-0b59c349c49d req-99627084-1235-4e5a-aae4-3a6eafe1c806 service nova] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Updating instance_info_cache with network_info: [{"id": "b704ce74-3ed5-4f87-9cc8-a2e79c5f2686", "address": "fa:16:3e:82:8e:5d", "network": {"id": "1fa0852d-814a-45ef-80fa-171693e4d02a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-184537544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ce607a3614fc493d33e6ba8ca5807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb704ce74-3e", "ovs_interfaceid": "b704ce74-3ed5-4f87-9cc8-a2e79c5f2686", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:45:29 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-186c6909-dea6-4501-ba36-0b59c349c49d req-99627084-1235-4e5a-aae4-3a6eafe1c806 service nova] Releasing lock "refresh_cache-6b413793-f051-432c-83e0-57c3b0cd8fe0" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:45:30 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:45:30 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:45:30 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:45:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:45:31 user nova-compute[74683]: DEBUG nova.compute.manager [req-153cd23d-8fb7-40a5-9ccc-91f893bca2ab req-1555950f-5f3e-4609-b8c8-4a2f2fbd7a47 service nova] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Received event network-vif-plugged-b704ce74-3ed5-4f87-9cc8-a2e79c5f2686 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:45:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-153cd23d-8fb7-40a5-9ccc-91f893bca2ab req-1555950f-5f3e-4609-b8c8-4a2f2fbd7a47 service nova] Acquiring lock "6b413793-f051-432c-83e0-57c3b0cd8fe0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:45:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-153cd23d-8fb7-40a5-9ccc-91f893bca2ab req-1555950f-5f3e-4609-b8c8-4a2f2fbd7a47 service nova] Lock "6b413793-f051-432c-83e0-57c3b0cd8fe0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:45:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-153cd23d-8fb7-40a5-9ccc-91f893bca2ab req-1555950f-5f3e-4609-b8c8-4a2f2fbd7a47 service nova] Lock "6b413793-f051-432c-83e0-57c3b0cd8fe0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:45:31 user nova-compute[74683]: DEBUG nova.compute.manager [req-153cd23d-8fb7-40a5-9ccc-91f893bca2ab req-1555950f-5f3e-4609-b8c8-4a2f2fbd7a47 service nova] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] No waiting events found dispatching network-vif-plugged-b704ce74-3ed5-4f87-9cc8-a2e79c5f2686 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:45:31 user nova-compute[74683]: WARNING nova.compute.manager [req-153cd23d-8fb7-40a5-9ccc-91f893bca2ab req-1555950f-5f3e-4609-b8c8-4a2f2fbd7a47 service nova] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Received unexpected event network-vif-plugged-b704ce74-3ed5-4f87-9cc8-a2e79c5f2686 for instance with vm_state building and task_state spawning.
Oct 16 11:45:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:45:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:45:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:45:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:45:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:45:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:45:33 user nova-compute[74683]: DEBUG nova.compute.manager [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Instance event wait completed in 0 seconds for  {{(pid=74683) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 11:45:33 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Guest created on hypervisor {{(pid=74683) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 11:45:33 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Instance spawned successfully.
Oct 16 11:45:33 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 11:45:33 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Found default for hw_cdrom_bus of ide {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:45:33 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Found default for hw_disk_bus of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:45:33 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Found default for hw_input_bus of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:45:33 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Found default for hw_pointer_model of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:45:33 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Found default for hw_video_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:45:33 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Found default for hw_vif_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:45:33 user nova-compute[74683]: DEBUG nova.compute.manager [req-1f447960-1512-4205-bcca-cda238f6b385 req-f1b623d2-592d-4879-bdc3-e8ce8cbc18cf service nova] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Received event network-vif-plugged-b704ce74-3ed5-4f87-9cc8-a2e79c5f2686 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:45:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-1f447960-1512-4205-bcca-cda238f6b385 req-f1b623d2-592d-4879-bdc3-e8ce8cbc18cf service nova] Acquiring lock "6b413793-f051-432c-83e0-57c3b0cd8fe0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:45:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-1f447960-1512-4205-bcca-cda238f6b385 req-f1b623d2-592d-4879-bdc3-e8ce8cbc18cf service nova] Lock "6b413793-f051-432c-83e0-57c3b0cd8fe0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:45:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-1f447960-1512-4205-bcca-cda238f6b385 req-f1b623d2-592d-4879-bdc3-e8ce8cbc18cf service nova] Lock "6b413793-f051-432c-83e0-57c3b0cd8fe0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:45:33 user nova-compute[74683]: DEBUG nova.compute.manager [req-1f447960-1512-4205-bcca-cda238f6b385 req-f1b623d2-592d-4879-bdc3-e8ce8cbc18cf service nova] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] No waiting events found dispatching network-vif-plugged-b704ce74-3ed5-4f87-9cc8-a2e79c5f2686 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:45:33 user nova-compute[74683]: WARNING nova.compute.manager [req-1f447960-1512-4205-bcca-cda238f6b385 req-f1b623d2-592d-4879-bdc3-e8ce8cbc18cf service nova] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Received unexpected event network-vif-plugged-b704ce74-3ed5-4f87-9cc8-a2e79c5f2686 for instance with vm_state building and task_state spawning.
Oct 16 11:45:33 user nova-compute[74683]: INFO nova.compute.manager [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Took 6.13 seconds to spawn the instance on the hypervisor.
Oct 16 11:45:33 user nova-compute[74683]: DEBUG nova.compute.manager [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:45:33 user nova-compute[74683]: INFO nova.compute.manager [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Took 6.77 seconds to build instance.
Oct 16 11:45:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-e07465bd-50c4-49f2-a847-ed1b2c3e0d17 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "6b413793-f051-432c-83e0-57c3b0cd8fe0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.868s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:45:33 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:45:33 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74683) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 11:45:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-41fa8ed9-3f93-418c-8b81-236689f25416 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Acquiring lock "d6acbac6-01f7-4c5e-ba2f-1650713d1452" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:45:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-41fa8ed9-3f93-418c-8b81-236689f25416 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "d6acbac6-01f7-4c5e-ba2f-1650713d1452" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:45:33 user nova-compute[74683]: DEBUG nova.objects.instance [None req-41fa8ed9-3f93-418c-8b81-236689f25416 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lazy-loading 'flavor' on Instance uuid d6acbac6-01f7-4c5e-ba2f-1650713d1452 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:45:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-41fa8ed9-3f93-418c-8b81-236689f25416 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "d6acbac6-01f7-4c5e-ba2f-1650713d1452" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:45:34 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-41fa8ed9-3f93-418c-8b81-236689f25416 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Acquiring lock "d6acbac6-01f7-4c5e-ba2f-1650713d1452" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:45:34 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-41fa8ed9-3f93-418c-8b81-236689f25416 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "d6acbac6-01f7-4c5e-ba2f-1650713d1452" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:45:34 user nova-compute[74683]: INFO nova.compute.manager [None req-41fa8ed9-3f93-418c-8b81-236689f25416 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Attaching volume cf92b56a-0927-4aa5-a2a7-edb2431f7e7a to /dev/vdc
Oct 16 11:45:34 user nova-compute[74683]: DEBUG os_brick.utils [None req-41fa8ed9-3f93-418c-8b81-236689f25416 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:45:34 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:34 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:45:34 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2588787-7c43-4d9d-ba6e-82341cbbd7b9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:70b9d336ab7d\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:45:34 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:34 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:45:34 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4b7a1a-36ec-4cff-ae96-2b3349e9be65]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:45:34 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:34 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:45:34 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5045bbd-d9bd-40b7-8b2b-a7d105e2ce03]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:45:34 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[7440e5fa-4c6b-4ed2-8531-4d3c4567b386]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:45:34 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-41fa8ed9-3f93-418c-8b81-236689f25416 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Running cmd (subprocess): nvme version {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:34 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-41fa8ed9-3f93-418c-8b81-236689f25416 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] 'nvme version' failed. Not Retrying. {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:45:34 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.nvmeof [None req-41fa8ed9-3f93-418c-8b81-236689f25416 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] nvme not present on system {{(pid=74683) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 11:45:34 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:34 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:45:34 user nova-compute[74683]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 11:45:34 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b935ae9-2a65-4fac-8e1c-ae7035a4bf39]: (4, '') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:45:34 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-41fa8ed9-3f93-418c-8b81-236689f25416 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74683) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 11:45:34 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-41fa8ed9-3f93-418c-8b81-236689f25416 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 11:45:34 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-41fa8ed9-3f93-418c-8b81-236689f25416 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] LIGHTOS: no hostnqn found. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 11:45:34 user nova-compute[74683]: DEBUG os_brick.utils [None req-41fa8ed9-3f93-418c-8b81-236689f25416 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:70b9d336ab7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:45:34 user nova-compute[74683]: DEBUG nova.virt.block_device [None req-41fa8ed9-3f93-418c-8b81-236689f25416 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Updating existing volume attachment record: ea1e1ede-2958-4658-b350-299a40dc0b93 {{(pid=74683) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 11:45:34 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:45:34 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:45:34 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:45:34 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:45:34 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:45:34 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Auditing locally available compute resources for user (node: user) {{(pid=74683) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 11:45:34 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:35 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:45:35 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:35 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:45:35 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:45:35 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b413793-f051-432c-83e0-57c3b0cd8fe0/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:35 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b413793-f051-432c-83e0-57c3b0cd8fe0/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:45:35 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b413793-f051-432c-83e0-57c3b0cd8fe0/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:35 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b413793-f051-432c-83e0-57c3b0cd8fe0/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:45:35 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec2b88a5-6571-4f46-a07d-47ccfc1761e4/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:36 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec2b88a5-6571-4f46-a07d-47ccfc1761e4/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:45:36 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec2b88a5-6571-4f46-a07d-47ccfc1761e4/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:36 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec2b88a5-6571-4f46-a07d-47ccfc1761e4/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:45:36 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:45:36 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6acbac6-01f7-4c5e-ba2f-1650713d1452/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:36 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6acbac6-01f7-4c5e-ba2f-1650713d1452/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:45:36 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6acbac6-01f7-4c5e-ba2f-1650713d1452/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:36 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6acbac6-01f7-4c5e-ba2f-1650713d1452/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:45:36 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:45:37 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:45:37 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:45:37 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Hypervisor/Node resource view: name=user free_ram=8491MB free_disk=25.03539276123047GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74683) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 11:45:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:45:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:45:37 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:45:37 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance d6acbac6-01f7-4c5e-ba2f-1650713d1452 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:45:37 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance ec2b88a5-6571-4f46-a07d-47ccfc1761e4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:45:37 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 6b413793-f051-432c-83e0-57c3b0cd8fe0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:45:37 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 11:45:37 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 11:45:37 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:45:37 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:45:37 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Compute_service record updated for user:user {{(pid=74683) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 11:45:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.319s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:45:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:45:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:45:41 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:45:44 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:45:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:45:49 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:45:52 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41fa8ed9-3f93-418c-8b81-236689f25416 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Calling os-brick to attach iSCSI Volume {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 11:45:52 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fa8ed9-3f93-418c-8b81-236689f25416 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jUEiDYXl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:45:52 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-41fa8ed9-3f93-418c-8b81-236689f25416 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:45:52 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-41fa8ed9-3f93-418c-8b81-236689f25416 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:45:52 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-41fa8ed9-3f93-418c-8b81-236689f25416 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:45:52 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-41fa8ed9-3f93-418c-8b81-236689f25416 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:45:52 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-41fa8ed9-3f93-418c-8b81-236689f25416 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:45:52 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-41fa8ed9-3f93-418c-8b81-236689f25416 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:45:52 user nova-compute[74683]: INFO os_brick.initiator.connectors.iscsi [None req-41fa8ed9-3f93-418c-8b81-236689f25416 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 11:45:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a -p 172.16.0.220:3260 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:45:52 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ebcd021-5ce2-45ab-a601-14acbb3fb5b3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:45:52 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fa8ed9-3f93-418c-8b81-236689f25416 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 11:45:52 user nova-compute[74683]:  {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:45:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a -p 172.16.0.220:3260 --interface default --op new {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:45:52 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e71171f-551f-4427-8329-690fc1c7eadb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a] added\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:45:52 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fa8ed9-3f93-418c-8b81-236689f25416 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a] added
Oct 16 11:45:52 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:45:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:45:52 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[810f8654-bd35-435f-82f1-6a064a0a56cc]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:45:52 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fa8ed9-3f93-418c-8b81-236689f25416 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:45:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:45:52 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dac590d-b049-44ee-b3df-80e6503a73f5]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:45:52 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fa8ed9-3f93-418c-8b81-236689f25416 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:45:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jUEiDYXl {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jUEiDYXl" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:45:52 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b175e84-0419-45d8-b288-d847f591c123]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:45:52 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fa8ed9-3f93-418c-8b81-236689f25416 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jUEiDYXl'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:45:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:45:52 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf38a5c1-0a12-4595-8647-93f176042fd1]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:45:52 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fa8ed9-3f93-418c-8b81-236689f25416 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:45:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:45:52 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[08181875-8065-4256-ae5a-1ec689167d82]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da423e28-b07f-4647-bc4c-8e12d7e44bbd (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:45:52 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fa8ed9-3f93-418c-8b81-236689f25416 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7 (non-flash)
Oct 16 11:45:52 user nova-compute[74683]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba (non-flash)
Oct 16 11:45:52 user nova-compute[74683]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da423e28-b07f-4647-bc4c-8e12d7e44bbd (non-flash)
Oct 16 11:45:52 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:45:52 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fa8ed9-3f93-418c-8b81-236689f25416 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7 (non-flash)
Oct 16 11:45:52 user nova-compute[74683]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba (non-flash)
Oct 16 11:45:52 user nova-compute[74683]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da423e28-b07f-4647-bc4c-8e12d7e44bbd (non-flash)
Oct 16 11:45:52 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:45:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a -p 172.16.0.220:3260 --login {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:45:52 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead9df6d-384a-408d-ac3c-cfa18f650c54]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:45:52 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fa8ed9-3f93-418c-8b81-236689f25416 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a, portal: 172.16.0.220,3260]
Oct 16 11:45:52 user nova-compute[74683]: Login to [iface: default, target: iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a, portal: 172.16.0.220,3260] successful.
Oct 16 11:45:52 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:45:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:45:52 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a4af37-8a38-480e-8cad-0f03de040208]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:45:52 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fa8ed9-3f93-418c-8b81-236689f25416 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:45:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:45:52 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[15655524-5a99-4c53-b7df-57b6aa93eb06]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da423e28-b07f-4647-bc4c-8e12d7e44bbd (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:45:52 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fa8ed9-3f93-418c-8b81-236689f25416 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7 (non-flash)
Oct 16 11:45:52 user nova-compute[74683]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba (non-flash)
Oct 16 11:45:52 user nova-compute[74683]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da423e28-b07f-4647-bc4c-8e12d7e44bbd (non-flash)
Oct 16 11:45:52 user nova-compute[74683]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a (non-flash)
Oct 16 11:45:52 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:45:52 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fa8ed9-3f93-418c-8b81-236689f25416 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7 (non-flash)
Oct 16 11:45:52 user nova-compute[74683]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba (non-flash)
Oct 16 11:45:52 user nova-compute[74683]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da423e28-b07f-4647-bc4c-8e12d7e44bbd (non-flash)
Oct 16 11:45:52 user nova-compute[74683]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a (non-flash)
Oct 16 11:45:52 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:45:52 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-41fa8ed9-3f93-418c-8b81-236689f25416 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:45:52 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fa8ed9-3f93-418c-8b81-236689f25416 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Connected to 172.16.0.220:3260 {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 11:45:52 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-41fa8ed9-3f93-418c-8b81-236689f25416 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] HCTL ('36', '-', '-', 0) found on session 56 with lun 0 {{(pid=74683) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 11:45:52 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-41fa8ed9-3f93-418c-8b81-236689f25416 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74683) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 11:45:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:45:52 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:45:52 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[03329d45-ebfa-4c11-9b5a-32ccc410075c]: (4, ('- - 0', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:45:52 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-41fa8ed9-3f93-418c-8b81-236689f25416 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Searching for a device in session 56 and hctl ['36', '*', '*', 0] yield: None {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:45:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:45:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:45:53 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-41fa8ed9-3f93-418c-8b81-236689f25416 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Searching for a device in session 56 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:45:53 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fa8ed9-3f93-418c-8b81-236689f25416 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jUEiDYXl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 11:45:53 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-41fa8ed9-3f93-418c-8b81-236689f25416 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:45:53 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fa8ed9-3f93-418c-8b81-236689f25416 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23862613861366465', 'path': '/dev/sde'} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:45:53 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41fa8ed9-3f93-418c-8b81-236689f25416 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23862613861366465', 'path': '/dev/sde'} {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 11:45:53 user nova-compute[74683]: DEBUG nova.objects.instance [None req-41fa8ed9-3f93-418c-8b81-236689f25416 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lazy-loading 'flavor' on Instance uuid d6acbac6-01f7-4c5e-ba2f-1650713d1452 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:45:53 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-41fa8ed9-3f93-418c-8b81-236689f25416 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 11:45:53 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:45:53 user nova-compute[74683]:   <source dev="/dev/sde"/>
Oct 16 11:45:53 user nova-compute[74683]:   <target dev="vdc" bus="virtio"/>
Oct 16 11:45:53 user nova-compute[74683]:   <serial>cf92b56a-0927-4aa5-a2a7-edb2431f7e7a</serial>
Oct 16 11:45:53 user nova-compute[74683]: </disk>
Oct 16 11:45:53 user nova-compute[74683]:  {{(pid=74683) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 11:45:53 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-41fa8ed9-3f93-418c-8b81-236689f25416 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:45:53 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-41fa8ed9-3f93-418c-8b81-236689f25416 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:45:53 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-41fa8ed9-3f93-418c-8b81-236689f25416 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:45:53 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-41fa8ed9-3f93-418c-8b81-236689f25416 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] No VIF found with MAC fa:16:3e:d7:38:8f, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:45:54 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-41fa8ed9-3f93-418c-8b81-236689f25416 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "d6acbac6-01f7-4c5e-ba2f-1650713d1452" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.050s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:45:54 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:45:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9f8c2372-7781-46f9-a06e-4aaa0df43f90 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Acquiring lock "d6acbac6-01f7-4c5e-ba2f-1650713d1452" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:45:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9f8c2372-7781-46f9-a06e-4aaa0df43f90 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "d6acbac6-01f7-4c5e-ba2f-1650713d1452" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:45:55 user nova-compute[74683]: INFO nova.compute.manager [None req-9f8c2372-7781-46f9-a06e-4aaa0df43f90 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Detaching volume da423e28-b07f-4647-bc4c-8e12d7e44bbd
Oct 16 11:45:55 user nova-compute[74683]: INFO nova.virt.block_device [None req-9f8c2372-7781-46f9-a06e-4aaa0df43f90 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Attempting to driver detach volume da423e28-b07f-4647-bc4c-8e12d7e44bbd from mountpoint /dev/vdb
Oct 16 11:45:55 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9f8c2372-7781-46f9-a06e-4aaa0df43f90 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Attempting to detach device vdb from instance d6acbac6-01f7-4c5e-ba2f-1650713d1452 from the persistent domain config. {{(pid=74683) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 11:45:55 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-9f8c2372-7781-46f9-a06e-4aaa0df43f90 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 11:45:55 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:45:55 user nova-compute[74683]:   <source dev="/dev/sdd"/>
Oct 16 11:45:55 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:45:55 user nova-compute[74683]:   <serial>da423e28-b07f-4647-bc4c-8e12d7e44bbd</serial>
Oct 16 11:45:55 user nova-compute[74683]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 11:45:55 user nova-compute[74683]: </disk>
Oct 16 11:45:55 user nova-compute[74683]:  {{(pid=74683) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 11:45:55 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-9f8c2372-7781-46f9-a06e-4aaa0df43f90 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Successfully detached device vdb from instance d6acbac6-01f7-4c5e-ba2f-1650713d1452 from the persistent domain config.
Oct 16 11:45:55 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9f8c2372-7781-46f9-a06e-4aaa0df43f90 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d6acbac6-01f7-4c5e-ba2f-1650713d1452 from the live domain config. {{(pid=74683) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 11:45:55 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-9f8c2372-7781-46f9-a06e-4aaa0df43f90 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 11:45:55 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:45:55 user nova-compute[74683]:   <source dev="/dev/sdd"/>
Oct 16 11:45:55 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:45:55 user nova-compute[74683]:   <serial>da423e28-b07f-4647-bc4c-8e12d7e44bbd</serial>
Oct 16 11:45:55 user nova-compute[74683]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 11:45:55 user nova-compute[74683]: </disk>
Oct 16 11:45:55 user nova-compute[74683]:  {{(pid=74683) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 11:45:55 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9f8c2372-7781-46f9-a06e-4aaa0df43f90 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d6acbac6-01f7-4c5e-ba2f-1650713d1452 {{(pid=74683) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 11:45:55 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:45:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:45:59 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:46:01 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8a3dcba-bb98-4a97-bc7c-da5efd0d7f74 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Calling os-brick to attach iSCSI Volume {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 11:46:01 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8a3dcba-bb98-4a97-bc7c-da5efd0d7f74 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ab1e1d15-933a-4966-860e-bea21a15969c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kYNpTuKy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:46:01 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-b8a3dcba-bb98-4a97-bc7c-da5efd0d7f74 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:46:01 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-b8a3dcba-bb98-4a97-bc7c-da5efd0d7f74 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:46:01 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-b8a3dcba-bb98-4a97-bc7c-da5efd0d7f74 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:46:01 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-b8a3dcba-bb98-4a97-bc7c-da5efd0d7f74 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:46:01 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-b8a3dcba-bb98-4a97-bc7c-da5efd0d7f74 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab1e1d15-933a-4966-860e-bea21a15969c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:46:01 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-b8a3dcba-bb98-4a97-bc7c-da5efd0d7f74 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab1e1d15-933a-4966-860e-bea21a15969c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:46:01 user nova-compute[74683]: INFO os_brick.initiator.connectors.iscsi [None req-b8a3dcba-bb98-4a97-bc7c-da5efd0d7f74 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 11:46:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab1e1d15-933a-4966-860e-bea21a15969c -p 172.16.0.220:3260 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:46:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab1e1d15-933a-4966-860e-bea21a15969c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:46:01 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf14c89-77c0-4712-89d4-246817d211a3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:46:01 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8a3dcba-bb98-4a97-bc7c-da5efd0d7f74 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 11:46:01 user nova-compute[74683]:  {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:46:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab1e1d15-933a-4966-860e-bea21a15969c -p 172.16.0.220:3260 --interface default --op new {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:46:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab1e1d15-933a-4966-860e-bea21a15969c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:46:01 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[21497bcc-5cb6-4303-ab8c-942e7015806c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab1e1d15-933a-4966-860e-bea21a15969c] added\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:46:01 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8a3dcba-bb98-4a97-bc7c-da5efd0d7f74 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab1e1d15-933a-4966-860e-bea21a15969c] added
Oct 16 11:46:01 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:46:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab1e1d15-933a-4966-860e-bea21a15969c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:46:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab1e1d15-933a-4966-860e-bea21a15969c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:46:01 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[0875800d-250b-472c-816e-7de3d6c0c440]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:46:01 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8a3dcba-bb98-4a97-bc7c-da5efd0d7f74 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:46:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab1e1d15-933a-4966-860e-bea21a15969c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:46:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab1e1d15-933a-4966-860e-bea21a15969c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:46:01 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[690302c2-aa80-49e4-aa85-5506f280b47d]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:46:01 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8a3dcba-bb98-4a97-bc7c-da5efd0d7f74 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:46:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab1e1d15-933a-4966-860e-bea21a15969c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kYNpTuKy {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:46:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab1e1d15-933a-4966-860e-bea21a15969c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kYNpTuKy" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:46:01 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b376d98-4ee7-4f22-aa4f-9412cd33bccd]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:46:01 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8a3dcba-bb98-4a97-bc7c-da5efd0d7f74 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kYNpTuKy'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:46:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab1e1d15-933a-4966-860e-bea21a15969c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:46:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab1e1d15-933a-4966-860e-bea21a15969c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:46:01 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e5b8f0-3d77-4696-ad3c-90ee6ffe91fd]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:46:01 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8a3dcba-bb98-4a97-bc7c-da5efd0d7f74 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:46:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:46:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:46:01 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e8c8ce-b413-41a9-9f51-5a096537c02f]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da423e28-b07f-4647-bc4c-8e12d7e44bbd (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:46:01 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8a3dcba-bb98-4a97-bc7c-da5efd0d7f74 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7 (non-flash)
Oct 16 11:46:01 user nova-compute[74683]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba (non-flash)
Oct 16 11:46:01 user nova-compute[74683]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da423e28-b07f-4647-bc4c-8e12d7e44bbd (non-flash)
Oct 16 11:46:01 user nova-compute[74683]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a (non-flash)
Oct 16 11:46:01 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:46:01 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8a3dcba-bb98-4a97-bc7c-da5efd0d7f74 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7 (non-flash)
Oct 16 11:46:01 user nova-compute[74683]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba (non-flash)
Oct 16 11:46:01 user nova-compute[74683]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da423e28-b07f-4647-bc4c-8e12d7e44bbd (non-flash)
Oct 16 11:46:01 user nova-compute[74683]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a (non-flash)
Oct 16 11:46:01 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:46:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab1e1d15-933a-4966-860e-bea21a15969c -p 172.16.0.220:3260 --login {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:46:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab1e1d15-933a-4966-860e-bea21a15969c -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:46:01 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[dccdb1bd-4906-4443-bde2-cec1fd5a8bf4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab1e1d15-933a-4966-860e-bea21a15969c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ab1e1d15-933a-4966-860e-bea21a15969c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:46:01 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8a3dcba-bb98-4a97-bc7c-da5efd0d7f74 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab1e1d15-933a-4966-860e-bea21a15969c, portal: 172.16.0.220,3260]
Oct 16 11:46:01 user nova-compute[74683]: Login to [iface: default, target: iqn.2010-10.org.openstack:ab1e1d15-933a-4966-860e-bea21a15969c, portal: 172.16.0.220,3260] successful.
Oct 16 11:46:01 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:46:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab1e1d15-933a-4966-860e-bea21a15969c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:46:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab1e1d15-933a-4966-860e-bea21a15969c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:46:01 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3fb01f2-8110-4bbe-8944-3f9679309212]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:46:01 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8a3dcba-bb98-4a97-bc7c-da5efd0d7f74 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:46:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:46:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:46:01 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[791317ae-bb50-49b8-bd01-8cc98cc94335]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da423e28-b07f-4647-bc4c-8e12d7e44bbd (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab1e1d15-933a-4966-860e-bea21a15969c (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:46:01 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8a3dcba-bb98-4a97-bc7c-da5efd0d7f74 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7 (non-flash)
Oct 16 11:46:01 user nova-compute[74683]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba (non-flash)
Oct 16 11:46:01 user nova-compute[74683]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da423e28-b07f-4647-bc4c-8e12d7e44bbd (non-flash)
Oct 16 11:46:01 user nova-compute[74683]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a (non-flash)
Oct 16 11:46:01 user nova-compute[74683]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab1e1d15-933a-4966-860e-bea21a15969c (non-flash)
Oct 16 11:46:01 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:46:01 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8a3dcba-bb98-4a97-bc7c-da5efd0d7f74 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7 (non-flash)
Oct 16 11:46:01 user nova-compute[74683]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba (non-flash)
Oct 16 11:46:01 user nova-compute[74683]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da423e28-b07f-4647-bc4c-8e12d7e44bbd (non-flash)
Oct 16 11:46:01 user nova-compute[74683]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a (non-flash)
Oct 16 11:46:01 user nova-compute[74683]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab1e1d15-933a-4966-860e-bea21a15969c (non-flash)
Oct 16 11:46:01 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:46:01 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-b8a3dcba-bb98-4a97-bc7c-da5efd0d7f74 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab1e1d15-933a-4966-860e-bea21a15969c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:46:01 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8a3dcba-bb98-4a97-bc7c-da5efd0d7f74 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Connected to 172.16.0.220:3260 {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 11:46:01 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-b8a3dcba-bb98-4a97-bc7c-da5efd0d7f74 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] HCTL ('37', '-', '-', 0) found on session 57 with lun 0 {{(pid=74683) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 11:46:01 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-b8a3dcba-bb98-4a97-bc7c-da5efd0d7f74 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74683) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 11:46:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:46:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:46:01 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ad33c3-2224-4d96-8e13-9c8d8d9b5ec0]: (4, ('- - 0', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:46:01 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-b8a3dcba-bb98-4a97-bc7c-da5efd0d7f74 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Searching for a device in session 57 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:46:01 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8a3dcba-bb98-4a97-bc7c-da5efd0d7f74 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:ab1e1d15-933a-4966-860e-bea21a15969c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kYNpTuKy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 11:46:02 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-b8a3dcba-bb98-4a97-bc7c-da5efd0d7f74 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:46:02 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8a3dcba-bb98-4a97-bc7c-da5efd0d7f74 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23664353435356462', 'path': '/dev/sdf'} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:46:02 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8a3dcba-bb98-4a97-bc7c-da5efd0d7f74 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23664353435356462', 'path': '/dev/sdf'} {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 11:46:02 user nova-compute[74683]: DEBUG nova.objects.instance [None req-b8a3dcba-bb98-4a97-bc7c-da5efd0d7f74 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Lazy-loading 'flavor' on Instance uuid 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:46:02 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-b8a3dcba-bb98-4a97-bc7c-da5efd0d7f74 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 11:46:02 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:46:02 user nova-compute[74683]:   <source dev="/dev/sdf"/>
Oct 16 11:46:02 user nova-compute[74683]:   <target dev="vdc" bus="virtio"/>
Oct 16 11:46:02 user nova-compute[74683]:   <serial>ab1e1d15-933a-4966-860e-bea21a15969c</serial>
Oct 16 11:46:02 user nova-compute[74683]: </disk>
Oct 16 11:46:02 user nova-compute[74683]:  {{(pid=74683) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 11:46:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:46:02 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b8a3dcba-bb98-4a97-bc7c-da5efd0d7f74 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:46:02 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b8a3dcba-bb98-4a97-bc7c-da5efd0d7f74 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:46:02 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b8a3dcba-bb98-4a97-bc7c-da5efd0d7f74 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:46:02 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b8a3dcba-bb98-4a97-bc7c-da5efd0d7f74 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] No VIF found with MAC fa:16:3e:8e:cd:08, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:46:03 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b8a3dcba-bb98-4a97-bc7c-da5efd0d7f74 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Lock "3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 40.241s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:46:04 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1c56aae7-5674-4a77-998e-b22474691ddf tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Acquiring lock "3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:46:04 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1c56aae7-5674-4a77-998e-b22474691ddf tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Lock "3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:46:04 user nova-compute[74683]: INFO nova.compute.manager [None req-1c56aae7-5674-4a77-998e-b22474691ddf tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Detaching volume ab1e1d15-933a-4966-860e-bea21a15969c
Oct 16 11:46:04 user nova-compute[74683]: INFO nova.virt.block_device [None req-1c56aae7-5674-4a77-998e-b22474691ddf tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Attempting to driver detach volume ab1e1d15-933a-4966-860e-bea21a15969c from mountpoint /dev/vdc
Oct 16 11:46:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-1c56aae7-5674-4a77-998e-b22474691ddf tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Attempting to detach device vdc from instance 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94 from the persistent domain config. {{(pid=74683) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 11:46:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-1c56aae7-5674-4a77-998e-b22474691ddf tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 11:46:04 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:46:04 user nova-compute[74683]:   <source dev="/dev/sdf"/>
Oct 16 11:46:04 user nova-compute[74683]:   <target dev="vdc" bus="virtio"/>
Oct 16 11:46:04 user nova-compute[74683]:   <serial>ab1e1d15-933a-4966-860e-bea21a15969c</serial>
Oct 16 11:46:04 user nova-compute[74683]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 16 11:46:04 user nova-compute[74683]: </disk>
Oct 16 11:46:04 user nova-compute[74683]:  {{(pid=74683) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 11:46:04 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-1c56aae7-5674-4a77-998e-b22474691ddf tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Successfully detached device vdc from instance 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94 from the persistent domain config.
Oct 16 11:46:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-1c56aae7-5674-4a77-998e-b22474691ddf tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94 from the live domain config. {{(pid=74683) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 11:46:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-1c56aae7-5674-4a77-998e-b22474691ddf tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 11:46:04 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:46:04 user nova-compute[74683]:   <source dev="/dev/sdf"/>
Oct 16 11:46:04 user nova-compute[74683]:   <target dev="vdc" bus="virtio"/>
Oct 16 11:46:04 user nova-compute[74683]:   <serial>ab1e1d15-933a-4966-860e-bea21a15969c</serial>
Oct 16 11:46:04 user nova-compute[74683]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 16 11:46:04 user nova-compute[74683]: </disk>
Oct 16 11:46:04 user nova-compute[74683]:  {{(pid=74683) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 11:46:04 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:46:04 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-1c56aae7-5674-4a77-998e-b22474691ddf tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94 {{(pid=74683) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 11:46:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:46:09 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:46:14 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:46:15 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9f8c2372-7781-46f9-a06e-4aaa0df43f90 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d6acbac6-01f7-4c5e-ba2f-1650713d1452 is timed out.
Oct 16 11:46:15 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-9f8c2372-7781-46f9-a06e-4aaa0df43f90 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Successfully detached device vdb from instance d6acbac6-01f7-4c5e-ba2f-1650713d1452 from the live domain config.
Oct 16 11:46:15 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f8c2372-7781-46f9-a06e-4aaa0df43f90 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] calling os-brick to detach iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 11:46:15 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f8c2372-7781-46f9-a06e-4aaa0df43f90 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, {'target_iqn': 'iqn.2010-10.org.openstack:da423e28-b07f-4647-bc4c-8e12d7e44bbd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uszQpKIc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:46:15 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-9f8c2372-7781-46f9-a06e-4aaa0df43f90 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:46:15 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-9f8c2372-7781-46f9-a06e-4aaa0df43f90 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:46:15 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-9f8c2372-7781-46f9-a06e-4aaa0df43f90 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:46:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:46:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:46:15 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[10454515-5958-4e9b-b635-de502884b12f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:da423e28-b07f-4647-bc4c-8e12d7e44bbd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab1e1d15-933a-4966-860e-bea21a15969c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:46:15 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f8c2372-7781-46f9-a06e-4aaa0df43f90 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 11:46:15 user nova-compute[74683]: No targets found.
Oct 16 11:46:15 user nova-compute[74683]: iSNS:
Oct 16 11:46:15 user nova-compute[74683]: No targets found.
Oct 16 11:46:15 user nova-compute[74683]: STATIC:
Oct 16 11:46:15 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:da423e28-b07f-4647-bc4c-8e12d7e44bbd
Oct 16 11:46:15 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:46:15 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:46:15 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a
Oct 16 11:46:15 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:46:15 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:46:15 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7
Oct 16 11:46:15 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:46:15 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:46:15 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba
Oct 16 11:46:15 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:46:15 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:46:15 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:ab1e1d15-933a-4966-860e-bea21a15969c
Oct 16 11:46:15 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:46:15 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:46:15 user nova-compute[74683]: FIRMWARE:
Oct 16 11:46:15 user nova-compute[74683]: No targets found.
Oct 16 11:46:15 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:46:15 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f8c2372-7781-46f9-a06e-4aaa0df43f90 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 11:46:15 user nova-compute[74683]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 11:46:15 user nova-compute[74683]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74683) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 11:46:15 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f8c2372-7781-46f9-a06e-4aaa0df43f90 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da423e28-b07f-4647-bc4c-8e12d7e44bbd', 0)] {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 11:46:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:46:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:46:15 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ca9f12-eaba-4adf-9941-8e4d392d1c4b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab1e1d15-933a-4966-860e-bea21a15969c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da423e28-b07f-4647-bc4c-8e12d7e44bbd\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:46:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:46:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:46:15 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0bb488-88e7-42f6-a5b3-edeff652a1b1]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da423e28-b07f-4647-bc4c-8e12d7e44bbd (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab1e1d15-933a-4966-860e-bea21a15969c (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:46:15 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f8c2372-7781-46f9-a06e-4aaa0df43f90 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7 (non-flash)
Oct 16 11:46:15 user nova-compute[74683]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba (non-flash)
Oct 16 11:46:15 user nova-compute[74683]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da423e28-b07f-4647-bc4c-8e12d7e44bbd (non-flash)
Oct 16 11:46:15 user nova-compute[74683]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a (non-flash)
Oct 16 11:46:15 user nova-compute[74683]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab1e1d15-933a-4966-860e-bea21a15969c (non-flash)
Oct 16 11:46:15 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:46:15 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f8c2372-7781-46f9-a06e-4aaa0df43f90 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7 (non-flash)
Oct 16 11:46:15 user nova-compute[74683]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba (non-flash)
Oct 16 11:46:15 user nova-compute[74683]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da423e28-b07f-4647-bc4c-8e12d7e44bbd (non-flash)
Oct 16 11:46:15 user nova-compute[74683]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a (non-flash)
Oct 16 11:46:15 user nova-compute[74683]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab1e1d15-933a-4966-860e-bea21a15969c (non-flash)
Oct 16 11:46:15 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:46:15 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f8c2372-7781-46f9-a06e-4aaa0df43f90 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda6c271630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da423e28-b07f-4647-bc4c-8e12d7e44bbd'): ({'sdd'}, set())}) {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 11:46:15 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-9f8c2372-7781-46f9-a06e-4aaa0df43f90 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Removing single pathed devices sdd {{(pid=74683) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 11:46:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:46:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:46:15 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[2efd3a8e-d781-409c-b928-7266997b786b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:46:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:46:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:46:15 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f78569-c76f-4250-97a2-7466ee659c3e]: (4, ('ok\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:46:15 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-9f8c2372-7781-46f9-a06e-4aaa0df43f90 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Flushing IO for device /dev/sdd {{(pid=74683) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 11:46:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:46:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:46:15 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f27936-ccdc-41e9-af89-7e20da47cd01]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:46:15 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-9f8c2372-7781-46f9-a06e-4aaa0df43f90 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74683) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 11:46:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:46:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:46:15 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7d7f97-8efb-4733-b66e-f9dbf8ac8d82]: (4, ('1', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:46:15 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-9f8c2372-7781-46f9-a06e-4aaa0df43f90 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 11:46:15 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-9f8c2372-7781-46f9-a06e-4aaa0df43f90 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] SCSI volumes sdd have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 11:46:15 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f8c2372-7781-46f9-a06e-4aaa0df43f90 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da423e28-b07f-4647-bc4c-8e12d7e44bbd')] {{(pid=74683) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 11:46:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da423e28-b07f-4647-bc4c-8e12d7e44bbd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:46:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da423e28-b07f-4647-bc4c-8e12d7e44bbd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:46:15 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e491e5e9-0263-48b0-836a-326759fca5f7]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:46:15 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f8c2372-7781-46f9-a06e-4aaa0df43f90 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:46:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da423e28-b07f-4647-bc4c-8e12d7e44bbd -p 172.16.0.220:3260 --logout {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:46:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da423e28-b07f-4647-bc4c-8e12d7e44bbd -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:46:16 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[417db775-9038-41c1-adcf-09dd40681e44]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:da423e28-b07f-4647-bc4c-8e12d7e44bbd, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:da423e28-b07f-4647-bc4c-8e12d7e44bbd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:46:16 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f8c2372-7781-46f9-a06e-4aaa0df43f90 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:da423e28-b07f-4647-bc4c-8e12d7e44bbd, portal: 172.16.0.220,3260]
Oct 16 11:46:16 user nova-compute[74683]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:da423e28-b07f-4647-bc4c-8e12d7e44bbd, portal: 172.16.0.220,3260] successful.
Oct 16 11:46:16 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:46:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da423e28-b07f-4647-bc4c-8e12d7e44bbd -p 172.16.0.220:3260 --op delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:46:16 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da423e28-b07f-4647-bc4c-8e12d7e44bbd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:46:16 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[3751b39c-ed46-4c96-985e-b71903a68350]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:46:16 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f8c2372-7781-46f9-a06e-4aaa0df43f90 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:46:16 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-9f8c2372-7781-46f9-a06e-4aaa0df43f90 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:46:16 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f8c2372-7781-46f9-a06e-4aaa0df43f90 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] <== disconnect_volume: return (305ms) None {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:46:16 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f8c2372-7781-46f9-a06e-4aaa0df43f90 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Disconnected iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 11:46:16 user nova-compute[74683]: DEBUG nova.objects.instance [None req-9f8c2372-7781-46f9-a06e-4aaa0df43f90 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lazy-loading 'flavor' on Instance uuid d6acbac6-01f7-4c5e-ba2f-1650713d1452 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:46:16 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9f8c2372-7781-46f9-a06e-4aaa0df43f90 tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "d6acbac6-01f7-4c5e-ba2f-1650713d1452" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.680s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:46:17 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-29ea785e-3a61-4775-902d-3a4d492be7ba tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Acquiring lock "d6acbac6-01f7-4c5e-ba2f-1650713d1452" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:46:17 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-29ea785e-3a61-4775-902d-3a4d492be7ba tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "d6acbac6-01f7-4c5e-ba2f-1650713d1452" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:46:17 user nova-compute[74683]: INFO nova.compute.manager [None req-29ea785e-3a61-4775-902d-3a4d492be7ba tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Detaching volume cf92b56a-0927-4aa5-a2a7-edb2431f7e7a
Oct 16 11:46:17 user nova-compute[74683]: INFO nova.virt.block_device [None req-29ea785e-3a61-4775-902d-3a4d492be7ba tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Attempting to driver detach volume cf92b56a-0927-4aa5-a2a7-edb2431f7e7a from mountpoint /dev/vdc
Oct 16 11:46:17 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-29ea785e-3a61-4775-902d-3a4d492be7ba tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Attempting to detach device vdc from instance d6acbac6-01f7-4c5e-ba2f-1650713d1452 from the persistent domain config. {{(pid=74683) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 11:46:17 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-29ea785e-3a61-4775-902d-3a4d492be7ba tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 11:46:17 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:46:17 user nova-compute[74683]:   <source dev="/dev/sde"/>
Oct 16 11:46:17 user nova-compute[74683]:   <target dev="vdc" bus="virtio"/>
Oct 16 11:46:17 user nova-compute[74683]:   <serial>cf92b56a-0927-4aa5-a2a7-edb2431f7e7a</serial>
Oct 16 11:46:17 user nova-compute[74683]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 16 11:46:17 user nova-compute[74683]: </disk>
Oct 16 11:46:17 user nova-compute[74683]:  {{(pid=74683) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 11:46:18 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-29ea785e-3a61-4775-902d-3a4d492be7ba tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Successfully detached device vdc from instance d6acbac6-01f7-4c5e-ba2f-1650713d1452 from the persistent domain config.
Oct 16 11:46:18 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-29ea785e-3a61-4775-902d-3a4d492be7ba tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance d6acbac6-01f7-4c5e-ba2f-1650713d1452 from the live domain config. {{(pid=74683) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 11:46:18 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-29ea785e-3a61-4775-902d-3a4d492be7ba tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 11:46:18 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:46:18 user nova-compute[74683]:   <source dev="/dev/sde"/>
Oct 16 11:46:18 user nova-compute[74683]:   <target dev="vdc" bus="virtio"/>
Oct 16 11:46:18 user nova-compute[74683]:   <serial>cf92b56a-0927-4aa5-a2a7-edb2431f7e7a</serial>
Oct 16 11:46:18 user nova-compute[74683]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 16 11:46:18 user nova-compute[74683]: </disk>
Oct 16 11:46:18 user nova-compute[74683]:  {{(pid=74683) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 11:46:18 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-29ea785e-3a61-4775-902d-3a4d492be7ba tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance d6acbac6-01f7-4c5e-ba2f-1650713d1452 {{(pid=74683) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 11:46:19 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:46:19 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:46:19 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74683) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 11:46:19 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:46:19 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:46:19 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:46:20 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b5fbb779-d661-4f8d-a1c1-e0483021f333 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Acquiring lock "ec2b88a5-6571-4f46-a07d-47ccfc1761e4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:46:20 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b5fbb779-d661-4f8d-a1c1-e0483021f333 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "ec2b88a5-6571-4f46-a07d-47ccfc1761e4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:46:20 user nova-compute[74683]: INFO nova.compute.manager [None req-b5fbb779-d661-4f8d-a1c1-e0483021f333 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Detaching volume 7ce79b34-e4db-42a6-b4be-08ece45a72a7
Oct 16 11:46:20 user nova-compute[74683]: INFO nova.virt.block_device [None req-b5fbb779-d661-4f8d-a1c1-e0483021f333 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Attempting to driver detach volume 7ce79b34-e4db-42a6-b4be-08ece45a72a7 from mountpoint /dev/vdc
Oct 16 11:46:20 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b5fbb779-d661-4f8d-a1c1-e0483021f333 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Attempting to detach device vdc from instance ec2b88a5-6571-4f46-a07d-47ccfc1761e4 from the persistent domain config. {{(pid=74683) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 11:46:20 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-b5fbb779-d661-4f8d-a1c1-e0483021f333 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 11:46:20 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:46:20 user nova-compute[74683]:   <source dev="/dev/sdb"/>
Oct 16 11:46:20 user nova-compute[74683]:   <target dev="vdc" bus="virtio"/>
Oct 16 11:46:20 user nova-compute[74683]:   <serial>7ce79b34-e4db-42a6-b4be-08ece45a72a7</serial>
Oct 16 11:46:20 user nova-compute[74683]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 16 11:46:20 user nova-compute[74683]: </disk>
Oct 16 11:46:20 user nova-compute[74683]:  {{(pid=74683) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 11:46:20 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-b5fbb779-d661-4f8d-a1c1-e0483021f333 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Successfully detached device vdc from instance ec2b88a5-6571-4f46-a07d-47ccfc1761e4 from the persistent domain config.
Oct 16 11:46:20 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b5fbb779-d661-4f8d-a1c1-e0483021f333 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance ec2b88a5-6571-4f46-a07d-47ccfc1761e4 from the live domain config. {{(pid=74683) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 11:46:20 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-b5fbb779-d661-4f8d-a1c1-e0483021f333 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 11:46:20 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:46:20 user nova-compute[74683]:   <source dev="/dev/sdb"/>
Oct 16 11:46:20 user nova-compute[74683]:   <target dev="vdc" bus="virtio"/>
Oct 16 11:46:20 user nova-compute[74683]:   <serial>7ce79b34-e4db-42a6-b4be-08ece45a72a7</serial>
Oct 16 11:46:20 user nova-compute[74683]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 16 11:46:20 user nova-compute[74683]: </disk>
Oct 16 11:46:20 user nova-compute[74683]:  {{(pid=74683) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 11:46:21 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b5fbb779-d661-4f8d-a1c1-e0483021f333 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance ec2b88a5-6571-4f46-a07d-47ccfc1761e4 {{(pid=74683) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 11:46:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:46:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:46:24 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-1c56aae7-5674-4a77-998e-b22474691ddf tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94 is timed out.
Oct 16 11:46:24 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-1c56aae7-5674-4a77-998e-b22474691ddf tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Successfully detached device vdc from instance 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94 from the live domain config.
Oct 16 11:46:24 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c56aae7-5674-4a77-998e-b22474691ddf tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] calling os-brick to detach iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 11:46:24 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c56aae7-5674-4a77-998e-b22474691ddf tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, {'target_iqn': 'iqn.2010-10.org.openstack:ab1e1d15-933a-4966-860e-bea21a15969c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kYNpTuKy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:46:24 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-1c56aae7-5674-4a77-998e-b22474691ddf tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:46:24 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-1c56aae7-5674-4a77-998e-b22474691ddf tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:46:24 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-1c56aae7-5674-4a77-998e-b22474691ddf tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:46:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:46:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:46:24 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a4c772-1636-4f3e-89a6-5bf43409f073]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab1e1d15-933a-4966-860e-bea21a15969c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:46:24 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c56aae7-5674-4a77-998e-b22474691ddf tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 11:46:24 user nova-compute[74683]: No targets found.
Oct 16 11:46:24 user nova-compute[74683]: iSNS:
Oct 16 11:46:24 user nova-compute[74683]: No targets found.
Oct 16 11:46:24 user nova-compute[74683]: STATIC:
Oct 16 11:46:24 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a
Oct 16 11:46:24 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:46:24 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:46:24 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7
Oct 16 11:46:24 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:46:24 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:46:24 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba
Oct 16 11:46:24 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:46:24 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:46:24 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:ab1e1d15-933a-4966-860e-bea21a15969c
Oct 16 11:46:24 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:46:24 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:46:24 user nova-compute[74683]: FIRMWARE:
Oct 16 11:46:24 user nova-compute[74683]: No targets found.
Oct 16 11:46:24 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:46:24 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c56aae7-5674-4a77-998e-b22474691ddf tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 11:46:24 user nova-compute[74683]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 11:46:24 user nova-compute[74683]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74683) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 11:46:24 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c56aae7-5674-4a77-998e-b22474691ddf tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab1e1d15-933a-4966-860e-bea21a15969c', 0)] {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 11:46:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:46:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:46:24 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf2814a-62d0-4eca-8642-c8cdbd9badb3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab1e1d15-933a-4966-860e-bea21a15969c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:46:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:46:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:46:24 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8d8cf1-d708-493a-b348-52aa6c7d69e6]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab1e1d15-933a-4966-860e-bea21a15969c (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:46:24 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c56aae7-5674-4a77-998e-b22474691ddf tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7 (non-flash)
Oct 16 11:46:24 user nova-compute[74683]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba (non-flash)
Oct 16 11:46:24 user nova-compute[74683]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a (non-flash)
Oct 16 11:46:24 user nova-compute[74683]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab1e1d15-933a-4966-860e-bea21a15969c (non-flash)
Oct 16 11:46:24 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:46:24 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c56aae7-5674-4a77-998e-b22474691ddf tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7 (non-flash)
Oct 16 11:46:24 user nova-compute[74683]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba (non-flash)
Oct 16 11:46:24 user nova-compute[74683]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a (non-flash)
Oct 16 11:46:24 user nova-compute[74683]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab1e1d15-933a-4966-860e-bea21a15969c (non-flash)
Oct 16 11:46:24 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:46:24 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c56aae7-5674-4a77-998e-b22474691ddf tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda4c762f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab1e1d15-933a-4966-860e-bea21a15969c'): ({'sdf'}, set())}) {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 11:46:24 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-1c56aae7-5674-4a77-998e-b22474691ddf tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Removing single pathed devices sdf {{(pid=74683) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 11:46:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:46:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:46:24 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db1286f-91c9-401c-be2c-f7df647ae7bb]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:46:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:46:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:46:24 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6883492-35b6-4c3f-9068-3226829e5904]: (4, ('ok\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:46:24 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-1c56aae7-5674-4a77-998e-b22474691ddf tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Flushing IO for device /dev/sdf {{(pid=74683) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 11:46:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:46:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:46:24 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c4a54a-1633-45a0-94fa-dfc8a733700b]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:46:24 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-1c56aae7-5674-4a77-998e-b22474691ddf tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74683) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 11:46:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:46:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.041s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:46:24 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[de314cbb-afd3-4f3a-845f-eba0391caa70]: (4, ('1', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:46:24 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-1c56aae7-5674-4a77-998e-b22474691ddf tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 11:46:24 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-1c56aae7-5674-4a77-998e-b22474691ddf tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] SCSI volumes sdf have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 11:46:24 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c56aae7-5674-4a77-998e-b22474691ddf tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab1e1d15-933a-4966-860e-bea21a15969c')] {{(pid=74683) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 11:46:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab1e1d15-933a-4966-860e-bea21a15969c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:46:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab1e1d15-933a-4966-860e-bea21a15969c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:46:24 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[092e8ffa-74c2-431e-81e2-9a440eeea855]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:46:24 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c56aae7-5674-4a77-998e-b22474691ddf tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:46:24 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab1e1d15-933a-4966-860e-bea21a15969c -p 172.16.0.220:3260 --logout {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:46:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab1e1d15-933a-4966-860e-bea21a15969c -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:46:25 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[4937591e-698a-451c-98e8-985f1362f1f9]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:ab1e1d15-933a-4966-860e-bea21a15969c, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:ab1e1d15-933a-4966-860e-bea21a15969c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:46:25 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c56aae7-5674-4a77-998e-b22474691ddf tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:ab1e1d15-933a-4966-860e-bea21a15969c, portal: 172.16.0.220,3260]
Oct 16 11:46:25 user nova-compute[74683]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:ab1e1d15-933a-4966-860e-bea21a15969c, portal: 172.16.0.220,3260] successful.
Oct 16 11:46:25 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:46:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab1e1d15-933a-4966-860e-bea21a15969c -p 172.16.0.220:3260 --op delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:46:25 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab1e1d15-933a-4966-860e-bea21a15969c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:46:25 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[503c2fee-b3b7-4532-9cdf-78b95752c622]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:46:25 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c56aae7-5674-4a77-998e-b22474691ddf tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:46:25 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-1c56aae7-5674-4a77-998e-b22474691ddf tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:46:25 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c56aae7-5674-4a77-998e-b22474691ddf tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] <== disconnect_volume: return (287ms) None {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:46:25 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c56aae7-5674-4a77-998e-b22474691ddf tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Disconnected iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 11:46:25 user nova-compute[74683]: DEBUG nova.objects.instance [None req-1c56aae7-5674-4a77-998e-b22474691ddf tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Lazy-loading 'flavor' on Instance uuid 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:46:25 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-1c56aae7-5674-4a77-998e-b22474691ddf tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Lock "3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.689s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:46:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:46:27 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:46:29 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:46:29 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:46:30 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:46:30 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:46:30 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Starting heal instance info cache {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 11:46:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "refresh_cache-d6acbac6-01f7-4c5e-ba2f-1650713d1452" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:46:30 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquired lock "refresh_cache-d6acbac6-01f7-4c5e-ba2f-1650713d1452" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:46:30 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Forcefully refreshing network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 11:46:31 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Updating instance_info_cache with network_info: [{"id": "befa59d0-1d58-4231-a16b-d5981b3e8144", "address": "fa:16:3e:d7:38:8f", "network": {"id": "badd2db9-6c0f-40cc-afe9-a199e040399a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1368098259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "889cb980200446c0933fe965738a62df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbefa59d0-1d", "ovs_interfaceid": "befa59d0-1d58-4231-a16b-d5981b3e8144", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:46:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Releasing lock "refresh_cache-d6acbac6-01f7-4c5e-ba2f-1650713d1452" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:46:31 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Updated the network info_cache for instance {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 11:46:31 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:46:31 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:46:33 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:46:33 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74683) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 11:46:34 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:46:34 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:46:34 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74683) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 11:46:34 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:46:34 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:46:34 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:46:36 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:46:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:46:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:46:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:46:36 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Auditing locally available compute resources for user (node: user) {{(pid=74683) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 11:46:36 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:46:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:46:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:46:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:46:37 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:46:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b413793-f051-432c-83e0-57c3b0cd8fe0/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:46:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b413793-f051-432c-83e0-57c3b0cd8fe0/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:46:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b413793-f051-432c-83e0-57c3b0cd8fe0/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:46:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b413793-f051-432c-83e0-57c3b0cd8fe0/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:46:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec2b88a5-6571-4f46-a07d-47ccfc1761e4/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:46:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec2b88a5-6571-4f46-a07d-47ccfc1761e4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:46:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec2b88a5-6571-4f46-a07d-47ccfc1761e4/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:46:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec2b88a5-6571-4f46-a07d-47ccfc1761e4/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:46:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6acbac6-01f7-4c5e-ba2f-1650713d1452/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:46:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6acbac6-01f7-4c5e-ba2f-1650713d1452/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:46:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6acbac6-01f7-4c5e-ba2f-1650713d1452/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:46:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6acbac6-01f7-4c5e-ba2f-1650713d1452/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:46:38 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-29ea785e-3a61-4775-902d-3a4d492be7ba tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance d6acbac6-01f7-4c5e-ba2f-1650713d1452 is timed out.
Oct 16 11:46:38 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-29ea785e-3a61-4775-902d-3a4d492be7ba tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Successfully detached device vdc from instance d6acbac6-01f7-4c5e-ba2f-1650713d1452 from the live domain config.
Oct 16 11:46:38 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:46:38 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:46:38 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Hypervisor/Node resource view: name=user free_ram=8495MB free_disk=25.004230499267578GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74683) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 11:46:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:46:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:46:38 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29ea785e-3a61-4775-902d-3a4d492be7ba tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] calling os-brick to detach iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 11:46:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ea785e-3a61-4775-902d-3a4d492be7ba tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, {'target_iqn': 'iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jUEiDYXl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:46:38 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-29ea785e-3a61-4775-902d-3a4d492be7ba tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:46:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-29ea785e-3a61-4775-902d-3a4d492be7ba tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:46:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-29ea785e-3a61-4775-902d-3a4d492be7ba tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:46:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:46:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:46:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[06361e54-c13c-480c-aa1e-fd8bf3932377]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:46:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ea785e-3a61-4775-902d-3a4d492be7ba tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 11:46:38 user nova-compute[74683]: No targets found.
Oct 16 11:46:38 user nova-compute[74683]: iSNS:
Oct 16 11:46:38 user nova-compute[74683]: No targets found.
Oct 16 11:46:38 user nova-compute[74683]: STATIC:
Oct 16 11:46:38 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a
Oct 16 11:46:38 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:46:38 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:46:38 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7
Oct 16 11:46:38 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:46:38 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:46:38 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba
Oct 16 11:46:38 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:46:38 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:46:38 user nova-compute[74683]: FIRMWARE:
Oct 16 11:46:38 user nova-compute[74683]: No targets found.
Oct 16 11:46:38 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:46:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ea785e-3a61-4775-902d-3a4d492be7ba tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 11:46:38 user nova-compute[74683]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 11:46:38 user nova-compute[74683]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74683) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 11:46:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ea785e-3a61-4775-902d-3a4d492be7ba tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a', 0)] {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 11:46:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:46:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:46:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[1501fde1-5f21-4cb4-966b-99d09006320a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:46:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:46:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:46:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[8487a095-8b2e-4fb2-8ee3-a05cb0d9091d]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:46:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ea785e-3a61-4775-902d-3a4d492be7ba tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7 (non-flash)
Oct 16 11:46:38 user nova-compute[74683]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba (non-flash)
Oct 16 11:46:38 user nova-compute[74683]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a (non-flash)
Oct 16 11:46:38 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:46:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ea785e-3a61-4775-902d-3a4d492be7ba tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7 (non-flash)
Oct 16 11:46:38 user nova-compute[74683]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba (non-flash)
Oct 16 11:46:38 user nova-compute[74683]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a (non-flash)
Oct 16 11:46:38 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:46:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ea785e-3a61-4775-902d-3a4d492be7ba tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda4c761480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a'): ({'sde'}, set())}) {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 11:46:38 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-29ea785e-3a61-4775-902d-3a4d492be7ba tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Removing single pathed devices sde {{(pid=74683) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 11:46:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:46:38 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:46:38 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance d6acbac6-01f7-4c5e-ba2f-1650713d1452 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:46:38 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance ec2b88a5-6571-4f46-a07d-47ccfc1761e4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:46:38 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 6b413793-f051-432c-83e0-57c3b0cd8fe0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:46:38 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 11:46:38 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 11:46:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:46:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bbc3f97-e2b4-4d68-9480-28ec1cb4315c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:46:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:46:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:46:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9a57d6-fb19-4b20-ac37-84bc6548efaf]: (4, ('ok\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:46:38 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-29ea785e-3a61-4775-902d-3a4d492be7ba tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Flushing IO for device /dev/sde {{(pid=74683) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 11:46:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:46:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:46:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e824bb07-a8a0-48cb-b307-48f8f0d0df03]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:46:38 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-29ea785e-3a61-4775-902d-3a4d492be7ba tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74683) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 11:46:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:46:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:46:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[36244cb8-4c04-40b7-bc9b-d187a77889fd]: (4, ('1', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:46:38 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-29ea785e-3a61-4775-902d-3a4d492be7ba tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 11:46:38 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-29ea785e-3a61-4775-902d-3a4d492be7ba tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] SCSI volumes sde have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 11:46:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ea785e-3a61-4775-902d-3a4d492be7ba tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a')] {{(pid=74683) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 11:46:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:46:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:46:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15ddc3f-a428-4b29-8f6e-58a667c6276c]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:46:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ea785e-3a61-4775-902d-3a4d492be7ba tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:46:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a -p 172.16.0.220:3260 --logout {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:46:38 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:46:38 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:46:38 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Compute_service record updated for user:user {{(pid=74683) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 11:46:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.264s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:46:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:46:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc37d9c9-9c4c-4078-a387-2a9841f28da5]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:46:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ea785e-3a61-4775-902d-3a4d492be7ba tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a, portal: 172.16.0.220,3260]
Oct 16 11:46:39 user nova-compute[74683]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a, portal: 172.16.0.220,3260] successful.
Oct 16 11:46:39 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:46:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a -p 172.16.0.220:3260 --op delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:46:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf92b56a-0927-4aa5-a2a7-edb2431f7e7a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:46:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd260abc-6fb4-4ca4-acfd-e82834c43639]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:46:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ea785e-3a61-4775-902d-3a4d492be7ba tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:46:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-29ea785e-3a61-4775-902d-3a4d492be7ba tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:46:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ea785e-3a61-4775-902d-3a4d492be7ba tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] <== disconnect_volume: return (303ms) None {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:46:39 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29ea785e-3a61-4775-902d-3a4d492be7ba tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Disconnected iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 11:46:39 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:46:41 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-b5fbb779-d661-4f8d-a1c1-e0483021f333 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance ec2b88a5-6571-4f46-a07d-47ccfc1761e4 is timed out.
Oct 16 11:46:41 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-b5fbb779-d661-4f8d-a1c1-e0483021f333 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Successfully detached device vdc from instance ec2b88a5-6571-4f46-a07d-47ccfc1761e4 from the live domain config.
Oct 16 11:46:41 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5fbb779-d661-4f8d-a1c1-e0483021f333 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] calling os-brick to detach iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 11:46:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5fbb779-d661-4f8d-a1c1-e0483021f333 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, {'target_iqn': 'iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TlkhIPMo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:46:41 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-b5fbb779-d661-4f8d-a1c1-e0483021f333 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:46:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-b5fbb779-d661-4f8d-a1c1-e0483021f333 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:46:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-b5fbb779-d661-4f8d-a1c1-e0483021f333 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:46:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:46:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:46:41 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d8f37a-29b0-4db0-ac11-4e00940b065c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:46:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5fbb779-d661-4f8d-a1c1-e0483021f333 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 11:46:41 user nova-compute[74683]: No targets found.
Oct 16 11:46:41 user nova-compute[74683]: iSNS:
Oct 16 11:46:41 user nova-compute[74683]: No targets found.
Oct 16 11:46:41 user nova-compute[74683]: STATIC:
Oct 16 11:46:41 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7
Oct 16 11:46:41 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:46:41 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:46:41 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba
Oct 16 11:46:41 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:46:41 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:46:41 user nova-compute[74683]: FIRMWARE:
Oct 16 11:46:41 user nova-compute[74683]: No targets found.
Oct 16 11:46:41 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:46:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5fbb779-d661-4f8d-a1c1-e0483021f333 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 11:46:41 user nova-compute[74683]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 11:46:41 user nova-compute[74683]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74683) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 11:46:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5fbb779-d661-4f8d-a1c1-e0483021f333 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7', 0)] {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 11:46:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:46:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:46:41 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[94def2d4-1ca7-4dba-9a1d-86b42baf0d47]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:46:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:46:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:46:41 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd5a69f-01a9-4480-8d28-de9b1a7771c1]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:46:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5fbb779-d661-4f8d-a1c1-e0483021f333 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7 (non-flash)
Oct 16 11:46:41 user nova-compute[74683]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba (non-flash)
Oct 16 11:46:41 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:46:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5fbb779-d661-4f8d-a1c1-e0483021f333 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7 (non-flash)
Oct 16 11:46:41 user nova-compute[74683]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba (non-flash)
Oct 16 11:46:41 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:46:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5fbb779-d661-4f8d-a1c1-e0483021f333 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda4c7a0790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7'): ({'sdb'}, set())}) {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 11:46:41 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-b5fbb779-d661-4f8d-a1c1-e0483021f333 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Removing single pathed devices sdb {{(pid=74683) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 11:46:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:46:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:46:41 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d75018-7dcb-4b77-b98f-ed3704915de6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:46:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:46:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:46:41 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[207a3db4-09ec-4384-ad69-def5866a4fdb]: (4, ('ok\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:46:41 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-b5fbb779-d661-4f8d-a1c1-e0483021f333 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Flushing IO for device /dev/sdb {{(pid=74683) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 11:46:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:46:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:46:41 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c31fa2-f219-4430-8ccd-276d2ba18e71]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:46:41 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-b5fbb779-d661-4f8d-a1c1-e0483021f333 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74683) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 11:46:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:46:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.031s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:46:41 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[542cf6a9-7585-4356-8349-96e4d76a599f]: (4, ('1', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:46:41 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-b5fbb779-d661-4f8d-a1c1-e0483021f333 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 11:46:41 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-b5fbb779-d661-4f8d-a1c1-e0483021f333 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] SCSI volumes sdb have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 11:46:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5fbb779-d661-4f8d-a1c1-e0483021f333 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7')] {{(pid=74683) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 11:46:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:46:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:46:41 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd2296b-d4b3-4fee-a630-d5bfb944d6be]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:46:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5fbb779-d661-4f8d-a1c1-e0483021f333 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:46:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7 -p 172.16.0.220:3260 --logout {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:46:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:46:41 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[10db8127-1ebd-4e8b-b08f-b0105dc09011]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:46:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5fbb779-d661-4f8d-a1c1-e0483021f333 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7, portal: 172.16.0.220,3260]
Oct 16 11:46:41 user nova-compute[74683]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7, portal: 172.16.0.220,3260] successful.
Oct 16 11:46:41 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:46:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7 -p 172.16.0.220:3260 --op delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:46:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce79b34-e4db-42a6-b4be-08ece45a72a7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:46:41 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[da53171b-3251-43da-8b2f-516cf8cff9ca]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:46:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5fbb779-d661-4f8d-a1c1-e0483021f333 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:46:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-b5fbb779-d661-4f8d-a1c1-e0483021f333 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.268s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:46:41 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5fbb779-d661-4f8d-a1c1-e0483021f333 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] <== disconnect_volume: return (270ms) None {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:46:41 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5fbb779-d661-4f8d-a1c1-e0483021f333 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Disconnected iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 11:46:41 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:46:42 user nova-compute[74683]: DEBUG nova.objects.instance [None req-b5fbb779-d661-4f8d-a1c1-e0483021f333 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lazy-loading 'flavor' on Instance uuid ec2b88a5-6571-4f46-a07d-47ccfc1761e4 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:46:42 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b5fbb779-d661-4f8d-a1c1-e0483021f333 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "ec2b88a5-6571-4f46-a07d-47ccfc1761e4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.729s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:46:44 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:46:47 user nova-compute[74683]: DEBUG nova.objects.instance [None req-29ea785e-3a61-4775-902d-3a4d492be7ba tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lazy-loading 'flavor' on Instance uuid d6acbac6-01f7-4c5e-ba2f-1650713d1452 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:46:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-29ea785e-3a61-4775-902d-3a4d492be7ba tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "d6acbac6-01f7-4c5e-ba2f-1650713d1452" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 29.392s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:46:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-29e3df8a-5121-4b51-83ba-a13614bcf39e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Acquiring lock "d6acbac6-01f7-4c5e-ba2f-1650713d1452" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:46:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-29e3df8a-5121-4b51-83ba-a13614bcf39e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "d6acbac6-01f7-4c5e-ba2f-1650713d1452" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:46:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-29e3df8a-5121-4b51-83ba-a13614bcf39e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Acquiring lock "d6acbac6-01f7-4c5e-ba2f-1650713d1452-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:46:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-29e3df8a-5121-4b51-83ba-a13614bcf39e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "d6acbac6-01f7-4c5e-ba2f-1650713d1452-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:46:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-29e3df8a-5121-4b51-83ba-a13614bcf39e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "d6acbac6-01f7-4c5e-ba2f-1650713d1452-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:46:48 user nova-compute[74683]: INFO nova.compute.manager [None req-29e3df8a-5121-4b51-83ba-a13614bcf39e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Terminating instance
Oct 16 11:46:48 user nova-compute[74683]: DEBUG nova.compute.manager [None req-29e3df8a-5121-4b51-83ba-a13614bcf39e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Start destroying the instance on the hypervisor. {{(pid=74683) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 11:46:48 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:46:48 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:46:48 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:46:48 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:46:48 user nova-compute[74683]: DEBUG nova.compute.manager [req-11299fc3-07a6-4ef8-bab6-8972899da077 req-78f0ef5d-ce1c-47e6-8049-9b453e0510ee service nova] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Received event network-vif-unplugged-befa59d0-1d58-4231-a16b-d5981b3e8144 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:46:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-11299fc3-07a6-4ef8-bab6-8972899da077 req-78f0ef5d-ce1c-47e6-8049-9b453e0510ee service nova] Acquiring lock "d6acbac6-01f7-4c5e-ba2f-1650713d1452-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:46:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-11299fc3-07a6-4ef8-bab6-8972899da077 req-78f0ef5d-ce1c-47e6-8049-9b453e0510ee service nova] Lock "d6acbac6-01f7-4c5e-ba2f-1650713d1452-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:46:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-11299fc3-07a6-4ef8-bab6-8972899da077 req-78f0ef5d-ce1c-47e6-8049-9b453e0510ee service nova] Lock "d6acbac6-01f7-4c5e-ba2f-1650713d1452-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:46:48 user nova-compute[74683]: DEBUG nova.compute.manager [req-11299fc3-07a6-4ef8-bab6-8972899da077 req-78f0ef5d-ce1c-47e6-8049-9b453e0510ee service nova] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] No waiting events found dispatching network-vif-unplugged-befa59d0-1d58-4231-a16b-d5981b3e8144 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:46:48 user nova-compute[74683]: DEBUG nova.compute.manager [req-11299fc3-07a6-4ef8-bab6-8972899da077 req-78f0ef5d-ce1c-47e6-8049-9b453e0510ee service nova] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Received event network-vif-unplugged-befa59d0-1d58-4231-a16b-d5981b3e8144 for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 11:46:48 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:46:49 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:46:49 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:46:49 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Instance destroyed successfully.
Oct 16 11:46:49 user nova-compute[74683]: DEBUG nova.objects.instance [None req-29e3df8a-5121-4b51-83ba-a13614bcf39e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lazy-loading 'resources' on Instance uuid d6acbac6-01f7-4c5e-ba2f-1650713d1452 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:46:49 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-29e3df8a-5121-4b51-83ba-a13614bcf39e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:43:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1650330041',display_name='tempest-AttachVolumeTestJSON-server-1650330041',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1650330041',id=48,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9sH9tJo4P1YOMGkjnKhrKSGWCBqijUPy+RQJ9f5roAzPTpy1gDzjbiVEVpob9Q1bfwNGfbP4URb2sCpfv6WmEPnAViBpwF4ULLbyOJKQnMOI0KxH5FkyxYvUcTGst7cQ==',key_name='tempest-keypair-81233160',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:43:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='889cb980200446c0933fe965738a62df',ramdisk_id='',reservation_id='r-b629eewp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-263939305',owner_user_name='tempest-AttachVolumeTestJSON-263939305-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:43:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c38fd3bc86ba4b7a95e06b926d22e60f',uuid=d6acbac6-01f7-4c5e-ba2f-1650713d1452,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "befa59d0-1d58-4231-a16b-d5981b3e8144", "address": "fa:16:3e:d7:38:8f", "network": {"id": "badd2db9-6c0f-40cc-afe9-a199e040399a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1368098259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "889cb980200446c0933fe965738a62df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbefa59d0-1d", "ovs_interfaceid": "befa59d0-1d58-4231-a16b-d5981b3e8144", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:46:49 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-29e3df8a-5121-4b51-83ba-a13614bcf39e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Converting VIF {"id": "befa59d0-1d58-4231-a16b-d5981b3e8144", "address": "fa:16:3e:d7:38:8f", "network": {"id": "badd2db9-6c0f-40cc-afe9-a199e040399a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1368098259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "889cb980200446c0933fe965738a62df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbefa59d0-1d", "ovs_interfaceid": "befa59d0-1d58-4231-a16b-d5981b3e8144", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:46:49 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-29e3df8a-5121-4b51-83ba-a13614bcf39e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d7:38:8f,bridge_name='br-int',has_traffic_filtering=True,id=befa59d0-1d58-4231-a16b-d5981b3e8144,network=Network(badd2db9-6c0f-40cc-afe9-a199e040399a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbefa59d0-1d') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:46:49 user nova-compute[74683]: DEBUG os_vif [None req-29e3df8a-5121-4b51-83ba-a13614bcf39e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:38:8f,bridge_name='br-int',has_traffic_filtering=True,id=befa59d0-1d58-4231-a16b-d5981b3e8144,network=Network(badd2db9-6c0f-40cc-afe9-a199e040399a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbefa59d0-1d') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:46:49 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:46:49 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbefa59d0-1d, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:46:49 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:46:49 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:46:49 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d27487d2-4439-4649-bd30-308e2313323f) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:46:49 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:46:49 user nova-compute[74683]: INFO os_vif [None req-29e3df8a-5121-4b51-83ba-a13614bcf39e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:38:8f,bridge_name='br-int',has_traffic_filtering=True,id=befa59d0-1d58-4231-a16b-d5981b3e8144,network=Network(badd2db9-6c0f-40cc-afe9-a199e040399a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbefa59d0-1d')
Oct 16 11:46:49 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-29e3df8a-5121-4b51-83ba-a13614bcf39e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Deleting instance files /opt/stack/data/nova/instances/d6acbac6-01f7-4c5e-ba2f-1650713d1452_del
Oct 16 11:46:49 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-29e3df8a-5121-4b51-83ba-a13614bcf39e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Deletion of /opt/stack/data/nova/instances/d6acbac6-01f7-4c5e-ba2f-1650713d1452_del complete
Oct 16 11:46:49 user nova-compute[74683]: INFO nova.compute.manager [None req-29e3df8a-5121-4b51-83ba-a13614bcf39e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Took 0.84 seconds to destroy the instance on the hypervisor.
Oct 16 11:46:49 user nova-compute[74683]: DEBUG oslo.service.loopingcall [None req-29e3df8a-5121-4b51-83ba-a13614bcf39e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74683) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 11:46:49 user nova-compute[74683]: DEBUG nova.compute.manager [-] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Deallocating network for instance {{(pid=74683) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 11:46:49 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] deallocate_for_instance() {{(pid=74683) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 11:46:50 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:46:50 user nova-compute[74683]: INFO nova.compute.manager [-] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Took 1.12 seconds to deallocate network for instance.
Oct 16 11:46:50 user nova-compute[74683]: DEBUG nova.compute.manager [req-8c5188c6-8f0b-42f5-9a95-2019c8a87946 req-66f6fd6e-7c3d-4ecc-88d6-2f0cce2f7f10 service nova] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Received event network-vif-deleted-befa59d0-1d58-4231-a16b-d5981b3e8144 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:46:50 user nova-compute[74683]: INFO nova.compute.manager [req-8c5188c6-8f0b-42f5-9a95-2019c8a87946 req-66f6fd6e-7c3d-4ecc-88d6-2f0cce2f7f10 service nova] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Neutron deleted interface befa59d0-1d58-4231-a16b-d5981b3e8144; detaching it from the instance and deleting it from the info cache
Oct 16 11:46:50 user nova-compute[74683]: DEBUG nova.network.neutron [req-8c5188c6-8f0b-42f5-9a95-2019c8a87946 req-66f6fd6e-7c3d-4ecc-88d6-2f0cce2f7f10 service nova] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:46:50 user nova-compute[74683]: DEBUG nova.compute.manager [req-8c5188c6-8f0b-42f5-9a95-2019c8a87946 req-66f6fd6e-7c3d-4ecc-88d6-2f0cce2f7f10 service nova] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Detach interface failed, port_id=befa59d0-1d58-4231-a16b-d5981b3e8144, reason: Instance d6acbac6-01f7-4c5e-ba2f-1650713d1452 could not be found. {{(pid=74683) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 16 11:46:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-29e3df8a-5121-4b51-83ba-a13614bcf39e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:46:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-29e3df8a-5121-4b51-83ba-a13614bcf39e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:46:50 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-29e3df8a-5121-4b51-83ba-a13614bcf39e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:46:50 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-29e3df8a-5121-4b51-83ba-a13614bcf39e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:46:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-29e3df8a-5121-4b51-83ba-a13614bcf39e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.200s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:46:50 user nova-compute[74683]: INFO nova.scheduler.client.report [None req-29e3df8a-5121-4b51-83ba-a13614bcf39e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Deleted allocations for instance d6acbac6-01f7-4c5e-ba2f-1650713d1452
Oct 16 11:46:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-29e3df8a-5121-4b51-83ba-a13614bcf39e tempest-AttachVolumeTestJSON-263939305 tempest-AttachVolumeTestJSON-263939305-project-member] Lock "d6acbac6-01f7-4c5e-ba2f-1650713d1452" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.364s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:46:50 user nova-compute[74683]: DEBUG nova.compute.manager [req-e1247fae-6c25-44df-8c5f-cc98be94338a req-444301cd-216a-456b-b477-9ff3772739e8 service nova] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Received event network-vif-plugged-befa59d0-1d58-4231-a16b-d5981b3e8144 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:46:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e1247fae-6c25-44df-8c5f-cc98be94338a req-444301cd-216a-456b-b477-9ff3772739e8 service nova] Acquiring lock "d6acbac6-01f7-4c5e-ba2f-1650713d1452-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:46:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e1247fae-6c25-44df-8c5f-cc98be94338a req-444301cd-216a-456b-b477-9ff3772739e8 service nova] Lock "d6acbac6-01f7-4c5e-ba2f-1650713d1452-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:46:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e1247fae-6c25-44df-8c5f-cc98be94338a req-444301cd-216a-456b-b477-9ff3772739e8 service nova] Lock "d6acbac6-01f7-4c5e-ba2f-1650713d1452-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:46:50 user nova-compute[74683]: DEBUG nova.compute.manager [req-e1247fae-6c25-44df-8c5f-cc98be94338a req-444301cd-216a-456b-b477-9ff3772739e8 service nova] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] No waiting events found dispatching network-vif-plugged-befa59d0-1d58-4231-a16b-d5981b3e8144 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:46:50 user nova-compute[74683]: WARNING nova.compute.manager [req-e1247fae-6c25-44df-8c5f-cc98be94338a req-444301cd-216a-456b-b477-9ff3772739e8 service nova] [instance: d6acbac6-01f7-4c5e-ba2f-1650713d1452] Received unexpected event network-vif-plugged-befa59d0-1d58-4231-a16b-d5981b3e8144 for instance with vm_state deleted and task_state None.
Oct 16 11:46:54 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:46:54 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9bab734e-1cfc-4cac-8566-86c4040905cd tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Acquiring lock "3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:46:54 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9bab734e-1cfc-4cac-8566-86c4040905cd tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Lock "3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:46:54 user nova-compute[74683]: INFO nova.compute.manager [None req-9bab734e-1cfc-4cac-8566-86c4040905cd tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Detaching volume 19aaf202-f868-4a7f-82a2-01f2a97d93ba
Oct 16 11:46:54 user nova-compute[74683]: INFO nova.virt.block_device [None req-9bab734e-1cfc-4cac-8566-86c4040905cd tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Attempting to driver detach volume 19aaf202-f868-4a7f-82a2-01f2a97d93ba from mountpoint /dev/vdb
Oct 16 11:46:54 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9bab734e-1cfc-4cac-8566-86c4040905cd tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Attempting to detach device vdb from instance 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94 from the persistent domain config. {{(pid=74683) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 11:46:54 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-9bab734e-1cfc-4cac-8566-86c4040905cd tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 11:46:54 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:46:54 user nova-compute[74683]:   <source dev="/dev/sdc"/>
Oct 16 11:46:54 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:46:54 user nova-compute[74683]:   <serial>19aaf202-f868-4a7f-82a2-01f2a97d93ba</serial>
Oct 16 11:46:54 user nova-compute[74683]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 11:46:54 user nova-compute[74683]: </disk>
Oct 16 11:46:54 user nova-compute[74683]:  {{(pid=74683) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 11:46:54 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-9bab734e-1cfc-4cac-8566-86c4040905cd tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Successfully detached device vdb from instance 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94 from the persistent domain config.
Oct 16 11:46:54 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9bab734e-1cfc-4cac-8566-86c4040905cd tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94 from the live domain config. {{(pid=74683) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 11:46:54 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-9bab734e-1cfc-4cac-8566-86c4040905cd tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 11:46:54 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:46:54 user nova-compute[74683]:   <source dev="/dev/sdc"/>
Oct 16 11:46:54 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:46:54 user nova-compute[74683]:   <serial>19aaf202-f868-4a7f-82a2-01f2a97d93ba</serial>
Oct 16 11:46:54 user nova-compute[74683]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 11:46:54 user nova-compute[74683]: </disk>
Oct 16 11:46:54 user nova-compute[74683]:  {{(pid=74683) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 11:46:55 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9bab734e-1cfc-4cac-8566-86c4040905cd tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94 {{(pid=74683) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 11:46:59 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:46:59 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:47:04 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:47:09 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:47:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b5dc06eb-5911-42b8-957b-517d1f232bbd tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Acquiring lock "ec2b88a5-6571-4f46-a07d-47ccfc1761e4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:47:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b5dc06eb-5911-42b8-957b-517d1f232bbd tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "ec2b88a5-6571-4f46-a07d-47ccfc1761e4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:47:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b5dc06eb-5911-42b8-957b-517d1f232bbd tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Acquiring lock "ec2b88a5-6571-4f46-a07d-47ccfc1761e4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:47:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b5dc06eb-5911-42b8-957b-517d1f232bbd tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "ec2b88a5-6571-4f46-a07d-47ccfc1761e4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:47:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b5dc06eb-5911-42b8-957b-517d1f232bbd tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "ec2b88a5-6571-4f46-a07d-47ccfc1761e4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:47:11 user nova-compute[74683]: INFO nova.compute.manager [None req-b5dc06eb-5911-42b8-957b-517d1f232bbd tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Terminating instance
Oct 16 11:47:11 user nova-compute[74683]: DEBUG nova.compute.manager [None req-b5dc06eb-5911-42b8-957b-517d1f232bbd tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Start destroying the instance on the hypervisor. {{(pid=74683) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 11:47:11 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:47:11 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:47:11 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:47:11 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:47:11 user nova-compute[74683]: DEBUG nova.compute.manager [req-97f14a19-b660-4200-9924-590f72dd7d3f req-1cbd621e-b68f-4d1c-87e0-116a9ee86c48 service nova] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Received event network-vif-unplugged-75e552bb-fec2-47bd-adda-d562f27f8a36 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:47:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-97f14a19-b660-4200-9924-590f72dd7d3f req-1cbd621e-b68f-4d1c-87e0-116a9ee86c48 service nova] Acquiring lock "ec2b88a5-6571-4f46-a07d-47ccfc1761e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:47:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-97f14a19-b660-4200-9924-590f72dd7d3f req-1cbd621e-b68f-4d1c-87e0-116a9ee86c48 service nova] Lock "ec2b88a5-6571-4f46-a07d-47ccfc1761e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:47:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-97f14a19-b660-4200-9924-590f72dd7d3f req-1cbd621e-b68f-4d1c-87e0-116a9ee86c48 service nova] Lock "ec2b88a5-6571-4f46-a07d-47ccfc1761e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:47:11 user nova-compute[74683]: DEBUG nova.compute.manager [req-97f14a19-b660-4200-9924-590f72dd7d3f req-1cbd621e-b68f-4d1c-87e0-116a9ee86c48 service nova] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] No waiting events found dispatching network-vif-unplugged-75e552bb-fec2-47bd-adda-d562f27f8a36 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:47:11 user nova-compute[74683]: DEBUG nova.compute.manager [req-97f14a19-b660-4200-9924-590f72dd7d3f req-1cbd621e-b68f-4d1c-87e0-116a9ee86c48 service nova] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Received event network-vif-unplugged-75e552bb-fec2-47bd-adda-d562f27f8a36 for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 11:47:11 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:47:11 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:47:11 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:47:11 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:47:11 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Instance destroyed successfully.
Oct 16 11:47:11 user nova-compute[74683]: DEBUG nova.objects.instance [None req-b5dc06eb-5911-42b8-957b-517d1f232bbd tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lazy-loading 'resources' on Instance uuid ec2b88a5-6571-4f46-a07d-47ccfc1761e4 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:47:11 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-b5dc06eb-5911-42b8-957b-517d1f232bbd tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-16T11:40:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2110881689',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2110881689',id=45,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDrHmOsUhrm4YYKYARdlKrqlcDFGMaTykPh+zb4tGBwYVOfh9pZUyKRTzLOgTUyJT2LVaX7B+7+kT/t6ev3xOPaVzmYiORuHL6ffe3eYJ1lXFNVKMGK5E0k7O/PLikdAqQ==',key_name='tempest-keypair-127654640',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:44:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='622d2c7c33914a068b448c447db50b3c',ramdisk_id='',reservation_id='r-3kki01l8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-291825158',owner_user_name='tempest-AttachVolumeShelveTestJSON-291825158-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:44:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11130271beb44b368f9eb55bd4946cbc',uuid=ec2b88a5-6571-4f46-a07d-47ccfc1761e4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "75e552bb-fec2-47bd-adda-d562f27f8a36", "address": "fa:16:3e:f5:74:eb", "network": {"id": "2ea750a5-8511-4e40-b149-062e10e0096c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-563467594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d2c7c33914a068b448c447db50b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75e552bb-fe", "ovs_interfaceid": "75e552bb-fec2-47bd-adda-d562f27f8a36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:47:11 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-b5dc06eb-5911-42b8-957b-517d1f232bbd tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Converting VIF {"id": "75e552bb-fec2-47bd-adda-d562f27f8a36", "address": "fa:16:3e:f5:74:eb", "network": {"id": "2ea750a5-8511-4e40-b149-062e10e0096c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-563467594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d2c7c33914a068b448c447db50b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75e552bb-fe", "ovs_interfaceid": "75e552bb-fec2-47bd-adda-d562f27f8a36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:47:11 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-b5dc06eb-5911-42b8-957b-517d1f232bbd tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:74:eb,bridge_name='br-int',has_traffic_filtering=True,id=75e552bb-fec2-47bd-adda-d562f27f8a36,network=Network(2ea750a5-8511-4e40-b149-062e10e0096c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75e552bb-fe') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:47:11 user nova-compute[74683]: DEBUG os_vif [None req-b5dc06eb-5911-42b8-957b-517d1f232bbd tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:74:eb,bridge_name='br-int',has_traffic_filtering=True,id=75e552bb-fec2-47bd-adda-d562f27f8a36,network=Network(2ea750a5-8511-4e40-b149-062e10e0096c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75e552bb-fe') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:47:11 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:47:11 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap75e552bb-fe, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:47:11 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:47:11 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:47:11 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:47:11 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:47:11 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e9850c2f-cf13-4d8f-a62d-1d71af6ea05c) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:47:11 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:47:11 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:47:11 user nova-compute[74683]: INFO os_vif [None req-b5dc06eb-5911-42b8-957b-517d1f232bbd tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:74:eb,bridge_name='br-int',has_traffic_filtering=True,id=75e552bb-fec2-47bd-adda-d562f27f8a36,network=Network(2ea750a5-8511-4e40-b149-062e10e0096c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75e552bb-fe')
Oct 16 11:47:11 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-b5dc06eb-5911-42b8-957b-517d1f232bbd tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Deleting instance files /opt/stack/data/nova/instances/ec2b88a5-6571-4f46-a07d-47ccfc1761e4_del
Oct 16 11:47:11 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-b5dc06eb-5911-42b8-957b-517d1f232bbd tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Deletion of /opt/stack/data/nova/instances/ec2b88a5-6571-4f46-a07d-47ccfc1761e4_del complete
Oct 16 11:47:12 user nova-compute[74683]: INFO nova.compute.manager [None req-b5dc06eb-5911-42b8-957b-517d1f232bbd tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 16 11:47:12 user nova-compute[74683]: DEBUG oslo.service.loopingcall [None req-b5dc06eb-5911-42b8-957b-517d1f232bbd tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74683) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 11:47:12 user nova-compute[74683]: DEBUG nova.compute.manager [-] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Deallocating network for instance {{(pid=74683) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 11:47:12 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] deallocate_for_instance() {{(pid=74683) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 11:47:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:47:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:47:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:47:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:47:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:47:12 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:47:12 user nova-compute[74683]: INFO nova.compute.manager [-] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Took 0.86 seconds to deallocate network for instance.
Oct 16 11:47:12 user nova-compute[74683]: DEBUG nova.compute.manager [req-c8f39db9-dd1c-446a-9fbe-fa3b3721c976 req-0ec84818-acf0-440e-8e81-1c87daa567dd service nova] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Received event network-vif-deleted-75e552bb-fec2-47bd-adda-d562f27f8a36 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:47:12 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b5dc06eb-5911-42b8-957b-517d1f232bbd tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:47:12 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b5dc06eb-5911-42b8-957b-517d1f232bbd tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:47:13 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-b5dc06eb-5911-42b8-957b-517d1f232bbd tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:47:13 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-b5dc06eb-5911-42b8-957b-517d1f232bbd tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:47:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b5dc06eb-5911-42b8-957b-517d1f232bbd tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.154s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:47:13 user nova-compute[74683]: INFO nova.scheduler.client.report [None req-b5dc06eb-5911-42b8-957b-517d1f232bbd tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Deleted allocations for instance ec2b88a5-6571-4f46-a07d-47ccfc1761e4
Oct 16 11:47:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b5dc06eb-5911-42b8-957b-517d1f232bbd tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "ec2b88a5-6571-4f46-a07d-47ccfc1761e4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.105s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:47:13 user nova-compute[74683]: DEBUG nova.compute.manager [req-a2f78376-f5aa-4a48-a9a3-b0b6fb0c5890 req-7c8d23dc-e3d9-434e-b800-77877cf77f6d service nova] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Received event network-vif-plugged-75e552bb-fec2-47bd-adda-d562f27f8a36 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:47:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a2f78376-f5aa-4a48-a9a3-b0b6fb0c5890 req-7c8d23dc-e3d9-434e-b800-77877cf77f6d service nova] Acquiring lock "ec2b88a5-6571-4f46-a07d-47ccfc1761e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:47:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a2f78376-f5aa-4a48-a9a3-b0b6fb0c5890 req-7c8d23dc-e3d9-434e-b800-77877cf77f6d service nova] Lock "ec2b88a5-6571-4f46-a07d-47ccfc1761e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:47:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a2f78376-f5aa-4a48-a9a3-b0b6fb0c5890 req-7c8d23dc-e3d9-434e-b800-77877cf77f6d service nova] Lock "ec2b88a5-6571-4f46-a07d-47ccfc1761e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:47:13 user nova-compute[74683]: DEBUG nova.compute.manager [req-a2f78376-f5aa-4a48-a9a3-b0b6fb0c5890 req-7c8d23dc-e3d9-434e-b800-77877cf77f6d service nova] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] No waiting events found dispatching network-vif-plugged-75e552bb-fec2-47bd-adda-d562f27f8a36 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:47:13 user nova-compute[74683]: WARNING nova.compute.manager [req-a2f78376-f5aa-4a48-a9a3-b0b6fb0c5890 req-7c8d23dc-e3d9-434e-b800-77877cf77f6d service nova] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Received unexpected event network-vif-plugged-75e552bb-fec2-47bd-adda-d562f27f8a36 for instance with vm_state deleted and task_state None.
Oct 16 11:47:13 user nova-compute[74683]: DEBUG nova.compute.manager [req-a2f78376-f5aa-4a48-a9a3-b0b6fb0c5890 req-7c8d23dc-e3d9-434e-b800-77877cf77f6d service nova] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Received event network-vif-plugged-75e552bb-fec2-47bd-adda-d562f27f8a36 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:47:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a2f78376-f5aa-4a48-a9a3-b0b6fb0c5890 req-7c8d23dc-e3d9-434e-b800-77877cf77f6d service nova] Acquiring lock "ec2b88a5-6571-4f46-a07d-47ccfc1761e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:47:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a2f78376-f5aa-4a48-a9a3-b0b6fb0c5890 req-7c8d23dc-e3d9-434e-b800-77877cf77f6d service nova] Lock "ec2b88a5-6571-4f46-a07d-47ccfc1761e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:47:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a2f78376-f5aa-4a48-a9a3-b0b6fb0c5890 req-7c8d23dc-e3d9-434e-b800-77877cf77f6d service nova] Lock "ec2b88a5-6571-4f46-a07d-47ccfc1761e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:47:13 user nova-compute[74683]: DEBUG nova.compute.manager [req-a2f78376-f5aa-4a48-a9a3-b0b6fb0c5890 req-7c8d23dc-e3d9-434e-b800-77877cf77f6d service nova] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] No waiting events found dispatching network-vif-plugged-75e552bb-fec2-47bd-adda-d562f27f8a36 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:47:13 user nova-compute[74683]: WARNING nova.compute.manager [req-a2f78376-f5aa-4a48-a9a3-b0b6fb0c5890 req-7c8d23dc-e3d9-434e-b800-77877cf77f6d service nova] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Received unexpected event network-vif-plugged-75e552bb-fec2-47bd-adda-d562f27f8a36 for instance with vm_state deleted and task_state None.
Oct 16 11:47:13 user nova-compute[74683]: DEBUG nova.compute.manager [req-a2f78376-f5aa-4a48-a9a3-b0b6fb0c5890 req-7c8d23dc-e3d9-434e-b800-77877cf77f6d service nova] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Received event network-vif-plugged-75e552bb-fec2-47bd-adda-d562f27f8a36 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:47:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a2f78376-f5aa-4a48-a9a3-b0b6fb0c5890 req-7c8d23dc-e3d9-434e-b800-77877cf77f6d service nova] Acquiring lock "ec2b88a5-6571-4f46-a07d-47ccfc1761e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:47:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a2f78376-f5aa-4a48-a9a3-b0b6fb0c5890 req-7c8d23dc-e3d9-434e-b800-77877cf77f6d service nova] Lock "ec2b88a5-6571-4f46-a07d-47ccfc1761e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:47:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a2f78376-f5aa-4a48-a9a3-b0b6fb0c5890 req-7c8d23dc-e3d9-434e-b800-77877cf77f6d service nova] Lock "ec2b88a5-6571-4f46-a07d-47ccfc1761e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:47:13 user nova-compute[74683]: DEBUG nova.compute.manager [req-a2f78376-f5aa-4a48-a9a3-b0b6fb0c5890 req-7c8d23dc-e3d9-434e-b800-77877cf77f6d service nova] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] No waiting events found dispatching network-vif-plugged-75e552bb-fec2-47bd-adda-d562f27f8a36 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:47:13 user nova-compute[74683]: WARNING nova.compute.manager [req-a2f78376-f5aa-4a48-a9a3-b0b6fb0c5890 req-7c8d23dc-e3d9-434e-b800-77877cf77f6d service nova] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Received unexpected event network-vif-plugged-75e552bb-fec2-47bd-adda-d562f27f8a36 for instance with vm_state deleted and task_state None.
Oct 16 11:47:13 user nova-compute[74683]: DEBUG nova.compute.manager [req-a2f78376-f5aa-4a48-a9a3-b0b6fb0c5890 req-7c8d23dc-e3d9-434e-b800-77877cf77f6d service nova] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Received event network-vif-unplugged-75e552bb-fec2-47bd-adda-d562f27f8a36 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:47:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a2f78376-f5aa-4a48-a9a3-b0b6fb0c5890 req-7c8d23dc-e3d9-434e-b800-77877cf77f6d service nova] Acquiring lock "ec2b88a5-6571-4f46-a07d-47ccfc1761e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:47:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a2f78376-f5aa-4a48-a9a3-b0b6fb0c5890 req-7c8d23dc-e3d9-434e-b800-77877cf77f6d service nova] Lock "ec2b88a5-6571-4f46-a07d-47ccfc1761e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:47:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a2f78376-f5aa-4a48-a9a3-b0b6fb0c5890 req-7c8d23dc-e3d9-434e-b800-77877cf77f6d service nova] Lock "ec2b88a5-6571-4f46-a07d-47ccfc1761e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:47:13 user nova-compute[74683]: DEBUG nova.compute.manager [req-a2f78376-f5aa-4a48-a9a3-b0b6fb0c5890 req-7c8d23dc-e3d9-434e-b800-77877cf77f6d service nova] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] No waiting events found dispatching network-vif-unplugged-75e552bb-fec2-47bd-adda-d562f27f8a36 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:47:13 user nova-compute[74683]: WARNING nova.compute.manager [req-a2f78376-f5aa-4a48-a9a3-b0b6fb0c5890 req-7c8d23dc-e3d9-434e-b800-77877cf77f6d service nova] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Received unexpected event network-vif-unplugged-75e552bb-fec2-47bd-adda-d562f27f8a36 for instance with vm_state deleted and task_state None.
Oct 16 11:47:13 user nova-compute[74683]: DEBUG nova.compute.manager [req-a2f78376-f5aa-4a48-a9a3-b0b6fb0c5890 req-7c8d23dc-e3d9-434e-b800-77877cf77f6d service nova] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Received event network-vif-plugged-75e552bb-fec2-47bd-adda-d562f27f8a36 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:47:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a2f78376-f5aa-4a48-a9a3-b0b6fb0c5890 req-7c8d23dc-e3d9-434e-b800-77877cf77f6d service nova] Acquiring lock "ec2b88a5-6571-4f46-a07d-47ccfc1761e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:47:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a2f78376-f5aa-4a48-a9a3-b0b6fb0c5890 req-7c8d23dc-e3d9-434e-b800-77877cf77f6d service nova] Lock "ec2b88a5-6571-4f46-a07d-47ccfc1761e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:47:13 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a2f78376-f5aa-4a48-a9a3-b0b6fb0c5890 req-7c8d23dc-e3d9-434e-b800-77877cf77f6d service nova] Lock "ec2b88a5-6571-4f46-a07d-47ccfc1761e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:47:13 user nova-compute[74683]: DEBUG nova.compute.manager [req-a2f78376-f5aa-4a48-a9a3-b0b6fb0c5890 req-7c8d23dc-e3d9-434e-b800-77877cf77f6d service nova] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] No waiting events found dispatching network-vif-plugged-75e552bb-fec2-47bd-adda-d562f27f8a36 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:47:13 user nova-compute[74683]: WARNING nova.compute.manager [req-a2f78376-f5aa-4a48-a9a3-b0b6fb0c5890 req-7c8d23dc-e3d9-434e-b800-77877cf77f6d service nova] [instance: ec2b88a5-6571-4f46-a07d-47ccfc1761e4] Received unexpected event network-vif-plugged-75e552bb-fec2-47bd-adda-d562f27f8a36 for instance with vm_state deleted and task_state None.
Oct 16 11:47:15 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9bab734e-1cfc-4cac-8566-86c4040905cd tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94 is timed out.
Oct 16 11:47:15 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-9bab734e-1cfc-4cac-8566-86c4040905cd tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Successfully detached device vdb from instance 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94 from the live domain config.
Oct 16 11:47:15 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bab734e-1cfc-4cac-8566-86c4040905cd tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] calling os-brick to detach iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 11:47:15 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bab734e-1cfc-4cac-8566-86c4040905cd tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, {'target_iqn': 'iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wBeciVNH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:47:15 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-9bab734e-1cfc-4cac-8566-86c4040905cd tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:47:15 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-9bab734e-1cfc-4cac-8566-86c4040905cd tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:47:15 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-9bab734e-1cfc-4cac-8566-86c4040905cd tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:47:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:47:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:47:15 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79722df-c97f-4253-8daa-be55a4271049]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:47:15 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bab734e-1cfc-4cac-8566-86c4040905cd tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 11:47:15 user nova-compute[74683]: No targets found.
Oct 16 11:47:15 user nova-compute[74683]: iSNS:
Oct 16 11:47:15 user nova-compute[74683]: No targets found.
Oct 16 11:47:15 user nova-compute[74683]: STATIC:
Oct 16 11:47:15 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba
Oct 16 11:47:15 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:47:15 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:47:15 user nova-compute[74683]: FIRMWARE:
Oct 16 11:47:15 user nova-compute[74683]: No targets found.
Oct 16 11:47:15 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:47:15 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bab734e-1cfc-4cac-8566-86c4040905cd tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 11:47:15 user nova-compute[74683]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 11:47:15 user nova-compute[74683]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74683) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 11:47:15 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bab734e-1cfc-4cac-8566-86c4040905cd tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba', 0)] {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 11:47:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:47:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:47:15 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f94b81-9a58-4491-b4e2-94ca20bbee6b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:47:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:47:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:47:15 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b20b3a-252e-4d27-9923-dd8d859cf135]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:47:15 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bab734e-1cfc-4cac-8566-86c4040905cd tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba (non-flash)
Oct 16 11:47:15 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:47:15 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bab734e-1cfc-4cac-8566-86c4040905cd tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba (non-flash)
Oct 16 11:47:15 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:47:15 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bab734e-1cfc-4cac-8566-86c4040905cd tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda6c2e0700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba'): ({'sdc'}, set())}) {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 11:47:15 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-9bab734e-1cfc-4cac-8566-86c4040905cd tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Removing single pathed devices sdc {{(pid=74683) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 11:47:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:47:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:47:15 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda2013f-d7c6-4516-8acd-9122cc7e0214]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:47:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:47:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:47:15 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0d140b-28ce-4bf3-9669-a1c58e901ae2]: (4, ('ok\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:47:15 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-9bab734e-1cfc-4cac-8566-86c4040905cd tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Flushing IO for device /dev/sdc {{(pid=74683) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 11:47:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:47:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:47:15 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[162770e2-9cd9-44fa-8a20-dee1d0e5fdb1]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:47:15 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-9bab734e-1cfc-4cac-8566-86c4040905cd tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74683) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 11:47:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:47:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:47:15 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1ed85a-2352-46f8-81e9-d2a123853a3e]: (4, ('1', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:47:15 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-9bab734e-1cfc-4cac-8566-86c4040905cd tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 11:47:15 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-9bab734e-1cfc-4cac-8566-86c4040905cd tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] SCSI volumes sdc have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 11:47:15 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bab734e-1cfc-4cac-8566-86c4040905cd tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba')] {{(pid=74683) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 11:47:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:47:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:47:15 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9a9143-1a76-4914-acf8-36679e45bbf1]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:47:15 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bab734e-1cfc-4cac-8566-86c4040905cd tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:47:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba -p 172.16.0.220:3260 --logout {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:47:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:47:15 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1186d6-512c-4f09-ae97-3136d80f4a27]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:47:15 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bab734e-1cfc-4cac-8566-86c4040905cd tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba, portal: 172.16.0.220,3260]
Oct 16 11:47:15 user nova-compute[74683]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba, portal: 172.16.0.220,3260] successful.
Oct 16 11:47:15 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:47:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba -p 172.16.0.220:3260 --op delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:47:15 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19aaf202-f868-4a7f-82a2-01f2a97d93ba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.016s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:47:15 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4be5cf7-be14-4d92-99d3-ec0f042f7bb7]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:47:15 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bab734e-1cfc-4cac-8566-86c4040905cd tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:47:15 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-9bab734e-1cfc-4cac-8566-86c4040905cd tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.269s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:47:15 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bab734e-1cfc-4cac-8566-86c4040905cd tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] <== disconnect_volume: return (271ms) None {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:47:15 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bab734e-1cfc-4cac-8566-86c4040905cd tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Disconnected iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 11:47:16 user nova-compute[74683]: DEBUG nova.objects.instance [None req-9bab734e-1cfc-4cac-8566-86c4040905cd tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Lazy-loading 'flavor' on Instance uuid 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:47:16 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9bab734e-1cfc-4cac-8566-86c4040905cd tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Lock "3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.635s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:47:16 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:47:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:47:21 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-d0c4c1e8-cc09-4285-a696-24e423a2a851 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Acquiring lock "6b413793-f051-432c-83e0-57c3b0cd8fe0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:47:21 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-d0c4c1e8-cc09-4285-a696-24e423a2a851 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "6b413793-f051-432c-83e0-57c3b0cd8fe0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:47:21 user nova-compute[74683]: DEBUG nova.objects.instance [None req-d0c4c1e8-cc09-4285-a696-24e423a2a851 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lazy-loading 'flavor' on Instance uuid 6b413793-f051-432c-83e0-57c3b0cd8fe0 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:47:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-d0c4c1e8-cc09-4285-a696-24e423a2a851 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "6b413793-f051-432c-83e0-57c3b0cd8fe0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:47:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-d0c4c1e8-cc09-4285-a696-24e423a2a851 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Acquiring lock "6b413793-f051-432c-83e0-57c3b0cd8fe0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:47:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-d0c4c1e8-cc09-4285-a696-24e423a2a851 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "6b413793-f051-432c-83e0-57c3b0cd8fe0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:47:22 user nova-compute[74683]: INFO nova.compute.manager [None req-d0c4c1e8-cc09-4285-a696-24e423a2a851 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Attaching volume a9160eef-c687-4d75-a9cb-c577f6e90dfa to /dev/vdb
Oct 16 11:47:22 user nova-compute[74683]: DEBUG os_brick.utils [None req-d0c4c1e8-cc09-4285-a696-24e423a2a851 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:47:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:47:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:47:22 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0fc6b7b-9e65-47d7-99c9-f64f10612f9b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:70b9d336ab7d\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:47:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:47:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:47:22 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[0426a5c6-0c7f-48c7-9465-3b3f3287e674]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:47:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:47:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:47:22 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[421f96c8-f2b5-4251-aa17-6577f97c23ba]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:47:22 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[49fcba28-10a0-46ba-8d97-7c9ef754130f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:47:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-d0c4c1e8-cc09-4285-a696-24e423a2a851 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Running cmd (subprocess): nvme version {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:47:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-d0c4c1e8-cc09-4285-a696-24e423a2a851 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] 'nvme version' failed. Not Retrying. {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:47:22 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d0c4c1e8-cc09-4285-a696-24e423a2a851 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] nvme not present on system {{(pid=74683) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 11:47:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:47:22 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:47:22 user nova-compute[74683]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 11:47:22 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[4abd76d0-f3e0-4dfa-81cd-8ec4ce2c86d0]: (4, '') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:47:22 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-d0c4c1e8-cc09-4285-a696-24e423a2a851 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74683) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 11:47:22 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-d0c4c1e8-cc09-4285-a696-24e423a2a851 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 11:47:22 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-d0c4c1e8-cc09-4285-a696-24e423a2a851 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] LIGHTOS: no hostnqn found. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 11:47:22 user nova-compute[74683]: DEBUG os_brick.utils [None req-d0c4c1e8-cc09-4285-a696-24e423a2a851 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:70b9d336ab7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:47:22 user nova-compute[74683]: DEBUG nova.virt.block_device [None req-d0c4c1e8-cc09-4285-a696-24e423a2a851 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Updating existing volume attachment record: 9ca46c14-389a-42ec-b085-4553b4830125 {{(pid=74683) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 11:47:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:47:27 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:47:29 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:47:30 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:47:31 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:47:31 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:47:31 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Starting heal instance info cache {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 11:47:31 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Rebuilding the list of instances to heal {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 11:47:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "refresh_cache-3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:47:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquired lock "refresh_cache-3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:47:31 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Forcefully refreshing network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 11:47:31 user nova-compute[74683]: DEBUG nova.objects.instance [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lazy-loading 'info_cache' on Instance uuid 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:47:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:47:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:47:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74683) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 11:47:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:47:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:47:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:47:32 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Updating instance_info_cache with network_info: [{"id": "89990cc1-ff0b-45bf-b1e5-b61492762fef", "address": "fa:16:3e:8e:cd:08", "network": {"id": "f778eacd-969f-4106-913e-613bfb09ebfa", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-94933002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05dd191b8dd44be397c64d283cd5d441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89990cc1-ff", "ovs_interfaceid": "89990cc1-ff0b-45bf-b1e5-b61492762fef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:47:32 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Releasing lock "refresh_cache-3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:47:32 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Updated the network info_cache for instance {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 11:47:32 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:47:32 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:47:33 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:47:33 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74683) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 11:47:36 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:47:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:47:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:47:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:47:36 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Auditing locally available compute resources for user (node: user) {{(pid=74683) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 11:47:36 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:47:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:47:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:47:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:47:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:47:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b413793-f051-432c-83e0-57c3b0cd8fe0/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:47:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b413793-f051-432c-83e0-57c3b0cd8fe0/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:47:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b413793-f051-432c-83e0-57c3b0cd8fe0/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:47:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b413793-f051-432c-83e0-57c3b0cd8fe0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:47:37 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:47:37 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:47:37 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Hypervisor/Node resource view: name=user free_ram=8774MB free_disk=25.04993438720703GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74683) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 11:47:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:47:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:47:38 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:47:38 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 6b413793-f051-432c-83e0-57c3b0cd8fe0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:47:38 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 11:47:38 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 11:47:38 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0c4c1e8-cc09-4285-a696-24e423a2a851 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Calling os-brick to attach iSCSI Volume {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 11:47:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c4c1e8-cc09-4285-a696-24e423a2a851 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a9160eef-c687-4d75-a9cb-c577f6e90dfa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QkdGqNBL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:47:38 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-d0c4c1e8-cc09-4285-a696-24e423a2a851 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:47:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-d0c4c1e8-cc09-4285-a696-24e423a2a851 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:47:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-d0c4c1e8-cc09-4285-a696-24e423a2a851 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:47:38 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-d0c4c1e8-cc09-4285-a696-24e423a2a851 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:47:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-d0c4c1e8-cc09-4285-a696-24e423a2a851 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9160eef-c687-4d75-a9cb-c577f6e90dfa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:47:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-d0c4c1e8-cc09-4285-a696-24e423a2a851 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9160eef-c687-4d75-a9cb-c577f6e90dfa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:47:38 user nova-compute[74683]: INFO os_brick.initiator.connectors.iscsi [None req-d0c4c1e8-cc09-4285-a696-24e423a2a851 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 11:47:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9160eef-c687-4d75-a9cb-c577f6e90dfa -p 172.16.0.220:3260 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:47:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9160eef-c687-4d75-a9cb-c577f6e90dfa -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:47:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce3afe7-960f-4e4b-8e02-8afc7e1647d3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:47:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c4c1e8-cc09-4285-a696-24e423a2a851 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 11:47:38 user nova-compute[74683]:  {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:47:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9160eef-c687-4d75-a9cb-c577f6e90dfa -p 172.16.0.220:3260 --interface default --op new {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:47:38 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:47:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9160eef-c687-4d75-a9cb-c577f6e90dfa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:47:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc23c4bc-94e2-4b56-90ad-c0e0d86766e3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9160eef-c687-4d75-a9cb-c577f6e90dfa] added\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:47:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c4c1e8-cc09-4285-a696-24e423a2a851 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9160eef-c687-4d75-a9cb-c577f6e90dfa] added
Oct 16 11:47:38 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:47:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9160eef-c687-4d75-a9cb-c577f6e90dfa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:47:38 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:47:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9160eef-c687-4d75-a9cb-c577f6e90dfa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:47:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[904c81a8-89db-447d-96d2-1049d55f7f8e]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:47:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c4c1e8-cc09-4285-a696-24e423a2a851 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:47:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9160eef-c687-4d75-a9cb-c577f6e90dfa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:47:38 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Compute_service record updated for user:user {{(pid=74683) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 11:47:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.235s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:47:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9160eef-c687-4d75-a9cb-c577f6e90dfa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:47:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f568475f-e7da-405d-8da8-a48c6108009f]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:47:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c4c1e8-cc09-4285-a696-24e423a2a851 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:47:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9160eef-c687-4d75-a9cb-c577f6e90dfa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QkdGqNBL {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:47:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9160eef-c687-4d75-a9cb-c577f6e90dfa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QkdGqNBL" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:47:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70f73f3-0b17-4148-8922-037b71949c86]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:47:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c4c1e8-cc09-4285-a696-24e423a2a851 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QkdGqNBL'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:47:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9160eef-c687-4d75-a9cb-c577f6e90dfa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:47:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9160eef-c687-4d75-a9cb-c577f6e90dfa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:47:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[804f68a7-2cbb-4ac0-976b-e0b0e9378d3b]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:47:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c4c1e8-cc09-4285-a696-24e423a2a851 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:47:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:47:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:47:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b39564-a897-4ec3-84d8-08ccab110aa1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:47:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c4c1e8-cc09-4285-a696-24e423a2a851 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 16 11:47:38 user nova-compute[74683]:  {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:47:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c4c1e8-cc09-4285-a696-24e423a2a851 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 16 11:47:38 user nova-compute[74683]:  {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:47:38 user nova-compute[74683]: WARNING os_brick.initiator.connectors.iscsi [None req-d0c4c1e8-cc09-4285-a696-24e423a2a851 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 16 11:47:38 user nova-compute[74683]: 
Oct 16 11:47:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9160eef-c687-4d75-a9cb-c577f6e90dfa -p 172.16.0.220:3260 --login {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:47:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9160eef-c687-4d75-a9cb-c577f6e90dfa -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:47:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec10ff3-25fe-4ab3-8423-5243cacd7fcd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9160eef-c687-4d75-a9cb-c577f6e90dfa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a9160eef-c687-4d75-a9cb-c577f6e90dfa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:47:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c4c1e8-cc09-4285-a696-24e423a2a851 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9160eef-c687-4d75-a9cb-c577f6e90dfa, portal: 172.16.0.220,3260]
Oct 16 11:47:38 user nova-compute[74683]: Login to [iface: default, target: iqn.2010-10.org.openstack:a9160eef-c687-4d75-a9cb-c577f6e90dfa, portal: 172.16.0.220,3260] successful.
Oct 16 11:47:38 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:47:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9160eef-c687-4d75-a9cb-c577f6e90dfa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:47:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9160eef-c687-4d75-a9cb-c577f6e90dfa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:47:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a1d3ac-82ec-4685-bb53-b0247bf8887d]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:47:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c4c1e8-cc09-4285-a696-24e423a2a851 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:47:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:47:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:47:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f08139-e1d9-4972-b4fc-419cf920ef26]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9160eef-c687-4d75-a9cb-c577f6e90dfa (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:47:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c4c1e8-cc09-4285-a696-24e423a2a851 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9160eef-c687-4d75-a9cb-c577f6e90dfa (non-flash)
Oct 16 11:47:38 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:47:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c4c1e8-cc09-4285-a696-24e423a2a851 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9160eef-c687-4d75-a9cb-c577f6e90dfa (non-flash)
Oct 16 11:47:38 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:47:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-d0c4c1e8-cc09-4285-a696-24e423a2a851 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9160eef-c687-4d75-a9cb-c577f6e90dfa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.249s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:47:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c4c1e8-cc09-4285-a696-24e423a2a851 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Connected to 172.16.0.220:3260 {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 11:47:38 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-d0c4c1e8-cc09-4285-a696-24e423a2a851 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=74683) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 11:47:38 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-d0c4c1e8-cc09-4285-a696-24e423a2a851 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74683) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 11:47:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:47:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:47:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a4d805-66f2-4c2f-89de-2dec7991867d]: (4, ('- - 0', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:47:38 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-d0c4c1e8-cc09-4285-a696-24e423a2a851 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:47:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c4c1e8-cc09-4285-a696-24e423a2a851 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a9160eef-c687-4d75-a9cb-c577f6e90dfa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QkdGqNBL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 11:47:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-d0c4c1e8-cc09-4285-a696-24e423a2a851 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.277s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:47:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c4c1e8-cc09-4285-a696-24e423a2a851 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] <== connect_volume: return (1279ms) {'type': 'block', 'scsi_wwn': '26463613034376561', 'path': '/dev/sdb'} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:47:39 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0c4c1e8-cc09-4285-a696-24e423a2a851 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463613034376561', 'path': '/dev/sdb'} {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 11:47:39 user nova-compute[74683]: DEBUG nova.objects.instance [None req-d0c4c1e8-cc09-4285-a696-24e423a2a851 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lazy-loading 'flavor' on Instance uuid 6b413793-f051-432c-83e0-57c3b0cd8fe0 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:47:39 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-d0c4c1e8-cc09-4285-a696-24e423a2a851 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 11:47:39 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:47:39 user nova-compute[74683]:   <source dev="/dev/sdb"/>
Oct 16 11:47:39 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:47:39 user nova-compute[74683]:   <serial>a9160eef-c687-4d75-a9cb-c577f6e90dfa</serial>
Oct 16 11:47:39 user nova-compute[74683]: </disk>
Oct 16 11:47:39 user nova-compute[74683]:  {{(pid=74683) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 11:47:39 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-d0c4c1e8-cc09-4285-a696-24e423a2a851 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:47:39 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-d0c4c1e8-cc09-4285-a696-24e423a2a851 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:47:39 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-d0c4c1e8-cc09-4285-a696-24e423a2a851 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] No VIF found with MAC fa:16:3e:82:8e:5d, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:47:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-d0c4c1e8-cc09-4285-a696-24e423a2a851 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "6b413793-f051-432c-83e0-57c3b0cd8fe0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.873s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:47:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:47:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:47:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74683) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 11:47:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:47:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:47:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:47:42 user nova-compute[74683]: DEBUG nova.compute.manager [req-d62fe291-228a-4baf-a1d5-641a8e2daff9 req-91fe764c-b9af-4d3f-8413-b73f8f0357ae service nova] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Received event network-changed-b704ce74-3ed5-4f87-9cc8-a2e79c5f2686 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:47:42 user nova-compute[74683]: DEBUG nova.compute.manager [req-d62fe291-228a-4baf-a1d5-641a8e2daff9 req-91fe764c-b9af-4d3f-8413-b73f8f0357ae service nova] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Refreshing instance network info cache due to event network-changed-b704ce74-3ed5-4f87-9cc8-a2e79c5f2686. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:47:42 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-d62fe291-228a-4baf-a1d5-641a8e2daff9 req-91fe764c-b9af-4d3f-8413-b73f8f0357ae service nova] Acquiring lock "refresh_cache-6b413793-f051-432c-83e0-57c3b0cd8fe0" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:47:42 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-d62fe291-228a-4baf-a1d5-641a8e2daff9 req-91fe764c-b9af-4d3f-8413-b73f8f0357ae service nova] Acquired lock "refresh_cache-6b413793-f051-432c-83e0-57c3b0cd8fe0" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:47:42 user nova-compute[74683]: DEBUG nova.network.neutron [req-d62fe291-228a-4baf-a1d5-641a8e2daff9 req-91fe764c-b9af-4d3f-8413-b73f8f0357ae service nova] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Refreshing network info cache for port b704ce74-3ed5-4f87-9cc8-a2e79c5f2686 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:47:42 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:47:42 user nova-compute[74683]: DEBUG nova.network.neutron [req-d62fe291-228a-4baf-a1d5-641a8e2daff9 req-91fe764c-b9af-4d3f-8413-b73f8f0357ae service nova] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Updated VIF entry in instance network info cache for port b704ce74-3ed5-4f87-9cc8-a2e79c5f2686. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:47:42 user nova-compute[74683]: DEBUG nova.network.neutron [req-d62fe291-228a-4baf-a1d5-641a8e2daff9 req-91fe764c-b9af-4d3f-8413-b73f8f0357ae service nova] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Updating instance_info_cache with network_info: [{"id": "b704ce74-3ed5-4f87-9cc8-a2e79c5f2686", "address": "fa:16:3e:82:8e:5d", "network": {"id": "1fa0852d-814a-45ef-80fa-171693e4d02a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-184537544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ce607a3614fc493d33e6ba8ca5807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb704ce74-3e", "ovs_interfaceid": "b704ce74-3ed5-4f87-9cc8-a2e79c5f2686", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:47:42 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-d62fe291-228a-4baf-a1d5-641a8e2daff9 req-91fe764c-b9af-4d3f-8413-b73f8f0357ae service nova] Releasing lock "refresh_cache-6b413793-f051-432c-83e0-57c3b0cd8fe0" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:47:44 user nova-compute[74683]: DEBUG nova.compute.manager [req-1f8e052e-6a7f-4b84-8598-f44961ce18c7 req-74789666-44eb-4621-be8e-ba6907cf3401 service nova] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Received event network-changed-b704ce74-3ed5-4f87-9cc8-a2e79c5f2686 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:47:44 user nova-compute[74683]: DEBUG nova.compute.manager [req-1f8e052e-6a7f-4b84-8598-f44961ce18c7 req-74789666-44eb-4621-be8e-ba6907cf3401 service nova] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Refreshing instance network info cache due to event network-changed-b704ce74-3ed5-4f87-9cc8-a2e79c5f2686. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:47:44 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-1f8e052e-6a7f-4b84-8598-f44961ce18c7 req-74789666-44eb-4621-be8e-ba6907cf3401 service nova] Acquiring lock "refresh_cache-6b413793-f051-432c-83e0-57c3b0cd8fe0" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:47:44 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-1f8e052e-6a7f-4b84-8598-f44961ce18c7 req-74789666-44eb-4621-be8e-ba6907cf3401 service nova] Acquired lock "refresh_cache-6b413793-f051-432c-83e0-57c3b0cd8fe0" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:47:44 user nova-compute[74683]: DEBUG nova.network.neutron [req-1f8e052e-6a7f-4b84-8598-f44961ce18c7 req-74789666-44eb-4621-be8e-ba6907cf3401 service nova] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Refreshing network info cache for port b704ce74-3ed5-4f87-9cc8-a2e79c5f2686 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:47:44 user nova-compute[74683]: DEBUG nova.network.neutron [req-1f8e052e-6a7f-4b84-8598-f44961ce18c7 req-74789666-44eb-4621-be8e-ba6907cf3401 service nova] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Updated VIF entry in instance network info cache for port b704ce74-3ed5-4f87-9cc8-a2e79c5f2686. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:47:44 user nova-compute[74683]: DEBUG nova.network.neutron [req-1f8e052e-6a7f-4b84-8598-f44961ce18c7 req-74789666-44eb-4621-be8e-ba6907cf3401 service nova] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Updating instance_info_cache with network_info: [{"id": "b704ce74-3ed5-4f87-9cc8-a2e79c5f2686", "address": "fa:16:3e:82:8e:5d", "network": {"id": "1fa0852d-814a-45ef-80fa-171693e4d02a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-184537544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ce607a3614fc493d33e6ba8ca5807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb704ce74-3e", "ovs_interfaceid": "b704ce74-3ed5-4f87-9cc8-a2e79c5f2686", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:47:44 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-1f8e052e-6a7f-4b84-8598-f44961ce18c7 req-74789666-44eb-4621-be8e-ba6907cf3401 service nova] Releasing lock "refresh_cache-6b413793-f051-432c-83e0-57c3b0cd8fe0" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:47:44 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-acb88dfa-cd34-4f3b-afd0-8ece4bc04fd0 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Acquiring lock "6b413793-f051-432c-83e0-57c3b0cd8fe0" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:47:44 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-acb88dfa-cd34-4f3b-afd0-8ece4bc04fd0 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "6b413793-f051-432c-83e0-57c3b0cd8fe0" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:47:44 user nova-compute[74683]: INFO nova.compute.manager [None req-acb88dfa-cd34-4f3b-afd0-8ece4bc04fd0 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Rebooting instance
Oct 16 11:47:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-acb88dfa-cd34-4f3b-afd0-8ece4bc04fd0 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Acquiring lock "refresh_cache-6b413793-f051-432c-83e0-57c3b0cd8fe0" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:47:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-acb88dfa-cd34-4f3b-afd0-8ece4bc04fd0 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Acquired lock "refresh_cache-6b413793-f051-432c-83e0-57c3b0cd8fe0" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:47:45 user nova-compute[74683]: DEBUG nova.network.neutron [None req-acb88dfa-cd34-4f3b-afd0-8ece4bc04fd0 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:47:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-cc2e75b4-0857-4486-b6bd-4b63f8a44381 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Acquiring lock "3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:47:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-cc2e75b4-0857-4486-b6bd-4b63f8a44381 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Lock "3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:47:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-cc2e75b4-0857-4486-b6bd-4b63f8a44381 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Acquiring lock "3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:47:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-cc2e75b4-0857-4486-b6bd-4b63f8a44381 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Lock "3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:47:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-cc2e75b4-0857-4486-b6bd-4b63f8a44381 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Lock "3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:47:45 user nova-compute[74683]: INFO nova.compute.manager [None req-cc2e75b4-0857-4486-b6bd-4b63f8a44381 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Terminating instance
Oct 16 11:47:45 user nova-compute[74683]: DEBUG nova.compute.manager [None req-cc2e75b4-0857-4486-b6bd-4b63f8a44381 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Start destroying the instance on the hypervisor. {{(pid=74683) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 11:47:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:47:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:47:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:47:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:47:45 user nova-compute[74683]: DEBUG nova.network.neutron [None req-acb88dfa-cd34-4f3b-afd0-8ece4bc04fd0 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Updating instance_info_cache with network_info: [{"id": "b704ce74-3ed5-4f87-9cc8-a2e79c5f2686", "address": "fa:16:3e:82:8e:5d", "network": {"id": "1fa0852d-814a-45ef-80fa-171693e4d02a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-184537544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ce607a3614fc493d33e6ba8ca5807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb704ce74-3e", "ovs_interfaceid": "b704ce74-3ed5-4f87-9cc8-a2e79c5f2686", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:47:45 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-acb88dfa-cd34-4f3b-afd0-8ece4bc04fd0 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Releasing lock "refresh_cache-6b413793-f051-432c-83e0-57c3b0cd8fe0" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:47:45 user nova-compute[74683]: DEBUG nova.compute.manager [None req-acb88dfa-cd34-4f3b-afd0-8ece4bc04fd0 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:47:45 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Instance destroyed successfully.
Oct 16 11:47:45 user nova-compute[74683]: DEBUG nova.objects.instance [None req-cc2e75b4-0857-4486-b6bd-4b63f8a44381 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Lazy-loading 'resources' on Instance uuid 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:47:45 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-cc2e75b4-0857-4486-b6bd-4b63f8a44381 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:43:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-108034303',display_name='tempest-TestServerVolumeAttachmentScenario-server-108034303',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-108034303',id=47,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKg3PS17S/fJhgw4qUzmaKPMFx+xynYj3r6oNKDPVxa3pduB1I9bix5ZhH26j8N9SFpT0KXzaGPF0mnrBQ/UscE7IPlTPb7/Si8tF1COD8ki8dpoFg9yfFkg2cxlEM95gQ==',key_name='tempest-keypair-323076518',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:43:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='05dd191b8dd44be397c64d283cd5d441',ramdisk_id='',reservation_id='r-qblqy7e5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1231121602',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1231121602-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:43:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8c416a490ca45d7946ae9fdd7f4896a',uuid=3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89990cc1-ff0b-45bf-b1e5-b61492762fef", "address": "fa:16:3e:8e:cd:08", "network": {"id": "f778eacd-969f-4106-913e-613bfb09ebfa", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-94933002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05dd191b8dd44be397c64d283cd5d441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89990cc1-ff", "ovs_interfaceid": "89990cc1-ff0b-45bf-b1e5-b61492762fef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:47:45 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-cc2e75b4-0857-4486-b6bd-4b63f8a44381 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Converting VIF {"id": "89990cc1-ff0b-45bf-b1e5-b61492762fef", "address": "fa:16:3e:8e:cd:08", "network": {"id": "f778eacd-969f-4106-913e-613bfb09ebfa", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-94933002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05dd191b8dd44be397c64d283cd5d441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89990cc1-ff", "ovs_interfaceid": "89990cc1-ff0b-45bf-b1e5-b61492762fef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:47:45 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-cc2e75b4-0857-4486-b6bd-4b63f8a44381 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:cd:08,bridge_name='br-int',has_traffic_filtering=True,id=89990cc1-ff0b-45bf-b1e5-b61492762fef,network=Network(f778eacd-969f-4106-913e-613bfb09ebfa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89990cc1-ff') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:47:45 user nova-compute[74683]: DEBUG os_vif [None req-cc2e75b4-0857-4486-b6bd-4b63f8a44381 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:cd:08,bridge_name='br-int',has_traffic_filtering=True,id=89990cc1-ff0b-45bf-b1e5-b61492762fef,network=Network(f778eacd-969f-4106-913e-613bfb09ebfa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89990cc1-ff') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:47:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:47:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap89990cc1-ff, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:47:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:47:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:47:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:47:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3e33a92e-2d20-4770-9160-7e1e16b30d8f) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:47:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:47:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:47:45 user nova-compute[74683]: INFO os_vif [None req-cc2e75b4-0857-4486-b6bd-4b63f8a44381 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:cd:08,bridge_name='br-int',has_traffic_filtering=True,id=89990cc1-ff0b-45bf-b1e5-b61492762fef,network=Network(f778eacd-969f-4106-913e-613bfb09ebfa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89990cc1-ff')
Oct 16 11:47:45 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-cc2e75b4-0857-4486-b6bd-4b63f8a44381 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Deleting instance files /opt/stack/data/nova/instances/3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94_del
Oct 16 11:47:45 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-cc2e75b4-0857-4486-b6bd-4b63f8a44381 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Deletion of /opt/stack/data/nova/instances/3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94_del complete
Oct 16 11:47:45 user nova-compute[74683]: INFO nova.compute.manager [None req-cc2e75b4-0857-4486-b6bd-4b63f8a44381 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Took 0.89 seconds to destroy the instance on the hypervisor.
Oct 16 11:47:45 user nova-compute[74683]: DEBUG oslo.service.loopingcall [None req-cc2e75b4-0857-4486-b6bd-4b63f8a44381 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74683) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 11:47:45 user nova-compute[74683]: DEBUG nova.compute.manager [-] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Deallocating network for instance {{(pid=74683) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 11:47:45 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] deallocate_for_instance() {{(pid=74683) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 11:47:46 user nova-compute[74683]: DEBUG nova.compute.manager [req-985b5143-e7ab-4ae1-a6f4-a6c8bc6d7627 req-26bf51e9-427f-47bd-865c-9d050227e9b2 service nova] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Received event network-vif-unplugged-89990cc1-ff0b-45bf-b1e5-b61492762fef {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:47:46 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-985b5143-e7ab-4ae1-a6f4-a6c8bc6d7627 req-26bf51e9-427f-47bd-865c-9d050227e9b2 service nova] Acquiring lock "3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:47:46 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-985b5143-e7ab-4ae1-a6f4-a6c8bc6d7627 req-26bf51e9-427f-47bd-865c-9d050227e9b2 service nova] Lock "3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:47:46 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-985b5143-e7ab-4ae1-a6f4-a6c8bc6d7627 req-26bf51e9-427f-47bd-865c-9d050227e9b2 service nova] Lock "3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:47:46 user nova-compute[74683]: DEBUG nova.compute.manager [req-985b5143-e7ab-4ae1-a6f4-a6c8bc6d7627 req-26bf51e9-427f-47bd-865c-9d050227e9b2 service nova] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] No waiting events found dispatching network-vif-unplugged-89990cc1-ff0b-45bf-b1e5-b61492762fef {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:47:46 user nova-compute[74683]: DEBUG nova.compute.manager [req-985b5143-e7ab-4ae1-a6f4-a6c8bc6d7627 req-26bf51e9-427f-47bd-865c-9d050227e9b2 service nova] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Received event network-vif-unplugged-89990cc1-ff0b-45bf-b1e5-b61492762fef for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 11:47:46 user nova-compute[74683]: DEBUG nova.compute.manager [req-985b5143-e7ab-4ae1-a6f4-a6c8bc6d7627 req-26bf51e9-427f-47bd-865c-9d050227e9b2 service nova] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Received event network-vif-plugged-89990cc1-ff0b-45bf-b1e5-b61492762fef {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:47:46 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-985b5143-e7ab-4ae1-a6f4-a6c8bc6d7627 req-26bf51e9-427f-47bd-865c-9d050227e9b2 service nova] Acquiring lock "3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:47:46 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-985b5143-e7ab-4ae1-a6f4-a6c8bc6d7627 req-26bf51e9-427f-47bd-865c-9d050227e9b2 service nova] Lock "3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:47:46 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-985b5143-e7ab-4ae1-a6f4-a6c8bc6d7627 req-26bf51e9-427f-47bd-865c-9d050227e9b2 service nova] Lock "3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:47:46 user nova-compute[74683]: DEBUG nova.compute.manager [req-985b5143-e7ab-4ae1-a6f4-a6c8bc6d7627 req-26bf51e9-427f-47bd-865c-9d050227e9b2 service nova] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] No waiting events found dispatching network-vif-plugged-89990cc1-ff0b-45bf-b1e5-b61492762fef {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:47:46 user nova-compute[74683]: WARNING nova.compute.manager [req-985b5143-e7ab-4ae1-a6f4-a6c8bc6d7627 req-26bf51e9-427f-47bd-865c-9d050227e9b2 service nova] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Received unexpected event network-vif-plugged-89990cc1-ff0b-45bf-b1e5-b61492762fef for instance with vm_state active and task_state deleting.
Oct 16 11:47:46 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:47:46 user nova-compute[74683]: INFO nova.compute.manager [-] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Took 0.94 seconds to deallocate network for instance.
Oct 16 11:47:46 user nova-compute[74683]: DEBUG nova.compute.manager [req-ec2e0985-04eb-47b5-9901-c1ebd8539ed3 req-f652efdd-f7d6-4ef3-97b4-0f9b15863725 service nova] [instance: 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94] Received event network-vif-deleted-89990cc1-ff0b-45bf-b1e5-b61492762fef {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:47:46 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-cc2e75b4-0857-4486-b6bd-4b63f8a44381 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:47:46 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-cc2e75b4-0857-4486-b6bd-4b63f8a44381 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:47:47 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-cc2e75b4-0857-4486-b6bd-4b63f8a44381 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:47:47 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-cc2e75b4-0857-4486-b6bd-4b63f8a44381 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:47:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-cc2e75b4-0857-4486-b6bd-4b63f8a44381 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.182s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:47:47 user nova-compute[74683]: INFO nova.scheduler.client.report [None req-cc2e75b4-0857-4486-b6bd-4b63f8a44381 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Deleted allocations for instance 3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94
Oct 16 11:47:47 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-cc2e75b4-0857-4486-b6bd-4b63f8a44381 tempest-TestServerVolumeAttachmentScenario-1231121602 tempest-TestServerVolumeAttachmentScenario-1231121602-project-member] Lock "3ec5a0ec-8ae3-4ec4-ace3-5e9581071b94" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.274s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:47:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:47:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:47:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:47:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:47:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:47:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:47:48 user nova-compute[74683]: DEBUG nova.compute.manager [req-1c00764d-1851-40b7-9f05-6e40606c7ec9 req-7536fc9a-576a-4706-a54f-a5bc5784ca57 service nova] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Received event network-vif-unplugged-b704ce74-3ed5-4f87-9cc8-a2e79c5f2686 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:47:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-1c00764d-1851-40b7-9f05-6e40606c7ec9 req-7536fc9a-576a-4706-a54f-a5bc5784ca57 service nova] Acquiring lock "6b413793-f051-432c-83e0-57c3b0cd8fe0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:47:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-1c00764d-1851-40b7-9f05-6e40606c7ec9 req-7536fc9a-576a-4706-a54f-a5bc5784ca57 service nova] Lock "6b413793-f051-432c-83e0-57c3b0cd8fe0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:47:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-1c00764d-1851-40b7-9f05-6e40606c7ec9 req-7536fc9a-576a-4706-a54f-a5bc5784ca57 service nova] Lock "6b413793-f051-432c-83e0-57c3b0cd8fe0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:47:48 user nova-compute[74683]: DEBUG nova.compute.manager [req-1c00764d-1851-40b7-9f05-6e40606c7ec9 req-7536fc9a-576a-4706-a54f-a5bc5784ca57 service nova] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] No waiting events found dispatching network-vif-unplugged-b704ce74-3ed5-4f87-9cc8-a2e79c5f2686 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:47:48 user nova-compute[74683]: WARNING nova.compute.manager [req-1c00764d-1851-40b7-9f05-6e40606c7ec9 req-7536fc9a-576a-4706-a54f-a5bc5784ca57 service nova] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Received unexpected event network-vif-unplugged-b704ce74-3ed5-4f87-9cc8-a2e79c5f2686 for instance with vm_state active and task_state reboot_started.
Oct 16 11:47:48 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-acb88dfa-cd34-4f3b-afd0-8ece4bc04fd0 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Instance shutdown successfully.
Oct 16 11:47:49 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:47:49 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:47:49 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:47:49 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:47:50 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:47:50 user nova-compute[74683]: DEBUG nova.compute.manager [req-a938e987-ab79-499e-b814-b25e5801b358 req-92c86d3e-eac9-408d-9698-6f573fbff799 service nova] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Received event network-vif-plugged-b704ce74-3ed5-4f87-9cc8-a2e79c5f2686 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:47:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a938e987-ab79-499e-b814-b25e5801b358 req-92c86d3e-eac9-408d-9698-6f573fbff799 service nova] Acquiring lock "6b413793-f051-432c-83e0-57c3b0cd8fe0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:47:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a938e987-ab79-499e-b814-b25e5801b358 req-92c86d3e-eac9-408d-9698-6f573fbff799 service nova] Lock "6b413793-f051-432c-83e0-57c3b0cd8fe0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:47:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a938e987-ab79-499e-b814-b25e5801b358 req-92c86d3e-eac9-408d-9698-6f573fbff799 service nova] Lock "6b413793-f051-432c-83e0-57c3b0cd8fe0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:47:50 user nova-compute[74683]: DEBUG nova.compute.manager [req-a938e987-ab79-499e-b814-b25e5801b358 req-92c86d3e-eac9-408d-9698-6f573fbff799 service nova] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] No waiting events found dispatching network-vif-plugged-b704ce74-3ed5-4f87-9cc8-a2e79c5f2686 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:47:50 user nova-compute[74683]: WARNING nova.compute.manager [req-a938e987-ab79-499e-b814-b25e5801b358 req-92c86d3e-eac9-408d-9698-6f573fbff799 service nova] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Received unexpected event network-vif-plugged-b704ce74-3ed5-4f87-9cc8-a2e79c5f2686 for instance with vm_state active and task_state reboot_started.
Oct 16 11:47:50 user nova-compute[74683]: DEBUG nova.compute.manager [req-a938e987-ab79-499e-b814-b25e5801b358 req-92c86d3e-eac9-408d-9698-6f573fbff799 service nova] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Received event network-vif-plugged-b704ce74-3ed5-4f87-9cc8-a2e79c5f2686 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:47:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a938e987-ab79-499e-b814-b25e5801b358 req-92c86d3e-eac9-408d-9698-6f573fbff799 service nova] Acquiring lock "6b413793-f051-432c-83e0-57c3b0cd8fe0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:47:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a938e987-ab79-499e-b814-b25e5801b358 req-92c86d3e-eac9-408d-9698-6f573fbff799 service nova] Lock "6b413793-f051-432c-83e0-57c3b0cd8fe0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:47:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a938e987-ab79-499e-b814-b25e5801b358 req-92c86d3e-eac9-408d-9698-6f573fbff799 service nova] Lock "6b413793-f051-432c-83e0-57c3b0cd8fe0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:47:50 user nova-compute[74683]: DEBUG nova.compute.manager [req-a938e987-ab79-499e-b814-b25e5801b358 req-92c86d3e-eac9-408d-9698-6f573fbff799 service nova] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] No waiting events found dispatching network-vif-plugged-b704ce74-3ed5-4f87-9cc8-a2e79c5f2686 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:47:50 user nova-compute[74683]: WARNING nova.compute.manager [req-a938e987-ab79-499e-b814-b25e5801b358 req-92c86d3e-eac9-408d-9698-6f573fbff799 service nova] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Received unexpected event network-vif-plugged-b704ce74-3ed5-4f87-9cc8-a2e79c5f2686 for instance with vm_state active and task_state reboot_started.
Oct 16 11:47:50 user nova-compute[74683]: DEBUG nova.compute.manager [req-a938e987-ab79-499e-b814-b25e5801b358 req-92c86d3e-eac9-408d-9698-6f573fbff799 service nova] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Received event network-vif-plugged-b704ce74-3ed5-4f87-9cc8-a2e79c5f2686 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:47:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a938e987-ab79-499e-b814-b25e5801b358 req-92c86d3e-eac9-408d-9698-6f573fbff799 service nova] Acquiring lock "6b413793-f051-432c-83e0-57c3b0cd8fe0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:47:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a938e987-ab79-499e-b814-b25e5801b358 req-92c86d3e-eac9-408d-9698-6f573fbff799 service nova] Lock "6b413793-f051-432c-83e0-57c3b0cd8fe0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:47:50 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a938e987-ab79-499e-b814-b25e5801b358 req-92c86d3e-eac9-408d-9698-6f573fbff799 service nova] Lock "6b413793-f051-432c-83e0-57c3b0cd8fe0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:47:50 user nova-compute[74683]: DEBUG nova.compute.manager [req-a938e987-ab79-499e-b814-b25e5801b358 req-92c86d3e-eac9-408d-9698-6f573fbff799 service nova] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] No waiting events found dispatching network-vif-plugged-b704ce74-3ed5-4f87-9cc8-a2e79c5f2686 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:47:50 user nova-compute[74683]: WARNING nova.compute.manager [req-a938e987-ab79-499e-b814-b25e5801b358 req-92c86d3e-eac9-408d-9698-6f573fbff799 service nova] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Received unexpected event network-vif-plugged-b704ce74-3ed5-4f87-9cc8-a2e79c5f2686 for instance with vm_state active and task_state reboot_started.
Oct 16 11:47:50 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:47:50 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:47:50 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:47:50 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:47:52 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Instance running successfully.
Oct 16 11:47:52 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-acb88dfa-cd34-4f3b-afd0-8ece4bc04fd0 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Instance soft rebooted successfully.
Oct 16 11:47:52 user nova-compute[74683]: DEBUG nova.compute.manager [None req-acb88dfa-cd34-4f3b-afd0-8ece4bc04fd0 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:47:52 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-acb88dfa-cd34-4f3b-afd0-8ece4bc04fd0 tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "6b413793-f051-432c-83e0-57c3b0cd8fe0" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.403s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:47:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:47:55 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:47:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:48:00 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:48:05 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Acquiring lock "4411a1a8-cd51-46b3-9f99-46670bb7e72e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:48:05 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "4411a1a8-cd51-46b3-9f99-46670bb7e72e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:48:05 user nova-compute[74683]: DEBUG nova.compute.manager [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Starting instance... {{(pid=74683) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 11:48:05 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:48:05 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:48:05 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74683) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 11:48:05 user nova-compute[74683]: INFO nova.compute.claims [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Claim successful on node user
Oct 16 11:48:05 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:48:05 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:48:05 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.229s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:48:05 user nova-compute[74683]: DEBUG nova.compute.manager [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Start building networks asynchronously for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 11:48:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:48:05 user nova-compute[74683]: DEBUG nova.compute.manager [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Allocating IP information in the background. {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 11:48:05 user nova-compute[74683]: DEBUG nova.network.neutron [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] allocate_for_instance() {{(pid=74683) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 11:48:05 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 11:48:05 user nova-compute[74683]: DEBUG nova.compute.manager [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Start building block device mappings for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 11:48:06 user nova-compute[74683]: DEBUG nova.policy [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '11130271beb44b368f9eb55bd4946cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622d2c7c33914a068b448c447db50b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74683) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 11:48:06 user nova-compute[74683]: DEBUG nova.compute.manager [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Start spawning the instance on the hypervisor. {{(pid=74683) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 11:48:06 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Creating instance directory {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 11:48:06 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Creating image(s)
Oct 16 11:48:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Acquiring lock "/opt/stack/data/nova/instances/4411a1a8-cd51-46b3-9f99-46670bb7e72e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:48:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "/opt/stack/data/nova/instances/4411a1a8-cd51-46b3-9f99-46670bb7e72e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:48:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "/opt/stack/data/nova/instances/4411a1a8-cd51-46b3-9f99-46670bb7e72e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:48:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:48:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.179s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:48:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Acquiring lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:48:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:48:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:48:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.203s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:48:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/4411a1a8-cd51-46b3-9f99-46670bb7e72e/disk 1073741824 {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:48:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/4411a1a8-cd51-46b3-9f99-46670bb7e72e/disk 1073741824" returned: 0 in 0.069s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:48:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:48:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:48:06 user nova-compute[74683]: DEBUG nova.network.neutron [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Successfully created port: d82b8aef-5586-4582-9253-b964d495ce17 {{(pid=74683) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 11:48:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.265s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:48:06 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4411a1a8-cd51-46b3-9f99-46670bb7e72e/disk. size=1073741824 {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 11:48:06 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4411a1a8-cd51-46b3-9f99-46670bb7e72e/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:48:07 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4411a1a8-cd51-46b3-9f99-46670bb7e72e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:48:07 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Cannot resize image /opt/stack/data/nova/instances/4411a1a8-cd51-46b3-9f99-46670bb7e72e/disk to a smaller size. {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 11:48:07 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Created local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 11:48:07 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Ensure instance console log exists: /opt/stack/data/nova/instances/4411a1a8-cd51-46b3-9f99-46670bb7e72e/console.log {{(pid=74683) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 11:48:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:48:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:48:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:48:07 user nova-compute[74683]: DEBUG nova.network.neutron [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Successfully updated port: d82b8aef-5586-4582-9253-b964d495ce17 {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:48:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Acquiring lock "refresh_cache-4411a1a8-cd51-46b3-9f99-46670bb7e72e" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:48:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Acquired lock "refresh_cache-4411a1a8-cd51-46b3-9f99-46670bb7e72e" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:48:07 user nova-compute[74683]: DEBUG nova.network.neutron [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:48:07 user nova-compute[74683]: DEBUG nova.compute.manager [req-28b35fc3-0bb0-42f6-b09f-a64ff3293a92 req-ce851c9f-9bfc-4bb5-882a-fefaab74ea59 service nova] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Received event network-changed-d82b8aef-5586-4582-9253-b964d495ce17 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:48:07 user nova-compute[74683]: DEBUG nova.compute.manager [req-28b35fc3-0bb0-42f6-b09f-a64ff3293a92 req-ce851c9f-9bfc-4bb5-882a-fefaab74ea59 service nova] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Refreshing instance network info cache due to event network-changed-d82b8aef-5586-4582-9253-b964d495ce17. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:48:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-28b35fc3-0bb0-42f6-b09f-a64ff3293a92 req-ce851c9f-9bfc-4bb5-882a-fefaab74ea59 service nova] Acquiring lock "refresh_cache-4411a1a8-cd51-46b3-9f99-46670bb7e72e" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:48:07 user nova-compute[74683]: DEBUG nova.network.neutron [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:48:07 user nova-compute[74683]: DEBUG nova.network.neutron [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Updating instance_info_cache with network_info: [{"id": "d82b8aef-5586-4582-9253-b964d495ce17", "address": "fa:16:3e:05:e7:3e", "network": {"id": "2ea750a5-8511-4e40-b149-062e10e0096c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-563467594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d2c7c33914a068b448c447db50b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd82b8aef-55", "ovs_interfaceid": "d82b8aef-5586-4582-9253-b964d495ce17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:48:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Releasing lock "refresh_cache-4411a1a8-cd51-46b3-9f99-46670bb7e72e" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:48:07 user nova-compute[74683]: DEBUG nova.compute.manager [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Instance network_info: |[{"id": "d82b8aef-5586-4582-9253-b964d495ce17", "address": "fa:16:3e:05:e7:3e", "network": {"id": "2ea750a5-8511-4e40-b149-062e10e0096c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-563467594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d2c7c33914a068b448c447db50b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd82b8aef-55", "ovs_interfaceid": "d82b8aef-5586-4582-9253-b964d495ce17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 11:48:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-28b35fc3-0bb0-42f6-b09f-a64ff3293a92 req-ce851c9f-9bfc-4bb5-882a-fefaab74ea59 service nova] Acquired lock "refresh_cache-4411a1a8-cd51-46b3-9f99-46670bb7e72e" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:48:07 user nova-compute[74683]: DEBUG nova.network.neutron [req-28b35fc3-0bb0-42f6-b09f-a64ff3293a92 req-ce851c9f-9bfc-4bb5-882a-fefaab74ea59 service nova] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Refreshing network info cache for port d82b8aef-5586-4582-9253-b964d495ce17 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:48:07 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Start _get_guest_xml network_info=[{"id": "d82b8aef-5586-4582-9253-b964d495ce17", "address": "fa:16:3e:05:e7:3e", "network": {"id": "2ea750a5-8511-4e40-b149-062e10e0096c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-563467594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d2c7c33914a068b448c447db50b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd82b8aef-55", "ovs_interfaceid": "d82b8aef-5586-4582-9253-b964d495ce17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:48:07 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:48:07 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:48:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:48:07 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:48:07 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:48:07 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:48:07 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:48:07 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:48:07 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:48:07 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:48:07 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:48:07 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:48:07 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:48:07 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:48:07 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:48:07 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:48:07 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:48:07 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:48:07 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:48:07 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:48:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1398782217',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1398782217',id=50,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkjneMok6wxawPFluQoU/qX70mjcBLziRvERAL2SLF5JzucZefDlpd9cZZ9qDE1gaEMvkkp21bQmMlLaAlzbn/Yb1Cc+gwzL4SGhCqcfuWKGvbSFG8xR2wBd60BfbY1EQ==',key_name='tempest-keypair-253079390',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='622d2c7c33914a068b448c447db50b3c',ramdisk_id='',reservation_id='r-avxku7yo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-291825158',owner_user_name='tempest-AttachVolumeShelveTestJSON-291825158-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:48:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11130271beb44b368f9eb55bd4946cbc',uuid=4411a1a8-cd51-46b3-9f99-46670bb7e72e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d82b8aef-5586-4582-9253-b964d495ce17", "address": "fa:16:3e:05:e7:3e", "network": {"id": "2ea750a5-8511-4e40-b149-062e10e0096c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-563467594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d2c7c33914a068b448c447db50b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd82b8aef-55", "ovs_interfaceid": "d82b8aef-5586-4582-9253-b964d495ce17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:48:07 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Converting VIF {"id": "d82b8aef-5586-4582-9253-b964d495ce17", "address": "fa:16:3e:05:e7:3e", "network": {"id": "2ea750a5-8511-4e40-b149-062e10e0096c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-563467594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d2c7c33914a068b448c447db50b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd82b8aef-55", "ovs_interfaceid": "d82b8aef-5586-4582-9253-b964d495ce17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:48:07 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:e7:3e,bridge_name='br-int',has_traffic_filtering=True,id=d82b8aef-5586-4582-9253-b964d495ce17,network=Network(2ea750a5-8511-4e40-b149-062e10e0096c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd82b8aef-55') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:48:07 user nova-compute[74683]: DEBUG nova.objects.instance [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lazy-loading 'pci_devices' on Instance uuid 4411a1a8-cd51-46b3-9f99-46670bb7e72e {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:48:07 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:48:07 user nova-compute[74683]:   <uuid>4411a1a8-cd51-46b3-9f99-46670bb7e72e</uuid>
Oct 16 11:48:07 user nova-compute[74683]:   <name>instance-00000032</name>
Oct 16 11:48:07 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:48:07 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:48:07 user nova-compute[74683]:   <metadata>
Oct 16 11:48:07 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:48:07 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:48:07 user nova-compute[74683]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1398782217</nova:name>
Oct 16 11:48:07 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:48:07</nova:creationTime>
Oct 16 11:48:07 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:48:07 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:48:07 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:48:07 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:48:07 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:48:07 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:48:07 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:48:07 user nova-compute[74683]:       <nova:owner>
Oct 16 11:48:07 user nova-compute[74683]:         <nova:user uuid="11130271beb44b368f9eb55bd4946cbc">tempest-AttachVolumeShelveTestJSON-291825158-project-member</nova:user>
Oct 16 11:48:07 user nova-compute[74683]:         <nova:project uuid="622d2c7c33914a068b448c447db50b3c">tempest-AttachVolumeShelveTestJSON-291825158</nova:project>
Oct 16 11:48:07 user nova-compute[74683]:       </nova:owner>
Oct 16 11:48:07 user nova-compute[74683]:       <nova:root type="image" uuid="0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f"/>
Oct 16 11:48:07 user nova-compute[74683]:       <nova:ports>
Oct 16 11:48:07 user nova-compute[74683]:         <nova:port uuid="d82b8aef-5586-4582-9253-b964d495ce17">
Oct 16 11:48:07 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 16 11:48:07 user nova-compute[74683]:         </nova:port>
Oct 16 11:48:07 user nova-compute[74683]:       </nova:ports>
Oct 16 11:48:07 user nova-compute[74683]:     </nova:instance>
Oct 16 11:48:07 user nova-compute[74683]:   </metadata>
Oct 16 11:48:07 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:48:07 user nova-compute[74683]:     <system>
Oct 16 11:48:07 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:48:07 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:48:07 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:48:07 user nova-compute[74683]:       <entry name="serial">4411a1a8-cd51-46b3-9f99-46670bb7e72e</entry>
Oct 16 11:48:07 user nova-compute[74683]:       <entry name="uuid">4411a1a8-cd51-46b3-9f99-46670bb7e72e</entry>
Oct 16 11:48:07 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:48:07 user nova-compute[74683]:     </system>
Oct 16 11:48:07 user nova-compute[74683]:   </sysinfo>
Oct 16 11:48:07 user nova-compute[74683]:   <os>
Oct 16 11:48:07 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:48:07 user nova-compute[74683]:     <boot dev="hd"/>
Oct 16 11:48:07 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:48:07 user nova-compute[74683]:   </os>
Oct 16 11:48:07 user nova-compute[74683]:   <features>
Oct 16 11:48:07 user nova-compute[74683]:     <acpi/>
Oct 16 11:48:07 user nova-compute[74683]:     <apic/>
Oct 16 11:48:07 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:48:07 user nova-compute[74683]:   </features>
Oct 16 11:48:07 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:48:07 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:48:07 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:48:07 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:48:07 user nova-compute[74683]:   </clock>
Oct 16 11:48:07 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:48:07 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:48:07 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:48:07 user nova-compute[74683]:   </cpu>
Oct 16 11:48:07 user nova-compute[74683]:   <devices>
Oct 16 11:48:07 user nova-compute[74683]:     <disk type="file" device="disk">
Oct 16 11:48:07 user nova-compute[74683]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 11:48:07 user nova-compute[74683]:       <source file="/opt/stack/data/nova/instances/4411a1a8-cd51-46b3-9f99-46670bb7e72e/disk"/>
Oct 16 11:48:07 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:48:07 user nova-compute[74683]:     </disk>
Oct 16 11:48:07 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:48:07 user nova-compute[74683]:       <mac address="fa:16:3e:05:e7:3e"/>
Oct 16 11:48:07 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:48:07 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:48:07 user nova-compute[74683]:       <target dev="tapd82b8aef-55"/>
Oct 16 11:48:07 user nova-compute[74683]:     </interface>
Oct 16 11:48:07 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:48:07 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/4411a1a8-cd51-46b3-9f99-46670bb7e72e/console.log" append="off"/>
Oct 16 11:48:07 user nova-compute[74683]:     </serial>
Oct 16 11:48:07 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:48:07 user nova-compute[74683]:     <video>
Oct 16 11:48:07 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:48:07 user nova-compute[74683]:     </video>
Oct 16 11:48:07 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:48:07 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:48:07 user nova-compute[74683]:     </rng>
Oct 16 11:48:07 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:48:07 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:48:07 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:48:07 user nova-compute[74683]:     </memballoon>
Oct 16 11:48:07 user nova-compute[74683]:   </devices>
Oct 16 11:48:07 user nova-compute[74683]: </domain>
Oct 16 11:48:07 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:48:07 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:48:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1398782217',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1398782217',id=50,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkjneMok6wxawPFluQoU/qX70mjcBLziRvERAL2SLF5JzucZefDlpd9cZZ9qDE1gaEMvkkp21bQmMlLaAlzbn/Yb1Cc+gwzL4SGhCqcfuWKGvbSFG8xR2wBd60BfbY1EQ==',key_name='tempest-keypair-253079390',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='622d2c7c33914a068b448c447db50b3c',ramdisk_id='',reservation_id='r-avxku7yo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-291825158',owner_user_name='tempest-AttachVolumeShelveTestJSON-291825158-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:48:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11130271beb44b368f9eb55bd4946cbc',uuid=4411a1a8-cd51-46b3-9f99-46670bb7e72e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d82b8aef-5586-4582-9253-b964d495ce17", "address": "fa:16:3e:05:e7:3e", "network": {"id": "2ea750a5-8511-4e40-b149-062e10e0096c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-563467594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d2c7c33914a068b448c447db50b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd82b8aef-55", "ovs_interfaceid": "d82b8aef-5586-4582-9253-b964d495ce17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:48:07 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Converting VIF {"id": "d82b8aef-5586-4582-9253-b964d495ce17", "address": "fa:16:3e:05:e7:3e", "network": {"id": "2ea750a5-8511-4e40-b149-062e10e0096c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-563467594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d2c7c33914a068b448c447db50b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd82b8aef-55", "ovs_interfaceid": "d82b8aef-5586-4582-9253-b964d495ce17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:48:07 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:e7:3e,bridge_name='br-int',has_traffic_filtering=True,id=d82b8aef-5586-4582-9253-b964d495ce17,network=Network(2ea750a5-8511-4e40-b149-062e10e0096c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd82b8aef-55') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:48:07 user nova-compute[74683]: DEBUG os_vif [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:e7:3e,bridge_name='br-int',has_traffic_filtering=True,id=d82b8aef-5586-4582-9253-b964d495ce17,network=Network(2ea750a5-8511-4e40-b149-062e10e0096c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd82b8aef-55') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:48:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:48:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:48:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:48:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:48:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1157861d-78c4-5fe7-9a1b-ed522b81ea45', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:48:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:48:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:48:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:48:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd82b8aef-55, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:48:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd82b8aef-55, col_values=(('qos', UUID('ee1ff52e-9585-4320-b063-0b25129cc34c')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:48:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd82b8aef-55, col_values=(('external_ids', {'iface-id': 'd82b8aef-5586-4582-9253-b964d495ce17', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:e7:3e', 'vm-uuid': '4411a1a8-cd51-46b3-9f99-46670bb7e72e'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:48:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:48:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:48:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:48:07 user nova-compute[74683]: INFO os_vif [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:e7:3e,bridge_name='br-int',has_traffic_filtering=True,id=d82b8aef-5586-4582-9253-b964d495ce17,network=Network(2ea750a5-8511-4e40-b149-062e10e0096c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd82b8aef-55')
Oct 16 11:48:07 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:48:07 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] No VIF found with MAC fa:16:3e:05:e7:3e, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:48:08 user nova-compute[74683]: DEBUG nova.network.neutron [req-28b35fc3-0bb0-42f6-b09f-a64ff3293a92 req-ce851c9f-9bfc-4bb5-882a-fefaab74ea59 service nova] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Updated VIF entry in instance network info cache for port d82b8aef-5586-4582-9253-b964d495ce17. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:48:08 user nova-compute[74683]: DEBUG nova.network.neutron [req-28b35fc3-0bb0-42f6-b09f-a64ff3293a92 req-ce851c9f-9bfc-4bb5-882a-fefaab74ea59 service nova] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Updating instance_info_cache with network_info: [{"id": "d82b8aef-5586-4582-9253-b964d495ce17", "address": "fa:16:3e:05:e7:3e", "network": {"id": "2ea750a5-8511-4e40-b149-062e10e0096c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-563467594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d2c7c33914a068b448c447db50b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd82b8aef-55", "ovs_interfaceid": "d82b8aef-5586-4582-9253-b964d495ce17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:48:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-28b35fc3-0bb0-42f6-b09f-a64ff3293a92 req-ce851c9f-9bfc-4bb5-882a-fefaab74ea59 service nova] Releasing lock "refresh_cache-4411a1a8-cd51-46b3-9f99-46670bb7e72e" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:48:09 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:48:09 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:48:09 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:48:09 user nova-compute[74683]: DEBUG nova.compute.manager [req-33a97d68-5359-4834-8b0b-ce5c74d51876 req-7cdd68ff-c277-452f-9de5-f0f5b3309964 service nova] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Received event network-vif-plugged-d82b8aef-5586-4582-9253-b964d495ce17 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:48:09 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-33a97d68-5359-4834-8b0b-ce5c74d51876 req-7cdd68ff-c277-452f-9de5-f0f5b3309964 service nova] Acquiring lock "4411a1a8-cd51-46b3-9f99-46670bb7e72e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:48:09 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-33a97d68-5359-4834-8b0b-ce5c74d51876 req-7cdd68ff-c277-452f-9de5-f0f5b3309964 service nova] Lock "4411a1a8-cd51-46b3-9f99-46670bb7e72e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:48:09 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-33a97d68-5359-4834-8b0b-ce5c74d51876 req-7cdd68ff-c277-452f-9de5-f0f5b3309964 service nova] Lock "4411a1a8-cd51-46b3-9f99-46670bb7e72e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:48:09 user nova-compute[74683]: DEBUG nova.compute.manager [req-33a97d68-5359-4834-8b0b-ce5c74d51876 req-7cdd68ff-c277-452f-9de5-f0f5b3309964 service nova] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] No waiting events found dispatching network-vif-plugged-d82b8aef-5586-4582-9253-b964d495ce17 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:48:09 user nova-compute[74683]: WARNING nova.compute.manager [req-33a97d68-5359-4834-8b0b-ce5c74d51876 req-7cdd68ff-c277-452f-9de5-f0f5b3309964 service nova] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Received unexpected event network-vif-plugged-d82b8aef-5586-4582-9253-b964d495ce17 for instance with vm_state building and task_state spawning.
Oct 16 11:48:09 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:48:09 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:48:09 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:48:11 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:48:11 user nova-compute[74683]: DEBUG nova.compute.manager [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Instance event wait completed in 0 seconds for  {{(pid=74683) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 11:48:11 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Guest created on hypervisor {{(pid=74683) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 11:48:11 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Instance spawned successfully.
Oct 16 11:48:11 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 11:48:11 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Found default for hw_cdrom_bus of ide {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:48:11 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Found default for hw_disk_bus of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:48:11 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Found default for hw_input_bus of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:48:11 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Found default for hw_pointer_model of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:48:11 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Found default for hw_video_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:48:11 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Found default for hw_vif_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:48:11 user nova-compute[74683]: INFO nova.compute.manager [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Took 5.21 seconds to spawn the instance on the hypervisor.
Oct 16 11:48:11 user nova-compute[74683]: DEBUG nova.compute.manager [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:48:11 user nova-compute[74683]: INFO nova.compute.manager [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Took 5.82 seconds to build instance.
Oct 16 11:48:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-05574c3a-73d0-4df8-8201-0067e04c0667 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "4411a1a8-cd51-46b3-9f99-46670bb7e72e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.965s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:48:11 user nova-compute[74683]: DEBUG nova.compute.manager [req-4eb63117-165c-486b-9dcd-632a24f8426c req-b2c790b1-ae42-4555-93c5-d4a83754a20c service nova] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Received event network-vif-plugged-d82b8aef-5586-4582-9253-b964d495ce17 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:48:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-4eb63117-165c-486b-9dcd-632a24f8426c req-b2c790b1-ae42-4555-93c5-d4a83754a20c service nova] Acquiring lock "4411a1a8-cd51-46b3-9f99-46670bb7e72e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:48:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-4eb63117-165c-486b-9dcd-632a24f8426c req-b2c790b1-ae42-4555-93c5-d4a83754a20c service nova] Lock "4411a1a8-cd51-46b3-9f99-46670bb7e72e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:48:11 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-4eb63117-165c-486b-9dcd-632a24f8426c req-b2c790b1-ae42-4555-93c5-d4a83754a20c service nova] Lock "4411a1a8-cd51-46b3-9f99-46670bb7e72e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:48:11 user nova-compute[74683]: DEBUG nova.compute.manager [req-4eb63117-165c-486b-9dcd-632a24f8426c req-b2c790b1-ae42-4555-93c5-d4a83754a20c service nova] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] No waiting events found dispatching network-vif-plugged-d82b8aef-5586-4582-9253-b964d495ce17 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:48:11 user nova-compute[74683]: WARNING nova.compute.manager [req-4eb63117-165c-486b-9dcd-632a24f8426c req-b2c790b1-ae42-4555-93c5-d4a83754a20c service nova] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Received unexpected event network-vif-plugged-d82b8aef-5586-4582-9253-b964d495ce17 for instance with vm_state active and task_state None.
Oct 16 11:48:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:48:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:48:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:48:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:48:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:48:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:48:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:48:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:48:29 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:48:30 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:48:31 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:48:31 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:48:31 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Starting heal instance info cache {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 11:48:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "refresh_cache-6b413793-f051-432c-83e0-57c3b0cd8fe0" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:48:31 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquired lock "refresh_cache-6b413793-f051-432c-83e0-57c3b0cd8fe0" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:48:31 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Forcefully refreshing network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 11:48:32 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Updating instance_info_cache with network_info: [{"id": "b704ce74-3ed5-4f87-9cc8-a2e79c5f2686", "address": "fa:16:3e:82:8e:5d", "network": {"id": "1fa0852d-814a-45ef-80fa-171693e4d02a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-184537544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ce607a3614fc493d33e6ba8ca5807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb704ce74-3e", "ovs_interfaceid": "b704ce74-3ed5-4f87-9cc8-a2e79c5f2686", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:48:32 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Releasing lock "refresh_cache-6b413793-f051-432c-83e0-57c3b0cd8fe0" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:48:32 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Updated the network info_cache for instance {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 11:48:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:48:32 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:48:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:48:33 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:48:34 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:48:34 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74683) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 11:48:36 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:48:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:48:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:48:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:48:36 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Auditing locally available compute resources for user (node: user) {{(pid=74683) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 11:48:36 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b413793-f051-432c-83e0-57c3b0cd8fe0/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:48:36 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b413793-f051-432c-83e0-57c3b0cd8fe0/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:48:36 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b413793-f051-432c-83e0-57c3b0cd8fe0/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:48:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b413793-f051-432c-83e0-57c3b0cd8fe0/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:48:37 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:48:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4411a1a8-cd51-46b3-9f99-46670bb7e72e/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:48:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4411a1a8-cd51-46b3-9f99-46670bb7e72e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:48:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4411a1a8-cd51-46b3-9f99-46670bb7e72e/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:48:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4411a1a8-cd51-46b3-9f99-46670bb7e72e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:48:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:48:37 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:48:37 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:48:37 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Hypervisor/Node resource view: name=user free_ram=8725MB free_disk=25.045143127441406GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74683) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 11:48:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:48:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:48:38 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 6b413793-f051-432c-83e0-57c3b0cd8fe0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:48:38 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 4411a1a8-cd51-46b3-9f99-46670bb7e72e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:48:38 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 11:48:38 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 11:48:38 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:48:38 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:48:38 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Compute_service record updated for user:user {{(pid=74683) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 11:48:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.234s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:48:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:48:40 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:48:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:48:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:48:43 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:48:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:48:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:48:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:48:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:48:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:48:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:48:55 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:48:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:48:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:48:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:48:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:48:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:48:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:48:55 user nova-compute[74683]: DEBUG nova.virt.libvirt.imagecache [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Verify base images {{(pid=74683) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Oct 16 11:48:55 user nova-compute[74683]: DEBUG nova.virt.libvirt.imagecache [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Image id 0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f yields fingerprint 96f96cd77ed2c6025a116f6aa707a654b7041c66 {{(pid=74683) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 16 11:48:55 user nova-compute[74683]: INFO nova.virt.libvirt.imagecache [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] image 0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f at (/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66): checking
Oct 16 11:48:55 user nova-compute[74683]: DEBUG nova.virt.libvirt.imagecache [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] image 0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f at (/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66): image is in use {{(pid=74683) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Oct 16 11:48:55 user nova-compute[74683]: DEBUG nova.virt.libvirt.imagecache [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74683) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 16 11:48:55 user nova-compute[74683]: DEBUG nova.virt.libvirt.imagecache [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Image id 0b5ca083-cbac-428b-995c-21d45c134ea3 yields fingerprint 409609c6df6f77990abc03b8e29769dca3a69f22 {{(pid=74683) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 16 11:48:55 user nova-compute[74683]: INFO nova.virt.libvirt.imagecache [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] image 0b5ca083-cbac-428b-995c-21d45c134ea3 at (/opt/stack/data/nova/instances/_base/409609c6df6f77990abc03b8e29769dca3a69f22): checking
Oct 16 11:48:55 user nova-compute[74683]: DEBUG nova.virt.libvirt.imagecache [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] image 0b5ca083-cbac-428b-995c-21d45c134ea3 at (/opt/stack/data/nova/instances/_base/409609c6df6f77990abc03b8e29769dca3a69f22): image is in use {{(pid=74683) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Oct 16 11:48:55 user nova-compute[74683]: DEBUG nova.virt.libvirt.imagecache [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] 6b413793-f051-432c-83e0-57c3b0cd8fe0 is a valid instance name {{(pid=74683) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 16 11:48:55 user nova-compute[74683]: DEBUG nova.virt.libvirt.imagecache [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] 6b413793-f051-432c-83e0-57c3b0cd8fe0 has a disk file {{(pid=74683) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 16 11:48:55 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b413793-f051-432c-83e0-57c3b0cd8fe0/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:48:55 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b413793-f051-432c-83e0-57c3b0cd8fe0/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:48:55 user nova-compute[74683]: DEBUG nova.virt.libvirt.imagecache [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 6b413793-f051-432c-83e0-57c3b0cd8fe0 is backed by 409609c6df6f77990abc03b8e29769dca3a69f22 {{(pid=74683) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 16 11:48:55 user nova-compute[74683]: DEBUG nova.virt.libvirt.imagecache [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] 4411a1a8-cd51-46b3-9f99-46670bb7e72e is a valid instance name {{(pid=74683) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 16 11:48:55 user nova-compute[74683]: DEBUG nova.virt.libvirt.imagecache [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] 4411a1a8-cd51-46b3-9f99-46670bb7e72e has a disk file {{(pid=74683) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 16 11:48:55 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4411a1a8-cd51-46b3-9f99-46670bb7e72e/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:48:56 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4411a1a8-cd51-46b3-9f99-46670bb7e72e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:48:56 user nova-compute[74683]: DEBUG nova.virt.libvirt.imagecache [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 4411a1a8-cd51-46b3-9f99-46670bb7e72e is backed by 96f96cd77ed2c6025a116f6aa707a654b7041c66 {{(pid=74683) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 16 11:48:56 user nova-compute[74683]: WARNING nova.virt.libvirt.imagecache [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Unknown base file: /opt/stack/data/nova/instances/_base/7898848eee21754e7d2b5036ba0eb2807d0bd2ff
Oct 16 11:48:56 user nova-compute[74683]: WARNING nova.virt.libvirt.imagecache [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Unknown base file: /opt/stack/data/nova/instances/_base/2183d85fa54afd2afaec3f5017aa7aba864f1ecf
Oct 16 11:48:56 user nova-compute[74683]: WARNING nova.virt.libvirt.imagecache [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Unknown base file: /opt/stack/data/nova/instances/_base/ac1a8389430fdf84d804d757a831a83e5e15e188
Oct 16 11:48:56 user nova-compute[74683]: WARNING nova.virt.libvirt.imagecache [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Unknown base file: /opt/stack/data/nova/instances/_base/599effbe8b015f8f32845bbe528a552caba4a42c
Oct 16 11:48:56 user nova-compute[74683]: WARNING nova.virt.libvirt.imagecache [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Unknown base file: /opt/stack/data/nova/instances/_base/b6761ea8a845e7d7245c24089ba0178f468f718a
Oct 16 11:48:56 user nova-compute[74683]: WARNING nova.virt.libvirt.imagecache [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Unknown base file: /opt/stack/data/nova/instances/_base/277b29b8c5445afe97c486e1dcabeef46d49eb32
Oct 16 11:48:56 user nova-compute[74683]: WARNING nova.virt.libvirt.imagecache [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Unknown base file: /opt/stack/data/nova/instances/_base/d975990e8dce3e3d11242bd4cd8f6bd989b16568
Oct 16 11:48:56 user nova-compute[74683]: INFO nova.virt.libvirt.imagecache [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Active base files: /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 /opt/stack/data/nova/instances/_base/409609c6df6f77990abc03b8e29769dca3a69f22
Oct 16 11:48:56 user nova-compute[74683]: INFO nova.virt.libvirt.imagecache [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Removable base files: /opt/stack/data/nova/instances/_base/7898848eee21754e7d2b5036ba0eb2807d0bd2ff /opt/stack/data/nova/instances/_base/2183d85fa54afd2afaec3f5017aa7aba864f1ecf /opt/stack/data/nova/instances/_base/ac1a8389430fdf84d804d757a831a83e5e15e188 /opt/stack/data/nova/instances/_base/599effbe8b015f8f32845bbe528a552caba4a42c /opt/stack/data/nova/instances/_base/b6761ea8a845e7d7245c24089ba0178f468f718a /opt/stack/data/nova/instances/_base/277b29b8c5445afe97c486e1dcabeef46d49eb32 /opt/stack/data/nova/instances/_base/d975990e8dce3e3d11242bd4cd8f6bd989b16568
Oct 16 11:48:56 user nova-compute[74683]: INFO nova.virt.libvirt.imagecache [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7898848eee21754e7d2b5036ba0eb2807d0bd2ff
Oct 16 11:48:56 user nova-compute[74683]: INFO nova.virt.libvirt.imagecache [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2183d85fa54afd2afaec3f5017aa7aba864f1ecf
Oct 16 11:48:56 user nova-compute[74683]: INFO nova.virt.libvirt.imagecache [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ac1a8389430fdf84d804d757a831a83e5e15e188
Oct 16 11:48:56 user nova-compute[74683]: INFO nova.virt.libvirt.imagecache [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/599effbe8b015f8f32845bbe528a552caba4a42c
Oct 16 11:48:56 user nova-compute[74683]: INFO nova.virt.libvirt.imagecache [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b6761ea8a845e7d7245c24089ba0178f468f718a
Oct 16 11:48:56 user nova-compute[74683]: INFO nova.virt.libvirt.imagecache [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/277b29b8c5445afe97c486e1dcabeef46d49eb32
Oct 16 11:48:56 user nova-compute[74683]: INFO nova.virt.libvirt.imagecache [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d975990e8dce3e3d11242bd4cd8f6bd989b16568
Oct 16 11:48:56 user nova-compute[74683]: DEBUG nova.virt.libvirt.imagecache [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Verification complete {{(pid=74683) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Oct 16 11:48:56 user nova-compute[74683]: DEBUG nova.virt.libvirt.imagecache [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Verify swap images {{(pid=74683) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Oct 16 11:48:56 user nova-compute[74683]: DEBUG nova.virt.libvirt.imagecache [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Verify ephemeral images {{(pid=74683) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Oct 16 11:48:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:48:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:48:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:48:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:48:59 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:49:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:49:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Acquiring lock "d35db024-18c5-4281-9518-7fd351811e6f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:49:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Lock "d35db024-18c5-4281-9518-7fd351811e6f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:49:02 user nova-compute[74683]: DEBUG nova.compute.manager [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Starting instance... {{(pid=74683) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 11:49:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:49:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:49:02 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74683) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 11:49:02 user nova-compute[74683]: INFO nova.compute.claims [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Claim successful on node user
Oct 16 11:49:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:49:03 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:49:03 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:49:03 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.249s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:49:03 user nova-compute[74683]: DEBUG nova.compute.manager [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Start building networks asynchronously for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 11:49:03 user nova-compute[74683]: DEBUG nova.compute.manager [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Allocating IP information in the background. {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 11:49:03 user nova-compute[74683]: DEBUG nova.network.neutron [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] allocate_for_instance() {{(pid=74683) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 11:49:03 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 11:49:03 user nova-compute[74683]: DEBUG nova.compute.manager [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Start building block device mappings for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 11:49:03 user nova-compute[74683]: DEBUG nova.policy [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c7c151337018403599b6d06a6d82f7d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e892ddc4503c42a5a5724f1ea3933a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74683) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 11:49:03 user nova-compute[74683]: INFO nova.virt.block_device [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Booting with volume 29fc964e-fa79-4448-9141-032d88e43c68 at /dev/vda
Oct 16 11:49:03 user nova-compute[74683]: DEBUG os_brick.utils [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:49:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:49:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:49:03 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1de63b-35d2-475d-a88a-de7793df0566]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:70b9d336ab7d\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:49:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:49:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:49:03 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f846d7-df09-4950-910e-31158344d581]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:49:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:49:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:49:03 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[4654ce3a-4ef6-42cb-8e06-135b6e68a36f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:49:03 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea8a537-13b7-4844-9eac-af8b50abd49c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:49:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Running cmd (subprocess): nvme version {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:49:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] 'nvme version' failed. Not Retrying. {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:49:03 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] nvme not present on system {{(pid=74683) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 11:49:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:49:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:49:03 user nova-compute[74683]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 11:49:03 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[74abb5ab-30e0-41d2-9657-691edb56126f]: (4, '') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:49:03 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74683) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 11:49:03 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 11:49:03 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] LIGHTOS: no hostnqn found. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 11:49:03 user nova-compute[74683]: DEBUG os_brick.utils [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:70b9d336ab7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:49:03 user nova-compute[74683]: DEBUG nova.virt.block_device [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Updating existing volume attachment record: 60b4b7a1-6cd4-4ca2-b1b8-f5e2fc4cb1f3 {{(pid=74683) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 11:49:04 user nova-compute[74683]: DEBUG nova.network.neutron [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Successfully created port: f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f {{(pid=74683) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 11:49:04 user nova-compute[74683]: DEBUG nova.network.neutron [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Successfully updated port: f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:49:04 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Acquiring lock "refresh_cache-d35db024-18c5-4281-9518-7fd351811e6f" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:49:04 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Acquired lock "refresh_cache-d35db024-18c5-4281-9518-7fd351811e6f" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:49:04 user nova-compute[74683]: DEBUG nova.network.neutron [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:49:04 user nova-compute[74683]: DEBUG nova.compute.manager [req-6ab15cc2-76fb-4947-9bc5-3b38b20b7a4b req-bbc14c9c-beba-4088-9dad-791c56a1e7f2 service nova] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Received event network-changed-f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:49:04 user nova-compute[74683]: DEBUG nova.compute.manager [req-6ab15cc2-76fb-4947-9bc5-3b38b20b7a4b req-bbc14c9c-beba-4088-9dad-791c56a1e7f2 service nova] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Refreshing instance network info cache due to event network-changed-f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:49:04 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-6ab15cc2-76fb-4947-9bc5-3b38b20b7a4b req-bbc14c9c-beba-4088-9dad-791c56a1e7f2 service nova] Acquiring lock "refresh_cache-d35db024-18c5-4281-9518-7fd351811e6f" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:49:04 user nova-compute[74683]: DEBUG nova.network.neutron [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:49:05 user nova-compute[74683]: DEBUG nova.network.neutron [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Updating instance_info_cache with network_info: [{"id": "f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f", "address": "fa:16:3e:72:48:68", "network": {"id": "893d103e-5e60-4e15-9617-530ec1b284c1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1497002321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e892ddc4503c42a5a5724f1ea3933a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a7ee77-cd", "ovs_interfaceid": "f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:49:05 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Releasing lock "refresh_cache-d35db024-18c5-4281-9518-7fd351811e6f" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:49:05 user nova-compute[74683]: DEBUG nova.compute.manager [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Instance network_info: |[{"id": "f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f", "address": "fa:16:3e:72:48:68", "network": {"id": "893d103e-5e60-4e15-9617-530ec1b284c1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1497002321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e892ddc4503c42a5a5724f1ea3933a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a7ee77-cd", "ovs_interfaceid": "f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 11:49:05 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-6ab15cc2-76fb-4947-9bc5-3b38b20b7a4b req-bbc14c9c-beba-4088-9dad-791c56a1e7f2 service nova] Acquired lock "refresh_cache-d35db024-18c5-4281-9518-7fd351811e6f" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:49:05 user nova-compute[74683]: DEBUG nova.network.neutron [req-6ab15cc2-76fb-4947-9bc5-3b38b20b7a4b req-bbc14c9c-beba-4088-9dad-791c56a1e7f2 service nova] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Refreshing network info cache for port f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:49:05 user nova-compute[74683]: DEBUG nova.network.neutron [req-6ab15cc2-76fb-4947-9bc5-3b38b20b7a4b req-bbc14c9c-beba-4088-9dad-791c56a1e7f2 service nova] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Updated VIF entry in instance network info cache for port f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:49:05 user nova-compute[74683]: DEBUG nova.network.neutron [req-6ab15cc2-76fb-4947-9bc5-3b38b20b7a4b req-bbc14c9c-beba-4088-9dad-791c56a1e7f2 service nova] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Updating instance_info_cache with network_info: [{"id": "f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f", "address": "fa:16:3e:72:48:68", "network": {"id": "893d103e-5e60-4e15-9617-530ec1b284c1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1497002321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e892ddc4503c42a5a5724f1ea3933a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a7ee77-cd", "ovs_interfaceid": "f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:49:05 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-6ab15cc2-76fb-4947-9bc5-3b38b20b7a4b req-bbc14c9c-beba-4088-9dad-791c56a1e7f2 service nova] Releasing lock "refresh_cache-d35db024-18c5-4281-9518-7fd351811e6f" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:49:08 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:49:08 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:49:08 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74683) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 11:49:08 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:49:08 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:49:08 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:49:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:49:13 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:49:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:49:18 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:49:19 user nova-compute[74683]: DEBUG nova.compute.manager [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Start spawning the instance on the hypervisor. {{(pid=74683) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 11:49:19 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Creating instance directory {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 11:49:19 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Creating image(s)
Oct 16 11:49:19 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Did not create local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 16 11:49:19 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Ensure instance console log exists: /opt/stack/data/nova/instances/d35db024-18c5-4281-9518-7fd351811e6f/console.log {{(pid=74683) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 11:49:19 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:49:19 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:49:19 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:49:19 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Start _get_guest_xml network_info=[{"id": "f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f", "address": "fa:16:3e:72:48:68", "network": {"id": "893d103e-5e60-4e15-9617-530ec1b284c1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1497002321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e892ddc4503c42a5a5724f1ea3933a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a7ee77-cd", "ovs_interfaceid": "f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LKoeZfiz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd35db024-18c5-4281-9518-7fd351811e6f', 'attached_at': '', 'detached_at': '', 'volume_id': '29fc964e-fa79-4448-9141-032d88e43c68', 'serial': '29fc964e-fa79-4448-9141-032d88e43c68'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': '60b4b7a1-6cd4-4ca2-b1b8-f5e2fc4cb1f3', 'volume_type': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:49:19 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:49:19 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:49:19 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:49:19 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:49:19 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:49:19 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:49:19 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:49:19 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:49:19 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:49:19 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:49:19 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:49:19 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:49:19 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:49:19 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:49:19 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:49:19 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:49:19 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:49:19 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:49:19 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Calling os-brick to attach iSCSI Volume {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 11:49:19 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LKoeZfiz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:49:19 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:49:19 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:49:19 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:49:19 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:49:19 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:49:19 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:49:19 user nova-compute[74683]: INFO os_brick.initiator.connectors.iscsi [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 11:49:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68 -p 172.16.0.220:3260 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:49:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:49:19 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[45901688-946f-45da-a6cb-6289a77b0a78]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:49:19 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 11:49:19 user nova-compute[74683]:  {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:49:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68 -p 172.16.0.220:3260 --interface default --op new {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:49:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:49:19 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c684704-aafc-425d-bfe6-3674a6f08466]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68] added\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:49:19 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68] added
Oct 16 11:49:19 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:49:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:49:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:49:19 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff720936-f89f-45fa-9c41-e750fb103eb4]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:49:19 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:49:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:49:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:49:19 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d00e98-4f96-4d24-a6d0-9669782dbf78]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:49:19 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:49:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LKoeZfiz {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:49:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LKoeZfiz" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:49:19 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[05cbe652-42d9-4ce8-b26a-e625a0c47752]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:49:19 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LKoeZfiz'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:49:19 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:49:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:49:20 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f54a11-5f3d-4de2-9951-89eea08a67ac]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:49:20 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:49:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:49:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:49:20 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8c70d3-718c-4772-ad61-341e86cfb15e]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9160eef-c687-4d75-a9cb-c577f6e90dfa (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:49:20 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9160eef-c687-4d75-a9cb-c577f6e90dfa (non-flash)
Oct 16 11:49:20 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:49:20 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9160eef-c687-4d75-a9cb-c577f6e90dfa (non-flash)
Oct 16 11:49:20 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:49:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68 -p 172.16.0.220:3260 --login {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:49:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:49:20 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a648866c-db4f-4e2d-aaf6-e718aade7e31]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:49:20 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68, portal: 172.16.0.220,3260]
Oct 16 11:49:20 user nova-compute[74683]: Login to [iface: default, target: iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68, portal: 172.16.0.220,3260] successful.
Oct 16 11:49:20 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:49:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:49:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:49:20 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d70da22-1501-4f81-8ba9-748335e8f3b3]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:49:20 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:49:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:49:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:49:20 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53cdb2a-0b7d-4484-9990-3ebb6f01da03]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9160eef-c687-4d75-a9cb-c577f6e90dfa (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:49:20 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9160eef-c687-4d75-a9cb-c577f6e90dfa (non-flash)
Oct 16 11:49:20 user nova-compute[74683]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68 (non-flash)
Oct 16 11:49:20 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:49:20 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9160eef-c687-4d75-a9cb-c577f6e90dfa (non-flash)
Oct 16 11:49:20 user nova-compute[74683]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68 (non-flash)
Oct 16 11:49:20 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:49:20 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:49:20 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Connected to 172.16.0.220:3260 {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 11:49:20 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] HCTL ('34', '-', '-', 0) found on session 59 with lun 0 {{(pid=74683) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 11:49:20 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74683) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 11:49:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:49:20 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:49:20 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[42773c79-78b2-489a-8d21-e4809690f3e4]: (4, ('- - 0', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:49:20 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Searching for a device in session 59 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:49:20 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LKoeZfiz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 11:49:21 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:49:21 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '26136343436363461', 'path': '/dev/sdc'} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:49:21 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136343436363461', 'path': '/dev/sdc'} {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 11:49:21 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:49:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2144957190',display_name='tempest-TestShelveInstance-server-2144957190',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2144957190',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfm6FrJOA0WYRBy7wT7iNCupFsFZVd6Aq+19ZRioq/2RyWJNDIrJ0fsOj3lJoLuQCVoc7/fo6IFP4c6X+8hjsPPsbmQFAlV9644xjIYyaH1rp5jWUE3kh/muw9UkmtKXQ==',key_name='tempest-TestShelveInstance-527121964',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e892ddc4503c42a5a5724f1ea3933a88',ramdisk_id='',reservation_id='r-tnn3schj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-547173108',owner_user_name='tempest-TestShelveInstance-547173108-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:49:03Z,user_data=None,user_id='c7c151337018403599b6d06a6d82f7d2',uuid=d35db024-18c5-4281-9518-7fd351811e6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f", "address": "fa:16:3e:72:48:68", "network": {"id": "893d103e-5e60-4e15-9617-530ec1b284c1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1497002321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e892ddc4503c42a5a5724f1ea3933a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a7ee77-cd", "ovs_interfaceid": "f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:49:21 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Converting VIF {"id": "f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f", "address": "fa:16:3e:72:48:68", "network": {"id": "893d103e-5e60-4e15-9617-530ec1b284c1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1497002321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e892ddc4503c42a5a5724f1ea3933a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a7ee77-cd", "ovs_interfaceid": "f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:49:21 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:48:68,bridge_name='br-int',has_traffic_filtering=True,id=f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f,network=Network(893d103e-5e60-4e15-9617-530ec1b284c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4a7ee77-cd') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:49:21 user nova-compute[74683]: DEBUG nova.objects.instance [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Lazy-loading 'pci_devices' on Instance uuid d35db024-18c5-4281-9518-7fd351811e6f {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:49:21 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:49:21 user nova-compute[74683]:   <uuid>d35db024-18c5-4281-9518-7fd351811e6f</uuid>
Oct 16 11:49:21 user nova-compute[74683]:   <name>instance-00000033</name>
Oct 16 11:49:21 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:49:21 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:49:21 user nova-compute[74683]:   <metadata>
Oct 16 11:49:21 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:49:21 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:49:21 user nova-compute[74683]:       <nova:name>tempest-TestShelveInstance-server-2144957190</nova:name>
Oct 16 11:49:21 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:49:19</nova:creationTime>
Oct 16 11:49:21 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:49:21 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:49:21 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:49:21 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:49:21 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:49:21 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:49:21 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:49:21 user nova-compute[74683]:       <nova:owner>
Oct 16 11:49:21 user nova-compute[74683]:         <nova:user uuid="c7c151337018403599b6d06a6d82f7d2">tempest-TestShelveInstance-547173108-project-member</nova:user>
Oct 16 11:49:21 user nova-compute[74683]:         <nova:project uuid="e892ddc4503c42a5a5724f1ea3933a88">tempest-TestShelveInstance-547173108</nova:project>
Oct 16 11:49:21 user nova-compute[74683]:       </nova:owner>
Oct 16 11:49:21 user nova-compute[74683]:       <nova:ports>
Oct 16 11:49:21 user nova-compute[74683]:         <nova:port uuid="f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f">
Oct 16 11:49:21 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 16 11:49:21 user nova-compute[74683]:         </nova:port>
Oct 16 11:49:21 user nova-compute[74683]:       </nova:ports>
Oct 16 11:49:21 user nova-compute[74683]:     </nova:instance>
Oct 16 11:49:21 user nova-compute[74683]:   </metadata>
Oct 16 11:49:21 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:49:21 user nova-compute[74683]:     <system>
Oct 16 11:49:21 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:49:21 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:49:21 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:49:21 user nova-compute[74683]:       <entry name="serial">d35db024-18c5-4281-9518-7fd351811e6f</entry>
Oct 16 11:49:21 user nova-compute[74683]:       <entry name="uuid">d35db024-18c5-4281-9518-7fd351811e6f</entry>
Oct 16 11:49:21 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:49:21 user nova-compute[74683]:     </system>
Oct 16 11:49:21 user nova-compute[74683]:   </sysinfo>
Oct 16 11:49:21 user nova-compute[74683]:   <os>
Oct 16 11:49:21 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:49:21 user nova-compute[74683]:     <boot dev="hd"/>
Oct 16 11:49:21 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:49:21 user nova-compute[74683]:   </os>
Oct 16 11:49:21 user nova-compute[74683]:   <features>
Oct 16 11:49:21 user nova-compute[74683]:     <acpi/>
Oct 16 11:49:21 user nova-compute[74683]:     <apic/>
Oct 16 11:49:21 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:49:21 user nova-compute[74683]:   </features>
Oct 16 11:49:21 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:49:21 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:49:21 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:49:21 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:49:21 user nova-compute[74683]:   </clock>
Oct 16 11:49:21 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:49:21 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:49:21 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:49:21 user nova-compute[74683]:   </cpu>
Oct 16 11:49:21 user nova-compute[74683]:   <devices>
Oct 16 11:49:21 user nova-compute[74683]:     <disk type="block" device="disk">
Oct 16 11:49:21 user nova-compute[74683]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:49:21 user nova-compute[74683]:       <source dev="/dev/sdc"/>
Oct 16 11:49:21 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:49:21 user nova-compute[74683]:       <serial>29fc964e-fa79-4448-9141-032d88e43c68</serial>
Oct 16 11:49:21 user nova-compute[74683]:     </disk>
Oct 16 11:49:21 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:49:21 user nova-compute[74683]:       <mac address="fa:16:3e:72:48:68"/>
Oct 16 11:49:21 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:49:21 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:49:21 user nova-compute[74683]:       <target dev="tapf4a7ee77-cd"/>
Oct 16 11:49:21 user nova-compute[74683]:     </interface>
Oct 16 11:49:21 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:49:21 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/d35db024-18c5-4281-9518-7fd351811e6f/console.log" append="off"/>
Oct 16 11:49:21 user nova-compute[74683]:     </serial>
Oct 16 11:49:21 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:49:21 user nova-compute[74683]:     <video>
Oct 16 11:49:21 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:49:21 user nova-compute[74683]:     </video>
Oct 16 11:49:21 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:49:21 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:49:21 user nova-compute[74683]:     </rng>
Oct 16 11:49:21 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:49:21 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:49:21 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:49:21 user nova-compute[74683]:     </memballoon>
Oct 16 11:49:21 user nova-compute[74683]:   </devices>
Oct 16 11:49:21 user nova-compute[74683]: </domain>
Oct 16 11:49:21 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:49:21 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:49:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2144957190',display_name='tempest-TestShelveInstance-server-2144957190',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2144957190',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfm6FrJOA0WYRBy7wT7iNCupFsFZVd6Aq+19ZRioq/2RyWJNDIrJ0fsOj3lJoLuQCVoc7/fo6IFP4c6X+8hjsPPsbmQFAlV9644xjIYyaH1rp5jWUE3kh/muw9UkmtKXQ==',key_name='tempest-TestShelveInstance-527121964',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e892ddc4503c42a5a5724f1ea3933a88',ramdisk_id='',reservation_id='r-tnn3schj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-547173108',owner_user_name='tempest-TestShelveInstance-547173108-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:49:03Z,user_data=None,user_id='c7c151337018403599b6d06a6d82f7d2',uuid=d35db024-18c5-4281-9518-7fd351811e6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f", "address": "fa:16:3e:72:48:68", "network": {"id": "893d103e-5e60-4e15-9617-530ec1b284c1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1497002321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e892ddc4503c42a5a5724f1ea3933a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a7ee77-cd", "ovs_interfaceid": "f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:49:21 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Converting VIF {"id": "f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f", "address": "fa:16:3e:72:48:68", "network": {"id": "893d103e-5e60-4e15-9617-530ec1b284c1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1497002321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e892ddc4503c42a5a5724f1ea3933a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a7ee77-cd", "ovs_interfaceid": "f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:49:21 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:48:68,bridge_name='br-int',has_traffic_filtering=True,id=f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f,network=Network(893d103e-5e60-4e15-9617-530ec1b284c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4a7ee77-cd') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:49:21 user nova-compute[74683]: DEBUG os_vif [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:48:68,bridge_name='br-int',has_traffic_filtering=True,id=f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f,network=Network(893d103e-5e60-4e15-9617-530ec1b284c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4a7ee77-cd') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:49:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:49:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:49:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:49:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:49:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'af910176-1b17-51a9-998c-0f0d955c06b7', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:49:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:49:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:49:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:49:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4a7ee77-cd, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:49:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf4a7ee77-cd, col_values=(('qos', UUID('78f51f43-a384-408a-8e6e-1e058a927990')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:49:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf4a7ee77-cd, col_values=(('external_ids', {'iface-id': 'f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:48:68', 'vm-uuid': 'd35db024-18c5-4281-9518-7fd351811e6f'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:49:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:49:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:49:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:49:21 user nova-compute[74683]: INFO os_vif [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:48:68,bridge_name='br-int',has_traffic_filtering=True,id=f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f,network=Network(893d103e-5e60-4e15-9617-530ec1b284c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4a7ee77-cd')
Oct 16 11:49:21 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:49:21 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] No VIF found with MAC fa:16:3e:72:48:68, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:49:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:49:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:49:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:49:22 user nova-compute[74683]: DEBUG nova.compute.manager [req-d4a8cd5f-8fe7-4ac7-95ca-242cbf97cb2a req-cbd74637-9029-4565-93cc-989d15882b70 service nova] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Received event network-vif-plugged-f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:49:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-d4a8cd5f-8fe7-4ac7-95ca-242cbf97cb2a req-cbd74637-9029-4565-93cc-989d15882b70 service nova] Acquiring lock "d35db024-18c5-4281-9518-7fd351811e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:49:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-d4a8cd5f-8fe7-4ac7-95ca-242cbf97cb2a req-cbd74637-9029-4565-93cc-989d15882b70 service nova] Lock "d35db024-18c5-4281-9518-7fd351811e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:49:22 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-d4a8cd5f-8fe7-4ac7-95ca-242cbf97cb2a req-cbd74637-9029-4565-93cc-989d15882b70 service nova] Lock "d35db024-18c5-4281-9518-7fd351811e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:49:22 user nova-compute[74683]: DEBUG nova.compute.manager [req-d4a8cd5f-8fe7-4ac7-95ca-242cbf97cb2a req-cbd74637-9029-4565-93cc-989d15882b70 service nova] [instance: d35db024-18c5-4281-9518-7fd351811e6f] No waiting events found dispatching network-vif-plugged-f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:49:22 user nova-compute[74683]: WARNING nova.compute.manager [req-d4a8cd5f-8fe7-4ac7-95ca-242cbf97cb2a req-cbd74637-9029-4565-93cc-989d15882b70 service nova] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Received unexpected event network-vif-plugged-f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f for instance with vm_state building and task_state spawning.
Oct 16 11:49:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:49:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:49:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:49:24 user nova-compute[74683]: DEBUG nova.compute.manager [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Instance event wait completed in 0 seconds for  {{(pid=74683) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 11:49:24 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Guest created on hypervisor {{(pid=74683) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 11:49:24 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Instance spawned successfully.
Oct 16 11:49:24 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 11:49:24 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Found default for hw_cdrom_bus of ide {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:49:24 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Found default for hw_disk_bus of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:49:24 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Found default for hw_input_bus of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:49:24 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Found default for hw_pointer_model of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:49:24 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Found default for hw_video_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:49:24 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Found default for hw_vif_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:49:24 user nova-compute[74683]: INFO nova.compute.manager [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Took 4.87 seconds to spawn the instance on the hypervisor.
Oct 16 11:49:24 user nova-compute[74683]: DEBUG nova.compute.manager [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:49:24 user nova-compute[74683]: INFO nova.compute.manager [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Took 21.83 seconds to build instance.
Oct 16 11:49:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-bf51136c-220c-420e-89e8-8d18e11f07c3 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Lock "d35db024-18c5-4281-9518-7fd351811e6f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.941s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:49:24 user nova-compute[74683]: DEBUG nova.compute.manager [req-a8578a24-5d35-4a30-8a61-9d6232431bb7 req-3b21574d-2cd8-40de-8b46-16c0cf461e97 service nova] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Received event network-vif-plugged-f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:49:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a8578a24-5d35-4a30-8a61-9d6232431bb7 req-3b21574d-2cd8-40de-8b46-16c0cf461e97 service nova] Acquiring lock "d35db024-18c5-4281-9518-7fd351811e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:49:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a8578a24-5d35-4a30-8a61-9d6232431bb7 req-3b21574d-2cd8-40de-8b46-16c0cf461e97 service nova] Lock "d35db024-18c5-4281-9518-7fd351811e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:49:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a8578a24-5d35-4a30-8a61-9d6232431bb7 req-3b21574d-2cd8-40de-8b46-16c0cf461e97 service nova] Lock "d35db024-18c5-4281-9518-7fd351811e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:49:24 user nova-compute[74683]: DEBUG nova.compute.manager [req-a8578a24-5d35-4a30-8a61-9d6232431bb7 req-3b21574d-2cd8-40de-8b46-16c0cf461e97 service nova] [instance: d35db024-18c5-4281-9518-7fd351811e6f] No waiting events found dispatching network-vif-plugged-f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:49:24 user nova-compute[74683]: WARNING nova.compute.manager [req-a8578a24-5d35-4a30-8a61-9d6232431bb7 req-3b21574d-2cd8-40de-8b46-16c0cf461e97 service nova] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Received unexpected event network-vif-plugged-f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f for instance with vm_state active and task_state None.
Oct 16 11:49:25 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:49:25 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Cleaning up deleted instances with incomplete migration  {{(pid=74683) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 16 11:49:26 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:49:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:49:29 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:49:30 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:49:30 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:49:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:49:31 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:49:32 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:49:32 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Starting heal instance info cache {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 11:49:32 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Rebuilding the list of instances to heal {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 11:49:32 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "refresh_cache-6b413793-f051-432c-83e0-57c3b0cd8fe0" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:49:32 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquired lock "refresh_cache-6b413793-f051-432c-83e0-57c3b0cd8fe0" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:49:32 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Forcefully refreshing network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 11:49:32 user nova-compute[74683]: DEBUG nova.objects.instance [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lazy-loading 'info_cache' on Instance uuid 6b413793-f051-432c-83e0-57c3b0cd8fe0 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:49:33 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Updating instance_info_cache with network_info: [{"id": "b704ce74-3ed5-4f87-9cc8-a2e79c5f2686", "address": "fa:16:3e:82:8e:5d", "network": {"id": "1fa0852d-814a-45ef-80fa-171693e4d02a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-184537544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ce607a3614fc493d33e6ba8ca5807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb704ce74-3e", "ovs_interfaceid": "b704ce74-3ed5-4f87-9cc8-a2e79c5f2686", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:49:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Releasing lock "refresh_cache-6b413793-f051-432c-83e0-57c3b0cd8fe0" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:49:33 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Updated the network info_cache for instance {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 11:49:33 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:49:33 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:49:34 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:49:35 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:49:35 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74683) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 11:49:36 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:49:36 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:49:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:49:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:49:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:49:36 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Auditing locally available compute resources for user (node: user) {{(pid=74683) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 11:49:36 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b413793-f051-432c-83e0-57c3b0cd8fe0/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:49:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b413793-f051-432c-83e0-57c3b0cd8fe0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:49:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b413793-f051-432c-83e0-57c3b0cd8fe0/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:49:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b413793-f051-432c-83e0-57c3b0cd8fe0/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:49:37 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:49:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4411a1a8-cd51-46b3-9f99-46670bb7e72e/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:49:37 user nova-compute[74683]: DEBUG nova.compute.manager [req-e49cee72-ea4c-4326-9dc9-9ac749b18f0a req-e8cd8f00-be32-4ce2-b86f-ae3db3355c49 service nova] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Received event network-changed-b704ce74-3ed5-4f87-9cc8-a2e79c5f2686 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:49:37 user nova-compute[74683]: DEBUG nova.compute.manager [req-e49cee72-ea4c-4326-9dc9-9ac749b18f0a req-e8cd8f00-be32-4ce2-b86f-ae3db3355c49 service nova] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Refreshing instance network info cache due to event network-changed-b704ce74-3ed5-4f87-9cc8-a2e79c5f2686. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:49:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e49cee72-ea4c-4326-9dc9-9ac749b18f0a req-e8cd8f00-be32-4ce2-b86f-ae3db3355c49 service nova] Acquiring lock "refresh_cache-6b413793-f051-432c-83e0-57c3b0cd8fe0" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:49:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e49cee72-ea4c-4326-9dc9-9ac749b18f0a req-e8cd8f00-be32-4ce2-b86f-ae3db3355c49 service nova] Acquired lock "refresh_cache-6b413793-f051-432c-83e0-57c3b0cd8fe0" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:49:37 user nova-compute[74683]: DEBUG nova.network.neutron [req-e49cee72-ea4c-4326-9dc9-9ac749b18f0a req-e8cd8f00-be32-4ce2-b86f-ae3db3355c49 service nova] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Refreshing network info cache for port b704ce74-3ed5-4f87-9cc8-a2e79c5f2686 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:49:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4411a1a8-cd51-46b3-9f99-46670bb7e72e/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:49:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4411a1a8-cd51-46b3-9f99-46670bb7e72e/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:49:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4411a1a8-cd51-46b3-9f99-46670bb7e72e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:49:37 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:49:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:49:38 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:49:38 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:49:38 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Hypervisor/Node resource view: name=user free_ram=8586MB free_disk=25.03313446044922GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74683) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 11:49:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:49:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:49:38 user nova-compute[74683]: DEBUG nova.compute.manager [req-b5c1e528-cbff-4ded-a902-0524eef84c77 req-57b4a63d-8568-49f5-bd16-8522b3352798 service nova] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Received event network-changed-b704ce74-3ed5-4f87-9cc8-a2e79c5f2686 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:49:38 user nova-compute[74683]: DEBUG nova.compute.manager [req-b5c1e528-cbff-4ded-a902-0524eef84c77 req-57b4a63d-8568-49f5-bd16-8522b3352798 service nova] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Refreshing instance network info cache due to event network-changed-b704ce74-3ed5-4f87-9cc8-a2e79c5f2686. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:49:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b5c1e528-cbff-4ded-a902-0524eef84c77 req-57b4a63d-8568-49f5-bd16-8522b3352798 service nova] Acquiring lock "refresh_cache-6b413793-f051-432c-83e0-57c3b0cd8fe0" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:49:38 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 6b413793-f051-432c-83e0-57c3b0cd8fe0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:49:38 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 4411a1a8-cd51-46b3-9f99-46670bb7e72e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:49:38 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance d35db024-18c5-4281-9518-7fd351811e6f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:49:38 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 11:49:38 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 11:49:38 user nova-compute[74683]: DEBUG nova.network.neutron [req-e49cee72-ea4c-4326-9dc9-9ac749b18f0a req-e8cd8f00-be32-4ce2-b86f-ae3db3355c49 service nova] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Updated VIF entry in instance network info cache for port b704ce74-3ed5-4f87-9cc8-a2e79c5f2686. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:49:38 user nova-compute[74683]: DEBUG nova.network.neutron [req-e49cee72-ea4c-4326-9dc9-9ac749b18f0a req-e8cd8f00-be32-4ce2-b86f-ae3db3355c49 service nova] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Updating instance_info_cache with network_info: [{"id": "b704ce74-3ed5-4f87-9cc8-a2e79c5f2686", "address": "fa:16:3e:82:8e:5d", "network": {"id": "1fa0852d-814a-45ef-80fa-171693e4d02a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-184537544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ce607a3614fc493d33e6ba8ca5807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb704ce74-3e", "ovs_interfaceid": "b704ce74-3ed5-4f87-9cc8-a2e79c5f2686", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:49:38 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Refreshing inventories for resource provider 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 16 11:49:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-e49cee72-ea4c-4326-9dc9-9ac749b18f0a req-e8cd8f00-be32-4ce2-b86f-ae3db3355c49 service nova] Releasing lock "refresh_cache-6b413793-f051-432c-83e0-57c3b0cd8fe0" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:49:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b5c1e528-cbff-4ded-a902-0524eef84c77 req-57b4a63d-8568-49f5-bd16-8522b3352798 service nova] Acquired lock "refresh_cache-6b413793-f051-432c-83e0-57c3b0cd8fe0" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:49:38 user nova-compute[74683]: DEBUG nova.network.neutron [req-b5c1e528-cbff-4ded-a902-0524eef84c77 req-57b4a63d-8568-49f5-bd16-8522b3352798 service nova] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Refreshing network info cache for port b704ce74-3ed5-4f87-9cc8-a2e79c5f2686 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:49:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-94cb575b-3969-4d58-b06f-5b35538188fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Acquiring lock "6b413793-f051-432c-83e0-57c3b0cd8fe0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:49:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-94cb575b-3969-4d58-b06f-5b35538188fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "6b413793-f051-432c-83e0-57c3b0cd8fe0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:49:38 user nova-compute[74683]: INFO nova.compute.manager [None req-94cb575b-3969-4d58-b06f-5b35538188fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Detaching volume a9160eef-c687-4d75-a9cb-c577f6e90dfa
Oct 16 11:49:38 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Updating ProviderTree inventory for provider 7142d606-df50-4cbe-b5ed-1802caa31862 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 16 11:49:38 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Updating inventory in ProviderTree for provider 7142d606-df50-4cbe-b5ed-1802caa31862 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 16 11:49:38 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Refreshing aggregate associations for resource provider 7142d606-df50-4cbe-b5ed-1802caa31862, aggregates: None {{(pid=74683) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 16 11:49:38 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Refreshing trait associations for resource provider 7142d606-df50-4cbe-b5ed-1802caa31862, traits: COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VMVGA {{(pid=74683) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 16 11:49:38 user nova-compute[74683]: INFO nova.virt.block_device [None req-94cb575b-3969-4d58-b06f-5b35538188fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Attempting to driver detach volume a9160eef-c687-4d75-a9cb-c577f6e90dfa from mountpoint /dev/vdb
Oct 16 11:49:38 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-94cb575b-3969-4d58-b06f-5b35538188fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Attempting to detach device vdb from instance 6b413793-f051-432c-83e0-57c3b0cd8fe0 from the persistent domain config. {{(pid=74683) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 11:49:38 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-94cb575b-3969-4d58-b06f-5b35538188fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 11:49:38 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:49:38 user nova-compute[74683]:   <source dev="/dev/sdb"/>
Oct 16 11:49:38 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:49:38 user nova-compute[74683]:   <serial>a9160eef-c687-4d75-a9cb-c577f6e90dfa</serial>
Oct 16 11:49:38 user nova-compute[74683]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 11:49:38 user nova-compute[74683]: </disk>
Oct 16 11:49:38 user nova-compute[74683]:  {{(pid=74683) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 11:49:38 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-94cb575b-3969-4d58-b06f-5b35538188fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Successfully detached device vdb from instance 6b413793-f051-432c-83e0-57c3b0cd8fe0 from the persistent domain config.
Oct 16 11:49:38 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-94cb575b-3969-4d58-b06f-5b35538188fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6b413793-f051-432c-83e0-57c3b0cd8fe0 from the live domain config. {{(pid=74683) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 11:49:38 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-94cb575b-3969-4d58-b06f-5b35538188fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 11:49:38 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:49:38 user nova-compute[74683]:   <source dev="/dev/sdb"/>
Oct 16 11:49:38 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:49:38 user nova-compute[74683]:   <serial>a9160eef-c687-4d75-a9cb-c577f6e90dfa</serial>
Oct 16 11:49:38 user nova-compute[74683]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 11:49:38 user nova-compute[74683]: </disk>
Oct 16 11:49:38 user nova-compute[74683]:  {{(pid=74683) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 11:49:38 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:49:38 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:49:38 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Compute_service record updated for user:user {{(pid=74683) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 11:49:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.599s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:49:38 user nova-compute[74683]: DEBUG nova.network.neutron [req-b5c1e528-cbff-4ded-a902-0524eef84c77 req-57b4a63d-8568-49f5-bd16-8522b3352798 service nova] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Updated VIF entry in instance network info cache for port b704ce74-3ed5-4f87-9cc8-a2e79c5f2686. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:49:38 user nova-compute[74683]: DEBUG nova.network.neutron [req-b5c1e528-cbff-4ded-a902-0524eef84c77 req-57b4a63d-8568-49f5-bd16-8522b3352798 service nova] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Updating instance_info_cache with network_info: [{"id": "b704ce74-3ed5-4f87-9cc8-a2e79c5f2686", "address": "fa:16:3e:82:8e:5d", "network": {"id": "1fa0852d-814a-45ef-80fa-171693e4d02a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-184537544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ce607a3614fc493d33e6ba8ca5807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb704ce74-3e", "ovs_interfaceid": "b704ce74-3ed5-4f87-9cc8-a2e79c5f2686", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:49:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-b5c1e528-cbff-4ded-a902-0524eef84c77 req-57b4a63d-8568-49f5-bd16-8522b3352798 service nova] Releasing lock "refresh_cache-6b413793-f051-432c-83e0-57c3b0cd8fe0" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:49:39 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-94cb575b-3969-4d58-b06f-5b35538188fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6b413793-f051-432c-83e0-57c3b0cd8fe0 {{(pid=74683) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 11:49:41 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:49:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:49:45 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:49:46 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:49:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:49:48 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:49:48 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Cleaning up deleted instances {{(pid=74683) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 16 11:49:48 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] There are 0 instances to clean {{(pid=74683) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 16 11:49:51 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:49:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:49:56 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:49:56 user nova-compute[74683]: DEBUG nova.compute.manager [req-4e1bd0c0-4052-4683-889a-e1e64b1218aa req-068cce6a-8be3-4928-8bc3-07e282da7552 service nova] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Received event network-changed-d82b8aef-5586-4582-9253-b964d495ce17 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:49:56 user nova-compute[74683]: DEBUG nova.compute.manager [req-4e1bd0c0-4052-4683-889a-e1e64b1218aa req-068cce6a-8be3-4928-8bc3-07e282da7552 service nova] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Refreshing instance network info cache due to event network-changed-d82b8aef-5586-4582-9253-b964d495ce17. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:49:56 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-4e1bd0c0-4052-4683-889a-e1e64b1218aa req-068cce6a-8be3-4928-8bc3-07e282da7552 service nova] Acquiring lock "refresh_cache-4411a1a8-cd51-46b3-9f99-46670bb7e72e" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:49:56 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-4e1bd0c0-4052-4683-889a-e1e64b1218aa req-068cce6a-8be3-4928-8bc3-07e282da7552 service nova] Acquired lock "refresh_cache-4411a1a8-cd51-46b3-9f99-46670bb7e72e" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:49:56 user nova-compute[74683]: DEBUG nova.network.neutron [req-4e1bd0c0-4052-4683-889a-e1e64b1218aa req-068cce6a-8be3-4928-8bc3-07e282da7552 service nova] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Refreshing network info cache for port d82b8aef-5586-4582-9253-b964d495ce17 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:49:56 user nova-compute[74683]: DEBUG nova.network.neutron [req-4e1bd0c0-4052-4683-889a-e1e64b1218aa req-068cce6a-8be3-4928-8bc3-07e282da7552 service nova] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Updated VIF entry in instance network info cache for port d82b8aef-5586-4582-9253-b964d495ce17. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:49:56 user nova-compute[74683]: DEBUG nova.network.neutron [req-4e1bd0c0-4052-4683-889a-e1e64b1218aa req-068cce6a-8be3-4928-8bc3-07e282da7552 service nova] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Updating instance_info_cache with network_info: [{"id": "d82b8aef-5586-4582-9253-b964d495ce17", "address": "fa:16:3e:05:e7:3e", "network": {"id": "2ea750a5-8511-4e40-b149-062e10e0096c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-563467594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d2c7c33914a068b448c447db50b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd82b8aef-55", "ovs_interfaceid": "d82b8aef-5586-4582-9253-b964d495ce17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:49:56 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-4e1bd0c0-4052-4683-889a-e1e64b1218aa req-068cce6a-8be3-4928-8bc3-07e282da7552 service nova] Releasing lock "refresh_cache-4411a1a8-cd51-46b3-9f99-46670bb7e72e" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:49:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:49:59 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-94cb575b-3969-4d58-b06f-5b35538188fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6b413793-f051-432c-83e0-57c3b0cd8fe0 is timed out.
Oct 16 11:49:59 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-94cb575b-3969-4d58-b06f-5b35538188fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Successfully detached device vdb from instance 6b413793-f051-432c-83e0-57c3b0cd8fe0 from the live domain config.
Oct 16 11:49:59 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94cb575b-3969-4d58-b06f-5b35538188fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] calling os-brick to detach iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 11:49:59 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-94cb575b-3969-4d58-b06f-5b35538188fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, {'target_iqn': 'iqn.2010-10.org.openstack:a9160eef-c687-4d75-a9cb-c577f6e90dfa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QkdGqNBL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:49:59 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-94cb575b-3969-4d58-b06f-5b35538188fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:49:59 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-94cb575b-3969-4d58-b06f-5b35538188fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:49:59 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-94cb575b-3969-4d58-b06f-5b35538188fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:49:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:49:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:49:59 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[4564c2e6-4934-466e-857f-85a80910e2f2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a9160eef-c687-4d75-a9cb-c577f6e90dfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:49:59 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-94cb575b-3969-4d58-b06f-5b35538188fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 11:49:59 user nova-compute[74683]: No targets found.
Oct 16 11:49:59 user nova-compute[74683]: iSNS:
Oct 16 11:49:59 user nova-compute[74683]: No targets found.
Oct 16 11:49:59 user nova-compute[74683]: STATIC:
Oct 16 11:49:59 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68
Oct 16 11:49:59 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:49:59 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:49:59 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:a9160eef-c687-4d75-a9cb-c577f6e90dfa
Oct 16 11:49:59 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:49:59 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:49:59 user nova-compute[74683]: FIRMWARE:
Oct 16 11:49:59 user nova-compute[74683]: No targets found.
Oct 16 11:49:59 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:49:59 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-94cb575b-3969-4d58-b06f-5b35538188fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 11:49:59 user nova-compute[74683]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 11:49:59 user nova-compute[74683]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74683) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 11:49:59 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-94cb575b-3969-4d58-b06f-5b35538188fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9160eef-c687-4d75-a9cb-c577f6e90dfa', 0)] {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 11:49:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:49:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:49:59 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[102bf1c0-acb8-4b3c-ba50-b7fe7a42487f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9160eef-c687-4d75-a9cb-c577f6e90dfa\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:49:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:49:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:49:59 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9c82ea-03cc-4d42-adee-6b1e820aa80f]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9160eef-c687-4d75-a9cb-c577f6e90dfa (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:49:59 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-94cb575b-3969-4d58-b06f-5b35538188fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9160eef-c687-4d75-a9cb-c577f6e90dfa (non-flash)
Oct 16 11:49:59 user nova-compute[74683]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68 (non-flash)
Oct 16 11:49:59 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:49:59 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-94cb575b-3969-4d58-b06f-5b35538188fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9160eef-c687-4d75-a9cb-c577f6e90dfa (non-flash)
Oct 16 11:49:59 user nova-compute[74683]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68 (non-flash)
Oct 16 11:49:59 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:49:59 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-94cb575b-3969-4d58-b06f-5b35538188fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda4c688f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9160eef-c687-4d75-a9cb-c577f6e90dfa'): ({'sdb'}, set())}) {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 11:49:59 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-94cb575b-3969-4d58-b06f-5b35538188fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Removing single pathed devices sdb {{(pid=74683) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 11:49:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:49:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:49:59 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceadfd9a-4566-4928-80d3-6a1ebdefe110]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:49:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:49:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:49:59 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb2d8d8-6d38-4c68-a61c-d41c610b0dcd]: (4, ('ok\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:49:59 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-94cb575b-3969-4d58-b06f-5b35538188fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Flushing IO for device /dev/sdb {{(pid=74683) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 11:49:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:49:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:49:59 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[76403bb1-9521-481a-8cc6-b15d06cec5d0]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:49:59 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-94cb575b-3969-4d58-b06f-5b35538188fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74683) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 11:49:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:49:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:49:59 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[b899818d-cf2b-41ea-a003-bfb1b6ad8b46]: (4, ('1', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:49:59 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-94cb575b-3969-4d58-b06f-5b35538188fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 11:49:59 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-94cb575b-3969-4d58-b06f-5b35538188fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] SCSI volumes sdb have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 11:49:59 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-94cb575b-3969-4d58-b06f-5b35538188fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9160eef-c687-4d75-a9cb-c577f6e90dfa')] {{(pid=74683) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 11:49:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9160eef-c687-4d75-a9cb-c577f6e90dfa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:49:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9160eef-c687-4d75-a9cb-c577f6e90dfa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:49:59 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf35dc2-6422-4d79-9db0-41178b895c4d]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:49:59 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-94cb575b-3969-4d58-b06f-5b35538188fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:49:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9160eef-c687-4d75-a9cb-c577f6e90dfa -p 172.16.0.220:3260 --logout {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:49:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9160eef-c687-4d75-a9cb-c577f6e90dfa -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:49:59 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0b8c9f-b70b-42ed-9170-15282a169925]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:a9160eef-c687-4d75-a9cb-c577f6e90dfa, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:a9160eef-c687-4d75-a9cb-c577f6e90dfa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:49:59 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-94cb575b-3969-4d58-b06f-5b35538188fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:a9160eef-c687-4d75-a9cb-c577f6e90dfa, portal: 172.16.0.220,3260]
Oct 16 11:49:59 user nova-compute[74683]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:a9160eef-c687-4d75-a9cb-c577f6e90dfa, portal: 172.16.0.220,3260] successful.
Oct 16 11:49:59 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:49:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9160eef-c687-4d75-a9cb-c577f6e90dfa -p 172.16.0.220:3260 --op delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:49:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9160eef-c687-4d75-a9cb-c577f6e90dfa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:49:59 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a693ae-ccd7-4018-9601-6c1c5b80c48f]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:49:59 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-94cb575b-3969-4d58-b06f-5b35538188fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:49:59 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-94cb575b-3969-4d58-b06f-5b35538188fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:49:59 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-94cb575b-3969-4d58-b06f-5b35538188fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] <== disconnect_volume: return (309ms) None {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:49:59 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94cb575b-3969-4d58-b06f-5b35538188fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Disconnected iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 11:50:01 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:50:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:50:03 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-7b6d4f8d-64ec-47fb-8b66-bf399317e736 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Acquiring lock "4411a1a8-cd51-46b3-9f99-46670bb7e72e" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:50:03 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-7b6d4f8d-64ec-47fb-8b66-bf399317e736 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "4411a1a8-cd51-46b3-9f99-46670bb7e72e" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:50:03 user nova-compute[74683]: INFO nova.compute.manager [None req-7b6d4f8d-64ec-47fb-8b66-bf399317e736 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Shelving
Oct 16 11:50:03 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:50:03 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:50:03 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:50:03 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:50:03 user nova-compute[74683]: DEBUG nova.compute.manager [req-bdf5c75f-c4ab-477a-946d-d11b1abb09b2 req-6e1920e9-3dcd-429c-af8e-419fcc96a3e8 service nova] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Received event network-vif-unplugged-d82b8aef-5586-4582-9253-b964d495ce17 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:50:03 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-bdf5c75f-c4ab-477a-946d-d11b1abb09b2 req-6e1920e9-3dcd-429c-af8e-419fcc96a3e8 service nova] Acquiring lock "4411a1a8-cd51-46b3-9f99-46670bb7e72e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:50:03 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-bdf5c75f-c4ab-477a-946d-d11b1abb09b2 req-6e1920e9-3dcd-429c-af8e-419fcc96a3e8 service nova] Lock "4411a1a8-cd51-46b3-9f99-46670bb7e72e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:50:03 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-bdf5c75f-c4ab-477a-946d-d11b1abb09b2 req-6e1920e9-3dcd-429c-af8e-419fcc96a3e8 service nova] Lock "4411a1a8-cd51-46b3-9f99-46670bb7e72e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:50:03 user nova-compute[74683]: DEBUG nova.compute.manager [req-bdf5c75f-c4ab-477a-946d-d11b1abb09b2 req-6e1920e9-3dcd-429c-af8e-419fcc96a3e8 service nova] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] No waiting events found dispatching network-vif-unplugged-d82b8aef-5586-4582-9253-b964d495ce17 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:50:03 user nova-compute[74683]: WARNING nova.compute.manager [req-bdf5c75f-c4ab-477a-946d-d11b1abb09b2 req-6e1920e9-3dcd-429c-af8e-419fcc96a3e8 service nova] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Received unexpected event network-vif-unplugged-d82b8aef-5586-4582-9253-b964d495ce17 for instance with vm_state active and task_state shelving.
Oct 16 11:50:04 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:50:04 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:50:04 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:50:04 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Instance destroyed successfully.
Oct 16 11:50:04 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:50:04 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-7b6d4f8d-64ec-47fb-8b66-bf399317e736 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Beginning cold snapshot process
Oct 16 11:50:04 user nova-compute[74683]: DEBUG nova.privsep.utils [None req-7b6d4f8d-64ec-47fb-8b66-bf399317e736 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74683) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 11:50:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-7b6d4f8d-64ec-47fb-8b66-bf399317e736 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/4411a1a8-cd51-46b3-9f99-46670bb7e72e/disk /opt/stack/data/nova/instances/snapshots/tmpvfslwhl5/6353624c12a94ca3b7a23eb8b8cf120a {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:50:04 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:50:04 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:50:04 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:50:04 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:50:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:50:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:50:05 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-7b6d4f8d-64ec-47fb-8b66-bf399317e736 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/4411a1a8-cd51-46b3-9f99-46670bb7e72e/disk /opt/stack/data/nova/instances/snapshots/tmpvfslwhl5/6353624c12a94ca3b7a23eb8b8cf120a" returned: 0 in 0.569s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:50:05 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-7b6d4f8d-64ec-47fb-8b66-bf399317e736 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Snapshot extracted, beginning image upload
Oct 16 11:50:06 user nova-compute[74683]: DEBUG nova.compute.manager [req-66dfde44-b335-498b-9b56-b86068f427c4 req-2b496ff6-6240-4063-8e88-86b1656f9009 service nova] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Received event network-vif-plugged-d82b8aef-5586-4582-9253-b964d495ce17 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:50:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-66dfde44-b335-498b-9b56-b86068f427c4 req-2b496ff6-6240-4063-8e88-86b1656f9009 service nova] Acquiring lock "4411a1a8-cd51-46b3-9f99-46670bb7e72e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:50:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-66dfde44-b335-498b-9b56-b86068f427c4 req-2b496ff6-6240-4063-8e88-86b1656f9009 service nova] Lock "4411a1a8-cd51-46b3-9f99-46670bb7e72e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:50:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-66dfde44-b335-498b-9b56-b86068f427c4 req-2b496ff6-6240-4063-8e88-86b1656f9009 service nova] Lock "4411a1a8-cd51-46b3-9f99-46670bb7e72e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:50:06 user nova-compute[74683]: DEBUG nova.compute.manager [req-66dfde44-b335-498b-9b56-b86068f427c4 req-2b496ff6-6240-4063-8e88-86b1656f9009 service nova] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] No waiting events found dispatching network-vif-plugged-d82b8aef-5586-4582-9253-b964d495ce17 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:50:06 user nova-compute[74683]: WARNING nova.compute.manager [req-66dfde44-b335-498b-9b56-b86068f427c4 req-2b496ff6-6240-4063-8e88-86b1656f9009 service nova] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Received unexpected event network-vif-plugged-d82b8aef-5586-4582-9253-b964d495ce17 for instance with vm_state active and task_state shelving_image_uploading.
Oct 16 11:50:06 user nova-compute[74683]: DEBUG nova.compute.manager [req-66dfde44-b335-498b-9b56-b86068f427c4 req-2b496ff6-6240-4063-8e88-86b1656f9009 service nova] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Received event network-vif-plugged-d82b8aef-5586-4582-9253-b964d495ce17 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:50:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-66dfde44-b335-498b-9b56-b86068f427c4 req-2b496ff6-6240-4063-8e88-86b1656f9009 service nova] Acquiring lock "4411a1a8-cd51-46b3-9f99-46670bb7e72e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:50:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-66dfde44-b335-498b-9b56-b86068f427c4 req-2b496ff6-6240-4063-8e88-86b1656f9009 service nova] Lock "4411a1a8-cd51-46b3-9f99-46670bb7e72e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:50:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-66dfde44-b335-498b-9b56-b86068f427c4 req-2b496ff6-6240-4063-8e88-86b1656f9009 service nova] Lock "4411a1a8-cd51-46b3-9f99-46670bb7e72e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:50:06 user nova-compute[74683]: DEBUG nova.compute.manager [req-66dfde44-b335-498b-9b56-b86068f427c4 req-2b496ff6-6240-4063-8e88-86b1656f9009 service nova] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] No waiting events found dispatching network-vif-plugged-d82b8aef-5586-4582-9253-b964d495ce17 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:50:06 user nova-compute[74683]: WARNING nova.compute.manager [req-66dfde44-b335-498b-9b56-b86068f427c4 req-2b496ff6-6240-4063-8e88-86b1656f9009 service nova] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Received unexpected event network-vif-plugged-d82b8aef-5586-4582-9253-b964d495ce17 for instance with vm_state active and task_state shelving_image_uploading.
Oct 16 11:50:06 user nova-compute[74683]: DEBUG nova.compute.manager [req-66dfde44-b335-498b-9b56-b86068f427c4 req-2b496ff6-6240-4063-8e88-86b1656f9009 service nova] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Received event network-vif-plugged-d82b8aef-5586-4582-9253-b964d495ce17 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:50:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-66dfde44-b335-498b-9b56-b86068f427c4 req-2b496ff6-6240-4063-8e88-86b1656f9009 service nova] Acquiring lock "4411a1a8-cd51-46b3-9f99-46670bb7e72e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:50:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-66dfde44-b335-498b-9b56-b86068f427c4 req-2b496ff6-6240-4063-8e88-86b1656f9009 service nova] Lock "4411a1a8-cd51-46b3-9f99-46670bb7e72e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:50:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-66dfde44-b335-498b-9b56-b86068f427c4 req-2b496ff6-6240-4063-8e88-86b1656f9009 service nova] Lock "4411a1a8-cd51-46b3-9f99-46670bb7e72e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:50:06 user nova-compute[74683]: DEBUG nova.compute.manager [req-66dfde44-b335-498b-9b56-b86068f427c4 req-2b496ff6-6240-4063-8e88-86b1656f9009 service nova] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] No waiting events found dispatching network-vif-plugged-d82b8aef-5586-4582-9253-b964d495ce17 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:50:06 user nova-compute[74683]: WARNING nova.compute.manager [req-66dfde44-b335-498b-9b56-b86068f427c4 req-2b496ff6-6240-4063-8e88-86b1656f9009 service nova] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Received unexpected event network-vif-plugged-d82b8aef-5586-4582-9253-b964d495ce17 for instance with vm_state active and task_state shelving_image_uploading.
Oct 16 11:50:06 user nova-compute[74683]: DEBUG nova.compute.manager [req-66dfde44-b335-498b-9b56-b86068f427c4 req-2b496ff6-6240-4063-8e88-86b1656f9009 service nova] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Received event network-vif-unplugged-d82b8aef-5586-4582-9253-b964d495ce17 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:50:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-66dfde44-b335-498b-9b56-b86068f427c4 req-2b496ff6-6240-4063-8e88-86b1656f9009 service nova] Acquiring lock "4411a1a8-cd51-46b3-9f99-46670bb7e72e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:50:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-66dfde44-b335-498b-9b56-b86068f427c4 req-2b496ff6-6240-4063-8e88-86b1656f9009 service nova] Lock "4411a1a8-cd51-46b3-9f99-46670bb7e72e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:50:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-66dfde44-b335-498b-9b56-b86068f427c4 req-2b496ff6-6240-4063-8e88-86b1656f9009 service nova] Lock "4411a1a8-cd51-46b3-9f99-46670bb7e72e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:50:06 user nova-compute[74683]: DEBUG nova.compute.manager [req-66dfde44-b335-498b-9b56-b86068f427c4 req-2b496ff6-6240-4063-8e88-86b1656f9009 service nova] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] No waiting events found dispatching network-vif-unplugged-d82b8aef-5586-4582-9253-b964d495ce17 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:50:06 user nova-compute[74683]: WARNING nova.compute.manager [req-66dfde44-b335-498b-9b56-b86068f427c4 req-2b496ff6-6240-4063-8e88-86b1656f9009 service nova] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Received unexpected event network-vif-unplugged-d82b8aef-5586-4582-9253-b964d495ce17 for instance with vm_state active and task_state shelving_image_uploading.
Oct 16 11:50:06 user nova-compute[74683]: DEBUG nova.compute.manager [req-66dfde44-b335-498b-9b56-b86068f427c4 req-2b496ff6-6240-4063-8e88-86b1656f9009 service nova] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Received event network-vif-plugged-d82b8aef-5586-4582-9253-b964d495ce17 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:50:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-66dfde44-b335-498b-9b56-b86068f427c4 req-2b496ff6-6240-4063-8e88-86b1656f9009 service nova] Acquiring lock "4411a1a8-cd51-46b3-9f99-46670bb7e72e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:50:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-66dfde44-b335-498b-9b56-b86068f427c4 req-2b496ff6-6240-4063-8e88-86b1656f9009 service nova] Lock "4411a1a8-cd51-46b3-9f99-46670bb7e72e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:50:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-66dfde44-b335-498b-9b56-b86068f427c4 req-2b496ff6-6240-4063-8e88-86b1656f9009 service nova] Lock "4411a1a8-cd51-46b3-9f99-46670bb7e72e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:50:06 user nova-compute[74683]: DEBUG nova.compute.manager [req-66dfde44-b335-498b-9b56-b86068f427c4 req-2b496ff6-6240-4063-8e88-86b1656f9009 service nova] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] No waiting events found dispatching network-vif-plugged-d82b8aef-5586-4582-9253-b964d495ce17 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:50:06 user nova-compute[74683]: WARNING nova.compute.manager [req-66dfde44-b335-498b-9b56-b86068f427c4 req-2b496ff6-6240-4063-8e88-86b1656f9009 service nova] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Received unexpected event network-vif-plugged-d82b8aef-5586-4582-9253-b964d495ce17 for instance with vm_state active and task_state shelving_image_uploading.
Oct 16 11:50:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:50:07 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-7b6d4f8d-64ec-47fb-8b66-bf399317e736 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Snapshot image upload complete
Oct 16 11:50:07 user nova-compute[74683]: DEBUG nova.compute.manager [None req-7b6d4f8d-64ec-47fb-8b66-bf399317e736 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:50:07 user nova-compute[74683]: INFO nova.compute.manager [None req-7b6d4f8d-64ec-47fb-8b66-bf399317e736 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Shelve offloading
Oct 16 11:50:07 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Instance destroyed successfully.
Oct 16 11:50:07 user nova-compute[74683]: DEBUG nova.compute.manager [None req-7b6d4f8d-64ec-47fb-8b66-bf399317e736 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:50:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-7b6d4f8d-64ec-47fb-8b66-bf399317e736 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Acquiring lock "refresh_cache-4411a1a8-cd51-46b3-9f99-46670bb7e72e" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:50:07 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-7b6d4f8d-64ec-47fb-8b66-bf399317e736 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Acquired lock "refresh_cache-4411a1a8-cd51-46b3-9f99-46670bb7e72e" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:50:07 user nova-compute[74683]: DEBUG nova.network.neutron [None req-7b6d4f8d-64ec-47fb-8b66-bf399317e736 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:50:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:50:08 user nova-compute[74683]: DEBUG nova.network.neutron [None req-7b6d4f8d-64ec-47fb-8b66-bf399317e736 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Updating instance_info_cache with network_info: [{"id": "d82b8aef-5586-4582-9253-b964d495ce17", "address": "fa:16:3e:05:e7:3e", "network": {"id": "2ea750a5-8511-4e40-b149-062e10e0096c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-563467594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d2c7c33914a068b448c447db50b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd82b8aef-55", "ovs_interfaceid": "d82b8aef-5586-4582-9253-b964d495ce17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:50:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-7b6d4f8d-64ec-47fb-8b66-bf399317e736 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Releasing lock "refresh_cache-4411a1a8-cd51-46b3-9f99-46670bb7e72e" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:50:08 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Instance destroyed successfully.
Oct 16 11:50:08 user nova-compute[74683]: DEBUG nova.objects.instance [None req-7b6d4f8d-64ec-47fb-8b66-bf399317e736 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lazy-loading 'resources' on Instance uuid 4411a1a8-cd51-46b3-9f99-46670bb7e72e {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:50:08 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-7b6d4f8d-64ec-47fb-8b66-bf399317e736 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:48:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1398782217',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1398782217',id=50,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkjneMok6wxawPFluQoU/qX70mjcBLziRvERAL2SLF5JzucZefDlpd9cZZ9qDE1gaEMvkkp21bQmMlLaAlzbn/Yb1Cc+gwzL4SGhCqcfuWKGvbSFG8xR2wBd60BfbY1EQ==',key_name='tempest-keypair-253079390',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:48:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='622d2c7c33914a068b448c447db50b3c',ramdisk_id='',reservation_id='r-avxku7yo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-291825158',owner_user_name='tempest-AttachVolumeShelveTestJSON-291825158-project-member',shelved_at='2023-10-16T11:50:07.602397',shelved_host='user',shelved_image_id='4b928905-4725-4c50-9a1c-0551f5a1dd27'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:50:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11130271beb44b368f9eb55bd4946cbc',uuid=4411a1a8-cd51-46b3-9f99-46670bb7e72e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "d82b8aef-5586-4582-9253-b964d495ce17", "address": "fa:16:3e:05:e7:3e", "network": {"id": "2ea750a5-8511-4e40-b149-062e10e0096c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-563467594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d2c7c33914a068b448c447db50b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd82b8aef-55", "ovs_interfaceid": "d82b8aef-5586-4582-9253-b964d495ce17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:50:08 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-7b6d4f8d-64ec-47fb-8b66-bf399317e736 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Converting VIF {"id": "d82b8aef-5586-4582-9253-b964d495ce17", "address": "fa:16:3e:05:e7:3e", "network": {"id": "2ea750a5-8511-4e40-b149-062e10e0096c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-563467594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d2c7c33914a068b448c447db50b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd82b8aef-55", "ovs_interfaceid": "d82b8aef-5586-4582-9253-b964d495ce17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:50:08 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-7b6d4f8d-64ec-47fb-8b66-bf399317e736 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:e7:3e,bridge_name='br-int',has_traffic_filtering=True,id=d82b8aef-5586-4582-9253-b964d495ce17,network=Network(2ea750a5-8511-4e40-b149-062e10e0096c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd82b8aef-55') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:50:08 user nova-compute[74683]: DEBUG os_vif [None req-7b6d4f8d-64ec-47fb-8b66-bf399317e736 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:e7:3e,bridge_name='br-int',has_traffic_filtering=True,id=d82b8aef-5586-4582-9253-b964d495ce17,network=Network(2ea750a5-8511-4e40-b149-062e10e0096c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd82b8aef-55') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:50:08 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:50:08 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd82b8aef-55, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:50:08 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:50:08 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:50:08 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:50:08 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ee1ff52e-9585-4320-b063-0b25129cc34c) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:50:08 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:50:08 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:50:08 user nova-compute[74683]: INFO os_vif [None req-7b6d4f8d-64ec-47fb-8b66-bf399317e736 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:e7:3e,bridge_name='br-int',has_traffic_filtering=True,id=d82b8aef-5586-4582-9253-b964d495ce17,network=Network(2ea750a5-8511-4e40-b149-062e10e0096c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd82b8aef-55')
Oct 16 11:50:08 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-7b6d4f8d-64ec-47fb-8b66-bf399317e736 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Deleting instance files /opt/stack/data/nova/instances/4411a1a8-cd51-46b3-9f99-46670bb7e72e_del
Oct 16 11:50:08 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-7b6d4f8d-64ec-47fb-8b66-bf399317e736 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Deletion of /opt/stack/data/nova/instances/4411a1a8-cd51-46b3-9f99-46670bb7e72e_del complete
Oct 16 11:50:08 user nova-compute[74683]: DEBUG nova.compute.manager [req-c6fc8581-a5d3-4476-b9f1-c7b52405f22e req-2a699a4b-0ba5-415f-b1ab-d149c9f778ac service nova] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Received event network-changed-d82b8aef-5586-4582-9253-b964d495ce17 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:50:08 user nova-compute[74683]: DEBUG nova.compute.manager [req-c6fc8581-a5d3-4476-b9f1-c7b52405f22e req-2a699a4b-0ba5-415f-b1ab-d149c9f778ac service nova] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Refreshing instance network info cache due to event network-changed-d82b8aef-5586-4582-9253-b964d495ce17. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:50:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c6fc8581-a5d3-4476-b9f1-c7b52405f22e req-2a699a4b-0ba5-415f-b1ab-d149c9f778ac service nova] Acquiring lock "refresh_cache-4411a1a8-cd51-46b3-9f99-46670bb7e72e" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:50:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c6fc8581-a5d3-4476-b9f1-c7b52405f22e req-2a699a4b-0ba5-415f-b1ab-d149c9f778ac service nova] Acquired lock "refresh_cache-4411a1a8-cd51-46b3-9f99-46670bb7e72e" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:50:08 user nova-compute[74683]: DEBUG nova.network.neutron [req-c6fc8581-a5d3-4476-b9f1-c7b52405f22e req-2a699a4b-0ba5-415f-b1ab-d149c9f778ac service nova] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Refreshing network info cache for port d82b8aef-5586-4582-9253-b964d495ce17 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:50:08 user nova-compute[74683]: INFO nova.scheduler.client.report [None req-7b6d4f8d-64ec-47fb-8b66-bf399317e736 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Deleted allocations for instance 4411a1a8-cd51-46b3-9f99-46670bb7e72e
Oct 16 11:50:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-7b6d4f8d-64ec-47fb-8b66-bf399317e736 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:50:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-7b6d4f8d-64ec-47fb-8b66-bf399317e736 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:50:08 user nova-compute[74683]: DEBUG nova.objects.instance [None req-7b6d4f8d-64ec-47fb-8b66-bf399317e736 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lazy-loading 'numa_topology' on Instance uuid 4411a1a8-cd51-46b3-9f99-46670bb7e72e {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:50:08 user nova-compute[74683]: DEBUG nova.objects.base [None req-7b6d4f8d-64ec-47fb-8b66-bf399317e736 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Object Instance<4411a1a8-cd51-46b3-9f99-46670bb7e72e> lazy-loaded attributes: resources,numa_topology {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:50:09 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-7b6d4f8d-64ec-47fb-8b66-bf399317e736 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:50:09 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-7b6d4f8d-64ec-47fb-8b66-bf399317e736 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:50:09 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-7b6d4f8d-64ec-47fb-8b66-bf399317e736 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.156s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:50:09 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-7b6d4f8d-64ec-47fb-8b66-bf399317e736 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "4411a1a8-cd51-46b3-9f99-46670bb7e72e" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.666s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:50:09 user nova-compute[74683]: DEBUG nova.network.neutron [req-c6fc8581-a5d3-4476-b9f1-c7b52405f22e req-2a699a4b-0ba5-415f-b1ab-d149c9f778ac service nova] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Updated VIF entry in instance network info cache for port d82b8aef-5586-4582-9253-b964d495ce17. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:50:09 user nova-compute[74683]: DEBUG nova.network.neutron [req-c6fc8581-a5d3-4476-b9f1-c7b52405f22e req-2a699a4b-0ba5-415f-b1ab-d149c9f778ac service nova] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Updating instance_info_cache with network_info: [{"id": "d82b8aef-5586-4582-9253-b964d495ce17", "address": "fa:16:3e:05:e7:3e", "network": {"id": "2ea750a5-8511-4e40-b149-062e10e0096c", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-563467594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d2c7c33914a068b448c447db50b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapd82b8aef-55", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:50:09 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-c6fc8581-a5d3-4476-b9f1-c7b52405f22e req-2a699a4b-0ba5-415f-b1ab-d149c9f778ac service nova] Releasing lock "refresh_cache-4411a1a8-cd51-46b3-9f99-46670bb7e72e" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:50:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:50:13 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:50:14 user nova-compute[74683]: DEBUG nova.objects.instance [None req-94cb575b-3969-4d58-b06f-5b35538188fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lazy-loading 'flavor' on Instance uuid 6b413793-f051-432c-83e0-57c3b0cd8fe0 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:50:15 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-94cb575b-3969-4d58-b06f-5b35538188fd tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "6b413793-f051-432c-83e0-57c3b0cd8fe0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 36.591s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:50:18 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:50:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:50:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:50:28 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:50:29 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:50:30 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:50:33 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._sync_power_states {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:50:33 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Triggering sync for uuid 6b413793-f051-432c-83e0-57c3b0cd8fe0 {{(pid=74683) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 11:50:33 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Triggering sync for uuid d35db024-18c5-4281-9518-7fd351811e6f {{(pid=74683) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 11:50:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "6b413793-f051-432c-83e0-57c3b0cd8fe0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:50:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "6b413793-f051-432c-83e0-57c3b0cd8fe0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:50:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "d35db024-18c5-4281-9518-7fd351811e6f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:50:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "d35db024-18c5-4281-9518-7fd351811e6f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:50:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "6b413793-f051-432c-83e0-57c3b0cd8fe0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:50:33 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "d35db024-18c5-4281-9518-7fd351811e6f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:50:33 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:50:33 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:50:33 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:50:34 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:50:34 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Starting heal instance info cache {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 11:50:34 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Skipping network cache update for instance because it has been migrated to another host. {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9965}}
Oct 16 11:50:34 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "refresh_cache-d35db024-18c5-4281-9518-7fd351811e6f" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:50:34 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquired lock "refresh_cache-d35db024-18c5-4281-9518-7fd351811e6f" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:50:34 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Forcefully refreshing network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 11:50:35 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Updating instance_info_cache with network_info: [{"id": "f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f", "address": "fa:16:3e:72:48:68", "network": {"id": "893d103e-5e60-4e15-9617-530ec1b284c1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1497002321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e892ddc4503c42a5a5724f1ea3933a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a7ee77-cd", "ovs_interfaceid": "f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:50:35 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Releasing lock "refresh_cache-d35db024-18c5-4281-9518-7fd351811e6f" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:50:35 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Updated the network info_cache for instance {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 11:50:35 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:50:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-4024b299-f5ae-41a3-8245-0bec24d775ec tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Acquiring lock "6b413793-f051-432c-83e0-57c3b0cd8fe0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:50:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-4024b299-f5ae-41a3-8245-0bec24d775ec tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "6b413793-f051-432c-83e0-57c3b0cd8fe0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:50:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-4024b299-f5ae-41a3-8245-0bec24d775ec tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Acquiring lock "6b413793-f051-432c-83e0-57c3b0cd8fe0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:50:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-4024b299-f5ae-41a3-8245-0bec24d775ec tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "6b413793-f051-432c-83e0-57c3b0cd8fe0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:50:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-4024b299-f5ae-41a3-8245-0bec24d775ec tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "6b413793-f051-432c-83e0-57c3b0cd8fe0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:50:37 user nova-compute[74683]: INFO nova.compute.manager [None req-4024b299-f5ae-41a3-8245-0bec24d775ec tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Terminating instance
Oct 16 11:50:37 user nova-compute[74683]: DEBUG nova.compute.manager [None req-4024b299-f5ae-41a3-8245-0bec24d775ec tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Start destroying the instance on the hypervisor. {{(pid=74683) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 11:50:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:50:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:50:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:50:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:50:37 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:50:37 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74683) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 11:50:37 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:50:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:50:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:50:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:50:37 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Auditing locally available compute resources for user (node: user) {{(pid=74683) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 11:50:37 user nova-compute[74683]: DEBUG nova.compute.manager [req-8da5d8ab-64ff-40be-8ddb-91bf3df460e9 req-91f058b7-90ab-4448-9890-eb3324c9efbb service nova] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Received event network-vif-unplugged-b704ce74-3ed5-4f87-9cc8-a2e79c5f2686 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:50:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-8da5d8ab-64ff-40be-8ddb-91bf3df460e9 req-91f058b7-90ab-4448-9890-eb3324c9efbb service nova] Acquiring lock "6b413793-f051-432c-83e0-57c3b0cd8fe0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:50:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-8da5d8ab-64ff-40be-8ddb-91bf3df460e9 req-91f058b7-90ab-4448-9890-eb3324c9efbb service nova] Lock "6b413793-f051-432c-83e0-57c3b0cd8fe0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:50:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-8da5d8ab-64ff-40be-8ddb-91bf3df460e9 req-91f058b7-90ab-4448-9890-eb3324c9efbb service nova] Lock "6b413793-f051-432c-83e0-57c3b0cd8fe0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:50:37 user nova-compute[74683]: DEBUG nova.compute.manager [req-8da5d8ab-64ff-40be-8ddb-91bf3df460e9 req-91f058b7-90ab-4448-9890-eb3324c9efbb service nova] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] No waiting events found dispatching network-vif-unplugged-b704ce74-3ed5-4f87-9cc8-a2e79c5f2686 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:50:37 user nova-compute[74683]: DEBUG nova.compute.manager [req-8da5d8ab-64ff-40be-8ddb-91bf3df460e9 req-91f058b7-90ab-4448-9890-eb3324c9efbb service nova] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Received event network-vif-unplugged-b704ce74-3ed5-4f87-9cc8-a2e79c5f2686 for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 11:50:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:50:38 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Instance destroyed successfully.
Oct 16 11:50:38 user nova-compute[74683]: DEBUG nova.objects.instance [None req-4024b299-f5ae-41a3-8245-0bec24d775ec tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lazy-loading 'resources' on Instance uuid 6b413793-f051-432c-83e0-57c3b0cd8fe0 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:50:38 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-4024b299-f5ae-41a3-8245-0bec24d775ec tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:45:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1561153830',display_name='tempest-TestMinimumBasicScenario-server-1561153830',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1561153830',id=49,image_ref='0b5ca083-cbac-428b-995c-21d45c134ea3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbq1M6CbTv9Kq87utCBwWTW5WPDtN6ZWdDN7lgZ8QpmolFhyUxlfMeLXmZZryk31Im7+Pr7xc6RYPPxwCVFM2+yNIsnT12OtbvwqrbSR537LGBEgcbNQrG3jKPWV0kmug==',key_name='tempest-TestMinimumBasicScenario-2029896967',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:45:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f1ce607a3614fc493d33e6ba8ca5807',ramdisk_id='',reservation_id='r-rl1o9dkm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b5ca083-cbac-428b-995c-21d45c134ea3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-470564601',owner_user_name='tempest-TestMinimumBasicScenario-470564601-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:47:52Z,user_data=None,user_id='7bd40e88d3914927a7804e3b4fb26549',uuid=6b413793-f051-432c-83e0-57c3b0cd8fe0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b704ce74-3ed5-4f87-9cc8-a2e79c5f2686", "address": "fa:16:3e:82:8e:5d", "network": {"id": "1fa0852d-814a-45ef-80fa-171693e4d02a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-184537544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ce607a3614fc493d33e6ba8ca5807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb704ce74-3e", "ovs_interfaceid": "b704ce74-3ed5-4f87-9cc8-a2e79c5f2686", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:50:38 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-4024b299-f5ae-41a3-8245-0bec24d775ec tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Converting VIF {"id": "b704ce74-3ed5-4f87-9cc8-a2e79c5f2686", "address": "fa:16:3e:82:8e:5d", "network": {"id": "1fa0852d-814a-45ef-80fa-171693e4d02a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-184537544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ce607a3614fc493d33e6ba8ca5807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb704ce74-3e", "ovs_interfaceid": "b704ce74-3ed5-4f87-9cc8-a2e79c5f2686", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:50:38 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-4024b299-f5ae-41a3-8245-0bec24d775ec tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:82:8e:5d,bridge_name='br-int',has_traffic_filtering=True,id=b704ce74-3ed5-4f87-9cc8-a2e79c5f2686,network=Network(1fa0852d-814a-45ef-80fa-171693e4d02a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb704ce74-3e') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:50:38 user nova-compute[74683]: DEBUG os_vif [None req-4024b299-f5ae-41a3-8245-0bec24d775ec tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:8e:5d,bridge_name='br-int',has_traffic_filtering=True,id=b704ce74-3ed5-4f87-9cc8-a2e79c5f2686,network=Network(1fa0852d-814a-45ef-80fa-171693e4d02a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb704ce74-3e') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:50:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:50:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb704ce74-3e, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:50:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:50:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:50:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:50:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=72c66859-e422-475c-9e2a-68fab20a3f1a) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:50:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:50:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:50:38 user nova-compute[74683]: INFO os_vif [None req-4024b299-f5ae-41a3-8245-0bec24d775ec tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:8e:5d,bridge_name='br-int',has_traffic_filtering=True,id=b704ce74-3ed5-4f87-9cc8-a2e79c5f2686,network=Network(1fa0852d-814a-45ef-80fa-171693e4d02a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb704ce74-3e')
Oct 16 11:50:38 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-4024b299-f5ae-41a3-8245-0bec24d775ec tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Deleting instance files /opt/stack/data/nova/instances/6b413793-f051-432c-83e0-57c3b0cd8fe0_del
Oct 16 11:50:38 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-4024b299-f5ae-41a3-8245-0bec24d775ec tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Deletion of /opt/stack/data/nova/instances/6b413793-f051-432c-83e0-57c3b0cd8fe0_del complete
Oct 16 11:50:38 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000031, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/6b413793-f051-432c-83e0-57c3b0cd8fe0/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/6b413793-f051-432c-83e0-57c3b0cd8fe0/disk
Oct 16 11:50:38 user nova-compute[74683]: INFO nova.compute.manager [None req-4024b299-f5ae-41a3-8245-0bec24d775ec tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Took 0.85 seconds to destroy the instance on the hypervisor.
Oct 16 11:50:38 user nova-compute[74683]: DEBUG oslo.service.loopingcall [None req-4024b299-f5ae-41a3-8245-0bec24d775ec tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74683) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 11:50:38 user nova-compute[74683]: DEBUG nova.compute.manager [-] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Deallocating network for instance {{(pid=74683) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 11:50:38 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] deallocate_for_instance() {{(pid=74683) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 11:50:38 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:50:38 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:50:38 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:50:38 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Hypervisor/Node resource view: name=user free_ram=8888MB free_disk=25.010169982910156GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74683) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 11:50:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:50:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:50:38 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 6b413793-f051-432c-83e0-57c3b0cd8fe0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:50:38 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance d35db024-18c5-4281-9518-7fd351811e6f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:50:38 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 11:50:38 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 11:50:38 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:50:38 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:50:38 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Compute_service record updated for user:user {{(pid=74683) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 11:50:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.213s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:50:39 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:50:39 user nova-compute[74683]: INFO nova.compute.manager [-] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Took 0.75 seconds to deallocate network for instance.
Oct 16 11:50:39 user nova-compute[74683]: DEBUG nova.compute.manager [req-6df94dee-84d7-4454-86d9-771f19446e69 req-4d7e129d-5b22-4a81-bebe-30883697caf2 service nova] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Received event network-vif-deleted-b704ce74-3ed5-4f87-9cc8-a2e79c5f2686 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:50:39 user nova-compute[74683]: INFO nova.compute.manager [req-6df94dee-84d7-4454-86d9-771f19446e69 req-4d7e129d-5b22-4a81-bebe-30883697caf2 service nova] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Neutron deleted interface b704ce74-3ed5-4f87-9cc8-a2e79c5f2686; detaching it from the instance and deleting it from the info cache
Oct 16 11:50:39 user nova-compute[74683]: DEBUG nova.network.neutron [req-6df94dee-84d7-4454-86d9-771f19446e69 req-4d7e129d-5b22-4a81-bebe-30883697caf2 service nova] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:50:39 user nova-compute[74683]: DEBUG nova.compute.manager [req-6df94dee-84d7-4454-86d9-771f19446e69 req-4d7e129d-5b22-4a81-bebe-30883697caf2 service nova] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Detach interface failed, port_id=b704ce74-3ed5-4f87-9cc8-a2e79c5f2686, reason: Instance 6b413793-f051-432c-83e0-57c3b0cd8fe0 could not be found. {{(pid=74683) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 16 11:50:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-4024b299-f5ae-41a3-8245-0bec24d775ec tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:50:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-4024b299-f5ae-41a3-8245-0bec24d775ec tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:50:39 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-4024b299-f5ae-41a3-8245-0bec24d775ec tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:50:39 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-4024b299-f5ae-41a3-8245-0bec24d775ec tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:50:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-4024b299-f5ae-41a3-8245-0bec24d775ec tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.130s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:50:39 user nova-compute[74683]: INFO nova.scheduler.client.report [None req-4024b299-f5ae-41a3-8245-0bec24d775ec tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Deleted allocations for instance 6b413793-f051-432c-83e0-57c3b0cd8fe0
Oct 16 11:50:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-4024b299-f5ae-41a3-8245-0bec24d775ec tempest-TestMinimumBasicScenario-470564601 tempest-TestMinimumBasicScenario-470564601-project-member] Lock "6b413793-f051-432c-83e0-57c3b0cd8fe0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.914s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:50:39 user nova-compute[74683]: DEBUG nova.compute.manager [req-408457d7-4601-462f-960a-45eb40f7e628 req-e7515150-5020-498d-8da2-1f00b2e7bcf8 service nova] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Received event network-vif-plugged-b704ce74-3ed5-4f87-9cc8-a2e79c5f2686 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:50:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-408457d7-4601-462f-960a-45eb40f7e628 req-e7515150-5020-498d-8da2-1f00b2e7bcf8 service nova] Acquiring lock "6b413793-f051-432c-83e0-57c3b0cd8fe0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:50:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-408457d7-4601-462f-960a-45eb40f7e628 req-e7515150-5020-498d-8da2-1f00b2e7bcf8 service nova] Lock "6b413793-f051-432c-83e0-57c3b0cd8fe0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:50:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-408457d7-4601-462f-960a-45eb40f7e628 req-e7515150-5020-498d-8da2-1f00b2e7bcf8 service nova] Lock "6b413793-f051-432c-83e0-57c3b0cd8fe0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:50:39 user nova-compute[74683]: DEBUG nova.compute.manager [req-408457d7-4601-462f-960a-45eb40f7e628 req-e7515150-5020-498d-8da2-1f00b2e7bcf8 service nova] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] No waiting events found dispatching network-vif-plugged-b704ce74-3ed5-4f87-9cc8-a2e79c5f2686 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:50:39 user nova-compute[74683]: WARNING nova.compute.manager [req-408457d7-4601-462f-960a-45eb40f7e628 req-e7515150-5020-498d-8da2-1f00b2e7bcf8 service nova] [instance: 6b413793-f051-432c-83e0-57c3b0cd8fe0] Received unexpected event network-vif-plugged-b704ce74-3ed5-4f87-9cc8-a2e79c5f2686 for instance with vm_state deleted and task_state None.
Oct 16 11:50:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:50:45 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:50:48 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:50:53 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:50:54 user nova-compute[74683]: DEBUG nova.compute.manager [req-584b0304-2c5b-4706-8c16-94ce032ed89c req-d941119d-be32-46e5-9e2b-077c7ef12d49 service nova] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Received event network-changed-f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:50:54 user nova-compute[74683]: DEBUG nova.compute.manager [req-584b0304-2c5b-4706-8c16-94ce032ed89c req-d941119d-be32-46e5-9e2b-077c7ef12d49 service nova] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Refreshing instance network info cache due to event network-changed-f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:50:54 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-584b0304-2c5b-4706-8c16-94ce032ed89c req-d941119d-be32-46e5-9e2b-077c7ef12d49 service nova] Acquiring lock "refresh_cache-d35db024-18c5-4281-9518-7fd351811e6f" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:50:54 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-584b0304-2c5b-4706-8c16-94ce032ed89c req-d941119d-be32-46e5-9e2b-077c7ef12d49 service nova] Acquired lock "refresh_cache-d35db024-18c5-4281-9518-7fd351811e6f" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:50:54 user nova-compute[74683]: DEBUG nova.network.neutron [req-584b0304-2c5b-4706-8c16-94ce032ed89c req-d941119d-be32-46e5-9e2b-077c7ef12d49 service nova] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Refreshing network info cache for port f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:50:54 user nova-compute[74683]: DEBUG nova.network.neutron [req-584b0304-2c5b-4706-8c16-94ce032ed89c req-d941119d-be32-46e5-9e2b-077c7ef12d49 service nova] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Updated VIF entry in instance network info cache for port f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:50:54 user nova-compute[74683]: DEBUG nova.network.neutron [req-584b0304-2c5b-4706-8c16-94ce032ed89c req-d941119d-be32-46e5-9e2b-077c7ef12d49 service nova] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Updating instance_info_cache with network_info: [{"id": "f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f", "address": "fa:16:3e:72:48:68", "network": {"id": "893d103e-5e60-4e15-9617-530ec1b284c1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1497002321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e892ddc4503c42a5a5724f1ea3933a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a7ee77-cd", "ovs_interfaceid": "f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:50:54 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-584b0304-2c5b-4706-8c16-94ce032ed89c req-d941119d-be32-46e5-9e2b-077c7ef12d49 service nova] Releasing lock "refresh_cache-d35db024-18c5-4281-9518-7fd351811e6f" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:50:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-cbbc2f92-c1d7-4d8f-b71a-565a33cca70d tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Acquiring lock "d35db024-18c5-4281-9518-7fd351811e6f" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:50:55 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-cbbc2f92-c1d7-4d8f-b71a-565a33cca70d tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Lock "d35db024-18c5-4281-9518-7fd351811e6f" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:50:55 user nova-compute[74683]: INFO nova.compute.manager [None req-cbbc2f92-c1d7-4d8f-b71a-565a33cca70d tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Shelve offloading
Oct 16 11:50:55 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:50:55 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:50:55 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:50:55 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:50:55 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:50:56 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Instance destroyed successfully.
Oct 16 11:50:56 user nova-compute[74683]: DEBUG nova.compute.manager [None req-cbbc2f92-c1d7-4d8f-b71a-565a33cca70d tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:50:56 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-cbbc2f92-c1d7-4d8f-b71a-565a33cca70d tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Acquiring lock "refresh_cache-d35db024-18c5-4281-9518-7fd351811e6f" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:50:56 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-cbbc2f92-c1d7-4d8f-b71a-565a33cca70d tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Acquired lock "refresh_cache-d35db024-18c5-4281-9518-7fd351811e6f" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:50:56 user nova-compute[74683]: DEBUG nova.network.neutron [None req-cbbc2f92-c1d7-4d8f-b71a-565a33cca70d tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:50:56 user nova-compute[74683]: DEBUG nova.compute.manager [req-50138cf9-abf6-41a5-b3fa-cc3d8afb75cf req-ac30a468-3cf0-4d33-97d1-d1984f3687d9 service nova] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Received event network-vif-unplugged-f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:50:56 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-50138cf9-abf6-41a5-b3fa-cc3d8afb75cf req-ac30a468-3cf0-4d33-97d1-d1984f3687d9 service nova] Acquiring lock "d35db024-18c5-4281-9518-7fd351811e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:50:56 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-50138cf9-abf6-41a5-b3fa-cc3d8afb75cf req-ac30a468-3cf0-4d33-97d1-d1984f3687d9 service nova] Lock "d35db024-18c5-4281-9518-7fd351811e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:50:56 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-50138cf9-abf6-41a5-b3fa-cc3d8afb75cf req-ac30a468-3cf0-4d33-97d1-d1984f3687d9 service nova] Lock "d35db024-18c5-4281-9518-7fd351811e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:50:56 user nova-compute[74683]: DEBUG nova.compute.manager [req-50138cf9-abf6-41a5-b3fa-cc3d8afb75cf req-ac30a468-3cf0-4d33-97d1-d1984f3687d9 service nova] [instance: d35db024-18c5-4281-9518-7fd351811e6f] No waiting events found dispatching network-vif-unplugged-f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:50:56 user nova-compute[74683]: WARNING nova.compute.manager [req-50138cf9-abf6-41a5-b3fa-cc3d8afb75cf req-ac30a468-3cf0-4d33-97d1-d1984f3687d9 service nova] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Received unexpected event network-vif-unplugged-f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f for instance with vm_state active and task_state shelving.
Oct 16 11:50:56 user nova-compute[74683]: DEBUG nova.compute.manager [req-50138cf9-abf6-41a5-b3fa-cc3d8afb75cf req-ac30a468-3cf0-4d33-97d1-d1984f3687d9 service nova] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Received event network-vif-plugged-f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:50:56 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-50138cf9-abf6-41a5-b3fa-cc3d8afb75cf req-ac30a468-3cf0-4d33-97d1-d1984f3687d9 service nova] Acquiring lock "d35db024-18c5-4281-9518-7fd351811e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:50:56 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-50138cf9-abf6-41a5-b3fa-cc3d8afb75cf req-ac30a468-3cf0-4d33-97d1-d1984f3687d9 service nova] Lock "d35db024-18c5-4281-9518-7fd351811e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:50:56 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-50138cf9-abf6-41a5-b3fa-cc3d8afb75cf req-ac30a468-3cf0-4d33-97d1-d1984f3687d9 service nova] Lock "d35db024-18c5-4281-9518-7fd351811e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:50:56 user nova-compute[74683]: DEBUG nova.compute.manager [req-50138cf9-abf6-41a5-b3fa-cc3d8afb75cf req-ac30a468-3cf0-4d33-97d1-d1984f3687d9 service nova] [instance: d35db024-18c5-4281-9518-7fd351811e6f] No waiting events found dispatching network-vif-plugged-f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:50:56 user nova-compute[74683]: WARNING nova.compute.manager [req-50138cf9-abf6-41a5-b3fa-cc3d8afb75cf req-ac30a468-3cf0-4d33-97d1-d1984f3687d9 service nova] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Received unexpected event network-vif-plugged-f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f for instance with vm_state active and task_state shelving.
Oct 16 11:50:56 user nova-compute[74683]: DEBUG nova.network.neutron [None req-cbbc2f92-c1d7-4d8f-b71a-565a33cca70d tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Updating instance_info_cache with network_info: [{"id": "f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f", "address": "fa:16:3e:72:48:68", "network": {"id": "893d103e-5e60-4e15-9617-530ec1b284c1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1497002321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e892ddc4503c42a5a5724f1ea3933a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a7ee77-cd", "ovs_interfaceid": "f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:50:56 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-cbbc2f92-c1d7-4d8f-b71a-565a33cca70d tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Releasing lock "refresh_cache-d35db024-18c5-4281-9518-7fd351811e6f" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:50:57 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Instance destroyed successfully.
Oct 16 11:50:57 user nova-compute[74683]: DEBUG nova.objects.instance [None req-cbbc2f92-c1d7-4d8f-b71a-565a33cca70d tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Lazy-loading 'resources' on Instance uuid d35db024-18c5-4281-9518-7fd351811e6f {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:50:57 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-cbbc2f92-c1d7-4d8f-b71a-565a33cca70d tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:49:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2144957190',display_name='tempest-TestShelveInstance-server-2144957190',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2144957190',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfm6FrJOA0WYRBy7wT7iNCupFsFZVd6Aq+19ZRioq/2RyWJNDIrJ0fsOj3lJoLuQCVoc7/fo6IFP4c6X+8hjsPPsbmQFAlV9644xjIYyaH1rp5jWUE3kh/muw9UkmtKXQ==',key_name='tempest-TestShelveInstance-527121964',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:49:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e892ddc4503c42a5a5724f1ea3933a88',ramdisk_id='',reservation_id='r-tnn3schj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-547173108',owner_user_name='tempest-TestShelveInstance-547173108-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:49:25Z,user_data=None,user_id='c7c151337018403599b6d06a6d82f7d2',uuid=d35db024-18c5-4281-9518-7fd351811e6f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f", "address": "fa:16:3e:72:48:68", "network": {"id": "893d103e-5e60-4e15-9617-530ec1b284c1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1497002321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e892ddc4503c42a5a5724f1ea3933a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a7ee77-cd", "ovs_interfaceid": "f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:50:57 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-cbbc2f92-c1d7-4d8f-b71a-565a33cca70d tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Converting VIF {"id": "f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f", "address": "fa:16:3e:72:48:68", "network": {"id": "893d103e-5e60-4e15-9617-530ec1b284c1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1497002321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e892ddc4503c42a5a5724f1ea3933a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a7ee77-cd", "ovs_interfaceid": "f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:50:57 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-cbbc2f92-c1d7-4d8f-b71a-565a33cca70d tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:48:68,bridge_name='br-int',has_traffic_filtering=True,id=f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f,network=Network(893d103e-5e60-4e15-9617-530ec1b284c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4a7ee77-cd') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:50:57 user nova-compute[74683]: DEBUG os_vif [None req-cbbc2f92-c1d7-4d8f-b71a-565a33cca70d tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:48:68,bridge_name='br-int',has_traffic_filtering=True,id=f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f,network=Network(893d103e-5e60-4e15-9617-530ec1b284c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4a7ee77-cd') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:50:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:50:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4a7ee77-cd, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:50:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:50:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:50:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:50:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=78f51f43-a384-408a-8e6e-1e058a927990) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:50:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:50:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:50:57 user nova-compute[74683]: INFO os_vif [None req-cbbc2f92-c1d7-4d8f-b71a-565a33cca70d tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:48:68,bridge_name='br-int',has_traffic_filtering=True,id=f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f,network=Network(893d103e-5e60-4e15-9617-530ec1b284c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4a7ee77-cd')
Oct 16 11:50:57 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbbc2f92-c1d7-4d8f-b71a-565a33cca70d tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] calling os-brick to detach iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 11:50:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbc2f92-c1d7-4d8f-b71a-565a33cca70d tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, {'target_iqn': 'iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LKoeZfiz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:50:57 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-cbbc2f92-c1d7-4d8f-b71a-565a33cca70d tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:50:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-cbbc2f92-c1d7-4d8f-b71a-565a33cca70d tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:50:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-cbbc2f92-c1d7-4d8f-b71a-565a33cca70d tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:50:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:50:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:50:57 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed876b1b-51b2-4448-99e8-9ec0644acd59]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:50:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbc2f92-c1d7-4d8f-b71a-565a33cca70d tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 11:50:57 user nova-compute[74683]: No targets found.
Oct 16 11:50:57 user nova-compute[74683]: iSNS:
Oct 16 11:50:57 user nova-compute[74683]: No targets found.
Oct 16 11:50:57 user nova-compute[74683]: STATIC:
Oct 16 11:50:57 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68
Oct 16 11:50:57 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:50:57 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:50:57 user nova-compute[74683]: FIRMWARE:
Oct 16 11:50:57 user nova-compute[74683]: No targets found.
Oct 16 11:50:57 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:50:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbc2f92-c1d7-4d8f-b71a-565a33cca70d tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 11:50:57 user nova-compute[74683]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 11:50:57 user nova-compute[74683]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74683) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 11:50:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbc2f92-c1d7-4d8f-b71a-565a33cca70d tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68', 0)] {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 11:50:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:50:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:50:57 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d533f337-b3d4-4550-bffa-73bdebd16cf9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:50:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:50:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:50:57 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f71f97-92d9-4106-bbdd-29e693fd68c8]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:50:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbc2f92-c1d7-4d8f-b71a-565a33cca70d tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68 (non-flash)
Oct 16 11:50:57 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:50:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbc2f92-c1d7-4d8f-b71a-565a33cca70d tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68 (non-flash)
Oct 16 11:50:57 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:50:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbc2f92-c1d7-4d8f-b71a-565a33cca70d tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda4c5b6050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68'): ({'sdc'}, set())}) {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 11:50:57 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-cbbc2f92-c1d7-4d8f-b71a-565a33cca70d tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Removing single pathed devices sdc {{(pid=74683) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 11:50:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:50:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:50:57 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[847b9937-b9ce-4e9d-a189-c5efc90d9ef9]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:50:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:50:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:50:57 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd092c84-fc35-40a4-b4d2-e841daba43c4]: (4, ('ok\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:50:57 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-cbbc2f92-c1d7-4d8f-b71a-565a33cca70d tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Flushing IO for device /dev/sdc {{(pid=74683) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 11:50:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:50:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:50:57 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[56969ac7-c8ef-4a1a-83fd-abc617284c76]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:50:57 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-cbbc2f92-c1d7-4d8f-b71a-565a33cca70d tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74683) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 11:50:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:50:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:50:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:50:57 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[38808287-199d-4414-8a30-882f61d6d032]: (4, ('1', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:50:57 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-cbbc2f92-c1d7-4d8f-b71a-565a33cca70d tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 11:50:57 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-cbbc2f92-c1d7-4d8f-b71a-565a33cca70d tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] SCSI volumes sdc have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 11:50:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbc2f92-c1d7-4d8f-b71a-565a33cca70d tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68')] {{(pid=74683) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 11:50:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:50:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:50:57 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e04e45-3d3e-457d-9072-bb9509ee82ad]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:50:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbc2f92-c1d7-4d8f-b71a-565a33cca70d tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:50:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68 -p 172.16.0.220:3260 --logout {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:50:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68 -p 172.16.0.220:3260 --logout" returned: 0 in 0.042s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:50:57 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[44584fac-cdb9-4336-ba77-f6dc5476dc6f]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:50:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbc2f92-c1d7-4d8f-b71a-565a33cca70d tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68, portal: 172.16.0.220,3260]
Oct 16 11:50:57 user nova-compute[74683]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68, portal: 172.16.0.220,3260] successful.
Oct 16 11:50:57 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:50:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68 -p 172.16.0.220:3260 --op delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:50:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:50:57 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0c80fb-3cd0-4050-8c60-c57bfbb1e30a]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:50:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbc2f92-c1d7-4d8f-b71a-565a33cca70d tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:50:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-cbbc2f92-c1d7-4d8f-b71a-565a33cca70d tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.273s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:50:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbc2f92-c1d7-4d8f-b71a-565a33cca70d tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] <== disconnect_volume: return (275ms) None {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:50:57 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbbc2f92-c1d7-4d8f-b71a-565a33cca70d tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Disconnected iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 11:50:57 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-cbbc2f92-c1d7-4d8f-b71a-565a33cca70d tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Deleting instance files /opt/stack/data/nova/instances/d35db024-18c5-4281-9518-7fd351811e6f_del
Oct 16 11:50:57 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-cbbc2f92-c1d7-4d8f-b71a-565a33cca70d tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Deletion of /opt/stack/data/nova/instances/d35db024-18c5-4281-9518-7fd351811e6f_del complete
Oct 16 11:50:58 user nova-compute[74683]: DEBUG nova.compute.manager [req-d2bf27db-3a77-44ad-a4ab-478b545984af req-c9e15085-95f6-4ce9-895f-1b4646de2629 service nova] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Received event network-changed-f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:50:58 user nova-compute[74683]: DEBUG nova.compute.manager [req-d2bf27db-3a77-44ad-a4ab-478b545984af req-c9e15085-95f6-4ce9-895f-1b4646de2629 service nova] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Refreshing instance network info cache due to event network-changed-f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:50:58 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-d2bf27db-3a77-44ad-a4ab-478b545984af req-c9e15085-95f6-4ce9-895f-1b4646de2629 service nova] Acquiring lock "refresh_cache-d35db024-18c5-4281-9518-7fd351811e6f" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:50:58 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-d2bf27db-3a77-44ad-a4ab-478b545984af req-c9e15085-95f6-4ce9-895f-1b4646de2629 service nova] Acquired lock "refresh_cache-d35db024-18c5-4281-9518-7fd351811e6f" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:50:58 user nova-compute[74683]: DEBUG nova.network.neutron [req-d2bf27db-3a77-44ad-a4ab-478b545984af req-c9e15085-95f6-4ce9-895f-1b4646de2629 service nova] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Refreshing network info cache for port f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:50:59 user nova-compute[74683]: INFO nova.scheduler.client.report [None req-cbbc2f92-c1d7-4d8f-b71a-565a33cca70d tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Deleted allocations for instance d35db024-18c5-4281-9518-7fd351811e6f
Oct 16 11:50:59 user nova-compute[74683]: DEBUG nova.network.neutron [req-d2bf27db-3a77-44ad-a4ab-478b545984af req-c9e15085-95f6-4ce9-895f-1b4646de2629 service nova] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Updated VIF entry in instance network info cache for port f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:50:59 user nova-compute[74683]: DEBUG nova.network.neutron [req-d2bf27db-3a77-44ad-a4ab-478b545984af req-c9e15085-95f6-4ce9-895f-1b4646de2629 service nova] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Updating instance_info_cache with network_info: [{"id": "f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f", "address": "fa:16:3e:72:48:68", "network": {"id": "893d103e-5e60-4e15-9617-530ec1b284c1", "bridge": null, "label": "tempest-TestShelveInstance-1497002321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e892ddc4503c42a5a5724f1ea3933a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapf4a7ee77-cd", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:50:59 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-d2bf27db-3a77-44ad-a4ab-478b545984af req-c9e15085-95f6-4ce9-895f-1b4646de2629 service nova] Releasing lock "refresh_cache-d35db024-18c5-4281-9518-7fd351811e6f" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:50:59 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-cbbc2f92-c1d7-4d8f-b71a-565a33cca70d tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:50:59 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-cbbc2f92-c1d7-4d8f-b71a-565a33cca70d tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:50:59 user nova-compute[74683]: DEBUG nova.objects.instance [None req-cbbc2f92-c1d7-4d8f-b71a-565a33cca70d tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Lazy-loading 'numa_topology' on Instance uuid d35db024-18c5-4281-9518-7fd351811e6f {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:50:59 user nova-compute[74683]: DEBUG nova.objects.base [None req-cbbc2f92-c1d7-4d8f-b71a-565a33cca70d tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Object Instance<d35db024-18c5-4281-9518-7fd351811e6f> lazy-loaded attributes: resources,numa_topology {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:50:59 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-cbbc2f92-c1d7-4d8f-b71a-565a33cca70d tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:50:59 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-cbbc2f92-c1d7-4d8f-b71a-565a33cca70d tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:50:59 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-cbbc2f92-c1d7-4d8f-b71a-565a33cca70d tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.093s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:50:59 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-cbbc2f92-c1d7-4d8f-b71a-565a33cca70d tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Lock "d35db024-18c5-4281-9518-7fd351811e6f" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.047s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:51:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:51:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:51:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:51:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:51:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:51:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74683) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 11:51:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:51:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:51:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:51:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:51:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:51:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:51:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:51:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74683) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 11:51:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:51:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:51:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:51:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:51:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:51:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74683) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 11:51:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:51:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:51:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:51:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:51:28 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:51:29 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:51:30 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:51:31 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:51:31 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:51:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:51:33 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:51:35 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:51:35 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:51:35 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Starting heal instance info cache {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 11:51:35 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Rebuilding the list of instances to heal {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 11:51:35 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Didn't find any instances for network info cache update. {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 16 11:51:35 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:51:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:51:37 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:51:37 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:51:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:51:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:51:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:51:37 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Auditing locally available compute resources for user (node: user) {{(pid=74683) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 11:51:38 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:51:38 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:51:38 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Hypervisor/Node resource view: name=user free_ram=9103MB free_disk=25.07674789428711GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74683) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 11:51:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:51:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:51:38 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 11:51:38 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 11:51:38 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:51:38 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:51:38 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Compute_service record updated for user:user {{(pid=74683) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 11:51:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.129s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:51:39 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:51:39 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74683) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 11:51:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:51:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:51:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74683) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 11:51:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:51:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:51:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:51:45 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:51:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:51:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:51:56 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Acquiring lock "4411a1a8-cd51-46b3-9f99-46670bb7e72e" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:51:56 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "4411a1a8-cd51-46b3-9f99-46670bb7e72e" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:51:56 user nova-compute[74683]: INFO nova.compute.manager [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Unshelving
Oct 16 11:51:56 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:51:56 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:51:56 user nova-compute[74683]: DEBUG nova.objects.instance [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lazy-loading 'pci_requests' on Instance uuid 4411a1a8-cd51-46b3-9f99-46670bb7e72e {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:51:56 user nova-compute[74683]: DEBUG nova.objects.instance [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lazy-loading 'numa_topology' on Instance uuid 4411a1a8-cd51-46b3-9f99-46670bb7e72e {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:51:56 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74683) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 11:51:56 user nova-compute[74683]: INFO nova.compute.claims [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Claim successful on node user
Oct 16 11:51:57 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:51:57 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:51:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.580s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:51:57 user nova-compute[74683]: INFO nova.network.neutron [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Updating port d82b8aef-5586-4582-9253-b964d495ce17 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 16 11:51:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:51:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Acquiring lock "refresh_cache-4411a1a8-cd51-46b3-9f99-46670bb7e72e" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:51:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Acquired lock "refresh_cache-4411a1a8-cd51-46b3-9f99-46670bb7e72e" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:51:57 user nova-compute[74683]: DEBUG nova.network.neutron [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:51:57 user nova-compute[74683]: DEBUG nova.compute.manager [req-eb6aa1c9-ec50-478d-a709-18ffdafb6785 req-1eeb07d9-4b89-4646-97aa-352a2646dab8 service nova] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Received event network-changed-d82b8aef-5586-4582-9253-b964d495ce17 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:51:57 user nova-compute[74683]: DEBUG nova.compute.manager [req-eb6aa1c9-ec50-478d-a709-18ffdafb6785 req-1eeb07d9-4b89-4646-97aa-352a2646dab8 service nova] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Refreshing instance network info cache due to event network-changed-d82b8aef-5586-4582-9253-b964d495ce17. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:51:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-eb6aa1c9-ec50-478d-a709-18ffdafb6785 req-1eeb07d9-4b89-4646-97aa-352a2646dab8 service nova] Acquiring lock "refresh_cache-4411a1a8-cd51-46b3-9f99-46670bb7e72e" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:51:58 user nova-compute[74683]: DEBUG nova.network.neutron [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Updating instance_info_cache with network_info: [{"id": "d82b8aef-5586-4582-9253-b964d495ce17", "address": "fa:16:3e:05:e7:3e", "network": {"id": "2ea750a5-8511-4e40-b149-062e10e0096c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-563467594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d2c7c33914a068b448c447db50b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd82b8aef-55", "ovs_interfaceid": "d82b8aef-5586-4582-9253-b964d495ce17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:51:58 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Releasing lock "refresh_cache-4411a1a8-cd51-46b3-9f99-46670bb7e72e" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:51:58 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Creating instance directory {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 11:51:58 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Creating image(s)
Oct 16 11:51:58 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Acquiring lock "/opt/stack/data/nova/instances/4411a1a8-cd51-46b3-9f99-46670bb7e72e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:51:58 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "/opt/stack/data/nova/instances/4411a1a8-cd51-46b3-9f99-46670bb7e72e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:51:58 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "/opt/stack/data/nova/instances/4411a1a8-cd51-46b3-9f99-46670bb7e72e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:51:58 user nova-compute[74683]: DEBUG nova.objects.instance [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4411a1a8-cd51-46b3-9f99-46670bb7e72e {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:51:58 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-eb6aa1c9-ec50-478d-a709-18ffdafb6785 req-1eeb07d9-4b89-4646-97aa-352a2646dab8 service nova] Acquired lock "refresh_cache-4411a1a8-cd51-46b3-9f99-46670bb7e72e" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:51:58 user nova-compute[74683]: DEBUG nova.network.neutron [req-eb6aa1c9-ec50-478d-a709-18ffdafb6785 req-1eeb07d9-4b89-4646-97aa-352a2646dab8 service nova] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Refreshing network info cache for port d82b8aef-5586-4582-9253-b964d495ce17 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:51:58 user nova-compute[74683]: DEBUG nova.objects.base [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Object Instance<4411a1a8-cd51-46b3-9f99-46670bb7e72e> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:51:58 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Acquiring lock "eb4fa20fc12c3c7469db5f00a6eba561a9a23e9f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:51:58 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "eb4fa20fc12c3c7469db5f00a6eba561a9a23e9f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:51:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb4fa20fc12c3c7469db5f00a6eba561a9a23e9f.part --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:51:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb4fa20fc12c3c7469db5f00a6eba561a9a23e9f.part --force-share --output=json" returned: 0 in 0.171s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:51:59 user nova-compute[74683]: DEBUG nova.virt.images [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] 4b928905-4725-4c50-9a1c-0551f5a1dd27 was qcow2, converting to raw {{(pid=74683) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 16 11:51:59 user nova-compute[74683]: DEBUG nova.privsep.utils [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74683) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 11:51:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/eb4fa20fc12c3c7469db5f00a6eba561a9a23e9f.part /opt/stack/data/nova/instances/_base/eb4fa20fc12c3c7469db5f00a6eba561a9a23e9f.converted {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:51:59 user nova-compute[74683]: DEBUG nova.network.neutron [req-eb6aa1c9-ec50-478d-a709-18ffdafb6785 req-1eeb07d9-4b89-4646-97aa-352a2646dab8 service nova] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Updated VIF entry in instance network info cache for port d82b8aef-5586-4582-9253-b964d495ce17. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:51:59 user nova-compute[74683]: DEBUG nova.network.neutron [req-eb6aa1c9-ec50-478d-a709-18ffdafb6785 req-1eeb07d9-4b89-4646-97aa-352a2646dab8 service nova] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Updating instance_info_cache with network_info: [{"id": "d82b8aef-5586-4582-9253-b964d495ce17", "address": "fa:16:3e:05:e7:3e", "network": {"id": "2ea750a5-8511-4e40-b149-062e10e0096c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-563467594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d2c7c33914a068b448c447db50b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd82b8aef-55", "ovs_interfaceid": "d82b8aef-5586-4582-9253-b964d495ce17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:51:59 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-eb6aa1c9-ec50-478d-a709-18ffdafb6785 req-1eeb07d9-4b89-4646-97aa-352a2646dab8 service nova] Releasing lock "refresh_cache-4411a1a8-cd51-46b3-9f99-46670bb7e72e" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:51:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/eb4fa20fc12c3c7469db5f00a6eba561a9a23e9f.part /opt/stack/data/nova/instances/_base/eb4fa20fc12c3c7469db5f00a6eba561a9a23e9f.converted" returned: 0 in 0.286s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:51:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb4fa20fc12c3c7469db5f00a6eba561a9a23e9f.converted --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:51:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb4fa20fc12c3c7469db5f00a6eba561a9a23e9f.converted --force-share --output=json" returned: 0 in 0.169s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:51:59 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "eb4fa20fc12c3c7469db5f00a6eba561a9a23e9f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.626s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:51:59 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb4fa20fc12c3c7469db5f00a6eba561a9a23e9f --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:52:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb4fa20fc12c3c7469db5f00a6eba561a9a23e9f --force-share --output=json" returned: 0 in 0.168s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:52:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Acquiring lock "eb4fa20fc12c3c7469db5f00a6eba561a9a23e9f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:52:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "eb4fa20fc12c3c7469db5f00a6eba561a9a23e9f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:52:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb4fa20fc12c3c7469db5f00a6eba561a9a23e9f --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:52:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb4fa20fc12c3c7469db5f00a6eba561a9a23e9f --force-share --output=json" returned: 0 in 0.177s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:52:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb4fa20fc12c3c7469db5f00a6eba561a9a23e9f,backing_fmt=raw /opt/stack/data/nova/instances/4411a1a8-cd51-46b3-9f99-46670bb7e72e/disk 1073741824 {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:52:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb4fa20fc12c3c7469db5f00a6eba561a9a23e9f,backing_fmt=raw /opt/stack/data/nova/instances/4411a1a8-cd51-46b3-9f99-46670bb7e72e/disk 1073741824" returned: 0 in 0.046s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:52:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "eb4fa20fc12c3c7469db5f00a6eba561a9a23e9f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:52:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb4fa20fc12c3c7469db5f00a6eba561a9a23e9f --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:52:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb4fa20fc12c3c7469db5f00a6eba561a9a23e9f --force-share --output=json" returned: 0 in 0.168s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:52:00 user nova-compute[74683]: DEBUG nova.objects.instance [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lazy-loading 'migration_context' on Instance uuid 4411a1a8-cd51-46b3-9f99-46670bb7e72e {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:52:00 user nova-compute[74683]: DEBUG nova.objects.base [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Object Instance<4411a1a8-cd51-46b3-9f99-46670bb7e72e> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:52:00 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Rebasing disk image.
Oct 16 11:52:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:52:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.173s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:52:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 -F raw /opt/stack/data/nova/instances/4411a1a8-cd51-46b3-9f99-46670bb7e72e/disk {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:52:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:52:02 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 -F raw /opt/stack/data/nova/instances/4411a1a8-cd51-46b3-9f99-46670bb7e72e/disk" returned: 0 in 2.222s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:52:02 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Created local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 11:52:02 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Ensure instance console log exists: /opt/stack/data/nova/instances/4411a1a8-cd51-46b3-9f99-46670bb7e72e/console.log {{(pid=74683) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 11:52:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:52:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:52:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:52:02 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Start _get_guest_xml network_info=[{"id": "d82b8aef-5586-4582-9253-b964d495ce17", "address": "fa:16:3e:05:e7:3e", "network": {"id": "2ea750a5-8511-4e40-b149-062e10e0096c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-563467594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d2c7c33914a068b448c447db50b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd82b8aef-55", "ovs_interfaceid": "d82b8aef-5586-4582-9253-b964d495ce17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c4a853a79d5f679f2c1cdebe2d7b9796',container_format='bare',created_at=2023-10-16T11:50:03Z,direct_url=<?>,disk_format='qcow2',id=4b928905-4725-4c50-9a1c-0551f5a1dd27,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1398782217-shelved',owner='622d2c7c33914a068b448c447db50b3c',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-16T11:50:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:52:02 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:52:02 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:52:02 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:52:02 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:52:02 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:52:02 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:52:02 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:52:02 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c4a853a79d5f679f2c1cdebe2d7b9796',container_format='bare',created_at=2023-10-16T11:50:03Z,direct_url=<?>,disk_format='qcow2',id=4b928905-4725-4c50-9a1c-0551f5a1dd27,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1398782217-shelved',owner='622d2c7c33914a068b448c447db50b3c',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-16T11:50:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:52:02 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:52:02 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:52:02 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:52:02 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:52:02 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:52:02 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:52:02 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:52:02 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:52:02 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:52:02 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:52:02 user nova-compute[74683]: DEBUG nova.objects.instance [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4411a1a8-cd51-46b3-9f99-46670bb7e72e {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:52:02 user nova-compute[74683]: DEBUG nova.objects.base [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Object Instance<4411a1a8-cd51-46b3-9f99-46670bb7e72e> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:52:02 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-16T11:48:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1398782217',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1398782217',id=50,image_ref='4b928905-4725-4c50-9a1c-0551f5a1dd27',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-253079390',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:48:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='622d2c7c33914a068b448c447db50b3c',ramdisk_id='',reservation_id='r-avxku7yo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-291825158',owner_user_name='tempest-AttachVolumeShelveTestJSON-291825158-project-member',shelved_at='2023-10-16T11:50:07.602397',shelved_host='user',shelved_image_id='4b928905-4725-4c50-9a1c-0551f5a1dd27'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:51:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11130271beb44b368f9eb55bd4946cbc',uuid=4411a1a8-cd51-46b3-9f99-46670bb7e72e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d82b8aef-5586-4582-9253-b964d495ce17", "address": "fa:16:3e:05:e7:3e", "network": {"id": "2ea750a5-8511-4e40-b149-062e10e0096c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-563467594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d2c7c33914a068b448c447db50b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd82b8aef-55", "ovs_interfaceid": "d82b8aef-5586-4582-9253-b964d495ce17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:52:02 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Converting VIF {"id": "d82b8aef-5586-4582-9253-b964d495ce17", "address": "fa:16:3e:05:e7:3e", "network": {"id": "2ea750a5-8511-4e40-b149-062e10e0096c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-563467594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d2c7c33914a068b448c447db50b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd82b8aef-55", "ovs_interfaceid": "d82b8aef-5586-4582-9253-b964d495ce17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:52:02 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:e7:3e,bridge_name='br-int',has_traffic_filtering=True,id=d82b8aef-5586-4582-9253-b964d495ce17,network=Network(2ea750a5-8511-4e40-b149-062e10e0096c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd82b8aef-55') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:52:02 user nova-compute[74683]: DEBUG nova.objects.instance [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lazy-loading 'pci_devices' on Instance uuid 4411a1a8-cd51-46b3-9f99-46670bb7e72e {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:52:02 user nova-compute[74683]: DEBUG nova.objects.base [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Object Instance<4411a1a8-cd51-46b3-9f99-46670bb7e72e> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:52:02 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:52:02 user nova-compute[74683]:   <uuid>4411a1a8-cd51-46b3-9f99-46670bb7e72e</uuid>
Oct 16 11:52:02 user nova-compute[74683]:   <name>instance-00000032</name>
Oct 16 11:52:02 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:52:02 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:52:02 user nova-compute[74683]:   <metadata>
Oct 16 11:52:02 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:52:02 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:52:02 user nova-compute[74683]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1398782217</nova:name>
Oct 16 11:52:02 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:52:02</nova:creationTime>
Oct 16 11:52:02 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:52:02 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:52:02 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:52:02 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:52:02 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:52:02 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:52:02 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:52:02 user nova-compute[74683]:       <nova:owner>
Oct 16 11:52:02 user nova-compute[74683]:         <nova:user uuid="11130271beb44b368f9eb55bd4946cbc">tempest-AttachVolumeShelveTestJSON-291825158-project-member</nova:user>
Oct 16 11:52:02 user nova-compute[74683]:         <nova:project uuid="622d2c7c33914a068b448c447db50b3c">tempest-AttachVolumeShelveTestJSON-291825158</nova:project>
Oct 16 11:52:02 user nova-compute[74683]:       </nova:owner>
Oct 16 11:52:02 user nova-compute[74683]:       <nova:root type="image" uuid="4b928905-4725-4c50-9a1c-0551f5a1dd27"/>
Oct 16 11:52:02 user nova-compute[74683]:       <nova:ports>
Oct 16 11:52:02 user nova-compute[74683]:         <nova:port uuid="d82b8aef-5586-4582-9253-b964d495ce17">
Oct 16 11:52:02 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 16 11:52:02 user nova-compute[74683]:         </nova:port>
Oct 16 11:52:02 user nova-compute[74683]:       </nova:ports>
Oct 16 11:52:02 user nova-compute[74683]:     </nova:instance>
Oct 16 11:52:02 user nova-compute[74683]:   </metadata>
Oct 16 11:52:02 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:52:02 user nova-compute[74683]:     <system>
Oct 16 11:52:02 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:52:02 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:52:02 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:52:02 user nova-compute[74683]:       <entry name="serial">4411a1a8-cd51-46b3-9f99-46670bb7e72e</entry>
Oct 16 11:52:02 user nova-compute[74683]:       <entry name="uuid">4411a1a8-cd51-46b3-9f99-46670bb7e72e</entry>
Oct 16 11:52:02 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:52:02 user nova-compute[74683]:     </system>
Oct 16 11:52:02 user nova-compute[74683]:   </sysinfo>
Oct 16 11:52:02 user nova-compute[74683]:   <os>
Oct 16 11:52:02 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:52:02 user nova-compute[74683]:     <boot dev="hd"/>
Oct 16 11:52:02 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:52:02 user nova-compute[74683]:   </os>
Oct 16 11:52:02 user nova-compute[74683]:   <features>
Oct 16 11:52:02 user nova-compute[74683]:     <acpi/>
Oct 16 11:52:02 user nova-compute[74683]:     <apic/>
Oct 16 11:52:02 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:52:02 user nova-compute[74683]:   </features>
Oct 16 11:52:02 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:52:02 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:52:02 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:52:02 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:52:02 user nova-compute[74683]:   </clock>
Oct 16 11:52:02 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:52:02 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:52:02 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:52:02 user nova-compute[74683]:   </cpu>
Oct 16 11:52:02 user nova-compute[74683]:   <devices>
Oct 16 11:52:02 user nova-compute[74683]:     <disk type="file" device="disk">
Oct 16 11:52:02 user nova-compute[74683]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 11:52:02 user nova-compute[74683]:       <source file="/opt/stack/data/nova/instances/4411a1a8-cd51-46b3-9f99-46670bb7e72e/disk"/>
Oct 16 11:52:02 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:52:02 user nova-compute[74683]:     </disk>
Oct 16 11:52:02 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:52:02 user nova-compute[74683]:       <mac address="fa:16:3e:05:e7:3e"/>
Oct 16 11:52:02 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:52:02 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:52:02 user nova-compute[74683]:       <target dev="tapd82b8aef-55"/>
Oct 16 11:52:02 user nova-compute[74683]:     </interface>
Oct 16 11:52:02 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:52:02 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/4411a1a8-cd51-46b3-9f99-46670bb7e72e/console.log" append="off"/>
Oct 16 11:52:02 user nova-compute[74683]:     </serial>
Oct 16 11:52:02 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:52:02 user nova-compute[74683]:     <video>
Oct 16 11:52:02 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:52:02 user nova-compute[74683]:     </video>
Oct 16 11:52:02 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:52:02 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:52:02 user nova-compute[74683]:     </rng>
Oct 16 11:52:02 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:52:02 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:52:02 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:52:02 user nova-compute[74683]:     </memballoon>
Oct 16 11:52:02 user nova-compute[74683]:   </devices>
Oct 16 11:52:02 user nova-compute[74683]: </domain>
Oct 16 11:52:02 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:52:02 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-16T11:48:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1398782217',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1398782217',id=50,image_ref='4b928905-4725-4c50-9a1c-0551f5a1dd27',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-253079390',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:48:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='622d2c7c33914a068b448c447db50b3c',ramdisk_id='',reservation_id='r-avxku7yo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-291825158',owner_user_name='tempest-AttachVolumeShelveTestJSON-291825158-project-member',shelved_at='2023-10-16T11:50:07.602397',shelved_host='user',shelved_image_id='4b928905-4725-4c50-9a1c-0551f5a1dd27'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:51:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11130271beb44b368f9eb55bd4946cbc',uuid=4411a1a8-cd51-46b3-9f99-46670bb7e72e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d82b8aef-5586-4582-9253-b964d495ce17", "address": "fa:16:3e:05:e7:3e", "network": {"id": "2ea750a5-8511-4e40-b149-062e10e0096c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-563467594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d2c7c33914a068b448c447db50b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd82b8aef-55", "ovs_interfaceid": "d82b8aef-5586-4582-9253-b964d495ce17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:52:02 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Converting VIF {"id": "d82b8aef-5586-4582-9253-b964d495ce17", "address": "fa:16:3e:05:e7:3e", "network": {"id": "2ea750a5-8511-4e40-b149-062e10e0096c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-563467594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d2c7c33914a068b448c447db50b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd82b8aef-55", "ovs_interfaceid": "d82b8aef-5586-4582-9253-b964d495ce17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:52:02 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:e7:3e,bridge_name='br-int',has_traffic_filtering=True,id=d82b8aef-5586-4582-9253-b964d495ce17,network=Network(2ea750a5-8511-4e40-b149-062e10e0096c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd82b8aef-55') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:52:02 user nova-compute[74683]: DEBUG os_vif [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:e7:3e,bridge_name='br-int',has_traffic_filtering=True,id=d82b8aef-5586-4582-9253-b964d495ce17,network=Network(2ea750a5-8511-4e40-b149-062e10e0096c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd82b8aef-55') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:52:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:52:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:52:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:52:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:52:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1157861d-78c4-5fe7-9a1b-ed522b81ea45', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:52:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:52:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:52:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:52:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd82b8aef-55, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:52:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd82b8aef-55, col_values=(('qos', UUID('4f596b1d-a71a-46b0-a5c7-743835030d87')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:52:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd82b8aef-55, col_values=(('external_ids', {'iface-id': 'd82b8aef-5586-4582-9253-b964d495ce17', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:e7:3e', 'vm-uuid': '4411a1a8-cd51-46b3-9f99-46670bb7e72e'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:52:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:52:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:52:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:52:02 user nova-compute[74683]: INFO os_vif [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:e7:3e,bridge_name='br-int',has_traffic_filtering=True,id=d82b8aef-5586-4582-9253-b964d495ce17,network=Network(2ea750a5-8511-4e40-b149-062e10e0096c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd82b8aef-55')
Oct 16 11:52:03 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:52:03 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] No VIF found with MAC fa:16:3e:05:e7:3e, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:52:04 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:52:04 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:52:04 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:52:04 user nova-compute[74683]: DEBUG nova.compute.manager [req-746104f0-6f89-4082-8ca1-18dd8bef10a1 req-43fbc7e3-72b8-4b5c-99f8-0e602e7732ee service nova] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Received event network-vif-plugged-d82b8aef-5586-4582-9253-b964d495ce17 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:52:04 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-746104f0-6f89-4082-8ca1-18dd8bef10a1 req-43fbc7e3-72b8-4b5c-99f8-0e602e7732ee service nova] Acquiring lock "4411a1a8-cd51-46b3-9f99-46670bb7e72e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:52:04 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-746104f0-6f89-4082-8ca1-18dd8bef10a1 req-43fbc7e3-72b8-4b5c-99f8-0e602e7732ee service nova] Lock "4411a1a8-cd51-46b3-9f99-46670bb7e72e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:52:04 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-746104f0-6f89-4082-8ca1-18dd8bef10a1 req-43fbc7e3-72b8-4b5c-99f8-0e602e7732ee service nova] Lock "4411a1a8-cd51-46b3-9f99-46670bb7e72e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:52:04 user nova-compute[74683]: DEBUG nova.compute.manager [req-746104f0-6f89-4082-8ca1-18dd8bef10a1 req-43fbc7e3-72b8-4b5c-99f8-0e602e7732ee service nova] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] No waiting events found dispatching network-vif-plugged-d82b8aef-5586-4582-9253-b964d495ce17 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:52:04 user nova-compute[74683]: WARNING nova.compute.manager [req-746104f0-6f89-4082-8ca1-18dd8bef10a1 req-43fbc7e3-72b8-4b5c-99f8-0e602e7732ee service nova] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Received unexpected event network-vif-plugged-d82b8aef-5586-4582-9253-b964d495ce17 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 16 11:52:04 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:52:04 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:52:04 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:52:06 user nova-compute[74683]: DEBUG nova.compute.manager [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Instance event wait completed in 0 seconds for  {{(pid=74683) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 11:52:06 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Guest created on hypervisor {{(pid=74683) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 11:52:06 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Instance spawned successfully.
Oct 16 11:52:06 user nova-compute[74683]: DEBUG nova.compute.manager [req-01452ddd-ca03-4dd8-a1ee-f78ebbd617b4 req-d1a1671d-c076-4212-b9b5-ad5fd88a0a36 service nova] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Received event network-vif-plugged-d82b8aef-5586-4582-9253-b964d495ce17 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:52:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-01452ddd-ca03-4dd8-a1ee-f78ebbd617b4 req-d1a1671d-c076-4212-b9b5-ad5fd88a0a36 service nova] Acquiring lock "4411a1a8-cd51-46b3-9f99-46670bb7e72e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:52:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-01452ddd-ca03-4dd8-a1ee-f78ebbd617b4 req-d1a1671d-c076-4212-b9b5-ad5fd88a0a36 service nova] Lock "4411a1a8-cd51-46b3-9f99-46670bb7e72e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:52:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-01452ddd-ca03-4dd8-a1ee-f78ebbd617b4 req-d1a1671d-c076-4212-b9b5-ad5fd88a0a36 service nova] Lock "4411a1a8-cd51-46b3-9f99-46670bb7e72e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:52:06 user nova-compute[74683]: DEBUG nova.compute.manager [req-01452ddd-ca03-4dd8-a1ee-f78ebbd617b4 req-d1a1671d-c076-4212-b9b5-ad5fd88a0a36 service nova] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] No waiting events found dispatching network-vif-plugged-d82b8aef-5586-4582-9253-b964d495ce17 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:52:06 user nova-compute[74683]: WARNING nova.compute.manager [req-01452ddd-ca03-4dd8-a1ee-f78ebbd617b4 req-d1a1671d-c076-4212-b9b5-ad5fd88a0a36 service nova] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Received unexpected event network-vif-plugged-d82b8aef-5586-4582-9253-b964d495ce17 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 16 11:52:06 user nova-compute[74683]: DEBUG nova.compute.manager [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:52:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-f37f9a4b-c5e6-4860-a3eb-c23371f55d10 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "4411a1a8-cd51-46b3-9f99-46670bb7e72e" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.515s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:52:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:52:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:52:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:52:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:52:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74683) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 11:52:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:52:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:52:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:52:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:52:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:52:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:52:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:52:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:52:31 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:52:32 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:52:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:52:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:52:35 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:52:35 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:52:35 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Starting heal instance info cache {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 11:52:35 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Rebuilding the list of instances to heal {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 11:52:35 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "refresh_cache-4411a1a8-cd51-46b3-9f99-46670bb7e72e" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:52:35 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquired lock "refresh_cache-4411a1a8-cd51-46b3-9f99-46670bb7e72e" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:52:35 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Forcefully refreshing network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 11:52:35 user nova-compute[74683]: DEBUG nova.objects.instance [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lazy-loading 'info_cache' on Instance uuid 4411a1a8-cd51-46b3-9f99-46670bb7e72e {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:52:36 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Updating instance_info_cache with network_info: [{"id": "d82b8aef-5586-4582-9253-b964d495ce17", "address": "fa:16:3e:05:e7:3e", "network": {"id": "2ea750a5-8511-4e40-b149-062e10e0096c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-563467594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d2c7c33914a068b448c447db50b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd82b8aef-55", "ovs_interfaceid": "d82b8aef-5586-4582-9253-b964d495ce17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:52:36 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Releasing lock "refresh_cache-4411a1a8-cd51-46b3-9f99-46670bb7e72e" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:52:36 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Updated the network info_cache for instance {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 11:52:36 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:52:37 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:52:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:52:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:52:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:52:37 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Auditing locally available compute resources for user (node: user) {{(pid=74683) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 11:52:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:52:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4411a1a8-cd51-46b3-9f99-46670bb7e72e/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:52:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:52:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4411a1a8-cd51-46b3-9f99-46670bb7e72e/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:52:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4411a1a8-cd51-46b3-9f99-46670bb7e72e/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:52:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4411a1a8-cd51-46b3-9f99-46670bb7e72e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:52:38 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:52:38 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:52:38 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Hypervisor/Node resource view: name=user free_ram=9028MB free_disk=25.050399780273438GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74683) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 11:52:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:52:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:52:38 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 4411a1a8-cd51-46b3-9f99-46670bb7e72e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:52:38 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 11:52:38 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 11:52:38 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:52:38 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:52:38 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Compute_service record updated for user:user {{(pid=74683) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 11:52:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.190s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:52:39 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:52:39 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:52:39 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74683) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 11:52:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:52:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:52:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74683) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 11:52:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:52:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:52:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:52:46 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Acquiring lock "d35db024-18c5-4281-9518-7fd351811e6f" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:52:46 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Lock "d35db024-18c5-4281-9518-7fd351811e6f" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:52:46 user nova-compute[74683]: INFO nova.compute.manager [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Unshelving
Oct 16 11:52:46 user nova-compute[74683]: INFO nova.virt.block_device [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Booting with volume 29fc964e-fa79-4448-9141-032d88e43c68 at /dev/vda
Oct 16 11:52:46 user nova-compute[74683]: DEBUG os_brick.utils [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:52:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:52:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:52:46 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a19c46c-a3ae-40e9-8981-2a67aaf5a5b7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:70b9d336ab7d\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:52:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:52:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:52:46 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a4e116-da62-4769-8406-8b292102f169]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:52:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:52:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:52:46 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b92436-5598-44e6-8f87-ac8c637f5f2a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:52:46 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb169885-9b55-40a6-8769-18c5d9c7e2c2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:52:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Running cmd (subprocess): nvme version {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:52:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] 'nvme version' failed. Not Retrying. {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:52:46 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] nvme not present on system {{(pid=74683) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 11:52:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:52:46 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:52:46 user nova-compute[74683]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 11:52:46 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b86a09-8957-4ed2-9299-4d48d0959809]: (4, '') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:52:46 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74683) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 11:52:46 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 11:52:46 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] LIGHTOS: no hostnqn found. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 11:52:46 user nova-compute[74683]: DEBUG os_brick.utils [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:70b9d336ab7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:52:46 user nova-compute[74683]: DEBUG nova.virt.block_device [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Updating existing volume attachment record: 36765133-6b7c-4f31-ae99-27c038bcee85 {{(pid=74683) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 11:52:47 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:52:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:52:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:52:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74683) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 11:52:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:52:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:52:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:52:53 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:52:53 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:52:53 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74683) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 11:52:53 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:52:53 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:52:53 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:52:58 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:52:58 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:52:58 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74683) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 11:52:58 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:52:58 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:52:58 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:53:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:53:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:53:02 user nova-compute[74683]: DEBUG nova.objects.instance [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Lazy-loading 'pci_requests' on Instance uuid d35db024-18c5-4281-9518-7fd351811e6f {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:53:02 user nova-compute[74683]: DEBUG nova.objects.instance [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Lazy-loading 'numa_topology' on Instance uuid d35db024-18c5-4281-9518-7fd351811e6f {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:53:02 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74683) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 11:53:02 user nova-compute[74683]: INFO nova.compute.claims [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Claim successful on node user
Oct 16 11:53:02 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:53:02 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:53:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.271s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:53:02 user nova-compute[74683]: INFO nova.network.neutron [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Updating port f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 16 11:53:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Acquiring lock "refresh_cache-d35db024-18c5-4281-9518-7fd351811e6f" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Acquired lock "refresh_cache-d35db024-18c5-4281-9518-7fd351811e6f" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG nova.network.neutron [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG nova.compute.manager [req-4d28c616-0577-4377-9603-5c2083f439a9 req-c178d45e-3c69-4ddd-a4b4-4c96bacdd860 service nova] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Received event network-changed-f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG nova.compute.manager [req-4d28c616-0577-4377-9603-5c2083f439a9 req-c178d45e-3c69-4ddd-a4b4-4c96bacdd860 service nova] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Refreshing instance network info cache due to event network-changed-f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-4d28c616-0577-4377-9603-5c2083f439a9 req-c178d45e-3c69-4ddd-a4b4-4c96bacdd860 service nova] Acquiring lock "refresh_cache-d35db024-18c5-4281-9518-7fd351811e6f" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG nova.network.neutron [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Updating instance_info_cache with network_info: [{"id": "f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f", "address": "fa:16:3e:72:48:68", "network": {"id": "893d103e-5e60-4e15-9617-530ec1b284c1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1497002321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e892ddc4503c42a5a5724f1ea3933a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a7ee77-cd", "ovs_interfaceid": "f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Releasing lock "refresh_cache-d35db024-18c5-4281-9518-7fd351811e6f" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Creating instance directory {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 11:53:03 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Creating image(s)
Oct 16 11:53:03 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Did not create local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Ensure instance console log exists: /opt/stack/data/nova/instances/d35db024-18c5-4281-9518-7fd351811e6f/console.log {{(pid=74683) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Start _get_guest_xml network_info=[{"id": "f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f", "address": "fa:16:3e:72:48:68", "network": {"id": "893d103e-5e60-4e15-9617-530ec1b284c1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1497002321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e892ddc4503c42a5a5724f1ea3933a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a7ee77-cd", "ovs_interfaceid": "f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LKoeZfiz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd35db024-18c5-4281-9518-7fd351811e6f', 'attached_at': '', 'detached_at': '', 'volume_id': '29fc964e-fa79-4448-9141-032d88e43c68', 'serial': '29fc964e-fa79-4448-9141-032d88e43c68'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': '36765133-6b7c-4f31-ae99-27c038bcee85', 'volume_type': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-4d28c616-0577-4377-9603-5c2083f439a9 req-c178d45e-3c69-4ddd-a4b4-4c96bacdd860 service nova] Acquired lock "refresh_cache-d35db024-18c5-4281-9518-7fd351811e6f" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG nova.network.neutron [req-4d28c616-0577-4377-9603-5c2083f439a9 req-c178d45e-3c69-4ddd-a4b4-4c96bacdd860 service nova] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Refreshing network info cache for port f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:53:03 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:53:03 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:53:03 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG nova.objects.instance [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Lazy-loading 'vcpu_model' on Instance uuid d35db024-18c5-4281-9518-7fd351811e6f {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG nova.objects.base [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Object Instance<d35db024-18c5-4281-9518-7fd351811e6f> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Calling os-brick to attach iSCSI Volume {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LKoeZfiz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:53:03 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:53:03 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:53:03 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:53:03 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:53:03 user nova-compute[74683]: INFO os_brick.initiator.connectors.iscsi [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 11:53:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68 -p 172.16.0.220:3260 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68 -p 172.16.0.220:3260" returned: 21 in 0.102s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3ee48d-8163-4995-bb58-20503e9cadae]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 11:53:03 user nova-compute[74683]:  {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68 -p 172.16.0.220:3260 --interface default --op new {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97f7d51-2323-4d5e-8cfd-a8484f4206d4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68] added\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68] added
Oct 16 11:53:03 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[1daba28d-9679-428a-be00-c9b9ce5b0958]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d136a4b-319a-4c0e-821d-112abad5a01c]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LKoeZfiz {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LKoeZfiz" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c011757-f8cb-41ce-a4a3-16f207d3e7aa]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LKoeZfiz'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c9fe77-4346-4c53-bc2c-17298c5206e3]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea39e26-062b-4deb-bc66-f779e69b9efe]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 16 11:53:03 user nova-compute[74683]:  {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:53:03 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 16 11:53:03 user nova-compute[74683]:  {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:53:03 user nova-compute[74683]: WARNING os_brick.initiator.connectors.iscsi [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 16 11:53:03 user nova-compute[74683]: 
Oct 16 11:53:03 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68 -p 172.16.0.220:3260 --login {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:53:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:53:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec1c791-f7d4-4efa-8bf0-d9d2bf49eaa8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:53:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68, portal: 172.16.0.220,3260]
Oct 16 11:53:04 user nova-compute[74683]: Login to [iface: default, target: iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68, portal: 172.16.0.220,3260] successful.
Oct 16 11:53:04 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:53:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:53:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:53:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1df3ec8-214d-46d7-a9bf-9c40e429db93]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:53:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:53:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:53:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:53:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce14bd7-bd49-47e9-bd8a-8f65f07d5219]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:53:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68 (non-flash)
Oct 16 11:53:04 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:53:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68 (non-flash)
Oct 16 11:53:04 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:53:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.361s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:53:04 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Connected to 172.16.0.220:3260 {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 11:53:04 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=74683) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 11:53:04 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74683) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 11:53:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:53:04 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:53:04 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[59481522-ce81-499b-af26-c8480277ea81]: (4, ('- - 0', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:53:04 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: None {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:53:04 user nova-compute[74683]: DEBUG nova.network.neutron [req-4d28c616-0577-4377-9603-5c2083f439a9 req-c178d45e-3c69-4ddd-a4b4-4c96bacdd860 service nova] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Updated VIF entry in instance network info cache for port f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:53:04 user nova-compute[74683]: DEBUG nova.network.neutron [req-4d28c616-0577-4377-9603-5c2083f439a9 req-c178d45e-3c69-4ddd-a4b4-4c96bacdd860 service nova] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Updating instance_info_cache with network_info: [{"id": "f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f", "address": "fa:16:3e:72:48:68", "network": {"id": "893d103e-5e60-4e15-9617-530ec1b284c1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1497002321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e892ddc4503c42a5a5724f1ea3933a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a7ee77-cd", "ovs_interfaceid": "f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:53:04 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-4d28c616-0577-4377-9603-5c2083f439a9 req-c178d45e-3c69-4ddd-a4b4-4c96bacdd860 service nova] Releasing lock "refresh_cache-d35db024-18c5-4281-9518-7fd351811e6f" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:53:05 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:53:05 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LKoeZfiz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 11:53:05 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.394s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:53:05 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] <== connect_volume: return (1395ms) {'type': 'block', 'scsi_wwn': '26136343436363461', 'path': '/dev/sdb'} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:53:05 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136343436363461', 'path': '/dev/sdb'} {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 11:53:05 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-16T11:49:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2144957190',display_name='tempest-TestShelveInstance-server-2144957190',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2144957190',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-527121964',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:49:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e892ddc4503c42a5a5724f1ea3933a88',ramdisk_id='',reservation_id='r-tnn3schj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-547173108',owner_user_name='tempest-TestShelveInstance-547173108-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:52:47Z,user_data=None,user_id='c7c151337018403599b6d06a6d82f7d2',uuid=d35db024-18c5-4281-9518-7fd351811e6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f", "address": "fa:16:3e:72:48:68", "network": {"id": "893d103e-5e60-4e15-9617-530ec1b284c1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1497002321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e892ddc4503c42a5a5724f1ea3933a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a7ee77-cd", "ovs_interfaceid": "f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:53:05 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Converting VIF {"id": "f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f", "address": "fa:16:3e:72:48:68", "network": {"id": "893d103e-5e60-4e15-9617-530ec1b284c1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1497002321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e892ddc4503c42a5a5724f1ea3933a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a7ee77-cd", "ovs_interfaceid": "f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:53:05 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:48:68,bridge_name='br-int',has_traffic_filtering=True,id=f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f,network=Network(893d103e-5e60-4e15-9617-530ec1b284c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4a7ee77-cd') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:53:05 user nova-compute[74683]: DEBUG nova.objects.instance [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Lazy-loading 'pci_devices' on Instance uuid d35db024-18c5-4281-9518-7fd351811e6f {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:53:05 user nova-compute[74683]: DEBUG nova.objects.base [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Object Instance<d35db024-18c5-4281-9518-7fd351811e6f> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=74683) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 11:53:05 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:53:05 user nova-compute[74683]:   <uuid>d35db024-18c5-4281-9518-7fd351811e6f</uuid>
Oct 16 11:53:05 user nova-compute[74683]:   <name>instance-00000033</name>
Oct 16 11:53:05 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:53:05 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:53:05 user nova-compute[74683]:   <metadata>
Oct 16 11:53:05 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:53:05 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:53:05 user nova-compute[74683]:       <nova:name>tempest-TestShelveInstance-server-2144957190</nova:name>
Oct 16 11:53:05 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:53:03</nova:creationTime>
Oct 16 11:53:05 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:53:05 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:53:05 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:53:05 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:53:05 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:53:05 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:53:05 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:53:05 user nova-compute[74683]:       <nova:owner>
Oct 16 11:53:05 user nova-compute[74683]:         <nova:user uuid="c7c151337018403599b6d06a6d82f7d2">tempest-TestShelveInstance-547173108-project-member</nova:user>
Oct 16 11:53:05 user nova-compute[74683]:         <nova:project uuid="e892ddc4503c42a5a5724f1ea3933a88">tempest-TestShelveInstance-547173108</nova:project>
Oct 16 11:53:05 user nova-compute[74683]:       </nova:owner>
Oct 16 11:53:05 user nova-compute[74683]:       <nova:ports>
Oct 16 11:53:05 user nova-compute[74683]:         <nova:port uuid="f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f">
Oct 16 11:53:05 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 16 11:53:05 user nova-compute[74683]:         </nova:port>
Oct 16 11:53:05 user nova-compute[74683]:       </nova:ports>
Oct 16 11:53:05 user nova-compute[74683]:     </nova:instance>
Oct 16 11:53:05 user nova-compute[74683]:   </metadata>
Oct 16 11:53:05 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:53:05 user nova-compute[74683]:     <system>
Oct 16 11:53:05 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:53:05 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:53:05 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:53:05 user nova-compute[74683]:       <entry name="serial">d35db024-18c5-4281-9518-7fd351811e6f</entry>
Oct 16 11:53:05 user nova-compute[74683]:       <entry name="uuid">d35db024-18c5-4281-9518-7fd351811e6f</entry>
Oct 16 11:53:05 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:53:05 user nova-compute[74683]:     </system>
Oct 16 11:53:05 user nova-compute[74683]:   </sysinfo>
Oct 16 11:53:05 user nova-compute[74683]:   <os>
Oct 16 11:53:05 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:53:05 user nova-compute[74683]:     <boot dev="hd"/>
Oct 16 11:53:05 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:53:05 user nova-compute[74683]:   </os>
Oct 16 11:53:05 user nova-compute[74683]:   <features>
Oct 16 11:53:05 user nova-compute[74683]:     <acpi/>
Oct 16 11:53:05 user nova-compute[74683]:     <apic/>
Oct 16 11:53:05 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:53:05 user nova-compute[74683]:   </features>
Oct 16 11:53:05 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:53:05 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:53:05 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:53:05 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:53:05 user nova-compute[74683]:   </clock>
Oct 16 11:53:05 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:53:05 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:53:05 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:53:05 user nova-compute[74683]:   </cpu>
Oct 16 11:53:05 user nova-compute[74683]:   <devices>
Oct 16 11:53:05 user nova-compute[74683]:     <disk type="block" device="disk">
Oct 16 11:53:05 user nova-compute[74683]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:53:05 user nova-compute[74683]:       <source dev="/dev/sdb"/>
Oct 16 11:53:05 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:53:05 user nova-compute[74683]:       <serial>29fc964e-fa79-4448-9141-032d88e43c68</serial>
Oct 16 11:53:05 user nova-compute[74683]:     </disk>
Oct 16 11:53:05 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:53:05 user nova-compute[74683]:       <mac address="fa:16:3e:72:48:68"/>
Oct 16 11:53:05 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:53:05 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:53:05 user nova-compute[74683]:       <target dev="tapf4a7ee77-cd"/>
Oct 16 11:53:05 user nova-compute[74683]:     </interface>
Oct 16 11:53:05 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:53:05 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/d35db024-18c5-4281-9518-7fd351811e6f/console.log" append="off"/>
Oct 16 11:53:05 user nova-compute[74683]:     </serial>
Oct 16 11:53:05 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:53:05 user nova-compute[74683]:     <video>
Oct 16 11:53:05 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:53:05 user nova-compute[74683]:     </video>
Oct 16 11:53:05 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:53:05 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:53:05 user nova-compute[74683]:     </rng>
Oct 16 11:53:05 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:53:05 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:53:05 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:53:05 user nova-compute[74683]:     </memballoon>
Oct 16 11:53:05 user nova-compute[74683]:   </devices>
Oct 16 11:53:05 user nova-compute[74683]: </domain>
Oct 16 11:53:05 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:53:05 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-16T11:49:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2144957190',display_name='tempest-TestShelveInstance-server-2144957190',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2144957190',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-527121964',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:49:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e892ddc4503c42a5a5724f1ea3933a88',ramdisk_id='',reservation_id='r-tnn3schj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-547173108',owner_user_name='tempest-TestShelveInstance-547173108-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:52:47Z,user_data=None,user_id='c7c151337018403599b6d06a6d82f7d2',uuid=d35db024-18c5-4281-9518-7fd351811e6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f", "address": "fa:16:3e:72:48:68", "network": {"id": "893d103e-5e60-4e15-9617-530ec1b284c1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1497002321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e892ddc4503c42a5a5724f1ea3933a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a7ee77-cd", "ovs_interfaceid": "f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:53:05 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Converting VIF {"id": "f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f", "address": "fa:16:3e:72:48:68", "network": {"id": "893d103e-5e60-4e15-9617-530ec1b284c1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1497002321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e892ddc4503c42a5a5724f1ea3933a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a7ee77-cd", "ovs_interfaceid": "f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:53:05 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:48:68,bridge_name='br-int',has_traffic_filtering=True,id=f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f,network=Network(893d103e-5e60-4e15-9617-530ec1b284c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4a7ee77-cd') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:53:05 user nova-compute[74683]: DEBUG os_vif [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:48:68,bridge_name='br-int',has_traffic_filtering=True,id=f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f,network=Network(893d103e-5e60-4e15-9617-530ec1b284c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4a7ee77-cd') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:53:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:53:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:53:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:53:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:53:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'af910176-1b17-51a9-998c-0f0d955c06b7', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:53:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:53:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:53:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:53:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4a7ee77-cd, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:53:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf4a7ee77-cd, col_values=(('qos', UUID('25835915-e538-4a50-9c00-dcd90f89fd78')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:53:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf4a7ee77-cd, col_values=(('external_ids', {'iface-id': 'f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:48:68', 'vm-uuid': 'd35db024-18c5-4281-9518-7fd351811e6f'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:53:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:53:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:53:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:53:05 user nova-compute[74683]: INFO os_vif [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:48:68,bridge_name='br-int',has_traffic_filtering=True,id=f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f,network=Network(893d103e-5e60-4e15-9617-530ec1b284c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4a7ee77-cd')
Oct 16 11:53:05 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:53:05 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] No VIF found with MAC fa:16:3e:72:48:68, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:53:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:53:06 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:53:06 user nova-compute[74683]: DEBUG nova.compute.manager [req-f543e574-0ffc-497f-a0a7-920c0f565099 req-0b0b3d07-34a9-4791-8f9c-971620f11d11 service nova] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Received event network-vif-plugged-f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:53:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f543e574-0ffc-497f-a0a7-920c0f565099 req-0b0b3d07-34a9-4791-8f9c-971620f11d11 service nova] Acquiring lock "d35db024-18c5-4281-9518-7fd351811e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:53:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f543e574-0ffc-497f-a0a7-920c0f565099 req-0b0b3d07-34a9-4791-8f9c-971620f11d11 service nova] Lock "d35db024-18c5-4281-9518-7fd351811e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:53:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-f543e574-0ffc-497f-a0a7-920c0f565099 req-0b0b3d07-34a9-4791-8f9c-971620f11d11 service nova] Lock "d35db024-18c5-4281-9518-7fd351811e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:53:06 user nova-compute[74683]: DEBUG nova.compute.manager [req-f543e574-0ffc-497f-a0a7-920c0f565099 req-0b0b3d07-34a9-4791-8f9c-971620f11d11 service nova] [instance: d35db024-18c5-4281-9518-7fd351811e6f] No waiting events found dispatching network-vif-plugged-f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:53:06 user nova-compute[74683]: WARNING nova.compute.manager [req-f543e574-0ffc-497f-a0a7-920c0f565099 req-0b0b3d07-34a9-4791-8f9c-971620f11d11 service nova] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Received unexpected event network-vif-plugged-f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f for instance with vm_state shelved_offloaded and task_state spawning.
Oct 16 11:53:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:53:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:53:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:53:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:53:08 user nova-compute[74683]: DEBUG nova.compute.manager [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Instance event wait completed in 0 seconds for  {{(pid=74683) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 11:53:08 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Guest created on hypervisor {{(pid=74683) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 11:53:08 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Instance spawned successfully.
Oct 16 11:53:08 user nova-compute[74683]: DEBUG nova.compute.manager [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:53:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-2a526349-03af-4a7a-b04d-29ea600b436f tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Lock "d35db024-18c5-4281-9518-7fd351811e6f" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 21.864s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:53:08 user nova-compute[74683]: DEBUG nova.compute.manager [req-29903c77-81ce-473b-b3f4-dbce2dfd2dfc req-77b2324d-f5be-48ff-99cd-376469dbbe66 service nova] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Received event network-vif-plugged-f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:53:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-29903c77-81ce-473b-b3f4-dbce2dfd2dfc req-77b2324d-f5be-48ff-99cd-376469dbbe66 service nova] Acquiring lock "d35db024-18c5-4281-9518-7fd351811e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:53:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-29903c77-81ce-473b-b3f4-dbce2dfd2dfc req-77b2324d-f5be-48ff-99cd-376469dbbe66 service nova] Lock "d35db024-18c5-4281-9518-7fd351811e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:53:08 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-29903c77-81ce-473b-b3f4-dbce2dfd2dfc req-77b2324d-f5be-48ff-99cd-376469dbbe66 service nova] Lock "d35db024-18c5-4281-9518-7fd351811e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:53:08 user nova-compute[74683]: DEBUG nova.compute.manager [req-29903c77-81ce-473b-b3f4-dbce2dfd2dfc req-77b2324d-f5be-48ff-99cd-376469dbbe66 service nova] [instance: d35db024-18c5-4281-9518-7fd351811e6f] No waiting events found dispatching network-vif-plugged-f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:53:08 user nova-compute[74683]: WARNING nova.compute.manager [req-29903c77-81ce-473b-b3f4-dbce2dfd2dfc req-77b2324d-f5be-48ff-99cd-376469dbbe66 service nova] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Received unexpected event network-vif-plugged-f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f for instance with vm_state active and task_state None.
Oct 16 11:53:10 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:53:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:53:15 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:53:20 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:53:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:53:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:53:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:53:30 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:53:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:53:33 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:53:33 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:53:33 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:53:35 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:53:36 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:53:37 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:53:37 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:53:37 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Starting heal instance info cache {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 11:53:37 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Rebuilding the list of instances to heal {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 11:53:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:53:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "refresh_cache-4411a1a8-cd51-46b3-9f99-46670bb7e72e" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:53:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquired lock "refresh_cache-4411a1a8-cd51-46b3-9f99-46670bb7e72e" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:53:37 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Forcefully refreshing network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 11:53:37 user nova-compute[74683]: DEBUG nova.objects.instance [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lazy-loading 'info_cache' on Instance uuid 4411a1a8-cd51-46b3-9f99-46670bb7e72e {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:53:38 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Updating instance_info_cache with network_info: [{"id": "d82b8aef-5586-4582-9253-b964d495ce17", "address": "fa:16:3e:05:e7:3e", "network": {"id": "2ea750a5-8511-4e40-b149-062e10e0096c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-563467594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d2c7c33914a068b448c447db50b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd82b8aef-55", "ovs_interfaceid": "d82b8aef-5586-4582-9253-b964d495ce17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:53:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Releasing lock "refresh_cache-4411a1a8-cd51-46b3-9f99-46670bb7e72e" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:53:38 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Updated the network info_cache for instance {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 11:53:38 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:53:38 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:53:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:53:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:53:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:53:38 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Auditing locally available compute resources for user (node: user) {{(pid=74683) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 11:53:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4411a1a8-cd51-46b3-9f99-46670bb7e72e/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:53:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4411a1a8-cd51-46b3-9f99-46670bb7e72e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:53:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4411a1a8-cd51-46b3-9f99-46670bb7e72e/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:53:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4411a1a8-cd51-46b3-9f99-46670bb7e72e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:53:39 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:53:39 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:53:39 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:53:39 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Hypervisor/Node resource view: name=user free_ram=8874MB free_disk=25.048770904541016GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74683) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 11:53:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:53:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:53:39 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 4411a1a8-cd51-46b3-9f99-46670bb7e72e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:53:39 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance d35db024-18c5-4281-9518-7fd351811e6f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:53:39 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 11:53:39 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 11:53:39 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:53:39 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:53:39 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Compute_service record updated for user:user {{(pid=74683) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 11:53:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.250s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:53:40 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:53:40 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:53:40 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74683) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 11:53:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:53:46 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-84b87afa-8146-4282-8222-3a8e183cc928 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Acquiring lock "4411a1a8-cd51-46b3-9f99-46670bb7e72e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:53:46 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-84b87afa-8146-4282-8222-3a8e183cc928 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "4411a1a8-cd51-46b3-9f99-46670bb7e72e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:53:46 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-84b87afa-8146-4282-8222-3a8e183cc928 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Acquiring lock "4411a1a8-cd51-46b3-9f99-46670bb7e72e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:53:46 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-84b87afa-8146-4282-8222-3a8e183cc928 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "4411a1a8-cd51-46b3-9f99-46670bb7e72e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:53:46 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-84b87afa-8146-4282-8222-3a8e183cc928 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "4411a1a8-cd51-46b3-9f99-46670bb7e72e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:53:46 user nova-compute[74683]: INFO nova.compute.manager [None req-84b87afa-8146-4282-8222-3a8e183cc928 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Terminating instance
Oct 16 11:53:46 user nova-compute[74683]: DEBUG nova.compute.manager [None req-84b87afa-8146-4282-8222-3a8e183cc928 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Start destroying the instance on the hypervisor. {{(pid=74683) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 11:53:46 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:53:46 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:53:46 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:53:46 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:53:46 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:53:46 user nova-compute[74683]: DEBUG nova.compute.manager [req-8006e406-bebd-4198-95bb-864d16a102a2 req-81178e2b-c5e0-4390-b70f-1a0a98c04956 service nova] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Received event network-vif-unplugged-d82b8aef-5586-4582-9253-b964d495ce17 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:53:46 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-8006e406-bebd-4198-95bb-864d16a102a2 req-81178e2b-c5e0-4390-b70f-1a0a98c04956 service nova] Acquiring lock "4411a1a8-cd51-46b3-9f99-46670bb7e72e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:53:46 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-8006e406-bebd-4198-95bb-864d16a102a2 req-81178e2b-c5e0-4390-b70f-1a0a98c04956 service nova] Lock "4411a1a8-cd51-46b3-9f99-46670bb7e72e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:53:46 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-8006e406-bebd-4198-95bb-864d16a102a2 req-81178e2b-c5e0-4390-b70f-1a0a98c04956 service nova] Lock "4411a1a8-cd51-46b3-9f99-46670bb7e72e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:53:46 user nova-compute[74683]: DEBUG nova.compute.manager [req-8006e406-bebd-4198-95bb-864d16a102a2 req-81178e2b-c5e0-4390-b70f-1a0a98c04956 service nova] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] No waiting events found dispatching network-vif-unplugged-d82b8aef-5586-4582-9253-b964d495ce17 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:53:46 user nova-compute[74683]: DEBUG nova.compute.manager [req-8006e406-bebd-4198-95bb-864d16a102a2 req-81178e2b-c5e0-4390-b70f-1a0a98c04956 service nova] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Received event network-vif-unplugged-d82b8aef-5586-4582-9253-b964d495ce17 for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 11:53:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:53:47 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Instance destroyed successfully.
Oct 16 11:53:47 user nova-compute[74683]: DEBUG nova.objects.instance [None req-84b87afa-8146-4282-8222-3a8e183cc928 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lazy-loading 'resources' on Instance uuid 4411a1a8-cd51-46b3-9f99-46670bb7e72e {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:53:47 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-84b87afa-8146-4282-8222-3a8e183cc928 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-16T11:48:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1398782217',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1398782217',id=50,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkjneMok6wxawPFluQoU/qX70mjcBLziRvERAL2SLF5JzucZefDlpd9cZZ9qDE1gaEMvkkp21bQmMlLaAlzbn/Yb1Cc+gwzL4SGhCqcfuWKGvbSFG8xR2wBd60BfbY1EQ==',key_name='tempest-keypair-253079390',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:52:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='622d2c7c33914a068b448c447db50b3c',ramdisk_id='',reservation_id='r-avxku7yo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-291825158',owner_user_name='tempest-AttachVolumeShelveTestJSON-291825158-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:52:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11130271beb44b368f9eb55bd4946cbc',uuid=4411a1a8-cd51-46b3-9f99-46670bb7e72e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d82b8aef-5586-4582-9253-b964d495ce17", "address": "fa:16:3e:05:e7:3e", "network": {"id": "2ea750a5-8511-4e40-b149-062e10e0096c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-563467594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d2c7c33914a068b448c447db50b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd82b8aef-55", "ovs_interfaceid": "d82b8aef-5586-4582-9253-b964d495ce17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:53:47 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-84b87afa-8146-4282-8222-3a8e183cc928 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Converting VIF {"id": "d82b8aef-5586-4582-9253-b964d495ce17", "address": "fa:16:3e:05:e7:3e", "network": {"id": "2ea750a5-8511-4e40-b149-062e10e0096c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-563467594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d2c7c33914a068b448c447db50b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd82b8aef-55", "ovs_interfaceid": "d82b8aef-5586-4582-9253-b964d495ce17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:53:47 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-84b87afa-8146-4282-8222-3a8e183cc928 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:05:e7:3e,bridge_name='br-int',has_traffic_filtering=True,id=d82b8aef-5586-4582-9253-b964d495ce17,network=Network(2ea750a5-8511-4e40-b149-062e10e0096c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd82b8aef-55') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:53:47 user nova-compute[74683]: DEBUG os_vif [None req-84b87afa-8146-4282-8222-3a8e183cc928 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:e7:3e,bridge_name='br-int',has_traffic_filtering=True,id=d82b8aef-5586-4582-9253-b964d495ce17,network=Network(2ea750a5-8511-4e40-b149-062e10e0096c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd82b8aef-55') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:53:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:53:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd82b8aef-55, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:53:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:53:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:53:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:53:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4f596b1d-a71a-46b0-a5c7-743835030d87) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:53:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:53:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:53:47 user nova-compute[74683]: INFO os_vif [None req-84b87afa-8146-4282-8222-3a8e183cc928 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:e7:3e,bridge_name='br-int',has_traffic_filtering=True,id=d82b8aef-5586-4582-9253-b964d495ce17,network=Network(2ea750a5-8511-4e40-b149-062e10e0096c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd82b8aef-55')
Oct 16 11:53:47 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-84b87afa-8146-4282-8222-3a8e183cc928 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Deleting instance files /opt/stack/data/nova/instances/4411a1a8-cd51-46b3-9f99-46670bb7e72e_del
Oct 16 11:53:47 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-84b87afa-8146-4282-8222-3a8e183cc928 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Deletion of /opt/stack/data/nova/instances/4411a1a8-cd51-46b3-9f99-46670bb7e72e_del complete
Oct 16 11:53:47 user nova-compute[74683]: INFO nova.compute.manager [None req-84b87afa-8146-4282-8222-3a8e183cc928 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Took 0.86 seconds to destroy the instance on the hypervisor.
Oct 16 11:53:47 user nova-compute[74683]: DEBUG oslo.service.loopingcall [None req-84b87afa-8146-4282-8222-3a8e183cc928 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74683) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 11:53:47 user nova-compute[74683]: DEBUG nova.compute.manager [-] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Deallocating network for instance {{(pid=74683) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 11:53:47 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] deallocate_for_instance() {{(pid=74683) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 11:53:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:53:48 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:53:48 user nova-compute[74683]: INFO nova.compute.manager [-] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Took 0.70 seconds to deallocate network for instance.
Oct 16 11:53:48 user nova-compute[74683]: DEBUG nova.compute.manager [req-20e2177f-b101-4c61-9aee-576304625574 req-f7df4e0f-e18c-41a5-99ca-6d6a9901bff3 service nova] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Received event network-vif-deleted-d82b8aef-5586-4582-9253-b964d495ce17 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:53:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-84b87afa-8146-4282-8222-3a8e183cc928 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:53:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-84b87afa-8146-4282-8222-3a8e183cc928 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:53:48 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-84b87afa-8146-4282-8222-3a8e183cc928 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:53:48 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-84b87afa-8146-4282-8222-3a8e183cc928 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:53:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-84b87afa-8146-4282-8222-3a8e183cc928 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.137s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:53:48 user nova-compute[74683]: INFO nova.scheduler.client.report [None req-84b87afa-8146-4282-8222-3a8e183cc928 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Deleted allocations for instance 4411a1a8-cd51-46b3-9f99-46670bb7e72e
Oct 16 11:53:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-84b87afa-8146-4282-8222-3a8e183cc928 tempest-AttachVolumeShelveTestJSON-291825158 tempest-AttachVolumeShelveTestJSON-291825158-project-member] Lock "4411a1a8-cd51-46b3-9f99-46670bb7e72e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.881s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:53:48 user nova-compute[74683]: DEBUG nova.compute.manager [req-accb7ab1-d63a-409e-803a-5f29f6cb57e3 req-c99741e0-b144-4227-aba3-f9dda67916d0 service nova] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Received event network-vif-plugged-d82b8aef-5586-4582-9253-b964d495ce17 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:53:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-accb7ab1-d63a-409e-803a-5f29f6cb57e3 req-c99741e0-b144-4227-aba3-f9dda67916d0 service nova] Acquiring lock "4411a1a8-cd51-46b3-9f99-46670bb7e72e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:53:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-accb7ab1-d63a-409e-803a-5f29f6cb57e3 req-c99741e0-b144-4227-aba3-f9dda67916d0 service nova] Lock "4411a1a8-cd51-46b3-9f99-46670bb7e72e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:53:48 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-accb7ab1-d63a-409e-803a-5f29f6cb57e3 req-c99741e0-b144-4227-aba3-f9dda67916d0 service nova] Lock "4411a1a8-cd51-46b3-9f99-46670bb7e72e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:53:48 user nova-compute[74683]: DEBUG nova.compute.manager [req-accb7ab1-d63a-409e-803a-5f29f6cb57e3 req-c99741e0-b144-4227-aba3-f9dda67916d0 service nova] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] No waiting events found dispatching network-vif-plugged-d82b8aef-5586-4582-9253-b964d495ce17 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:53:48 user nova-compute[74683]: WARNING nova.compute.manager [req-accb7ab1-d63a-409e-803a-5f29f6cb57e3 req-c99741e0-b144-4227-aba3-f9dda67916d0 service nova] [instance: 4411a1a8-cd51-46b3-9f99-46670bb7e72e] Received unexpected event network-vif-plugged-d82b8aef-5586-4582-9253-b964d495ce17 for instance with vm_state deleted and task_state None.
Oct 16 11:53:49 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:53:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:53:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:53:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:53:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:54:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:54:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:54:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:54:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:54:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:54:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:54:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:54:32 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:54:32 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Cleaning up deleted instances with incomplete migration  {{(pid=74683) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 16 11:54:33 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:54:34 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:54:34 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:54:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:54:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:54:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:54:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-167e0f7c-3beb-4166-bc07-ea942bdac6b9 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Acquiring lock "d35db024-18c5-4281-9518-7fd351811e6f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:54:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-167e0f7c-3beb-4166-bc07-ea942bdac6b9 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Lock "d35db024-18c5-4281-9518-7fd351811e6f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:54:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-167e0f7c-3beb-4166-bc07-ea942bdac6b9 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Acquiring lock "d35db024-18c5-4281-9518-7fd351811e6f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:54:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-167e0f7c-3beb-4166-bc07-ea942bdac6b9 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Lock "d35db024-18c5-4281-9518-7fd351811e6f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:54:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-167e0f7c-3beb-4166-bc07-ea942bdac6b9 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Lock "d35db024-18c5-4281-9518-7fd351811e6f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:54:37 user nova-compute[74683]: INFO nova.compute.manager [None req-167e0f7c-3beb-4166-bc07-ea942bdac6b9 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Terminating instance
Oct 16 11:54:37 user nova-compute[74683]: DEBUG nova.compute.manager [None req-167e0f7c-3beb-4166-bc07-ea942bdac6b9 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Start destroying the instance on the hypervisor. {{(pid=74683) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 11:54:37 user nova-compute[74683]: DEBUG nova.compute.manager [req-9734ebfa-acab-4956-a765-0c39cd484c43 req-e4627a53-2f58-46a8-997f-ef6f866ab4a0 service nova] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Received event network-changed-f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:54:37 user nova-compute[74683]: DEBUG nova.compute.manager [req-9734ebfa-acab-4956-a765-0c39cd484c43 req-e4627a53-2f58-46a8-997f-ef6f866ab4a0 service nova] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Refreshing instance network info cache due to event network-changed-f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:54:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-9734ebfa-acab-4956-a765-0c39cd484c43 req-e4627a53-2f58-46a8-997f-ef6f866ab4a0 service nova] Acquiring lock "refresh_cache-d35db024-18c5-4281-9518-7fd351811e6f" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:54:37 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-9734ebfa-acab-4956-a765-0c39cd484c43 req-e4627a53-2f58-46a8-997f-ef6f866ab4a0 service nova] Acquired lock "refresh_cache-d35db024-18c5-4281-9518-7fd351811e6f" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:54:37 user nova-compute[74683]: DEBUG nova.network.neutron [req-9734ebfa-acab-4956-a765-0c39cd484c43 req-e4627a53-2f58-46a8-997f-ef6f866ab4a0 service nova] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Refreshing network info cache for port f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:54:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:54:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:54:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:54:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:54:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:54:38 user nova-compute[74683]: DEBUG nova.compute.manager [req-cfecd1b6-98e4-40bf-a7c9-c03bfec7a7e5 req-9e22d8a1-dff3-4bd6-8b4b-7659536209ec service nova] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Received event network-vif-unplugged-f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:54:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-cfecd1b6-98e4-40bf-a7c9-c03bfec7a7e5 req-9e22d8a1-dff3-4bd6-8b4b-7659536209ec service nova] Acquiring lock "d35db024-18c5-4281-9518-7fd351811e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:54:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-cfecd1b6-98e4-40bf-a7c9-c03bfec7a7e5 req-9e22d8a1-dff3-4bd6-8b4b-7659536209ec service nova] Lock "d35db024-18c5-4281-9518-7fd351811e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:54:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-cfecd1b6-98e4-40bf-a7c9-c03bfec7a7e5 req-9e22d8a1-dff3-4bd6-8b4b-7659536209ec service nova] Lock "d35db024-18c5-4281-9518-7fd351811e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:54:38 user nova-compute[74683]: DEBUG nova.compute.manager [req-cfecd1b6-98e4-40bf-a7c9-c03bfec7a7e5 req-9e22d8a1-dff3-4bd6-8b4b-7659536209ec service nova] [instance: d35db024-18c5-4281-9518-7fd351811e6f] No waiting events found dispatching network-vif-unplugged-f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:54:38 user nova-compute[74683]: DEBUG nova.compute.manager [req-cfecd1b6-98e4-40bf-a7c9-c03bfec7a7e5 req-9e22d8a1-dff3-4bd6-8b4b-7659536209ec service nova] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Received event network-vif-unplugged-f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 11:54:38 user nova-compute[74683]: DEBUG nova.network.neutron [req-9734ebfa-acab-4956-a765-0c39cd484c43 req-e4627a53-2f58-46a8-997f-ef6f866ab4a0 service nova] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Updated VIF entry in instance network info cache for port f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:54:38 user nova-compute[74683]: DEBUG nova.network.neutron [req-9734ebfa-acab-4956-a765-0c39cd484c43 req-e4627a53-2f58-46a8-997f-ef6f866ab4a0 service nova] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Updating instance_info_cache with network_info: [{"id": "f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f", "address": "fa:16:3e:72:48:68", "network": {"id": "893d103e-5e60-4e15-9617-530ec1b284c1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1497002321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e892ddc4503c42a5a5724f1ea3933a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a7ee77-cd", "ovs_interfaceid": "f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:54:38 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:54:38 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Starting heal instance info cache {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 11:54:38 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Instance destroyed successfully.
Oct 16 11:54:38 user nova-compute[74683]: DEBUG nova.objects.instance [None req-167e0f7c-3beb-4166-bc07-ea942bdac6b9 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Lazy-loading 'resources' on Instance uuid d35db024-18c5-4281-9518-7fd351811e6f {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:54:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-9734ebfa-acab-4956-a765-0c39cd484c43 req-e4627a53-2f58-46a8-997f-ef6f866ab4a0 service nova] Releasing lock "refresh_cache-d35db024-18c5-4281-9518-7fd351811e6f" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:54:38 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-167e0f7c-3beb-4166-bc07-ea942bdac6b9 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-16T11:49:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2144957190',display_name='tempest-TestShelveInstance-server-2144957190',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2144957190',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfm6FrJOA0WYRBy7wT7iNCupFsFZVd6Aq+19ZRioq/2RyWJNDIrJ0fsOj3lJoLuQCVoc7/fo6IFP4c6X+8hjsPPsbmQFAlV9644xjIYyaH1rp5jWUE3kh/muw9UkmtKXQ==',key_name='tempest-TestShelveInstance-527121964',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:53:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e892ddc4503c42a5a5724f1ea3933a88',ramdisk_id='',reservation_id='r-tnn3schj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-547173108',owner_user_name='tempest-TestShelveInstance-547173108-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:53:09Z,user_data=None,user_id='c7c151337018403599b6d06a6d82f7d2',uuid=d35db024-18c5-4281-9518-7fd351811e6f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f", "address": "fa:16:3e:72:48:68", "network": {"id": "893d103e-5e60-4e15-9617-530ec1b284c1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1497002321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e892ddc4503c42a5a5724f1ea3933a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a7ee77-cd", "ovs_interfaceid": "f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 11:54:38 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-167e0f7c-3beb-4166-bc07-ea942bdac6b9 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Converting VIF {"id": "f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f", "address": "fa:16:3e:72:48:68", "network": {"id": "893d103e-5e60-4e15-9617-530ec1b284c1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1497002321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e892ddc4503c42a5a5724f1ea3933a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a7ee77-cd", "ovs_interfaceid": "f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:54:38 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-167e0f7c-3beb-4166-bc07-ea942bdac6b9 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:48:68,bridge_name='br-int',has_traffic_filtering=True,id=f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f,network=Network(893d103e-5e60-4e15-9617-530ec1b284c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4a7ee77-cd') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:54:38 user nova-compute[74683]: DEBUG os_vif [None req-167e0f7c-3beb-4166-bc07-ea942bdac6b9 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:48:68,bridge_name='br-int',has_traffic_filtering=True,id=f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f,network=Network(893d103e-5e60-4e15-9617-530ec1b284c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4a7ee77-cd') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 11:54:38 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Skipping network cache update for instance because it is being deleted. {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9970}}
Oct 16 11:54:38 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Didn't find any instances for network info cache update. {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 16 11:54:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:54:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4a7ee77-cd, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:54:38 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:54:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:54:38 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:54:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:54:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:54:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=25835915-e538-4a50-9c00-dcd90f89fd78) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:54:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:54:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:54:38 user nova-compute[74683]: INFO os_vif [None req-167e0f7c-3beb-4166-bc07-ea942bdac6b9 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:48:68,bridge_name='br-int',has_traffic_filtering=True,id=f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f,network=Network(893d103e-5e60-4e15-9617-530ec1b284c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4a7ee77-cd')
Oct 16 11:54:38 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-167e0f7c-3beb-4166-bc07-ea942bdac6b9 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] calling os-brick to detach iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 11:54:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-167e0f7c-3beb-4166-bc07-ea942bdac6b9 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, {'target_iqn': 'iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LKoeZfiz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:54:38 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-167e0f7c-3beb-4166-bc07-ea942bdac6b9 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:54:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-167e0f7c-3beb-4166-bc07-ea942bdac6b9 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:54:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-167e0f7c-3beb-4166-bc07-ea942bdac6b9 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:54:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:54:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:54:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:54:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:54:38 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Auditing locally available compute resources for user (node: user) {{(pid=74683) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 11:54:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:54:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1af3da9-8cea-484d-9d04-08cdfac4048f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:54:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-167e0f7c-3beb-4166-bc07-ea942bdac6b9 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 11:54:38 user nova-compute[74683]: No targets found.
Oct 16 11:54:38 user nova-compute[74683]: iSNS:
Oct 16 11:54:38 user nova-compute[74683]: No targets found.
Oct 16 11:54:38 user nova-compute[74683]: STATIC:
Oct 16 11:54:38 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68
Oct 16 11:54:38 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:54:38 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:54:38 user nova-compute[74683]: FIRMWARE:
Oct 16 11:54:38 user nova-compute[74683]: No targets found.
Oct 16 11:54:38 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:54:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-167e0f7c-3beb-4166-bc07-ea942bdac6b9 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 11:54:38 user nova-compute[74683]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 11:54:38 user nova-compute[74683]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74683) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 11:54:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-167e0f7c-3beb-4166-bc07-ea942bdac6b9 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68', 0)] {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 11:54:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:54:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:54:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f35e475-dc2c-428f-bfb1-8f7c13e857a3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:54:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:54:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:54:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc4c69e-e053-4413-ac17-e7ac94ad9cc6]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68 (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:54:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-167e0f7c-3beb-4166-bc07-ea942bdac6b9 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68 (non-flash)
Oct 16 11:54:38 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:54:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-167e0f7c-3beb-4166-bc07-ea942bdac6b9 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68 (non-flash)
Oct 16 11:54:38 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:54:38 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-167e0f7c-3beb-4166-bc07-ea942bdac6b9 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda4c7c60e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68'): ({'sdb'}, set())}) {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 11:54:38 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-167e0f7c-3beb-4166-bc07-ea942bdac6b9 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Removing single pathed devices sdb {{(pid=74683) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 11:54:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:54:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:54:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e303a5e0-209d-4e26-92a6-11c1a058c32b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:54:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:54:38 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74683) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 11:54:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:54:38 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[861901c5-fe2b-40d7-85db-16471aae5b85]: (4, ('ok\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:54:38 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-167e0f7c-3beb-4166-bc07-ea942bdac6b9 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Flushing IO for device /dev/sdb {{(pid=74683) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 11:54:38 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:54:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:54:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[938eb655-f3f4-433a-8d53-159128bd9bca]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:54:39 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-167e0f7c-3beb-4166-bc07-ea942bdac6b9 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74683) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 11:54:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:54:39 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:54:39 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:54:39 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Hypervisor/Node resource view: name=user free_ram=9095MB free_disk=25.07585906982422GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74683) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 11:54:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:54:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:54:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.064s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:54:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[31605b08-c512-4199-98b2-23c2092b3930]: (4, ('1', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:54:39 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-167e0f7c-3beb-4166-bc07-ea942bdac6b9 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 11:54:39 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-167e0f7c-3beb-4166-bc07-ea942bdac6b9 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] SCSI volumes sdb have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 11:54:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-167e0f7c-3beb-4166-bc07-ea942bdac6b9 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68')] {{(pid=74683) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 11:54:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:54:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:54:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[812a6efc-8d4b-4392-a84c-a9029ac673b9]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:54:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-167e0f7c-3beb-4166-bc07-ea942bdac6b9 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:54:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68 -p 172.16.0.220:3260 --logout {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:54:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:54:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[962dfdb5-6749-4734-9228-12e2486e2a00]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:54:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-167e0f7c-3beb-4166-bc07-ea942bdac6b9 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68, portal: 172.16.0.220,3260]
Oct 16 11:54:39 user nova-compute[74683]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68, portal: 172.16.0.220,3260] successful.
Oct 16 11:54:39 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:54:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68 -p 172.16.0.220:3260 --op delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:54:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29fc964e-fa79-4448-9141-032d88e43c68 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:54:39 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[27294890-4c6a-4f8b-beea-6f95cfc004ab]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:54:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-167e0f7c-3beb-4166-bc07-ea942bdac6b9 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:54:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-167e0f7c-3beb-4166-bc07-ea942bdac6b9 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.617s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:54:39 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-167e0f7c-3beb-4166-bc07-ea942bdac6b9 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] <== disconnect_volume: return (618ms) None {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:54:39 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-167e0f7c-3beb-4166-bc07-ea942bdac6b9 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Disconnected iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 11:54:39 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-167e0f7c-3beb-4166-bc07-ea942bdac6b9 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Deleting instance files /opt/stack/data/nova/instances/d35db024-18c5-4281-9518-7fd351811e6f_del
Oct 16 11:54:39 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-167e0f7c-3beb-4166-bc07-ea942bdac6b9 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Deletion of /opt/stack/data/nova/instances/d35db024-18c5-4281-9518-7fd351811e6f_del complete
Oct 16 11:54:39 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance d35db024-18c5-4281-9518-7fd351811e6f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:54:39 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 11:54:39 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 11:54:39 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Refreshing inventories for resource provider 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 16 11:54:39 user nova-compute[74683]: INFO nova.compute.manager [None req-167e0f7c-3beb-4166-bc07-ea942bdac6b9 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Took 1.57 seconds to destroy the instance on the hypervisor.
Oct 16 11:54:39 user nova-compute[74683]: DEBUG oslo.service.loopingcall [None req-167e0f7c-3beb-4166-bc07-ea942bdac6b9 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74683) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 11:54:39 user nova-compute[74683]: DEBUG nova.compute.manager [-] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Deallocating network for instance {{(pid=74683) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 11:54:39 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: d35db024-18c5-4281-9518-7fd351811e6f] deallocate_for_instance() {{(pid=74683) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 11:54:39 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Updating ProviderTree inventory for provider 7142d606-df50-4cbe-b5ed-1802caa31862 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 16 11:54:39 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Updating inventory in ProviderTree for provider 7142d606-df50-4cbe-b5ed-1802caa31862 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 16 11:54:39 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Refreshing aggregate associations for resource provider 7142d606-df50-4cbe-b5ed-1802caa31862, aggregates: None {{(pid=74683) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 16 11:54:39 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Refreshing trait associations for resource provider 7142d606-df50-4cbe-b5ed-1802caa31862, traits: COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VMVGA {{(pid=74683) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 16 11:54:39 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:54:39 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:54:39 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Compute_service record updated for user:user {{(pid=74683) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 11:54:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.441s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:54:40 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:54:40 user nova-compute[74683]: INFO nova.compute.manager [-] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Took 0.81 seconds to deallocate network for instance.
Oct 16 11:54:40 user nova-compute[74683]: DEBUG nova.compute.manager [req-cab3d09e-a732-47ca-b387-41829da4ea3c req-0c3ca15b-7016-461b-962f-0901ff0360a2 service nova] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Received event network-vif-plugged-f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:54:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-cab3d09e-a732-47ca-b387-41829da4ea3c req-0c3ca15b-7016-461b-962f-0901ff0360a2 service nova] Acquiring lock "d35db024-18c5-4281-9518-7fd351811e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:54:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-cab3d09e-a732-47ca-b387-41829da4ea3c req-0c3ca15b-7016-461b-962f-0901ff0360a2 service nova] Lock "d35db024-18c5-4281-9518-7fd351811e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:54:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-cab3d09e-a732-47ca-b387-41829da4ea3c req-0c3ca15b-7016-461b-962f-0901ff0360a2 service nova] Lock "d35db024-18c5-4281-9518-7fd351811e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:54:40 user nova-compute[74683]: DEBUG nova.compute.manager [req-cab3d09e-a732-47ca-b387-41829da4ea3c req-0c3ca15b-7016-461b-962f-0901ff0360a2 service nova] [instance: d35db024-18c5-4281-9518-7fd351811e6f] No waiting events found dispatching network-vif-plugged-f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:54:40 user nova-compute[74683]: WARNING nova.compute.manager [req-cab3d09e-a732-47ca-b387-41829da4ea3c req-0c3ca15b-7016-461b-962f-0901ff0360a2 service nova] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Received unexpected event network-vif-plugged-f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f for instance with vm_state active and task_state deleting.
Oct 16 11:54:40 user nova-compute[74683]: DEBUG nova.compute.manager [req-cab3d09e-a732-47ca-b387-41829da4ea3c req-0c3ca15b-7016-461b-962f-0901ff0360a2 service nova] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Received event network-vif-deleted-f4a7ee77-cda1-4a0a-bcd1-83c5a4a72b5f {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:54:40 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:54:40 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:54:41 user nova-compute[74683]: INFO nova.compute.manager [None req-167e0f7c-3beb-4166-bc07-ea942bdac6b9 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Took 0.77 seconds to detach 1 volumes for instance.
Oct 16 11:54:41 user nova-compute[74683]: DEBUG nova.compute.manager [None req-167e0f7c-3beb-4166-bc07-ea942bdac6b9 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] [instance: d35db024-18c5-4281-9518-7fd351811e6f] Deleting volume: 29fc964e-fa79-4448-9141-032d88e43c68 {{(pid=74683) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 16 11:54:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-167e0f7c-3beb-4166-bc07-ea942bdac6b9 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:54:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-167e0f7c-3beb-4166-bc07-ea942bdac6b9 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:54:41 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-167e0f7c-3beb-4166-bc07-ea942bdac6b9 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:54:41 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-167e0f7c-3beb-4166-bc07-ea942bdac6b9 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:54:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-167e0f7c-3beb-4166-bc07-ea942bdac6b9 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.111s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:54:41 user nova-compute[74683]: INFO nova.scheduler.client.report [None req-167e0f7c-3beb-4166-bc07-ea942bdac6b9 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Deleted allocations for instance d35db024-18c5-4281-9518-7fd351811e6f
Oct 16 11:54:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-167e0f7c-3beb-4166-bc07-ea942bdac6b9 tempest-TestShelveInstance-547173108 tempest-TestShelveInstance-547173108-project-member] Lock "d35db024-18c5-4281-9518-7fd351811e6f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.495s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:54:41 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:54:41 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74683) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 11:54:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:54:48 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:54:49 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:54:53 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:54:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:54:57 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:54:57 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Cleaning up deleted instances {{(pid=74683) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 16 11:54:57 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] There are 0 instances to clean {{(pid=74683) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 16 11:54:58 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:55:03 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:55:08 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:55:13 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:55:13 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:55:13 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74683) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 11:55:13 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:55:13 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:55:13 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:55:18 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:55:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:55:28 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:55:31 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:55:33 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:55:34 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:55:35 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:55:36 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:55:38 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:55:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:55:39 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:55:39 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Starting heal instance info cache {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 11:55:39 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Rebuilding the list of instances to heal {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 11:55:39 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Didn't find any instances for network info cache update. {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 16 11:55:39 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:55:39 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:55:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:55:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:55:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:55:39 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Auditing locally available compute resources for user (node: user) {{(pid=74683) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 11:55:40 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:55:40 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:55:40 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Hypervisor/Node resource view: name=user free_ram=9184MB free_disk=25.065990447998047GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74683) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 11:55:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:55:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:55:40 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 11:55:40 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 11:55:40 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:55:40 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:55:40 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Compute_service record updated for user:user {{(pid=74683) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 11:55:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.146s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:55:42 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:55:42 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:55:42 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:55:42 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74683) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 11:55:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:55:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:55:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74683) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 11:55:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:55:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:55:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:55:48 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:55:51 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:55:53 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:55:58 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:56:03 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:56:08 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:56:13 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:56:18 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:56:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:56:28 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:56:33 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:56:35 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:56:37 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:56:38 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:56:39 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:56:39 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:56:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:56:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:56:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:56:39 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Auditing locally available compute resources for user (node: user) {{(pid=74683) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 11:56:40 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:56:40 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:56:40 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Hypervisor/Node resource view: name=user free_ram=9205MB free_disk=25.064830780029297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74683) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 11:56:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:56:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:56:40 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 11:56:40 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 11:56:40 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:56:40 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:56:40 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Compute_service record updated for user:user {{(pid=74683) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 11:56:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.146s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:56:40 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:56:42 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:56:42 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Starting heal instance info cache {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 11:56:42 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Rebuilding the list of instances to heal {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 11:56:42 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Didn't find any instances for network info cache update. {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 16 11:56:42 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:56:43 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:56:43 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:56:43 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74683) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 11:56:43 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:56:48 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:56:49 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:56:51 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:56:51 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:56:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:56:53 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:56:55 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:56:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:56:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:56:58 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:57:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Acquiring lock "4e810851-2f43-431a-9633-eb3a428aa8c7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:57:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Lock "4e810851-2f43-431a-9633-eb3a428aa8c7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:57:00 user nova-compute[74683]: DEBUG nova.compute.manager [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Starting instance... {{(pid=74683) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 11:57:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:57:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:57:00 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74683) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 11:57:00 user nova-compute[74683]: INFO nova.compute.claims [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Claim successful on node user
Oct 16 11:57:00 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:57:00 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:57:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.198s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:57:00 user nova-compute[74683]: DEBUG nova.compute.manager [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Start building networks asynchronously for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 11:57:00 user nova-compute[74683]: DEBUG nova.compute.manager [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Allocating IP information in the background. {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 11:57:00 user nova-compute[74683]: DEBUG nova.network.neutron [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] allocate_for_instance() {{(pid=74683) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 11:57:00 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 11:57:00 user nova-compute[74683]: DEBUG nova.compute.manager [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Start building block device mappings for instance. {{(pid=74683) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 11:57:00 user nova-compute[74683]: DEBUG nova.policy [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8c82ef1775414566917117264755365d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aacc226c2a54235ae0b88f724606b62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74683) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 11:57:00 user nova-compute[74683]: DEBUG nova.compute.manager [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Start spawning the instance on the hypervisor. {{(pid=74683) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 11:57:00 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Creating instance directory {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 11:57:00 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Creating image(s)
Oct 16 11:57:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Acquiring lock "/opt/stack/data/nova/instances/4e810851-2f43-431a-9633-eb3a428aa8c7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:57:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Lock "/opt/stack/data/nova/instances/4e810851-2f43-431a-9633-eb3a428aa8c7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:57:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Lock "/opt/stack/data/nova/instances/4e810851-2f43-431a-9633-eb3a428aa8c7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:57:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:57:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.182s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:57:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Acquiring lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:57:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:57:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:57:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.170s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:57:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/4e810851-2f43-431a-9633-eb3a428aa8c7/disk 1073741824 {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:57:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66,backing_fmt=raw /opt/stack/data/nova/instances/4e810851-2f43-431a-9633-eb3a428aa8c7/disk 1073741824" returned: 0 in 0.047s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:57:00 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Lock "96f96cd77ed2c6025a116f6aa707a654b7041c66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:57:00 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:57:01 user nova-compute[74683]: DEBUG nova.network.neutron [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Successfully created port: fd72f93a-a495-45ee-ae8d-200c8079ae38 {{(pid=74683) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 11:57:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96f96cd77ed2c6025a116f6aa707a654b7041c66 --force-share --output=json" returned: 0 in 0.180s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:57:01 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4e810851-2f43-431a-9633-eb3a428aa8c7/disk. size=1073741824 {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 11:57:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e810851-2f43-431a-9633-eb3a428aa8c7/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:57:01 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e810851-2f43-431a-9633-eb3a428aa8c7/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:57:01 user nova-compute[74683]: DEBUG nova.virt.disk.api [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Cannot resize image /opt/stack/data/nova/instances/4e810851-2f43-431a-9633-eb3a428aa8c7/disk to a smaller size. {{(pid=74683) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 11:57:01 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Created local disks {{(pid=74683) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 11:57:01 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Ensure instance console log exists: /opt/stack/data/nova/instances/4e810851-2f43-431a-9633-eb3a428aa8c7/console.log {{(pid=74683) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 11:57:01 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:57:01 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:57:01 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:57:01 user nova-compute[74683]: DEBUG nova.network.neutron [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Successfully updated port: fd72f93a-a495-45ee-ae8d-200c8079ae38 {{(pid=74683) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 11:57:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Acquiring lock "refresh_cache-4e810851-2f43-431a-9633-eb3a428aa8c7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:57:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Acquired lock "refresh_cache-4e810851-2f43-431a-9633-eb3a428aa8c7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:57:02 user nova-compute[74683]: DEBUG nova.network.neutron [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Building network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 11:57:02 user nova-compute[74683]: DEBUG nova.network.neutron [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Instance cache missing network info. {{(pid=74683) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 11:57:02 user nova-compute[74683]: DEBUG nova.compute.manager [req-a8101073-14b0-472a-bf31-58a5eaf29b24 req-0b1f54f7-4c43-44dd-81f9-abeb26a071e9 service nova] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Received event network-changed-fd72f93a-a495-45ee-ae8d-200c8079ae38 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:57:02 user nova-compute[74683]: DEBUG nova.compute.manager [req-a8101073-14b0-472a-bf31-58a5eaf29b24 req-0b1f54f7-4c43-44dd-81f9-abeb26a071e9 service nova] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Refreshing instance network info cache due to event network-changed-fd72f93a-a495-45ee-ae8d-200c8079ae38. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:57:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a8101073-14b0-472a-bf31-58a5eaf29b24 req-0b1f54f7-4c43-44dd-81f9-abeb26a071e9 service nova] Acquiring lock "refresh_cache-4e810851-2f43-431a-9633-eb3a428aa8c7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:57:02 user nova-compute[74683]: DEBUG nova.network.neutron [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Updating instance_info_cache with network_info: [{"id": "fd72f93a-a495-45ee-ae8d-200c8079ae38", "address": "fa:16:3e:ea:c5:42", "network": {"id": "b6596e83-4544-4f3b-a91b-16c04b310187", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2107616380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1aacc226c2a54235ae0b88f724606b62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd72f93a-a4", "ovs_interfaceid": "fd72f93a-a495-45ee-ae8d-200c8079ae38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:57:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Releasing lock "refresh_cache-4e810851-2f43-431a-9633-eb3a428aa8c7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:57:02 user nova-compute[74683]: DEBUG nova.compute.manager [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Instance network_info: |[{"id": "fd72f93a-a495-45ee-ae8d-200c8079ae38", "address": "fa:16:3e:ea:c5:42", "network": {"id": "b6596e83-4544-4f3b-a91b-16c04b310187", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2107616380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1aacc226c2a54235ae0b88f724606b62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd72f93a-a4", "ovs_interfaceid": "fd72f93a-a495-45ee-ae8d-200c8079ae38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74683) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 11:57:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a8101073-14b0-472a-bf31-58a5eaf29b24 req-0b1f54f7-4c43-44dd-81f9-abeb26a071e9 service nova] Acquired lock "refresh_cache-4e810851-2f43-431a-9633-eb3a428aa8c7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:57:02 user nova-compute[74683]: DEBUG nova.network.neutron [req-a8101073-14b0-472a-bf31-58a5eaf29b24 req-0b1f54f7-4c43-44dd-81f9-abeb26a071e9 service nova] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Refreshing network info cache for port fd72f93a-a495-45ee-ae8d-200c8079ae38 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:57:02 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Start _get_guest_xml network_info=[{"id": "fd72f93a-a495-45ee-ae8d-200c8079ae38", "address": "fa:16:3e:ea:c5:42", "network": {"id": "b6596e83-4544-4f3b-a91b-16c04b310187", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2107616380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1aacc226c2a54235ae0b88f724606b62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd72f93a-a4", "ovs_interfaceid": "fd72f93a-a495-45ee-ae8d-200c8079ae38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 11:57:02 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:57:02 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:57:02 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 11:57:02 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] CPU controller missing on host. {{(pid=74683) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 11:57:02 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 11:57:02 user nova-compute[74683]: DEBUG nova.virt.libvirt.host [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] CPU controller found on host. {{(pid=74683) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 11:57:02 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74683) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 11:57:02 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T11:09:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T11:09:24Z,direct_url=<?>,disk_format='qcow2',id=0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bb523d6f2b3446f8a5e869f72a4f150b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T11:09:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 11:57:02 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Flavor limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 11:57:02 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Image limits 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 11:57:02 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Flavor pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 11:57:02 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Image pref 0:0:0 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 11:57:02 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 11:57:02 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 11:57:02 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 11:57:02 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Got 1 possible topologies {{(pid=74683) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 11:57:02 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 11:57:02 user nova-compute[74683]: DEBUG nova.virt.hardware [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74683) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 11:57:02 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:56:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-381836128',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-381836128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3818361',id=52,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXUI5vYmRUuqJ+TdMswMKrTZgqaaKo3RZeOKkDPiWV5A7XU0UOg7WqL1yiv/5q+2pssRpXwTiithJ1sGgFNEqPJW8apWic2I5waJCP/+FmAXHuHyeQnrkI2ehOT4Xzegg==',key_name='tempest-keypair-392397390',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1aacc226c2a54235ae0b88f724606b62',ramdisk_id='',reservation_id='r-7mbhnp9q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1889919261',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:57:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c82ef1775414566917117264755365d',uuid=4e810851-2f43-431a-9633-eb3a428aa8c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd72f93a-a495-45ee-ae8d-200c8079ae38", "address": "fa:16:3e:ea:c5:42", "network": {"id": "b6596e83-4544-4f3b-a91b-16c04b310187", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2107616380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1aacc226c2a54235ae0b88f724606b62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd72f93a-a4", "ovs_interfaceid": "fd72f93a-a495-45ee-ae8d-200c8079ae38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74683) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 11:57:02 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Converting VIF {"id": "fd72f93a-a495-45ee-ae8d-200c8079ae38", "address": "fa:16:3e:ea:c5:42", "network": {"id": "b6596e83-4544-4f3b-a91b-16c04b310187", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2107616380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1aacc226c2a54235ae0b88f724606b62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd72f93a-a4", "ovs_interfaceid": "fd72f93a-a495-45ee-ae8d-200c8079ae38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:57:02 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:c5:42,bridge_name='br-int',has_traffic_filtering=True,id=fd72f93a-a495-45ee-ae8d-200c8079ae38,network=Network(b6596e83-4544-4f3b-a91b-16c04b310187),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd72f93a-a4') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:57:02 user nova-compute[74683]: DEBUG nova.objects.instance [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Lazy-loading 'pci_devices' on Instance uuid 4e810851-2f43-431a-9633-eb3a428aa8c7 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:57:02 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] End _get_guest_xml xml=<domain type="kvm">
Oct 16 11:57:02 user nova-compute[74683]:   <uuid>4e810851-2f43-431a-9633-eb3a428aa8c7</uuid>
Oct 16 11:57:02 user nova-compute[74683]:   <name>instance-00000034</name>
Oct 16 11:57:02 user nova-compute[74683]:   <memory>524288</memory>
Oct 16 11:57:02 user nova-compute[74683]:   <vcpu>1</vcpu>
Oct 16 11:57:02 user nova-compute[74683]:   <metadata>
Oct 16 11:57:02 user nova-compute[74683]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 11:57:02 user nova-compute[74683]:       <nova:package version="0.0.0"/>
Oct 16 11:57:02 user nova-compute[74683]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-381836128</nova:name>
Oct 16 11:57:02 user nova-compute[74683]:       <nova:creationTime>2023-10-16 11:57:02</nova:creationTime>
Oct 16 11:57:02 user nova-compute[74683]:       <nova:flavor name="m1.tiny">
Oct 16 11:57:02 user nova-compute[74683]:         <nova:memory>512</nova:memory>
Oct 16 11:57:02 user nova-compute[74683]:         <nova:disk>1</nova:disk>
Oct 16 11:57:02 user nova-compute[74683]:         <nova:swap>0</nova:swap>
Oct 16 11:57:02 user nova-compute[74683]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 11:57:02 user nova-compute[74683]:         <nova:vcpus>1</nova:vcpus>
Oct 16 11:57:02 user nova-compute[74683]:       </nova:flavor>
Oct 16 11:57:02 user nova-compute[74683]:       <nova:owner>
Oct 16 11:57:02 user nova-compute[74683]:         <nova:user uuid="8c82ef1775414566917117264755365d">tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member</nova:user>
Oct 16 11:57:02 user nova-compute[74683]:         <nova:project uuid="1aacc226c2a54235ae0b88f724606b62">tempest-TestServerVolumeAttachScenarioOldVersion-1889919261</nova:project>
Oct 16 11:57:02 user nova-compute[74683]:       </nova:owner>
Oct 16 11:57:02 user nova-compute[74683]:       <nova:root type="image" uuid="0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f"/>
Oct 16 11:57:02 user nova-compute[74683]:       <nova:ports>
Oct 16 11:57:02 user nova-compute[74683]:         <nova:port uuid="fd72f93a-a495-45ee-ae8d-200c8079ae38">
Oct 16 11:57:02 user nova-compute[74683]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 16 11:57:02 user nova-compute[74683]:         </nova:port>
Oct 16 11:57:02 user nova-compute[74683]:       </nova:ports>
Oct 16 11:57:02 user nova-compute[74683]:     </nova:instance>
Oct 16 11:57:02 user nova-compute[74683]:   </metadata>
Oct 16 11:57:02 user nova-compute[74683]:   <sysinfo type="smbios">
Oct 16 11:57:02 user nova-compute[74683]:     <system>
Oct 16 11:57:02 user nova-compute[74683]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 11:57:02 user nova-compute[74683]:       <entry name="product">OpenStack Nova</entry>
Oct 16 11:57:02 user nova-compute[74683]:       <entry name="version">0.0.0</entry>
Oct 16 11:57:02 user nova-compute[74683]:       <entry name="serial">4e810851-2f43-431a-9633-eb3a428aa8c7</entry>
Oct 16 11:57:02 user nova-compute[74683]:       <entry name="uuid">4e810851-2f43-431a-9633-eb3a428aa8c7</entry>
Oct 16 11:57:02 user nova-compute[74683]:       <entry name="family">Virtual Machine</entry>
Oct 16 11:57:02 user nova-compute[74683]:     </system>
Oct 16 11:57:02 user nova-compute[74683]:   </sysinfo>
Oct 16 11:57:02 user nova-compute[74683]:   <os>
Oct 16 11:57:02 user nova-compute[74683]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 11:57:02 user nova-compute[74683]:     <boot dev="hd"/>
Oct 16 11:57:02 user nova-compute[74683]:     <smbios mode="sysinfo"/>
Oct 16 11:57:02 user nova-compute[74683]:   </os>
Oct 16 11:57:02 user nova-compute[74683]:   <features>
Oct 16 11:57:02 user nova-compute[74683]:     <acpi/>
Oct 16 11:57:02 user nova-compute[74683]:     <apic/>
Oct 16 11:57:02 user nova-compute[74683]:     <vmcoreinfo/>
Oct 16 11:57:02 user nova-compute[74683]:   </features>
Oct 16 11:57:02 user nova-compute[74683]:   <clock offset="utc">
Oct 16 11:57:02 user nova-compute[74683]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 11:57:02 user nova-compute[74683]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 11:57:02 user nova-compute[74683]:     <timer name="hpet" present="no"/>
Oct 16 11:57:02 user nova-compute[74683]:   </clock>
Oct 16 11:57:02 user nova-compute[74683]:   <cpu mode="custom" match="exact">
Oct 16 11:57:02 user nova-compute[74683]:     <model>Nehalem</model>
Oct 16 11:57:02 user nova-compute[74683]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 11:57:02 user nova-compute[74683]:   </cpu>
Oct 16 11:57:02 user nova-compute[74683]:   <devices>
Oct 16 11:57:02 user nova-compute[74683]:     <disk type="file" device="disk">
Oct 16 11:57:02 user nova-compute[74683]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 11:57:02 user nova-compute[74683]:       <source file="/opt/stack/data/nova/instances/4e810851-2f43-431a-9633-eb3a428aa8c7/disk"/>
Oct 16 11:57:02 user nova-compute[74683]:       <target dev="vda" bus="virtio"/>
Oct 16 11:57:02 user nova-compute[74683]:     </disk>
Oct 16 11:57:02 user nova-compute[74683]:     <interface type="ethernet">
Oct 16 11:57:02 user nova-compute[74683]:       <mac address="fa:16:3e:ea:c5:42"/>
Oct 16 11:57:02 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:57:02 user nova-compute[74683]:       <mtu size="1442"/>
Oct 16 11:57:02 user nova-compute[74683]:       <target dev="tapfd72f93a-a4"/>
Oct 16 11:57:02 user nova-compute[74683]:     </interface>
Oct 16 11:57:02 user nova-compute[74683]:     <serial type="pty">
Oct 16 11:57:02 user nova-compute[74683]:       <log file="/opt/stack/data/nova/instances/4e810851-2f43-431a-9633-eb3a428aa8c7/console.log" append="off"/>
Oct 16 11:57:02 user nova-compute[74683]:     </serial>
Oct 16 11:57:02 user nova-compute[74683]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 11:57:02 user nova-compute[74683]:     <video>
Oct 16 11:57:02 user nova-compute[74683]:       <model type="virtio"/>
Oct 16 11:57:02 user nova-compute[74683]:     </video>
Oct 16 11:57:02 user nova-compute[74683]:     <rng model="virtio">
Oct 16 11:57:02 user nova-compute[74683]:       <backend model="random">/dev/urandom</backend>
Oct 16 11:57:02 user nova-compute[74683]:     </rng>
Oct 16 11:57:02 user nova-compute[74683]:     <controller type="usb" index="0" model="none"/>
Oct 16 11:57:02 user nova-compute[74683]:     <memballoon model="virtio">
Oct 16 11:57:02 user nova-compute[74683]:       <stats period="10"/>
Oct 16 11:57:02 user nova-compute[74683]:     </memballoon>
Oct 16 11:57:02 user nova-compute[74683]:   </devices>
Oct 16 11:57:02 user nova-compute[74683]: </domain>
Oct 16 11:57:02 user nova-compute[74683]:  {{(pid=74683) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 11:57:02 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:56:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-381836128',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-381836128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3818361',id=52,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXUI5vYmRUuqJ+TdMswMKrTZgqaaKo3RZeOKkDPiWV5A7XU0UOg7WqL1yiv/5q+2pssRpXwTiithJ1sGgFNEqPJW8apWic2I5waJCP/+FmAXHuHyeQnrkI2ehOT4Xzegg==',key_name='tempest-keypair-392397390',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1aacc226c2a54235ae0b88f724606b62',ramdisk_id='',reservation_id='r-7mbhnp9q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1889919261',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T11:57:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c82ef1775414566917117264755365d',uuid=4e810851-2f43-431a-9633-eb3a428aa8c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd72f93a-a495-45ee-ae8d-200c8079ae38", "address": "fa:16:3e:ea:c5:42", "network": {"id": "b6596e83-4544-4f3b-a91b-16c04b310187", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2107616380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1aacc226c2a54235ae0b88f724606b62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd72f93a-a4", "ovs_interfaceid": "fd72f93a-a495-45ee-ae8d-200c8079ae38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 11:57:02 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Converting VIF {"id": "fd72f93a-a495-45ee-ae8d-200c8079ae38", "address": "fa:16:3e:ea:c5:42", "network": {"id": "b6596e83-4544-4f3b-a91b-16c04b310187", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2107616380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1aacc226c2a54235ae0b88f724606b62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd72f93a-a4", "ovs_interfaceid": "fd72f93a-a495-45ee-ae8d-200c8079ae38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 11:57:02 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:c5:42,bridge_name='br-int',has_traffic_filtering=True,id=fd72f93a-a495-45ee-ae8d-200c8079ae38,network=Network(b6596e83-4544-4f3b-a91b-16c04b310187),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd72f93a-a4') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 11:57:02 user nova-compute[74683]: DEBUG os_vif [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:c5:42,bridge_name='br-int',has_traffic_filtering=True,id=fd72f93a-a495-45ee-ae8d-200c8079ae38,network=Network(b6596e83-4544-4f3b-a91b-16c04b310187),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd72f93a-a4') {{(pid=74683) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 11:57:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:57:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:57:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 11:57:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:57:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'db5a1a42-7a47-5211-a69d-13c80aa9378b', '_type': 'linux-noop'}}, row=False) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:57:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:57:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:57:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:57:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd72f93a-a4, may_exist=True, interface_attrs={}) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:57:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfd72f93a-a4, col_values=(('qos', UUID('d6bfaaa3-f809-48a4-ab03-f7f7bd7f9db9')),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:57:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfd72f93a-a4, col_values=(('external_ids', {'iface-id': 'fd72f93a-a495-45ee-ae8d-200c8079ae38', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:c5:42', 'vm-uuid': '4e810851-2f43-431a-9633-eb3a428aa8c7'}),), if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 11:57:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:57:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:57:02 user nova-compute[74683]: INFO os_vif [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:c5:42,bridge_name='br-int',has_traffic_filtering=True,id=fd72f93a-a495-45ee-ae8d-200c8079ae38,network=Network(b6596e83-4544-4f3b-a91b-16c04b310187),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd72f93a-a4')
Oct 16 11:57:02 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:57:02 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] No VIF found with MAC fa:16:3e:ea:c5:42, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:57:02 user nova-compute[74683]: DEBUG nova.network.neutron [req-a8101073-14b0-472a-bf31-58a5eaf29b24 req-0b1f54f7-4c43-44dd-81f9-abeb26a071e9 service nova] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Updated VIF entry in instance network info cache for port fd72f93a-a495-45ee-ae8d-200c8079ae38. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:57:02 user nova-compute[74683]: DEBUG nova.network.neutron [req-a8101073-14b0-472a-bf31-58a5eaf29b24 req-0b1f54f7-4c43-44dd-81f9-abeb26a071e9 service nova] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Updating instance_info_cache with network_info: [{"id": "fd72f93a-a495-45ee-ae8d-200c8079ae38", "address": "fa:16:3e:ea:c5:42", "network": {"id": "b6596e83-4544-4f3b-a91b-16c04b310187", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2107616380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1aacc226c2a54235ae0b88f724606b62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd72f93a-a4", "ovs_interfaceid": "fd72f93a-a495-45ee-ae8d-200c8079ae38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:57:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:57:02 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-a8101073-14b0-472a-bf31-58a5eaf29b24 req-0b1f54f7-4c43-44dd-81f9-abeb26a071e9 service nova] Releasing lock "refresh_cache-4e810851-2f43-431a-9633-eb3a428aa8c7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:57:03 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:57:03 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:57:03 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:57:04 user nova-compute[74683]: DEBUG nova.compute.manager [req-ebccfdae-a1d3-41e1-99c0-a84de5a3fd3e req-0f431fb8-89fc-4335-b819-555ec8f8daa5 service nova] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Received event network-vif-plugged-fd72f93a-a495-45ee-ae8d-200c8079ae38 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:57:04 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-ebccfdae-a1d3-41e1-99c0-a84de5a3fd3e req-0f431fb8-89fc-4335-b819-555ec8f8daa5 service nova] Acquiring lock "4e810851-2f43-431a-9633-eb3a428aa8c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:57:04 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-ebccfdae-a1d3-41e1-99c0-a84de5a3fd3e req-0f431fb8-89fc-4335-b819-555ec8f8daa5 service nova] Lock "4e810851-2f43-431a-9633-eb3a428aa8c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:57:04 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-ebccfdae-a1d3-41e1-99c0-a84de5a3fd3e req-0f431fb8-89fc-4335-b819-555ec8f8daa5 service nova] Lock "4e810851-2f43-431a-9633-eb3a428aa8c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:57:04 user nova-compute[74683]: DEBUG nova.compute.manager [req-ebccfdae-a1d3-41e1-99c0-a84de5a3fd3e req-0f431fb8-89fc-4335-b819-555ec8f8daa5 service nova] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] No waiting events found dispatching network-vif-plugged-fd72f93a-a495-45ee-ae8d-200c8079ae38 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:57:04 user nova-compute[74683]: WARNING nova.compute.manager [req-ebccfdae-a1d3-41e1-99c0-a84de5a3fd3e req-0f431fb8-89fc-4335-b819-555ec8f8daa5 service nova] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Received unexpected event network-vif-plugged-fd72f93a-a495-45ee-ae8d-200c8079ae38 for instance with vm_state building and task_state spawning.
Oct 16 11:57:04 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:57:04 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:57:04 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:57:06 user nova-compute[74683]: DEBUG nova.compute.manager [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Instance event wait completed in 0 seconds for  {{(pid=74683) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 11:57:06 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Guest created on hypervisor {{(pid=74683) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 11:57:06 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Instance spawned successfully.
Oct 16 11:57:06 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 11:57:06 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Found default for hw_cdrom_bus of ide {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:57:06 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Found default for hw_disk_bus of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:57:06 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Found default for hw_input_bus of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:57:06 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Found default for hw_pointer_model of None {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:57:06 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Found default for hw_video_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:57:06 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Found default for hw_vif_model of virtio {{(pid=74683) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 11:57:06 user nova-compute[74683]: INFO nova.compute.manager [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Took 5.56 seconds to spawn the instance on the hypervisor.
Oct 16 11:57:06 user nova-compute[74683]: DEBUG nova.compute.manager [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Checking state {{(pid=74683) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 11:57:06 user nova-compute[74683]: INFO nova.compute.manager [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Took 6.08 seconds to build instance.
Oct 16 11:57:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-b598c922-87a5-4938-8e06-60dbf1db095e tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Lock "4e810851-2f43-431a-9633-eb3a428aa8c7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.196s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:57:06 user nova-compute[74683]: DEBUG nova.compute.manager [req-5f6941e0-126e-4622-b76d-2d8f9bbdea70 req-e20042c6-0343-4b84-a0b9-75123d7e0675 service nova] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Received event network-vif-plugged-fd72f93a-a495-45ee-ae8d-200c8079ae38 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:57:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-5f6941e0-126e-4622-b76d-2d8f9bbdea70 req-e20042c6-0343-4b84-a0b9-75123d7e0675 service nova] Acquiring lock "4e810851-2f43-431a-9633-eb3a428aa8c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:57:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-5f6941e0-126e-4622-b76d-2d8f9bbdea70 req-e20042c6-0343-4b84-a0b9-75123d7e0675 service nova] Lock "4e810851-2f43-431a-9633-eb3a428aa8c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:57:06 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-5f6941e0-126e-4622-b76d-2d8f9bbdea70 req-e20042c6-0343-4b84-a0b9-75123d7e0675 service nova] Lock "4e810851-2f43-431a-9633-eb3a428aa8c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:57:06 user nova-compute[74683]: DEBUG nova.compute.manager [req-5f6941e0-126e-4622-b76d-2d8f9bbdea70 req-e20042c6-0343-4b84-a0b9-75123d7e0675 service nova] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] No waiting events found dispatching network-vif-plugged-fd72f93a-a495-45ee-ae8d-200c8079ae38 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 11:57:06 user nova-compute[74683]: WARNING nova.compute.manager [req-5f6941e0-126e-4622-b76d-2d8f9bbdea70 req-e20042c6-0343-4b84-a0b9-75123d7e0675 service nova] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Received unexpected event network-vif-plugged-fd72f93a-a495-45ee-ae8d-200c8079ae38 for instance with vm_state active and task_state None.
Oct 16 11:57:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:57:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:57:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:57:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:57:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:57:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:57:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:57:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74683) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 11:57:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:57:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:57:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:57:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:57:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:57:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:57:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:57:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:57:35 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:57:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:57:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:57:38 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:57:39 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:57:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:57:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:57:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:57:39 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Auditing locally available compute resources for user (node: user) {{(pid=74683) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 11:57:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e810851-2f43-431a-9633-eb3a428aa8c7/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:57:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e810851-2f43-431a-9633-eb3a428aa8c7/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:57:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e810851-2f43-431a-9633-eb3a428aa8c7/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:57:40 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e810851-2f43-431a-9633-eb3a428aa8c7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:57:40 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:57:40 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:57:40 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Hypervisor/Node resource view: name=user free_ram=9096MB free_disk=25.033935546875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74683) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 11:57:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:57:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:57:40 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 4e810851-2f43-431a-9633-eb3a428aa8c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:57:40 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 11:57:40 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 11:57:40 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:57:40 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:57:40 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Compute_service record updated for user:user {{(pid=74683) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 11:57:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.201s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:57:41 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:57:41 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Starting heal instance info cache {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 11:57:41 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Rebuilding the list of instances to heal {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 11:57:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "refresh_cache-4e810851-2f43-431a-9633-eb3a428aa8c7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:57:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquired lock "refresh_cache-4e810851-2f43-431a-9633-eb3a428aa8c7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:57:41 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Forcefully refreshing network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 11:57:41 user nova-compute[74683]: DEBUG nova.objects.instance [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lazy-loading 'info_cache' on Instance uuid 4e810851-2f43-431a-9633-eb3a428aa8c7 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:57:42 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Updating instance_info_cache with network_info: [{"id": "fd72f93a-a495-45ee-ae8d-200c8079ae38", "address": "fa:16:3e:ea:c5:42", "network": {"id": "b6596e83-4544-4f3b-a91b-16c04b310187", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2107616380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1aacc226c2a54235ae0b88f724606b62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd72f93a-a4", "ovs_interfaceid": "fd72f93a-a495-45ee-ae8d-200c8079ae38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:57:42 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Releasing lock "refresh_cache-4e810851-2f43-431a-9633-eb3a428aa8c7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:57:42 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Updated the network info_cache for instance {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 11:57:42 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:57:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:57:43 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:57:43 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:57:43 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:57:44 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:57:44 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74683) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 11:57:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:57:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:57:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:57:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74683) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 11:57:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:57:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:57:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:57:53 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:57:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:58:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:58:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:58:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74683) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 11:58:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:58:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:58:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:58:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:58:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:58:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74683) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 11:58:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:58:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:58:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:58:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:58:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:58:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74683) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 11:58:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:58:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:58:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:58:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:58:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:58:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:58:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74683) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 11:58:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:58:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:58:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:58:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:58:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:58:35 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:58:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:58:39 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:58:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:58:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:58:39 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:58:39 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Auditing locally available compute resources for user (node: user) {{(pid=74683) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 11:58:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e810851-2f43-431a-9633-eb3a428aa8c7/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:58:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e810851-2f43-431a-9633-eb3a428aa8c7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:58:39 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e810851-2f43-431a-9633-eb3a428aa8c7/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:58:40 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e810851-2f43-431a-9633-eb3a428aa8c7/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:58:40 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:58:40 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:58:40 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Hypervisor/Node resource view: name=user free_ram=9075MB free_disk=25.033309936523438GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74683) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 11:58:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:58:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:58:40 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 4e810851-2f43-431a-9633-eb3a428aa8c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:58:40 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 11:58:40 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 11:58:40 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:58:40 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:58:40 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Compute_service record updated for user:user {{(pid=74683) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 11:58:40 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.164s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:58:41 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:58:41 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:58:41 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Starting heal instance info cache {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 11:58:41 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Rebuilding the list of instances to heal {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 11:58:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "refresh_cache-4e810851-2f43-431a-9633-eb3a428aa8c7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:58:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquired lock "refresh_cache-4e810851-2f43-431a-9633-eb3a428aa8c7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:58:41 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Forcefully refreshing network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 11:58:41 user nova-compute[74683]: DEBUG nova.objects.instance [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lazy-loading 'info_cache' on Instance uuid 4e810851-2f43-431a-9633-eb3a428aa8c7 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:58:42 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Updating instance_info_cache with network_info: [{"id": "fd72f93a-a495-45ee-ae8d-200c8079ae38", "address": "fa:16:3e:ea:c5:42", "network": {"id": "b6596e83-4544-4f3b-a91b-16c04b310187", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2107616380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1aacc226c2a54235ae0b88f724606b62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd72f93a-a4", "ovs_interfaceid": "fd72f93a-a495-45ee-ae8d-200c8079ae38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:58:42 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Releasing lock "refresh_cache-4e810851-2f43-431a-9633-eb3a428aa8c7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:58:42 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Updated the network info_cache for instance {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 11:58:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:58:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:58:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74683) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 11:58:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:58:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:58:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:58:42 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:58:43 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:58:44 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:58:44 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74683) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 11:58:45 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:58:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:58:51 user nova-compute[74683]: DEBUG nova.compute.manager [req-5239f15c-7241-4c0b-9d3b-771f50e086bc req-787bee11-3a01-4727-92f2-849e32ae3994 service nova] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Received event network-changed-fd72f93a-a495-45ee-ae8d-200c8079ae38 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 11:58:51 user nova-compute[74683]: DEBUG nova.compute.manager [req-5239f15c-7241-4c0b-9d3b-771f50e086bc req-787bee11-3a01-4727-92f2-849e32ae3994 service nova] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Refreshing instance network info cache due to event network-changed-fd72f93a-a495-45ee-ae8d-200c8079ae38. {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 11:58:51 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-5239f15c-7241-4c0b-9d3b-771f50e086bc req-787bee11-3a01-4727-92f2-849e32ae3994 service nova] Acquiring lock "refresh_cache-4e810851-2f43-431a-9633-eb3a428aa8c7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:58:51 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-5239f15c-7241-4c0b-9d3b-771f50e086bc req-787bee11-3a01-4727-92f2-849e32ae3994 service nova] Acquired lock "refresh_cache-4e810851-2f43-431a-9633-eb3a428aa8c7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:58:51 user nova-compute[74683]: DEBUG nova.network.neutron [req-5239f15c-7241-4c0b-9d3b-771f50e086bc req-787bee11-3a01-4727-92f2-849e32ae3994 service nova] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Refreshing network info cache for port fd72f93a-a495-45ee-ae8d-200c8079ae38 {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 11:58:51 user nova-compute[74683]: DEBUG nova.network.neutron [req-5239f15c-7241-4c0b-9d3b-771f50e086bc req-787bee11-3a01-4727-92f2-849e32ae3994 service nova] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Updated VIF entry in instance network info cache for port fd72f93a-a495-45ee-ae8d-200c8079ae38. {{(pid=74683) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 11:58:51 user nova-compute[74683]: DEBUG nova.network.neutron [req-5239f15c-7241-4c0b-9d3b-771f50e086bc req-787bee11-3a01-4727-92f2-849e32ae3994 service nova] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Updating instance_info_cache with network_info: [{"id": "fd72f93a-a495-45ee-ae8d-200c8079ae38", "address": "fa:16:3e:ea:c5:42", "network": {"id": "b6596e83-4544-4f3b-a91b-16c04b310187", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2107616380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1aacc226c2a54235ae0b88f724606b62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd72f93a-a4", "ovs_interfaceid": "fd72f93a-a495-45ee-ae8d-200c8079ae38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:58:51 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-5239f15c-7241-4c0b-9d3b-771f50e086bc req-787bee11-3a01-4727-92f2-849e32ae3994 service nova] Releasing lock "refresh_cache-4e810851-2f43-431a-9633-eb3a428aa8c7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:58:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:58:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:58:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74683) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 11:58:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:58:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:58:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:58:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:58:54 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:58:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-8d9421a0-2f74-4e89-89ff-8b68ab48b97d tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Acquiring lock "4e810851-2f43-431a-9633-eb3a428aa8c7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:58:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-8d9421a0-2f74-4e89-89ff-8b68ab48b97d tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Lock "4e810851-2f43-431a-9633-eb3a428aa8c7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:58:57 user nova-compute[74683]: DEBUG nova.objects.instance [None req-8d9421a0-2f74-4e89-89ff-8b68ab48b97d tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Lazy-loading 'flavor' on Instance uuid 4e810851-2f43-431a-9633-eb3a428aa8c7 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:58:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-8d9421a0-2f74-4e89-89ff-8b68ab48b97d tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Lock "4e810851-2f43-431a-9633-eb3a428aa8c7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:58:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-8d9421a0-2f74-4e89-89ff-8b68ab48b97d tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Acquiring lock "4e810851-2f43-431a-9633-eb3a428aa8c7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:58:57 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-8d9421a0-2f74-4e89-89ff-8b68ab48b97d tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Lock "4e810851-2f43-431a-9633-eb3a428aa8c7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:58:57 user nova-compute[74683]: INFO nova.compute.manager [None req-8d9421a0-2f74-4e89-89ff-8b68ab48b97d tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Attaching volume 07fed20d-d01e-4f26-ad5d-8c4bbb0e876e to /dev/vdb
Oct 16 11:58:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:58:57 user nova-compute[74683]: DEBUG os_brick.utils [None req-8d9421a0-2f74-4e89-89ff-8b68ab48b97d tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:58:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:58:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:58:57 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[93217c3c-0a14-4259-a9b0-42ef8b101267]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:70b9d336ab7d\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:58:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:58:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:58:57 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d846464d-8134-4180-8c26-40baad4b0784]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:58:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:58:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:58:57 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9c719c-aaec-427c-931d-4a819a349efa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:58:57 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a788c8d-a5fa-40d0-b451-cec3023fafbc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:58:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-8d9421a0-2f74-4e89-89ff-8b68ab48b97d tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Running cmd (subprocess): nvme version {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:58:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-8d9421a0-2f74-4e89-89ff-8b68ab48b97d tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] 'nvme version' failed. Not Retrying. {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:58:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8d9421a0-2f74-4e89-89ff-8b68ab48b97d tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] nvme not present on system {{(pid=74683) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 11:58:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:58:57 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 11:58:57 user nova-compute[74683]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 11:58:57 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca4700a-fcba-405a-a80f-83e95baeddda]: (4, '') {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:58:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-8d9421a0-2f74-4e89-89ff-8b68ab48b97d tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74683) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 11:58:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-8d9421a0-2f74-4e89-89ff-8b68ab48b97d tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 11:58:57 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.lightos [None req-8d9421a0-2f74-4e89-89ff-8b68ab48b97d tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] LIGHTOS: no hostnqn found. {{(pid=74683) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 11:58:57 user nova-compute[74683]: DEBUG os_brick.utils [None req-8d9421a0-2f74-4e89-89ff-8b68ab48b97d tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:70b9d336ab7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:58:57 user nova-compute[74683]: DEBUG nova.virt.block_device [None req-8d9421a0-2f74-4e89-89ff-8b68ab48b97d tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Updating existing volume attachment record: c82ecb7d-df0c-4476-999f-5aaeeaafe79b {{(pid=74683) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 11:58:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:59:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:59:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:59:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:59:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74683) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 11:59:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:59:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:59:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:59:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:59:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:59:12 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d9421a0-2f74-4e89-89ff-8b68ab48b97d tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Calling os-brick to attach iSCSI Volume {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 11:59:12 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d9421a0-2f74-4e89-89ff-8b68ab48b97d tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:07fed20d-d01e-4f26-ad5d-8c4bbb0e876e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WVcxSZhy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:59:12 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-8d9421a0-2f74-4e89-89ff-8b68ab48b97d tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:59:12 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-8d9421a0-2f74-4e89-89ff-8b68ab48b97d tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:59:12 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-8d9421a0-2f74-4e89-89ff-8b68ab48b97d tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:59:12 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-8d9421a0-2f74-4e89-89ff-8b68ab48b97d tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:59:12 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-8d9421a0-2f74-4e89-89ff-8b68ab48b97d tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07fed20d-d01e-4f26-ad5d-8c4bbb0e876e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:59:12 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-8d9421a0-2f74-4e89-89ff-8b68ab48b97d tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07fed20d-d01e-4f26-ad5d-8c4bbb0e876e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:59:12 user nova-compute[74683]: INFO os_brick.initiator.connectors.iscsi [None req-8d9421a0-2f74-4e89-89ff-8b68ab48b97d tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 11:59:12 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07fed20d-d01e-4f26-ad5d-8c4bbb0e876e -p 172.16.0.220:3260 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:59:12 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07fed20d-d01e-4f26-ad5d-8c4bbb0e876e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:59:12 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[3107bf7a-c673-435e-ab2c-b32c55cecf2e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:59:12 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d9421a0-2f74-4e89-89ff-8b68ab48b97d tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 11:59:12 user nova-compute[74683]:  {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:59:12 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07fed20d-d01e-4f26-ad5d-8c4bbb0e876e -p 172.16.0.220:3260 --interface default --op new {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:59:13 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07fed20d-d01e-4f26-ad5d-8c4bbb0e876e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:59:13 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8cfc9e-c369-4ce7-96e5-bd4c1060683a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:07fed20d-d01e-4f26-ad5d-8c4bbb0e876e] added\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:59:13 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d9421a0-2f74-4e89-89ff-8b68ab48b97d tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:07fed20d-d01e-4f26-ad5d-8c4bbb0e876e] added
Oct 16 11:59:13 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:59:13 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07fed20d-d01e-4f26-ad5d-8c4bbb0e876e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:59:13 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07fed20d-d01e-4f26-ad5d-8c4bbb0e876e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:59:13 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[858d9ae4-c102-43c0-b0f4-71281c9e09cb]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:59:13 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d9421a0-2f74-4e89-89ff-8b68ab48b97d tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:59:13 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07fed20d-d01e-4f26-ad5d-8c4bbb0e876e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:59:13 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07fed20d-d01e-4f26-ad5d-8c4bbb0e876e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:59:13 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae2bd21-62ef-42d4-b41a-f3318acf19ec]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:59:13 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d9421a0-2f74-4e89-89ff-8b68ab48b97d tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:59:13 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07fed20d-d01e-4f26-ad5d-8c4bbb0e876e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WVcxSZhy {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:59:13 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07fed20d-d01e-4f26-ad5d-8c4bbb0e876e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WVcxSZhy" returned: 0 in 0.016s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:59:13 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa29b1b-485e-47a7-bd6b-9fff4b215458]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:59:13 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d9421a0-2f74-4e89-89ff-8b68ab48b97d tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WVcxSZhy'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:59:13 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07fed20d-d01e-4f26-ad5d-8c4bbb0e876e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:59:13 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07fed20d-d01e-4f26-ad5d-8c4bbb0e876e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:59:13 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[213ccc9c-668c-439a-aa42-aa16c6c3d38e]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:59:13 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d9421a0-2f74-4e89-89ff-8b68ab48b97d tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:59:13 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:59:13 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:59:13 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f83f655-8747-40a1-8c13-2f6768d7865a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:59:13 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d9421a0-2f74-4e89-89ff-8b68ab48b97d tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 16 11:59:13 user nova-compute[74683]:  {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:59:13 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d9421a0-2f74-4e89-89ff-8b68ab48b97d tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 16 11:59:13 user nova-compute[74683]:  {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:59:13 user nova-compute[74683]: WARNING os_brick.initiator.connectors.iscsi [None req-8d9421a0-2f74-4e89-89ff-8b68ab48b97d tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 16 11:59:13 user nova-compute[74683]: 
Oct 16 11:59:13 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07fed20d-d01e-4f26-ad5d-8c4bbb0e876e -p 172.16.0.220:3260 --login {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:59:13 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07fed20d-d01e-4f26-ad5d-8c4bbb0e876e -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:59:13 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[00798672-d219-4cc4-b1cc-c948bd2d0232]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:07fed20d-d01e-4f26-ad5d-8c4bbb0e876e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:07fed20d-d01e-4f26-ad5d-8c4bbb0e876e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:59:13 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d9421a0-2f74-4e89-89ff-8b68ab48b97d tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:07fed20d-d01e-4f26-ad5d-8c4bbb0e876e, portal: 172.16.0.220,3260]
Oct 16 11:59:13 user nova-compute[74683]: Login to [iface: default, target: iqn.2010-10.org.openstack:07fed20d-d01e-4f26-ad5d-8c4bbb0e876e, portal: 172.16.0.220,3260] successful.
Oct 16 11:59:13 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:59:13 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07fed20d-d01e-4f26-ad5d-8c4bbb0e876e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:59:13 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07fed20d-d01e-4f26-ad5d-8c4bbb0e876e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:59:13 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d950eac9-8fc2-46a2-b702-bae6ae2fd61b]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:59:13 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d9421a0-2f74-4e89-89ff-8b68ab48b97d tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:59:13 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:59:13 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:59:13 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0fa9c4-b33c-45bc-806e-2289fd89a049]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07fed20d-d01e-4f26-ad5d-8c4bbb0e876e (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:59:13 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d9421a0-2f74-4e89-89ff-8b68ab48b97d tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07fed20d-d01e-4f26-ad5d-8c4bbb0e876e (non-flash)
Oct 16 11:59:13 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:59:13 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d9421a0-2f74-4e89-89ff-8b68ab48b97d tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07fed20d-d01e-4f26-ad5d-8c4bbb0e876e (non-flash)
Oct 16 11:59:13 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:59:13 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-8d9421a0-2f74-4e89-89ff-8b68ab48b97d tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07fed20d-d01e-4f26-ad5d-8c4bbb0e876e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.236s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:59:13 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d9421a0-2f74-4e89-89ff-8b68ab48b97d tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Connected to 172.16.0.220:3260 {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 11:59:13 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-8d9421a0-2f74-4e89-89ff-8b68ab48b97d tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=74683) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 11:59:13 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-8d9421a0-2f74-4e89-89ff-8b68ab48b97d tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74683) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 11:59:13 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:59:13 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:59:13 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74c288f-2888-4b98-a770-6d51fefe0545]: (4, ('- - 0', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:59:13 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-8d9421a0-2f74-4e89-89ff-8b68ab48b97d tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74683) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 11:59:13 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d9421a0-2f74-4e89-89ff-8b68ab48b97d tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:07fed20d-d01e-4f26-ad5d-8c4bbb0e876e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WVcxSZhy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74683) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 11:59:14 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-8d9421a0-2f74-4e89-89ff-8b68ab48b97d tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.265s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:59:14 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d9421a0-2f74-4e89-89ff-8b68ab48b97d tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] <== connect_volume: return (1267ms) {'type': 'block', 'scsi_wwn': '23665626439316432', 'path': '/dev/sdb'} {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:59:14 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d9421a0-2f74-4e89-89ff-8b68ab48b97d tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665626439316432', 'path': '/dev/sdb'} {{(pid=74683) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 11:59:14 user nova-compute[74683]: DEBUG nova.objects.instance [None req-8d9421a0-2f74-4e89-89ff-8b68ab48b97d tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Lazy-loading 'flavor' on Instance uuid 4e810851-2f43-431a-9633-eb3a428aa8c7 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:59:14 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-8d9421a0-2f74-4e89-89ff-8b68ab48b97d tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 11:59:14 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:59:14 user nova-compute[74683]:   <source dev="/dev/sdb"/>
Oct 16 11:59:14 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:59:14 user nova-compute[74683]:   <serial>07fed20d-d01e-4f26-ad5d-8c4bbb0e876e</serial>
Oct 16 11:59:14 user nova-compute[74683]: </disk>
Oct 16 11:59:14 user nova-compute[74683]:  {{(pid=74683) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 11:59:14 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-8d9421a0-2f74-4e89-89ff-8b68ab48b97d tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] No BDM found with device name vda, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:59:14 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-8d9421a0-2f74-4e89-89ff-8b68ab48b97d tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74683) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 11:59:14 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-8d9421a0-2f74-4e89-89ff-8b68ab48b97d tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] No VIF found with MAC fa:16:3e:ea:c5:42, not building metadata {{(pid=74683) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 11:59:14 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-8d9421a0-2f74-4e89-89ff-8b68ab48b97d tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Lock "4e810851-2f43-431a-9633-eb3a428aa8c7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.268s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:59:16 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-399ea1fc-627e-4e2a-a9c1-c1142f03b3aa tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Acquiring lock "4e810851-2f43-431a-9633-eb3a428aa8c7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:59:16 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-399ea1fc-627e-4e2a-a9c1-c1142f03b3aa tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Lock "4e810851-2f43-431a-9633-eb3a428aa8c7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:59:16 user nova-compute[74683]: INFO nova.compute.manager [None req-399ea1fc-627e-4e2a-a9c1-c1142f03b3aa tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Detaching volume 07fed20d-d01e-4f26-ad5d-8c4bbb0e876e
Oct 16 11:59:16 user nova-compute[74683]: INFO nova.virt.block_device [None req-399ea1fc-627e-4e2a-a9c1-c1142f03b3aa tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Attempting to driver detach volume 07fed20d-d01e-4f26-ad5d-8c4bbb0e876e from mountpoint /dev/vdb
Oct 16 11:59:16 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-399ea1fc-627e-4e2a-a9c1-c1142f03b3aa tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Attempting to detach device vdb from instance 4e810851-2f43-431a-9633-eb3a428aa8c7 from the persistent domain config. {{(pid=74683) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 11:59:16 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-399ea1fc-627e-4e2a-a9c1-c1142f03b3aa tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 11:59:16 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:59:16 user nova-compute[74683]:   <source dev="/dev/sdb"/>
Oct 16 11:59:16 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:59:16 user nova-compute[74683]:   <serial>07fed20d-d01e-4f26-ad5d-8c4bbb0e876e</serial>
Oct 16 11:59:16 user nova-compute[74683]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 11:59:16 user nova-compute[74683]: </disk>
Oct 16 11:59:16 user nova-compute[74683]:  {{(pid=74683) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 11:59:16 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-399ea1fc-627e-4e2a-a9c1-c1142f03b3aa tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Successfully detached device vdb from instance 4e810851-2f43-431a-9633-eb3a428aa8c7 from the persistent domain config.
Oct 16 11:59:16 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-399ea1fc-627e-4e2a-a9c1-c1142f03b3aa tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4e810851-2f43-431a-9633-eb3a428aa8c7 from the live domain config. {{(pid=74683) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 11:59:16 user nova-compute[74683]: DEBUG nova.virt.libvirt.guest [None req-399ea1fc-627e-4e2a-a9c1-c1142f03b3aa tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 11:59:16 user nova-compute[74683]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 11:59:16 user nova-compute[74683]:   <source dev="/dev/sdb"/>
Oct 16 11:59:16 user nova-compute[74683]:   <target dev="vdb" bus="virtio"/>
Oct 16 11:59:16 user nova-compute[74683]:   <serial>07fed20d-d01e-4f26-ad5d-8c4bbb0e876e</serial>
Oct 16 11:59:16 user nova-compute[74683]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 11:59:16 user nova-compute[74683]: </disk>
Oct 16 11:59:16 user nova-compute[74683]:  {{(pid=74683) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 11:59:17 user nova-compute[74683]: DEBUG nova.virt.libvirt.driver [None req-399ea1fc-627e-4e2a-a9c1-c1142f03b3aa tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4e810851-2f43-431a-9633-eb3a428aa8c7 {{(pid=74683) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 11:59:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:59:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:59:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:59:27 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:59:32 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:59:34 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:59:35 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:59:37 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-399ea1fc-627e-4e2a-a9c1-c1142f03b3aa tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4e810851-2f43-431a-9633-eb3a428aa8c7 is timed out.
Oct 16 11:59:37 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-399ea1fc-627e-4e2a-a9c1-c1142f03b3aa tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Successfully detached device vdb from instance 4e810851-2f43-431a-9633-eb3a428aa8c7 from the live domain config.
Oct 16 11:59:37 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-399ea1fc-627e-4e2a-a9c1-c1142f03b3aa tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] calling os-brick to detach iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 11:59:37 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-399ea1fc-627e-4e2a-a9c1-c1142f03b3aa tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda6c185d20>, {'target_iqn': 'iqn.2010-10.org.openstack:07fed20d-d01e-4f26-ad5d-8c4bbb0e876e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WVcxSZhy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 11:59:37 user nova-compute[74683]: WARNING os_brick.initiator.connectors.base [None req-399ea1fc-627e-4e2a-a9c1-c1142f03b3aa tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 11:59:37 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-399ea1fc-627e-4e2a-a9c1-c1142f03b3aa tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 11:59:37 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-399ea1fc-627e-4e2a-a9c1-c1142f03b3aa tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 11:59:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:59:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:59:37 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cbd070c-278e-469e-ae99-89167a8eac9b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:07fed20d-d01e-4f26-ad5d-8c4bbb0e876e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:59:37 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-399ea1fc-627e-4e2a-a9c1-c1142f03b3aa tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 11:59:37 user nova-compute[74683]: No targets found.
Oct 16 11:59:37 user nova-compute[74683]: iSNS:
Oct 16 11:59:37 user nova-compute[74683]: No targets found.
Oct 16 11:59:37 user nova-compute[74683]: STATIC:
Oct 16 11:59:37 user nova-compute[74683]: Target: iqn.2010-10.org.openstack:07fed20d-d01e-4f26-ad5d-8c4bbb0e876e
Oct 16 11:59:37 user nova-compute[74683]:         Portal: 172.16.0.220:3260,-1
Oct 16 11:59:37 user nova-compute[74683]:                 Iface Name: default
Oct 16 11:59:37 user nova-compute[74683]: FIRMWARE:
Oct 16 11:59:37 user nova-compute[74683]: No targets found.
Oct 16 11:59:37 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:59:37 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-399ea1fc-627e-4e2a-a9c1-c1142f03b3aa tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 11:59:37 user nova-compute[74683]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 11:59:37 user nova-compute[74683]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74683) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 11:59:37 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-399ea1fc-627e-4e2a-a9c1-c1142f03b3aa tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07fed20d-d01e-4f26-ad5d-8c4bbb0e876e', 0)] {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 11:59:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:59:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:59:37 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7ee9e8-4b43-405b-883f-044917f3f52a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07fed20d-d01e-4f26-ad5d-8c4bbb0e876e\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:59:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:59:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:59:37 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d628f8e0-6547-45f6-96c5-c316156bd14a]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07fed20d-d01e-4f26-ad5d-8c4bbb0e876e (non-flash)\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:59:37 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-399ea1fc-627e-4e2a-a9c1-c1142f03b3aa tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07fed20d-d01e-4f26-ad5d-8c4bbb0e876e (non-flash)
Oct 16 11:59:37 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 11:59:37 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-399ea1fc-627e-4e2a-a9c1-c1142f03b3aa tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07fed20d-d01e-4f26-ad5d-8c4bbb0e876e (non-flash)
Oct 16 11:59:37 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 11:59:37 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-399ea1fc-627e-4e2a-a9c1-c1142f03b3aa tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda4c4c0dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07fed20d-d01e-4f26-ad5d-8c4bbb0e876e'): ({'sdb'}, set())}) {{(pid=74683) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 11:59:37 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-399ea1fc-627e-4e2a-a9c1-c1142f03b3aa tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Removing single pathed devices sdb {{(pid=74683) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 11:59:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:59:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:59:37 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[42cb0fe7-2db6-4480-a1a8-bba7b5215d9a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:59:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:59:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:59:37 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[874214c5-7f70-408c-be60-322ae614ea6c]: (4, ('ok\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:59:37 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-399ea1fc-627e-4e2a-a9c1-c1142f03b3aa tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Flushing IO for device /dev/sdb {{(pid=74683) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 11:59:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:59:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:59:37 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c7bad7-7ac4-4dd6-bd2d-e6eb9b266f55]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:59:37 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-399ea1fc-627e-4e2a-a9c1-c1142f03b3aa tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74683) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 11:59:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:59:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:59:37 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2b9d1c-94d3-40dd-93b6-b2ff3058456e]: (4, ('1', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:59:37 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-399ea1fc-627e-4e2a-a9c1-c1142f03b3aa tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 11:59:37 user nova-compute[74683]: DEBUG os_brick.initiator.linuxscsi [None req-399ea1fc-627e-4e2a-a9c1-c1142f03b3aa tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] SCSI volumes sdb have been removed. {{(pid=74683) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 11:59:37 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-399ea1fc-627e-4e2a-a9c1-c1142f03b3aa tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07fed20d-d01e-4f26-ad5d-8c4bbb0e876e')] {{(pid=74683) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 11:59:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07fed20d-d01e-4f26-ad5d-8c4bbb0e876e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:59:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07fed20d-d01e-4f26-ad5d-8c4bbb0e876e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:59:37 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e97f96-23bd-47f2-9ba9-8d4aa018f5de]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:59:37 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-399ea1fc-627e-4e2a-a9c1-c1142f03b3aa tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:59:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07fed20d-d01e-4f26-ad5d-8c4bbb0e876e -p 172.16.0.220:3260 --logout {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:59:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07fed20d-d01e-4f26-ad5d-8c4bbb0e876e -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:59:37 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c22d83-dea9-452b-834f-4fe5dfd40644]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:07fed20d-d01e-4f26-ad5d-8c4bbb0e876e, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:07fed20d-d01e-4f26-ad5d-8c4bbb0e876e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:59:37 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-399ea1fc-627e-4e2a-a9c1-c1142f03b3aa tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:07fed20d-d01e-4f26-ad5d-8c4bbb0e876e, portal: 172.16.0.220,3260]
Oct 16 11:59:37 user nova-compute[74683]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:07fed20d-d01e-4f26-ad5d-8c4bbb0e876e, portal: 172.16.0.220,3260] successful.
Oct 16 11:59:37 user nova-compute[74683]:  stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:59:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07fed20d-d01e-4f26-ad5d-8c4bbb0e876e -p 172.16.0.220:3260 --op delete {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:59:37 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07fed20d-d01e-4f26-ad5d-8c4bbb0e876e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85666) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:59:37 user nova-compute[74683]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ec11c6-0826-42ff-b4fb-cff6ad275329]: (4, ('', '')) {{(pid=85666) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 11:59:37 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-399ea1fc-627e-4e2a-a9c1-c1142f03b3aa tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74683) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 11:59:37 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.base [None req-399ea1fc-627e-4e2a-a9c1-c1142f03b3aa tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 11:59:37 user nova-compute[74683]: DEBUG os_brick.initiator.connectors.iscsi [None req-399ea1fc-627e-4e2a-a9c1-c1142f03b3aa tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] <== disconnect_volume: return (273ms) None {{(pid=74683) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 11:59:37 user nova-compute[74683]: DEBUG nova.virt.libvirt.volume.iscsi [None req-399ea1fc-627e-4e2a-a9c1-c1142f03b3aa tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Disconnected iSCSI Volume {{(pid=74683) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 11:59:37 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:59:38 user nova-compute[74683]: DEBUG nova.objects.instance [None req-399ea1fc-627e-4e2a-a9c1-c1142f03b3aa tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Lazy-loading 'flavor' on Instance uuid 4e810851-2f43-431a-9633-eb3a428aa8c7 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:59:38 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-399ea1fc-627e-4e2a-a9c1-c1142f03b3aa tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Lock "4e810851-2f43-431a-9633-eb3a428aa8c7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.804s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:59:38 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:59:38 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Cleaning up deleted instances with incomplete migration  {{(pid=74683) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 16 11:59:41 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:59:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:59:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:59:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:59:41 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Auditing locally available compute resources for user (node: user) {{(pid=74683) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 11:59:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e810851-2f43-431a-9633-eb3a428aa8c7/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:59:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e810851-2f43-431a-9633-eb3a428aa8c7/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:59:41 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e810851-2f43-431a-9633-eb3a428aa8c7/disk --force-share --output=json {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 11:59:42 user nova-compute[74683]: DEBUG oslo_concurrency.processutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e810851-2f43-431a-9633-eb3a428aa8c7/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 11:59:42 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:59:42 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 11:59:42 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Hypervisor/Node resource view: name=user free_ram=9022MB free_disk=25.03213882446289GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74683) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 11:59:42 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 11:59:42 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 11:59:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:59:42 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Instance 4e810851-2f43-431a-9633-eb3a428aa8c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74683) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 11:59:42 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 11:59:42 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 11:59:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 11:59:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5009 ms, sending inactivity probe {{(pid=74683) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 11:59:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:59:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 11:59:42 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:59:42 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Refreshing inventories for resource provider 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 16 11:59:42 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Updating ProviderTree inventory for provider 7142d606-df50-4cbe-b5ed-1802caa31862 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 16 11:59:42 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Updating inventory in ProviderTree for provider 7142d606-df50-4cbe-b5ed-1802caa31862 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 16 11:59:42 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Refreshing aggregate associations for resource provider 7142d606-df50-4cbe-b5ed-1802caa31862, aggregates: None {{(pid=74683) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 16 11:59:42 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Refreshing trait associations for resource provider 7142d606-df50-4cbe-b5ed-1802caa31862, traits: COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VMVGA {{(pid=74683) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 16 11:59:42 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 11:59:42 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 11:59:42 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Compute_service record updated for user:user {{(pid=74683) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 11:59:42 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.339s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 11:59:43 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:59:43 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Starting heal instance info cache {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 11:59:43 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Rebuilding the list of instances to heal {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 11:59:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "refresh_cache-4e810851-2f43-431a-9633-eb3a428aa8c7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 11:59:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquired lock "refresh_cache-4e810851-2f43-431a-9633-eb3a428aa8c7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 11:59:43 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Forcefully refreshing network info cache for instance {{(pid=74683) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 11:59:43 user nova-compute[74683]: DEBUG nova.objects.instance [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lazy-loading 'info_cache' on Instance uuid 4e810851-2f43-431a-9633-eb3a428aa8c7 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 11:59:44 user nova-compute[74683]: DEBUG nova.network.neutron [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Updating instance_info_cache with network_info: [{"id": "fd72f93a-a495-45ee-ae8d-200c8079ae38", "address": "fa:16:3e:ea:c5:42", "network": {"id": "b6596e83-4544-4f3b-a91b-16c04b310187", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2107616380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1aacc226c2a54235ae0b88f724606b62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd72f93a-a4", "ovs_interfaceid": "fd72f93a-a495-45ee-ae8d-200c8079ae38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 11:59:44 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Releasing lock "refresh_cache-4e810851-2f43-431a-9633-eb3a428aa8c7" {{(pid=74683) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 11:59:44 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Updated the network info_cache for instance {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 11:59:44 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:59:44 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:59:45 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:59:45 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:59:46 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:59:46 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:59:46 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74683) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 11:59:47 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:59:52 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:59:56 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:59:57 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 11:59:59 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 11:59:59 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Cleaning up deleted instances {{(pid=74683) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 16 11:59:59 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] There are 0 instances to clean {{(pid=74683) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 16 12:00:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 12:00:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 12:00:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74683) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 12:00:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 12:00:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 12:00:02 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 12:00:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 12:00:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 12:00:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74683) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 12:00:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 12:00:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 12:00:07 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 12:00:12 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 12:00:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 12:00:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 12:00:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 12:00:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74683) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 12:00:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 12:00:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 12:00:22 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 12:00:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ebcaa5ff-01ff-42e0-9582-aacc24ba2029 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Acquiring lock "4e810851-2f43-431a-9633-eb3a428aa8c7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 12:00:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ebcaa5ff-01ff-42e0-9582-aacc24ba2029 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Lock "4e810851-2f43-431a-9633-eb3a428aa8c7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 12:00:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ebcaa5ff-01ff-42e0-9582-aacc24ba2029 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Acquiring lock "4e810851-2f43-431a-9633-eb3a428aa8c7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 12:00:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ebcaa5ff-01ff-42e0-9582-aacc24ba2029 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Lock "4e810851-2f43-431a-9633-eb3a428aa8c7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 12:00:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ebcaa5ff-01ff-42e0-9582-aacc24ba2029 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Lock "4e810851-2f43-431a-9633-eb3a428aa8c7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 12:00:24 user nova-compute[74683]: INFO nova.compute.manager [None req-ebcaa5ff-01ff-42e0-9582-aacc24ba2029 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Terminating instance
Oct 16 12:00:24 user nova-compute[74683]: DEBUG nova.compute.manager [None req-ebcaa5ff-01ff-42e0-9582-aacc24ba2029 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Start destroying the instance on the hypervisor. {{(pid=74683) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 12:00:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 12:00:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 12:00:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 12:00:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 12:00:24 user nova-compute[74683]: DEBUG nova.compute.manager [req-78ce20d5-2c5a-4f81-8f6d-6818dea71197 req-818bb69e-bc91-4b0e-908f-d4db73d7b4dc service nova] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Received event network-vif-unplugged-fd72f93a-a495-45ee-ae8d-200c8079ae38 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 12:00:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-78ce20d5-2c5a-4f81-8f6d-6818dea71197 req-818bb69e-bc91-4b0e-908f-d4db73d7b4dc service nova] Acquiring lock "4e810851-2f43-431a-9633-eb3a428aa8c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 12:00:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-78ce20d5-2c5a-4f81-8f6d-6818dea71197 req-818bb69e-bc91-4b0e-908f-d4db73d7b4dc service nova] Lock "4e810851-2f43-431a-9633-eb3a428aa8c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 12:00:24 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-78ce20d5-2c5a-4f81-8f6d-6818dea71197 req-818bb69e-bc91-4b0e-908f-d4db73d7b4dc service nova] Lock "4e810851-2f43-431a-9633-eb3a428aa8c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 12:00:24 user nova-compute[74683]: DEBUG nova.compute.manager [req-78ce20d5-2c5a-4f81-8f6d-6818dea71197 req-818bb69e-bc91-4b0e-908f-d4db73d7b4dc service nova] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] No waiting events found dispatching network-vif-unplugged-fd72f93a-a495-45ee-ae8d-200c8079ae38 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 12:00:24 user nova-compute[74683]: DEBUG nova.compute.manager [req-78ce20d5-2c5a-4f81-8f6d-6818dea71197 req-818bb69e-bc91-4b0e-908f-d4db73d7b4dc service nova] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Received event network-vif-unplugged-fd72f93a-a495-45ee-ae8d-200c8079ae38 for instance with task_state deleting. {{(pid=74683) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 12:00:24 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 12:00:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 12:00:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 12:00:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 12:00:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 12:00:25 user nova-compute[74683]: INFO nova.virt.libvirt.driver [-] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Instance destroyed successfully.
Oct 16 12:00:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 12:00:25 user nova-compute[74683]: DEBUG nova.objects.instance [None req-ebcaa5ff-01ff-42e0-9582-aacc24ba2029 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Lazy-loading 'resources' on Instance uuid 4e810851-2f43-431a-9633-eb3a428aa8c7 {{(pid=74683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 12:00:25 user nova-compute[74683]: DEBUG nova.virt.libvirt.vif [None req-ebcaa5ff-01ff-42e0-9582-aacc24ba2029 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T11:56:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-381836128',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-381836128',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3818361',id=52,image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXUI5vYmRUuqJ+TdMswMKrTZgqaaKo3RZeOKkDPiWV5A7XU0UOg7WqL1yiv/5q+2pssRpXwTiithJ1sGgFNEqPJW8apWic2I5waJCP/+FmAXHuHyeQnrkI2ehOT4Xzegg==',key_name='tempest-keypair-392397390',keypairs=<?>,launch_index=0,launched_at=2023-10-16T11:57:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1aacc226c2a54235ae0b88f724606b62',ramdisk_id='',reservation_id='r-7mbhnp9q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ec5f786-25cf-4db2-8a52-6edd8d6a6f4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1889919261',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T11:57:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c82ef1775414566917117264755365d',uuid=4e810851-2f43-431a-9633-eb3a428aa8c7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd72f93a-a495-45ee-ae8d-200c8079ae38", "address": "fa:16:3e:ea:c5:42", "network": {"id": "b6596e83-4544-4f3b-a91b-16c04b310187", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2107616380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1aacc226c2a54235ae0b88f724606b62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd72f93a-a4", "ovs_interfaceid": "fd72f93a-a495-45ee-ae8d-200c8079ae38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 12:00:25 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-ebcaa5ff-01ff-42e0-9582-aacc24ba2029 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Converting VIF {"id": "fd72f93a-a495-45ee-ae8d-200c8079ae38", "address": "fa:16:3e:ea:c5:42", "network": {"id": "b6596e83-4544-4f3b-a91b-16c04b310187", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2107616380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1aacc226c2a54235ae0b88f724606b62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd72f93a-a4", "ovs_interfaceid": "fd72f93a-a495-45ee-ae8d-200c8079ae38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 12:00:25 user nova-compute[74683]: DEBUG nova.network.os_vif_util [None req-ebcaa5ff-01ff-42e0-9582-aacc24ba2029 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:c5:42,bridge_name='br-int',has_traffic_filtering=True,id=fd72f93a-a495-45ee-ae8d-200c8079ae38,network=Network(b6596e83-4544-4f3b-a91b-16c04b310187),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd72f93a-a4') {{(pid=74683) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 12:00:25 user nova-compute[74683]: DEBUG os_vif [None req-ebcaa5ff-01ff-42e0-9582-aacc24ba2029 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:c5:42,bridge_name='br-int',has_traffic_filtering=True,id=fd72f93a-a495-45ee-ae8d-200c8079ae38,network=Network(b6596e83-4544-4f3b-a91b-16c04b310187),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd72f93a-a4') {{(pid=74683) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 12:00:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 12:00:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd72f93a-a4, bridge=br-int, if_exists=True) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 12:00:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 12:00:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 12:00:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 12:00:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d6bfaaa3-f809-48a4-ab03-f7f7bd7f9db9) {{(pid=74683) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 12:00:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 12:00:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 12:00:25 user nova-compute[74683]: INFO os_vif [None req-ebcaa5ff-01ff-42e0-9582-aacc24ba2029 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:c5:42,bridge_name='br-int',has_traffic_filtering=True,id=fd72f93a-a495-45ee-ae8d-200c8079ae38,network=Network(b6596e83-4544-4f3b-a91b-16c04b310187),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd72f93a-a4')
Oct 16 12:00:25 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-ebcaa5ff-01ff-42e0-9582-aacc24ba2029 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Deleting instance files /opt/stack/data/nova/instances/4e810851-2f43-431a-9633-eb3a428aa8c7_del
Oct 16 12:00:25 user nova-compute[74683]: INFO nova.virt.libvirt.driver [None req-ebcaa5ff-01ff-42e0-9582-aacc24ba2029 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Deletion of /opt/stack/data/nova/instances/4e810851-2f43-431a-9633-eb3a428aa8c7_del complete
Oct 16 12:00:25 user nova-compute[74683]: INFO nova.compute.manager [None req-ebcaa5ff-01ff-42e0-9582-aacc24ba2029 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Took 0.88 seconds to destroy the instance on the hypervisor.
Oct 16 12:00:25 user nova-compute[74683]: DEBUG oslo.service.loopingcall [None req-ebcaa5ff-01ff-42e0-9582-aacc24ba2029 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74683) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 12:00:25 user nova-compute[74683]: DEBUG nova.compute.manager [-] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Deallocating network for instance {{(pid=74683) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 12:00:25 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] deallocate_for_instance() {{(pid=74683) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 12:00:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 12:00:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 12:00:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 12:00:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 12:00:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 12:00:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 12:00:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 12:00:26 user nova-compute[74683]: DEBUG nova.network.neutron [-] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Updating instance_info_cache with network_info: [] {{(pid=74683) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 12:00:26 user nova-compute[74683]: INFO nova.compute.manager [-] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Took 1.08 seconds to deallocate network for instance.
Oct 16 12:00:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ebcaa5ff-01ff-42e0-9582-aacc24ba2029 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 12:00:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ebcaa5ff-01ff-42e0-9582-aacc24ba2029 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 12:00:26 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-ebcaa5ff-01ff-42e0-9582-aacc24ba2029 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 12:00:26 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-ebcaa5ff-01ff-42e0-9582-aacc24ba2029 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 12:00:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ebcaa5ff-01ff-42e0-9582-aacc24ba2029 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.138s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 12:00:26 user nova-compute[74683]: INFO nova.scheduler.client.report [None req-ebcaa5ff-01ff-42e0-9582-aacc24ba2029 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Deleted allocations for instance 4e810851-2f43-431a-9633-eb3a428aa8c7
Oct 16 12:00:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-ebcaa5ff-01ff-42e0-9582-aacc24ba2029 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261 tempest-TestServerVolumeAttachScenarioOldVersion-1889919261-project-member] Lock "4e810851-2f43-431a-9633-eb3a428aa8c7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.288s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 12:00:26 user nova-compute[74683]: DEBUG nova.compute.manager [req-aada6bac-fb53-4754-8a76-f25cb0ae45c7 req-40a9fa4d-8005-416d-a428-8b07e17f8de4 service nova] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Received event network-vif-plugged-fd72f93a-a495-45ee-ae8d-200c8079ae38 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 12:00:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-aada6bac-fb53-4754-8a76-f25cb0ae45c7 req-40a9fa4d-8005-416d-a428-8b07e17f8de4 service nova] Acquiring lock "4e810851-2f43-431a-9633-eb3a428aa8c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 12:00:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-aada6bac-fb53-4754-8a76-f25cb0ae45c7 req-40a9fa4d-8005-416d-a428-8b07e17f8de4 service nova] Lock "4e810851-2f43-431a-9633-eb3a428aa8c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 12:00:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-aada6bac-fb53-4754-8a76-f25cb0ae45c7 req-40a9fa4d-8005-416d-a428-8b07e17f8de4 service nova] Lock "4e810851-2f43-431a-9633-eb3a428aa8c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 12:00:26 user nova-compute[74683]: DEBUG nova.compute.manager [req-aada6bac-fb53-4754-8a76-f25cb0ae45c7 req-40a9fa4d-8005-416d-a428-8b07e17f8de4 service nova] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] No waiting events found dispatching network-vif-plugged-fd72f93a-a495-45ee-ae8d-200c8079ae38 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 12:00:26 user nova-compute[74683]: WARNING nova.compute.manager [req-aada6bac-fb53-4754-8a76-f25cb0ae45c7 req-40a9fa4d-8005-416d-a428-8b07e17f8de4 service nova] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Received unexpected event network-vif-plugged-fd72f93a-a495-45ee-ae8d-200c8079ae38 for instance with vm_state deleted and task_state None.
Oct 16 12:00:26 user nova-compute[74683]: DEBUG nova.compute.manager [req-aada6bac-fb53-4754-8a76-f25cb0ae45c7 req-40a9fa4d-8005-416d-a428-8b07e17f8de4 service nova] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Received event network-vif-plugged-fd72f93a-a495-45ee-ae8d-200c8079ae38 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 12:00:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-aada6bac-fb53-4754-8a76-f25cb0ae45c7 req-40a9fa4d-8005-416d-a428-8b07e17f8de4 service nova] Acquiring lock "4e810851-2f43-431a-9633-eb3a428aa8c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 12:00:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-aada6bac-fb53-4754-8a76-f25cb0ae45c7 req-40a9fa4d-8005-416d-a428-8b07e17f8de4 service nova] Lock "4e810851-2f43-431a-9633-eb3a428aa8c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 12:00:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-aada6bac-fb53-4754-8a76-f25cb0ae45c7 req-40a9fa4d-8005-416d-a428-8b07e17f8de4 service nova] Lock "4e810851-2f43-431a-9633-eb3a428aa8c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 12:00:26 user nova-compute[74683]: DEBUG nova.compute.manager [req-aada6bac-fb53-4754-8a76-f25cb0ae45c7 req-40a9fa4d-8005-416d-a428-8b07e17f8de4 service nova] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] No waiting events found dispatching network-vif-plugged-fd72f93a-a495-45ee-ae8d-200c8079ae38 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 12:00:26 user nova-compute[74683]: WARNING nova.compute.manager [req-aada6bac-fb53-4754-8a76-f25cb0ae45c7 req-40a9fa4d-8005-416d-a428-8b07e17f8de4 service nova] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Received unexpected event network-vif-plugged-fd72f93a-a495-45ee-ae8d-200c8079ae38 for instance with vm_state deleted and task_state None.
Oct 16 12:00:26 user nova-compute[74683]: DEBUG nova.compute.manager [req-aada6bac-fb53-4754-8a76-f25cb0ae45c7 req-40a9fa4d-8005-416d-a428-8b07e17f8de4 service nova] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Received event network-vif-plugged-fd72f93a-a495-45ee-ae8d-200c8079ae38 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 12:00:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-aada6bac-fb53-4754-8a76-f25cb0ae45c7 req-40a9fa4d-8005-416d-a428-8b07e17f8de4 service nova] Acquiring lock "4e810851-2f43-431a-9633-eb3a428aa8c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 12:00:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-aada6bac-fb53-4754-8a76-f25cb0ae45c7 req-40a9fa4d-8005-416d-a428-8b07e17f8de4 service nova] Lock "4e810851-2f43-431a-9633-eb3a428aa8c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 12:00:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-aada6bac-fb53-4754-8a76-f25cb0ae45c7 req-40a9fa4d-8005-416d-a428-8b07e17f8de4 service nova] Lock "4e810851-2f43-431a-9633-eb3a428aa8c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 12:00:26 user nova-compute[74683]: DEBUG nova.compute.manager [req-aada6bac-fb53-4754-8a76-f25cb0ae45c7 req-40a9fa4d-8005-416d-a428-8b07e17f8de4 service nova] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] No waiting events found dispatching network-vif-plugged-fd72f93a-a495-45ee-ae8d-200c8079ae38 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 12:00:26 user nova-compute[74683]: WARNING nova.compute.manager [req-aada6bac-fb53-4754-8a76-f25cb0ae45c7 req-40a9fa4d-8005-416d-a428-8b07e17f8de4 service nova] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Received unexpected event network-vif-plugged-fd72f93a-a495-45ee-ae8d-200c8079ae38 for instance with vm_state deleted and task_state None.
Oct 16 12:00:26 user nova-compute[74683]: DEBUG nova.compute.manager [req-aada6bac-fb53-4754-8a76-f25cb0ae45c7 req-40a9fa4d-8005-416d-a428-8b07e17f8de4 service nova] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Received event network-vif-unplugged-fd72f93a-a495-45ee-ae8d-200c8079ae38 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 12:00:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-aada6bac-fb53-4754-8a76-f25cb0ae45c7 req-40a9fa4d-8005-416d-a428-8b07e17f8de4 service nova] Acquiring lock "4e810851-2f43-431a-9633-eb3a428aa8c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 12:00:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-aada6bac-fb53-4754-8a76-f25cb0ae45c7 req-40a9fa4d-8005-416d-a428-8b07e17f8de4 service nova] Lock "4e810851-2f43-431a-9633-eb3a428aa8c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 12:00:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-aada6bac-fb53-4754-8a76-f25cb0ae45c7 req-40a9fa4d-8005-416d-a428-8b07e17f8de4 service nova] Lock "4e810851-2f43-431a-9633-eb3a428aa8c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 12:00:26 user nova-compute[74683]: DEBUG nova.compute.manager [req-aada6bac-fb53-4754-8a76-f25cb0ae45c7 req-40a9fa4d-8005-416d-a428-8b07e17f8de4 service nova] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] No waiting events found dispatching network-vif-unplugged-fd72f93a-a495-45ee-ae8d-200c8079ae38 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 12:00:26 user nova-compute[74683]: WARNING nova.compute.manager [req-aada6bac-fb53-4754-8a76-f25cb0ae45c7 req-40a9fa4d-8005-416d-a428-8b07e17f8de4 service nova] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Received unexpected event network-vif-unplugged-fd72f93a-a495-45ee-ae8d-200c8079ae38 for instance with vm_state deleted and task_state None.
Oct 16 12:00:26 user nova-compute[74683]: DEBUG nova.compute.manager [req-aada6bac-fb53-4754-8a76-f25cb0ae45c7 req-40a9fa4d-8005-416d-a428-8b07e17f8de4 service nova] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Received event network-vif-plugged-fd72f93a-a495-45ee-ae8d-200c8079ae38 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 12:00:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-aada6bac-fb53-4754-8a76-f25cb0ae45c7 req-40a9fa4d-8005-416d-a428-8b07e17f8de4 service nova] Acquiring lock "4e810851-2f43-431a-9633-eb3a428aa8c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 12:00:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-aada6bac-fb53-4754-8a76-f25cb0ae45c7 req-40a9fa4d-8005-416d-a428-8b07e17f8de4 service nova] Lock "4e810851-2f43-431a-9633-eb3a428aa8c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 12:00:26 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [req-aada6bac-fb53-4754-8a76-f25cb0ae45c7 req-40a9fa4d-8005-416d-a428-8b07e17f8de4 service nova] Lock "4e810851-2f43-431a-9633-eb3a428aa8c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 12:00:26 user nova-compute[74683]: DEBUG nova.compute.manager [req-aada6bac-fb53-4754-8a76-f25cb0ae45c7 req-40a9fa4d-8005-416d-a428-8b07e17f8de4 service nova] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] No waiting events found dispatching network-vif-plugged-fd72f93a-a495-45ee-ae8d-200c8079ae38 {{(pid=74683) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 12:00:26 user nova-compute[74683]: WARNING nova.compute.manager [req-aada6bac-fb53-4754-8a76-f25cb0ae45c7 req-40a9fa4d-8005-416d-a428-8b07e17f8de4 service nova] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Received unexpected event network-vif-plugged-fd72f93a-a495-45ee-ae8d-200c8079ae38 for instance with vm_state deleted and task_state None.
Oct 16 12:00:26 user nova-compute[74683]: DEBUG nova.compute.manager [req-aada6bac-fb53-4754-8a76-f25cb0ae45c7 req-40a9fa4d-8005-416d-a428-8b07e17f8de4 service nova] [instance: 4e810851-2f43-431a-9633-eb3a428aa8c7] Received event network-vif-deleted-fd72f93a-a495-45ee-ae8d-200c8079ae38 {{(pid=74683) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 12:00:30 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 12:00:35 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 12:00:35 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 12:00:35 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74683) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 12:00:35 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 12:00:35 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 12:00:35 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 12:00:36 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 12:00:40 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 12:00:41 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 12:00:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 12:00:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 12:00:41 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 12:00:41 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Auditing locally available compute resources for user (node: user) {{(pid=74683) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 12:00:42 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 12:00:42 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 12:00:42 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Hypervisor/Node resource view: name=user free_ram=9146MB free_disk=25.051342010498047GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74683) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 12:00:42 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 12:00:42 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 12:00:42 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 12:00:42 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 12:00:42 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 12:00:42 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 12:00:42 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Compute_service record updated for user:user {{(pid=74683) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 12:00:42 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.158s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 12:00:44 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 12:00:44 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Starting heal instance info cache {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 12:00:44 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Rebuilding the list of instances to heal {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 12:00:44 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Didn't find any instances for network info cache update. {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 16 12:00:44 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 12:00:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 12:00:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 12:00:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74683) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 12:00:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 12:00:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 12:00:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 12:00:45 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 12:00:45 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 12:00:48 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 12:00:48 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 12:00:48 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74683) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 12:00:50 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 12:00:50 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 12:00:50 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74683) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 12:00:50 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 12:00:50 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 12:00:50 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 12:00:51 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._sync_power_states {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 12:00:55 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 12:00:55 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 12:00:55 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74683) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 12:00:55 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 12:00:55 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 12:00:55 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 12:00:57 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 12:01:00 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 12:01:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 12:01:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 12:01:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74683) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 12:01:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 12:01:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 12:01:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 12:01:10 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 12:01:15 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 12:01:15 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 12:01:17 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 12:01:20 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 12:01:21 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 12:01:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 12:01:30 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 12:01:35 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 12:01:35 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 12:01:35 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74683) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 12:01:35 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 12:01:35 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 12:01:35 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 12:01:36 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 12:01:40 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 12:01:42 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 12:01:42 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 12:01:42 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 12:01:42 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 12:01:42 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Auditing locally available compute resources for user (node: user) {{(pid=74683) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 12:01:43 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 12:01:43 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 12:01:43 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Hypervisor/Node resource view: name=user free_ram=9195MB free_disk=25.049789428710938GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74683) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 12:01:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 12:01:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 12:01:43 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 12:01:43 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 12:01:43 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 12:01:43 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 12:01:43 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Compute_service record updated for user:user {{(pid=74683) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 12:01:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.107s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 12:01:44 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 12:01:44 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 12:01:44 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Starting heal instance info cache {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 12:01:44 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Rebuilding the list of instances to heal {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 12:01:44 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Didn't find any instances for network info cache update. {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 16 12:01:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 12:01:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 12:01:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74683) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 12:01:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 12:01:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 12:01:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 12:01:45 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 12:01:47 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 12:01:47 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 12:01:48 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 12:01:48 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74683) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 12:01:50 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 12:01:50 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 12:01:50 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74683) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 12:01:50 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 12:01:50 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 12:01:50 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 12:01:50 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 12:01:55 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 12:01:57 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 12:02:00 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 12:02:05 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 12:02:10 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 12:02:15 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 12:02:20 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 12:02:23 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 12:02:25 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 12:02:30 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 12:02:35 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 12:02:38 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 12:02:40 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 12:02:40 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 12:02:40 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74683) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 12:02:40 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 12:02:40 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74683) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 12:02:40 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 12:02:43 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 12:02:43 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 12:02:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 12:02:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 12:02:43 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 12:02:43 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Auditing locally available compute resources for user (node: user) {{(pid=74683) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 12:02:44 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 12:02:44 user nova-compute[74683]: WARNING nova.virt.libvirt.driver [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 12:02:44 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Hypervisor/Node resource view: name=user free_ram=9315MB free_disk=25.01886749267578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74683) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 12:02:44 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 12:02:44 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 12:02:44 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 12:02:44 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74683) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 12:02:44 user nova-compute[74683]: DEBUG nova.compute.provider_tree [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed in ProviderTree for provider: 7142d606-df50-4cbe-b5ed-1802caa31862 {{(pid=74683) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 12:02:44 user nova-compute[74683]: DEBUG nova.scheduler.client.report [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Inventory has not changed for provider 7142d606-df50-4cbe-b5ed-1802caa31862 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74683) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 12:02:44 user nova-compute[74683]: DEBUG nova.compute.resource_tracker [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Compute_service record updated for user:user {{(pid=74683) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 12:02:44 user nova-compute[74683]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.120s {{(pid=74683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 12:02:45 user nova-compute[74683]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74683) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 12:02:47 user nova-compute[74683]: DEBUG oslo_service.periodic_task [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 12:02:47 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Starting heal instance info cache {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 12:02:47 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Rebuilding the list of instances to heal {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 12:02:47 user nova-compute[74683]: DEBUG nova.compute.manager [None req-9d9f3a73-3ab8-40ae-8831-761e19210e3f None None] Didn't find any instances for network info cache update. {{(pid=74683) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}